Great Expectations
The Great Expectations integration uses OpenLineage to collect and send metadata to Grai. Complete documentation for integrating OpenLineage with Great Expectations can be found here (opens in a new tab).
Web App
You'll also need to create a new Grai source in the web app. You can create a generic OpenLineage integration by selecting the OpenLineage source type.
Fields
| Field | Value | Example |
|---|---|---|
| source | The name of the source, see sources | Great Expectations |
| Name | Name for connection | production |
| Namespace | Namespace for the connection, see namespaces | default |
| namespaces | Optional |
Webhook
In order to authenticate your webhook, you will need to create an API key in the Grai web app.
Grai will open an endpoint at /api/v1/openlineage/<connection_id>/ which can be used to receive OpenLineage events.
The official OpenLineage docs (opens in a new tab) have more information on how to configure your instance to send OpenLineage events to Grai. However, you can use these values to finish your configuration:
An example config:
OPENLINEAGE_URL - https://api.grai.io/api/v1/openlineage/<connection_id>/
OPENLINEAGE_API_KEY - "<your_grai_api_key>"If you're self-hosting Grai, you'll need to replace the URL with your own instance.