Overview
Artie is a real-time database replication product for syncing data from source databases to data warehouses.
With this integration, you can view metrics about your Artie deployments directly in Datadog to monitor the health of your data pipelines. Metrics from this integration include the number of rows processed over time, ingestion lag, flush time, and replication slot size. This can help you diagnose any delays in your pipeline, tune the settings of your Artie deployment to optimize throughput, and prevent any negative impact on your source database from replication slot growth.
Setup
Installation
This integration is only available for existing Artie accounts. If you’re not using Artie yet and would like to start a trial, email hi@artie.com.
- In Datadog, click Connect Accounts on the Artie integration tile to connect Datadog with Artie.
- Log into Artie if you aren’t logged in yet.
- Review the Datadog permissions that will be granted to Artie, and click Authorize.
Validation
The included dashboard starts to show data 5-10 minutes after you connect the integration as long as you have data flowing in your Artie deployments.
Data Collected
Metrics
| |
|---|
artie.rows_processed
(count) | Number of rows processed by Artie |
artie.ingestion_lag_ms
(gauge) | Median time between a row being published to Kafka and being ingested by Artie
Shown as millisecond |
artie.row_lag
(gauge) | Number of rows remaining to be processed by Artie |
artie.flush_count
(count) | Number of flushes from Artie’s in-memory data store to the destination |
artie.flush_time_ms
(gauge) | Median time taken for Artie to flush rows to the destination
Shown as millisecond |
artie.replication_slot_size_mb
(gauge) | Size of the replication slot Artie is using in any PostgreSQL source databases
Shown as megabyte |
Troubleshooting
Need help? Contact Artie support.
