--- title: Airbyte description: Monitor the state of your Airbyte deployment. breadcrumbs: Docs > Integrations > Airbyte --- # Airbyte Supported OS Integration version1.0.0 ## Overview{% #overview %} This check monitors [Airbyte](https://airbyte.com/). Metrics are sent to Datadog through [DogStatsD](https://docs.datadoghq.com/developers/dogstatsd). **Minimum Agent version:** 7.47.0 ## Setup{% #setup %} ### Installation{% #installation %} All steps below are needed for the Airbyte integration to work properly. Before you begin, [install the Datadog Agent](https://app.datadoghq.com/account/settings/agent/latest) version `>=6.17` or `>=7.17`, which includes the StatsD/DogStatsD mapping feature. ### Configuration{% #configuration %} 1. Configure your Airbyte deployment [to send metrics to Datadog](https://docs.airbyte.com/operator-guides/collecting-metrics/). 1. Update the [Datadog Agent main configuration file](https://docs.datadoghq.com/agent/guide/agent-configuration-files/) `datadog.yaml` by adding the following configuration: ```yaml dogstatsd_mapper_profiles: - name: airbyte_worker prefix: "worker." mappings: - match: "worker.temporal_workflow_*" name: "airbyte.worker.temporal_workflow.$1" - match: "worker.worker_*" name: "airbyte.worker.$1" - match: "worker.state_commit_*" name: "airbyte.worker.state_commit.$1" - match: "worker.job_*" name: "airbyte.worker.job.$1" - match: "worker.attempt_*" name: "airbyte.worker.attempt.$1" - match: "worker.activity_*" name: "airbyte.worker.activity.$1" - match: "worker.*" name: "airbyte.worker.$1" - name: airbyte_cron prefix: "cron." mappings: - match: "cron.cron_jobs_run" name: "airbyte.cron.jobs_run" - match: "cron.*" name: "airbyte.cron.$1" - name: airbyte_metrics_reporter prefix: "metrics-reporter." mappings: - match: "metrics-reporter.*" name: "airbyte.metrics_reporter.$1" - name: airbyte_orchestrator prefix: "orchestrator." mappings: - match: "orchestrator.*" name: "airbyte.orchestrator.$1" - name: airbyte_server prefix: "server." mappings: - match: "server.*" name: "airbyte.server.$1" - name: airbyte_general prefix: "airbyte." mappings: - match: "airbyte.worker.temporal_workflow_*" name: "airbyte.worker.temporal_workflow.$1" - match: "airbyte.worker.worker_*" name: "airbyte.worker.$1" - match: "airbyte.worker.state_commit_*" name: "airbyte.worker.state_commit.$1" - match: "airbyte.worker.job_*" name: "airbyte.worker.job.$1" - match: "airbyte.worker.attempt_*" name: "airbyte.worker.attempt.$1" - match: "airbyte.worker.activity_*" name: "airbyte.worker.activity.$1" - match: "airbyte.cron.cron_jobs_run" name: "airbyte.cron.jobs_run" ``` [Restart the Agent](https://docs.datadoghq.com/agent/guide/agent-commands/?tab=agentv6#start-stop-and-restart-the-agent) and Airbyte. ## Data Collected{% #data-collected %} ### Metrics{% #metrics %} | | | | | **airbyte.cron.jobs\_run**(count) | Number of CRON runs by CRON type. | | **airbyte.cron.workflows\_healed**(count) | Number of workflows the self-healing CRON healed. | | **airbyte.metrics\_reporter.est\_num\_metrics\_emitted\_by\_reporter**(count) | Estimated metrics emitted by the reporter in the last interval. This is estimated since the count is not precise. | | **airbyte.metrics\_reporter.num\_orphan\_running\_jobs**(gauge) | Number of jobs reported as running that are associated to an inactive or deprecated connection.*Shown as job* | | **airbyte.metrics\_reporter.num\_pending\_jobs**(gauge) | Number of pending jobs.*Shown as job* | | **airbyte.metrics\_reporter.num\_running\_jobs**(gauge) | Number of running jobs.*Shown as job* | | **airbyte.metrics\_reporter.num\_total\_scheduled\_syncs\_last\_day**(gauge) | Number of total sync jobs runs in last day.*Shown as job* | | **airbyte.metrics\_reporter.num\_unusually\_long\_syncs**(gauge) | Number of unusual long sync jobs compared to their historic performance.*Shown as job* | | **airbyte.metrics\_reporter.oldest\_pending\_job\_age\_secs**(gauge) | The age of the oldest pending job in seconds.*Shown as second* | | **airbyte.metrics\_reporter.oldest\_running\_job\_age\_secs**(gauge) | The age of the oldest running job in seconds.*Shown as second* | | **airbyte.orchestrator.source\_hearbeat\_failure**(count) | The count of replication failures due to a source missing an heartbeat. | | **airbyte.server.breaking\_change\_detected**(count) | The count of breaking schema changes detected. | | **airbyte.server.schema\_change\_auto\_propagated**(count) | The count of schema changes that have been propagated. | | **airbyte.worker.activity.check\_connection**(count) | The count of check connection activity started.*Shown as connection* | | **airbyte.worker.activity.dbt\_transformation**(count) | The count of DBT transformation activity started. | | **airbyte.worker.activity.discover\_catalog**(count) | The count of discover catalog activity started. | | **airbyte.worker.activity.failure**(count) | The count of activity fails. Tagged by activity. | | **airbyte.worker.activity.normalization**(count) | The count of normalization activity started. | | **airbyte.worker.activity.normalization\_summary\_check**(count) | The count of normalization summary check activity started. | | **airbyte.worker.activity.refresh\_schema**(count) | The count of refresh schema activity started. | | **airbyte.worker.activity.replication**(count) | The count of replication activity started. | | **airbyte.worker.activity.spec**(count) | The count of spec activity started. | | **airbyte.worker.activity.submit\_check\_destination\_connection**(count) | The count of submit check connection activities started.*Shown as connection* | | **airbyte.worker.activity.submit\_check\_source\_connection**(count) | The count of submit check connection activities started.*Shown as connection* | | **airbyte.worker.activity.webhook\_operation**(count) | The count of webhook operation activity started. | | **airbyte.worker.attempt.completed**(count) | The count of new attempts completed. One is emitted per attempt.*Shown as attempt* | | **airbyte.worker.attempt.created**(count) | The count of new attempts created. One is emitted per attempt.*Shown as attempt* | | **airbyte.worker.attempt.created\_by\_release\_stage**(count) | The count of new attempts created. Attempts are double counted as this is tagged by release stage.*Shown as attempt* | | **airbyte.worker.attempt.failed\_by\_failure\_origin**(count) | The count of failure origins a failed attempt has. Since a failure can have multiple origins, a single failure can be counted more than once. Tagged by failure origin and failure type.*Shown as attempt* | | **airbyte.worker.attempt.failed\_by\_release\_stage**(count) | The count of attempt failed. Attempts are double counted as this is tagged by release stage.*Shown as attempt* | | **airbyte.worker.attempt.succeeded\_by\_release\_stage**(count) | The count of attempts succeeded. Attempts are double counted as this is tagged by release stage.*Shown as attempt* | | **airbyte.worker.destination\_buffer\_size**(gauge) | The size of the replication worker destination buffer queue.*Shown as record* | | **airbyte.worker.destination\_message\_read**(count) | The count of messages read from the destination.*Shown as message* | | **airbyte.worker.destination\_message\_sent**(count) | The count of messages sent to the destination.*Shown as message* | | **airbyte.worker.job.cancelled\_by\_release\_stage**(count) | The count of jobs cancelled. Jobs are double counted as this is tagged by release stage.*Shown as job* | | **airbyte.worker.job.created\_by\_release\_stage**(count) | The count of new jobs created. Jobs are double counted as this is tagged by release stage.*Shown as job* | | **airbyte.worker.job.failed\_by\_release\_stage**(count) | The count of job fails. Jobs are double counted as this is tagged by release stage.*Shown as job* | | **airbyte.worker.job.succeeded\_by\_release\_stage**(count) | The count of job succeeds. Jobs are double counted as this is tagged by release stage.*Shown as job* | | **airbyte.worker.notifications\_sent**(count) | Number of notifications sent. | | **airbyte.worker.replication\_bytes\_synced**(count) | Number of bytes synced during replication.*Shown as byte* | | **airbyte.worker.replication\_records\_synced**(count) | Number of records synced during replication.*Shown as record* | | **airbyte.worker.source\_buffer\_size**(gauge) | The size of the replication worker source buffer queue.*Shown as record* | | **airbyte.worker.source\_message\_read**(count) | The count of messages read from the source.*Shown as message* | | **airbyte.worker.state\_commit.close\_successful**(count) | Number of final to connection exiting with a successful final state flush. | | **airbyte.worker.state\_commit.not\_attempted**(count) | Number of attempts to commit states dropped due to an early termination.*Shown as attempt* | | **airbyte.worker.temporal\_workflow.attempt**(count) | The count of temporal workflow attempts.*Shown as attempt* | | **airbyte.worker.temporal\_workflow.failure**(count) | The count of temporal workflow failures. | | **airbyte.worker.temporal\_workflow.success**(count) | The count of temporal successful workflow syncs.*Shown as success* | ### Service Checks{% #service-checks %} The Airbyte check does not include any service checks. ### Events{% #events %} The Airbyte check does not include any events. ## Troubleshooting{% #troubleshooting %} Need help? Contact [Datadog support](https://docs.datadoghq.com/help/).