APM metrics sent by the Datadog Agent

Find below the list of out-of-the-box tracing metrics sent by the Datadog Agent when APM is enabled. Import the APM monitoring dashboard in your Datadog account in order to get an out-of-the-box dashboard exploiting most of those metrics.

datadog.trace_agent.cpu_percent
Type: Gauge
CPU usage (in cores), for example, 50 (half a core), 200 (two cores), 250 (2.5 cores)
datadog.trace_agent.events.max_eps.current_rate
Type: Gauge
Count of APM Events per second received by the Agent
datadog.trace_agent.events.max_eps.max_rate
Type: Gauge
Same as the Agent config’s max_events_per_second parameter.
datadog.trace_agent.events.max_eps.reached_max
Type: Gauge
Is set to 1 every time max_events_per_second is reached, otherwise it’s 0.
datadog.trace_agent.events.max_eps.sample_rate
Type: Gauge
Sample rate applied by the Agent to Events it received
datadog.trace_agent.heap_alloc
Type: Gauge
Heap allocations as reported by the Go runtime.
datadog.trace_agent.heartbeat
Type: Gauge
Increment by one every 10 seconds.
datadog.trace_agent.normalizer.spans_malformed
Type: Count
Number of spans having malformed fields that had to be altered in order for the system to accept them
datadog.trace_agent.obfuscations
Type: Count
Increment by one every time an SQL obfuscation happens.
datadog.trace_agent.panic
Type: Gauge
Increment by one on every code panic.
datadog.trace_agent.profile
Type: Count
Increment by one every time a reverse proxy of profile endpoints is created.
datadog.trace_agent.ratelimit
Type: Gauge
If lower than 1, it means payloads are being refused due to high resource usage (cpu or memory).
datadog.trace_agent.receiver.error
Type: Count
Number of times that the API rejected a payload due to an error in either decoding, formatting or other.
datadog.trace_agent.receiver.events_extracted
Type: Count
Total APM events sampled.
datadog.trace_agent.receiver.events_sampled
Type: Count
Total APM events sampled by the max_events_per_second parameter sampler.
datadog.trace_agent.receiver.oom_kill
Type: Count
Number of times the Agent killed itself due to excessive memory use (150% of max_memory).
datadog.trace_agent.receiver.out_chan_fill
Type: Gauge
Internal metric. Percentage of fill on the receiver’s output channel.
datadog.trace_agent.receiver.payload_accepted
Type: Count
Number of payloads accepted by the Agent.
datadog.trace_agent.receiver.payload_refused
Type: Count
Number of payloads rejected by the receiver because of the sampling.
datadog.trace_agent.receiver.spans_dropped
Type: Count
Total bytes of payloads dropped by the Agent.
datadog.trace_agent.receiver.spans_filtered
Type: Count
Total bytes of payloads filtered by the Agent
datadog.trace_agent.receiver.spans_received
Type: Count
Total bytes of payloads received by the Agent.
datadog.trace_agent.receiver.tcp_connections
Type: Count
Number of TCP connections coming in to the agent.
datadog.trace_agent.receiver.trace
Type: Count
Number of traces received and accepted.
datadog.trace_agent.receiver.traces_bytes
Type: Count
Total bytes of payloads accepted by the Agent.
datadog.trace_agent.receiver.traces_filtered
Type: Count
Traces filtered by ignored resources (as defined in datadog.yaml file).
datadog.trace_agent.receiver.traces_priority
Type: Count
Traces processed by priority sampler that have the priority tag.
datadog.trace_agent.receiver.traces_received
Type: Count
Number of traces received and accepted.
datadog.trace_agent.service_writer.services
Type: Count
Number of services flushed.
datadog.trace_agent.started
Type: Count
Increment by one every time the Agent starts.
datadog.trace_agent.stats_writer.bytes
Type: Count
Number of bytes sent (calculated after Gzip).
datadog.trace_agent.stats_writer.connection_fill
Type: Histogram
Percentage of outgoing connections used.
datadog.trace_agent.stats_writer.dropped
Type: Count
Number of payloads dropped due to non retriable HTTP errors.
datadog.trace_agent.stats_writer.dropped_bytes
Type: Count
Number of bytes dropped due to non retriable HTTP errors.
datadog.trace_agent.stats_writer.encode_ms
Type: Histogram
Time it took to encode a stats payload.
datadog.trace_agent.stats_writer.errors
Type: Count
Errors that could not be retried.
datadog.trace_agent.stats_writer.queue_fill
Type: Histogram
Percentage of queue filled.
datadog.trace_agent.stats_writer.retries
Type: Count
Number of retries on failures to the Datadog API
datadog.trace_agent.stats_writer.splits
Type: Count
Number of times a payload was split into multiple ones.
datadog.trace_agent.stats_writer.stats_buckets
Type: Count
Number of stats buckets flushed.
datadog.trace_agent.trace_writer.bytes
Type: Count
Number of bytes sent (calculated after Gzip).
datadog.trace_agent.trace_writer.bytes_estimated
Type: Count
Number of bytes estimated by Agent internal algorithm.
datadog.trace_agent.trace_writer.bytes_uncompressed
Type: Count
Number of bytes sent (calculated before Gzip).
datadog.trace_agent.trace_writer.compress_ms
Type: Gauge
Number of milliseconds it took to compress an encoded trace payload.
datadog.trace_agent.trace_writer.connection_fill
Type: Histogram
Percentage of outgoing connections used by the trace writer.
datadog.trace_agent.trace_writer.dropped
Type: Count
Number of dropped payloads due to non retriable HTTP errors.
datadog.trace_agent.trace_writer.dropped_bytes
Type: Count
Number of dropped bytes due to non retriable HTTP errors.
datadog.trace_agent.trace_writer.encode_ms
Type: Gauge
Number of milliseconds it took to encode a trace payload.
datadog.trace_agent.trace_writer.errors
Type: Count
Errors that could not be retried.
datadog.trace_agent.trace_writer.events
Type: Count
Number of events processed.
datadog.trace_agent.trace_writer.flush_duration
Type: Gauge
Time it took to flush a payload to the Datadog API.
datadog.trace_agent.trace_writer.payloads
Type: Count
Number of payloads processed.
datadog.trace_agent.trace_writer.payloads
Type: Count
Number of payloads sent.
datadog.trace_agent.trace_writer.queue_fill
Type: Histogram
Percentage of outgoing payload queue fill.
datadog.trace_agent.trace_writer.retries
Type: Count
Number of retries on failures to the Datadog API.
datadog.trace_agent.trace_writer.spans
Type: Count
Number of spans processed.
datadog.trace_agent.trace_writer.traces
Type: Count
Number of traces processed.