APM metrics sent by the Datadog Agent

Find below the list of out-of-the-box tracing metrics sent by the Datadog Agent when APM is enabled. Import the APM monitoring dashboard in your Datadog account in order to get an out of the box dashboard exploiting most of those metrics.

datadog.trace_agent.cpu_percent: Type: Gauge
CPU usage (in cores), e.g. 50 (half a core), 200 (two cores), 250 (2.5 cores)
datadog.trace_agent.events.max_eps.current_rate: Type: Gauge
Count of APM Events per second received by the Agent
datadog.trace_agent.events.max_eps.max_rate: Type: Gauge
Same as the Agent config’s max_events_per_second parameter.
datadog.trace_agent.events.max_eps.reached_max: Type: Gauge
Is set to 1 every time max_events_per_second is reached, otherwise it’s 0.
datadog.trace_agent.events.max_eps.sample_rate: Type: Gauge
Sample rate applied by the Agent to Events it received
datadog.trace_agent.heap_alloc: Type: Gauge
Heap allocations as reported by the Go runtime.
datadog.trace_agent.heartbeat: Type: Gauge
Increment by one every 10 seconds.
datadog.trace_agent.normalizer.spans_malformed: Type: Count
Number of spans having malformed fields that had to be altered in order for the system to accept them
datadog.trace_agent.obfuscations: Type: Count
Increment by one every time an SQL obfuscation happens.
datadog.trace_agent.panic: Type: Gauge
Increment by one on every code panic.
datadog.trace_agent.ratelimit: Type: Gauge
If lower than 1, it means payloads are being refused due to high resource usage (cpu or memory).
datadog.trace_agent.receiver.error: Type: Count
Number of times that the API rejected a payload due to an error in either decoding, formatting or other.
datadog.trace_agent.receiver.events_extracted: Type: Count
Total APM events sampled.
datadog.trace_agent.receiver.events_sampled: Type: Count
Total APM events sampled by the max_events_per_second parameter sampler.
datadog.trace_agent.receiver.oom_kill: Type: Count
Number of times the Agent killed itself due to excessive memory use (150% of max_memory).
datadog.trace_agent.receiver.out_chan_fill: Type: Gauge
Internal metric. Percentage of fill on the receiver’s output channel.
datadog.trace_agent.receiver.payload_accepted: Type: Count
Number of payloads accepted by the Agent.
datadog.trace_agent.receiver.payload_refused: Type: Count
Number of payloads rejected by the receiver because of the sampling.
datadog.trace_agent.receiver.spans_dropped: Type: Count
Total bytes of payloads dropped by the Agent.
datadog.trace_agent.receiver.spans_filtered: Type: Count
Total bytes of payloads filtered by the Agent
datadog.trace_agent.receiver.spans_received: Type: Count
Total bytes of payloads received by the Agent.
datadog.trace_agent.receiver.tcp_connections: Type: Count
Number of TCP connections coming in to the agent.
datadog.trace_agent.receiver.trace: Type: Count
Number of traces received and accepted.
datadog.trace_agent.receiver.traces_bytes: Type: Count
Total bytes of payloads accepted by the Agent.
datadog.trace_agent.receiver.traces_dropped: Type: Count
Traces dropped due to normalization errors.
datadog.trace_agent.receiver.traces_filtered: Type: Count
Traces filtered by ignored resources (as defined in datadog.yaml file).
datadog.trace_agent.receiver.traces_priority: Type: Count
Traces processed by priority sampler that have the priority tag.
datadog.trace_agent.receiver.traces_received: Type: Count
Number of traces received and accepted.
datadog.trace_agent.service_writer.services: Type: Count
Number of services flushed.
datadog.trace_agent.started: Type: Count
Increment by one every time the Agent starts.
datadog.trace_agent.stats_writer.bytes: Type: Count
Number of bytes sent (calculated after Gzip).
datadog.trace_agent.stats_writer.connection_fill: Type: Histogram
Percentage of outgoing connections used.
datadog.trace_agent.stats_writer.dropped: Type: Count
Number of payloads dropped due to non retriable HTTP errors.
datadog.trace_agent.stats_writer.dropped_bytes: Type: Count
Number of bytes dropped due to non retriable HTTP errors.
datadog.trace_agent.stats_writer.encode_ms: Type: Histogram
Time it took to encode a stats payload.
datadog.trace_agent.stats_writer.errors: Type: Count
Errors that could not be retried.
datadog.trace_agent.stats_writer.queue_fill: Type: Histogram
Percentage of queue filled.
datadog.trace_agent.stats_writer.retries: Type: Count
Number of retries on failures to the Datadog API
datadog.trace_agent.stats_writer.splits: Type: Count
Number of times a payload was split into multiple ones.
datadog.trace_agent.stats_writer.stats_buckets: Type: Count
Number of stats buckets flushed.
datadog.trace_agent.trace_writer.bytes: Type: Count
Number of bytes sent (calculated after Gzip).
datadog.trace_agent.trace_writer.bytes_estimated: Type: Count
Number of bytes estimated by Agent internal algorithm.
datadog.trace_agent.trace_writer.bytes_uncompressed: Type: Count
Number of bytes sent (calculated before Gzip).
datadog.trace_agent.trace_writer.compress_ms: Type: Gauge
Number of milliseconds it took to compress an encoded trace payload.
datadog.trace_agent.trace_writer.connection_fill: Type: Histogram
Percentage of outgoing connections used by the trace writer.
datadog.trace_agent.trace_writer.dropped: Type: Count
Number of dropped payloads due to non retriable HTTP errors.
datadog.trace_agent.trace_writer.dropped_bytes: Type: Count
Number of dropped bytes due to non retriable HTTP errors.
datadog.trace_agent.trace_writer.encode_ms: Type: Gauge
Number of milliseconds it took to encode a trace payload.
datadog.trace_agent.trace_writer.errors: Type: Count
Errors that could not be retried.
datadog.trace_agent.trace_writer.events: Type: Count
Number of events processed.
datadog.trace_agent.trace_writer.flush_duration: Type: Gauge
Time it took to flush a payload to the Datadog API.
datadog.trace_agent.trace_writer.payloads: Type: Count
Number of payloads processed.
datadog.trace_agent.trace_writer.payloads: Type: Count
Number of payloads sent.
datadog.trace_agent.trace_writer.queue_fill: Type: Histogram
Percentage of outgoing payload queue fill.
datadog.trace_agent.trace_writer.retries: Type: Count
Number of retries on failures to the Datadog API.
datadog.trace_agent.trace_writer.spans: Type: Count
Number of spans processed.
datadog.trace_agent.trace_writer.traces: Type: Count
Number of traces processed.