Datadog’s Logging without Limits* lets you dynamically decide what to include or exclude from your indexes. Log-based metrics are a cost-efficient way to summarize log data from the entire ingest stream. This means that even if you use exclusion filters to limit indexes to operationally critical logs, you can still visualize trends and anomalies over all of your log data at full granularity for 15 months.
With log-based metrics, you can record a count of logs that match a query or summarize a numeric value contained in a log, such as request duration.
*to generate a count of all logs matching your query or enter a log attribute (e.g.,
@network.bytes_written) to aggregate a numeric value and create its corresponding
group by: Select log attributes or tag keys to apply to the generated log-based metric to transform them into Tags following the
<KEY>:<VALUE>format. Log-based metrics are considered custom metrics. Avoid grouping by unbounded or extremely high cardinality attributes like timestamps, user IDs, request IDs, or session IDs to avert impacting your billing.
Note: Data points for Log-based metrics are generated at ten second intervals.
After a metric is created, only these fields can be updated:
To change the metric type or name, a new metric must be created.
Usage metrics are estimates of your current Datadog usage in near real-time. They enable you to:
Log Management usage metrics come with three tags that can be used for more granular monitoring:
| ||Indicates the routing query that matches a log to an intended index.|
| ||Indicates whether or not a log matches an exclusion query.|
| ||The service attribute of the log event.|
Additional helpful documentation, links, and articles: