Datadog Live Containers enable real-time visibility into all containers across your environment.
Taking inspiration from bedrock tools like htop and ctop, Live Containers give you complete coverage of your container infrastructure, in a continuously updated table with resource metrics at two-second resolution and faceted search. Coupled with Datadog’s integrations with Docker, Kubernetes, ECS, and other container technologies, plus our built-in tagging of dynamic components, this new Live Container view provides a detailed overview of your containers’ health, resource consumption, and deployment in real time:
After deploying the Docker Agent, no other configuration is necessary.
Note that for collecting Container information in the standard install rather than with the Docker Agent, the
dd-agent user needs to have permissions to access docker.sock.
It is possible to include and/or Exclude containers from real-time collection:
datadog.yamlmain configuration file.
datadog.yamlmain configuration file.
Both arguments take an image name as value; regexp are also supported.
For example, to exclude all debian images except containers with a name starting with frontend, add these two configuration lines in your
ac_exclude: ["image:debian"] ac_include: ["name:frontend.*"]
Note: For Agent v5, instead of including the above in the
datadog.conf main configuration file, you have to explicitly add a
datadog.yaml file to
/etc/datadog-agent/, as the Process Agent requires all configuration options here. This configuration only excludes containers from real-time collection not from Autodiscovery.
Containers are by their nature extremely high cardinality objects. Our flexible string search matches substrings in the container name, ID, or image fields.
Containers are tagged with all existing host-level tags. We also tag with metadata associated with individual containers.
All containers are tagged by
image_name, and additionally, we include integrations with popular orchestrators, such as ECS and Kubernetes, which provide further container-level tags. We also decorate each container with Docker, ECS, or Kubernetes icons so you can tell which are being orchestrated at a glance.
ECS Containers are tagged by:
Kubernetes Containers are tagged by:
Making sense of thousands or tens of thousands of containers can seem overwhelming! Using tagging, described in the previous section, makes navigation easy.
In the screenshot below, we have filtered down to a Kubernetes cluster of 9 nodes. RSS and CPU utilization on containers is reported compared to the provisioned limits on the containers, when they exist. Here, we see that the containers in this cluster are way over provisioned, and that we could use tighter limits and bin packing to achieve better utilization of resources.
Container environments are dynamic and can be hard to follow.
Here, we pivot by
host, and to reduce system noise, filter to
kube_namespace:default, and we can see what services are running where, and how saturated key metrics are:
It would be easy to pivot by ECS
ecs_task_version and understand changes to resource utilization between updates.
While actively working with the Containers page, metrics are collected at 2s resolution. This is very important for highly volatile metrics such as CPU. In the background, for historical context, metrics are collected at 10s resolution.
This feature does not support Windows containers at this time.
Real-time (2s) data collection is turned off after 30 minutes. To resume real-time collection, refresh the page.
Live Containers is available for the default Debian docker-dd-agent image only. It is not included in the Alpine image.
RBAC settings can restrict Kubernetes metadata collection. Refer to the RBAC entites for the Datadog Agent.
Additional helpful documentation, links, and articles: