Datadog-Cloud Foundry Integration

Overview

Any Cloud Foundry deployment can send metrics and events to Datadog. The data helps you track the health and availability of all nodes in the deployment, monitor the jobs they run, collect metrics from the Loggregator Firehose, and more.

There are three points of integration with Datadog, each of which achieves a different goal:

  • Datadog Agent BOSH release — Install the Datadog Agent on every node in your deployment to track system, network, and disk metrics. Enable any other Agent checks you wish.
  • Datadog Firehose Nozzle — Deploy one or more Datadog Firehose Nozzle jobs. The jobs tap into your deployment’s Loggregator Firehose and send all non-container metrics to Datadog.
  • Datadog plugin for BOSH Health Monitor — Configure your BOSH Director’s Health Monitor to send heartbeats (as metrics) and alerts (as events) from each node’s BOSH Agent to Datadog.

These integrations are meant for Cloud Foundry deployment administrators, not end users.

Setup

Installation

Prerequisites

You need to have a working Cloud Foundry deployment and access to the BOSH Director that manages it. You also need BOSH CLI to deploy each integration. You may use either major version of the CLI—v1 or v2.

To configure the Datadog plugin for BOSH Health Monitor, you need access to the state.json (or similarly named) file that accurately reflects the current state of your BOSH Director. If you don’t have such a file, you’ll need to create one.

Install the Datadog Agent BOSH Release

Datadog provides tarballs of the Datadog Agent packaged as a BOSH release. You can upload the latest release to your BOSH Director and then easily install it on every node in your deployment as an addon (i.e. the same way a Director deploys the BOSH Agent to all nodes).

Upload Datadog’s release to your BOSH Director
# BOSH CLI v1
bosh upload release https://cloudfoundry.datadoghq.com/datadog-agent/datadog-agent-boshrelease-latest.tgz

# BOSH CLI v2
bosh upload-release https://cloudfoundry.datadoghq.com/datadog-agent/datadog-agent-boshrelease-latest.tgz

If you’d like to create your own release, see the Datadog Agent BOSH Release repository.

Configure the Agent as an addon in your BOSH Director

Add the following to your BOSH Director’s runtime configuration file (e.g. runtime.yml):

---
releases:
  - name: datadog-agent
    version: <VERSION_YOU_UPLOADED> # specify the real version, i.e. x.y.z, not 'latest'

addons:
- name: datadog
  jobs:
  - name: dd-agent
    release: datadog-agent
  properties:
    dd:
      use_dogstatsd: yes
      dogstatsd_port: 18125               # Many CF deployments have a StatsD already on port 8125
      api_key: <YOUR_DATADOG_API_KEY>
      tags: ["cloudfoundry_deployment_1"] # any tags you wish
      generate_processes: true            # to enable the process check

To see which datadog-agent release version you uploaded earlier, run bosh releases.

If you don’t have a local copy of the runtime configuration, create a runtime.yml with the current runtime configuration (bosh runtime-config) and add the above YAML to it. If the Director’s runtime configuration is empty, create a new runtime.yml containing only the above YAML.

Enable extra Agent checks

For each extra Agent check you want to enable across your deployment, add its configuration under the properties.dd.integrations key, e.g.:

  properties:
    dd:
      integrations:
        directory:
          init_config: {}
          instances:
            directory: "."
        #process:
        #  init_config: {}
        #...

The configuration under each check name should look the same as if you were configuring the check in its own file in the Agent’s conf.d directory.

You cannot configure a check for a subset of nodes in your deployment; everything you configure in runtime.yml will apply to every node.

To customize configuration for the default checks—system, network, disk, and ntp—see the full list of configuration options for the Datadog Agent BOSH release.

Sync the runtime configuration to the Director
# BOSH CLI v1
bosh update runtime-config runtime.yml

# BOSH CLI v2
bosh update-runtime-config runtime.yml
Redeploy your Cloud Foundry deployment
# BOSH CLI v1
bosh deployment yourDeploymentManifest.yml
bosh -n deploy

# BOSH CLI v2
bosh -n -d yourDeployment deploy yourDeploymentManifest.yml

Since runtime configuration applies globally, BOSH will redeploy every node in your deployment. If you have more than one deployment, redeploy those, too, to install the Datadog Agent everywhere.

Verify the Agent is installed everywhere

The easiest way to check that Agent installs were successful is to filter for them in the Host map page in Datadog. The Agent BOSH release tags each host with a generic cloudfoundry tag, so filter by that, and optionally group hosts by any tag you wish (e.g. bosh_job), as in the following screenshot:

cloud-foundry-host-map

Click on any host to zoom in, then click system within its hexagon to make sure Datadog is receiving metrics for it:

cloud-foundry-host-map-detail

Deploy the Datadog Firehose Nozzle

As with the Datadog Agent, Datadog provides a BOSH release of the Datadog Firehose Nozzle. After uploading the release to your Director, you can add the Nozzle to an existing deployment, or create a new deployment that only includes the Nozzle. The instructions below assume you’re adding it to an existing Cloud Foundry deployment that has a working Loggregator Firehose.

Upload Datadog’s release to your BOSH Director
# BOSH CLI v1
bosh upload release http://cloudfoundry.datadoghq.com/datadog-firehose-nozzle/datadog-firehose-nozzle-release-latest.tgz

# BOSH CLI v2
bosh upload-release http://cloudfoundry.datadoghq.com/datadog-firehose-nozzle/datadog-firehose-nozzle-release-latest.tgz

If you’d like to create your own release, see the Datadog Firehose Nozzle release repository.

Configure a UAA client

In the manifest that contains your UAA configuration, add a new client for the Datadog Nozzle so the job(s) can access the Firehose:

uaa:
  clients:
    datadog-firehose-nozzle:
      access-token-validity: 1209600
      authorities: doppler.firehose
      authorized-grant-types: client_credentials
      override: true
      scope: doppler.firehose
      secret: <MAKE_IT_A_GOOD_ONE>

And redeploy the deployment to add the user.

Add Nozzle jobs

Configure one or more Nozzle jobs in your main Cloud Foundry deployment manifest (e.g. cf-manifest.yml):

jobs:
#- instances: 4
#  name: some_other_job
#  ...
- instances: 1            # add more instances if one job cannot keep up with the Firehose
  name: datadog_nozzle_z1
  networks:
    - name: cf1           # some network you've configured elsewhere in the manifest
  resource_pool: small_z1 # some resource_pool you've configured elsewhere in the manifest
  templates:
    - name: datadog-firehose-nozzle
      release: datadog-firehose-nozzle
  properties:
    datadog:
      api_key: <YOUR_DATADOG_API_KEY>
      api_url: https://app.datadoghq.com/api/v1/series
      flush_duration_seconds: 15 # seconds between flushes to Datadog. Default is 15.
    loggregator:
      # do NOT append '/firehose' or even a trailing slash to the URL; 'ws://<host>:<port>' will do
      traffic_controller_url: <LOGGREGATOR_URL> # e.g. ws://traffic-controller.your-cf-domain.com:8081
    nozzle:
      deployment: <DEPLOYMENT_NAME>    # tags each firehose metric with 'deployment:<DEPLOYMENT_NAME>'
      subscription_id: datadog-nozzle  # can be anything (firehose streams data evenly to all jobs using the same subscription_id)
      # disable_access_control: true   # for development only
      # insecure_ssl_skip_verify: true # for development only; enable if your UAA does not use a verifiable cert
    uaa:
      client: datadog-firehose-nozzle # client name you just configured
      client_secret: <SECRET_YOU_JUST_CONFIGURED>
      url: <UAA_URL> # e.g. https://uaa.your-cf-domain.com:8443

To see all available configuration options, check the Datadog Firehose Nozzle repository.

In the same manifest, add the Datadog Nozzle release name and version:

releases:
# - name: some-other-release
#   version: x.y.z
# ...
  - name: datadog-firehose-nozzle
    version: $VERSION_YOU_UPLOADED # specify the real version, i.e. x.y.z, not 'latest'

To see which datadog-firehose-nozzle release version you uploaded earlier, run bosh releases.

Redeploy the deployment
# BOSH CLI v1
bosh deployment cf-manifest.yml
bosh -n deploy

# BOSH CLI v2
bosh -n -d cf-manifest deploy cf-manifest.yml
Verify the Nozzle is collecting

On the Metrics explorer page in Datadog, search for metrics beginning cloudfoundry.nozzle:

cloud-foundry-nozzle-metrics

Configure the Datadog plugin for BOSH Health Monitor

The plugin is packaged with the BOSH Health Monitor, so if the Health Monitor is already installed and running on your BOSH Director, you just need to configure the plugin and redeploy the Director.

Add the configuration

In the manifest originally used to deploy the Director (e.g. bosh.yml), configure the Datadog plugin:

instance_groups:
- instances: 1
  properties:
    hm:
    # loglevel: info
    # resurrector: enabled
    #...other stuff
      datadog_enabled: true
      datadog:
        api_key: <YOUR_DATADOG_API_KEY>
        application_key: <YOUR_DATADOG_APP_KEY>
        pagerduty_service_name: "your_service_name" # optional
Redeploy the Director

BOSH cannot simply configure the plugin and restart the Health Monitor; it must destroy the Director and redeploy it as a new instance. To do this while retaining the Director’s current disk and database, you MUST redeploy using a state.json (or similarly named) file that accurately reflects the current state of your Director. If you don’t have such a file, follow the BOSH docs on Deployment State to create a basic state.yml.

You may use bosh-init or BOSH CLI v2 to redeploy the Director. If you use bosh-init, your state file must be named similarly to your manifest; for a manifest named bosh.yml, bosh-init expects a state file named bosh-state.yml.

# bosh-init (legacy)
bosh-init deploy bosh.yml

# BOSH CLI v2 - if your state file is not named bosh-state.yml, provide its name via --state
bosh create-env --state=your-state-file.json bosh.yml
Verify the plugin is working

On the Metrics explorer page in Datadog, search for metrics beginning bosh.healthmonitor:

cloud-foundry-bosh-hm-metrics

Data Collected

Events

The BOSH Health Monitor Datadog plugin emits an event to Datadog for any alert it receives from your deployment’s BOSH Agents. Read the BOSH Health Monitor docs to see what kinds of alerts might show up in your Datadog event stream.

The BOSH Agent sets a severity for each alert it generates, and the Datadog Health Monitor plugin uses that severity to prioritize the event it emits. Alerts with an Error, Critical, or Alert severity become Normal priority events in Datadog. Alerts with any other severity become Low priority events.

Metrics

The following metrics are sent by the Datadog Firehose Nozzle (cloudfoundry.nozzle) and the BOSH Health Monitor Datadog plugin (bosh.healthmonitor). The Datadog Agent release does not send any special metrics of its own, just the usual metrics from any Agent checks you configure in the Director runtime config (and, by default, system, network, disk, and ntp metrics).

The Datadog Firehose Nozzle only collects CounterEvents (as metrics, not events) and ValueMetrics; it ignores LogMessages, Errors, and ContainerMetrics.

cloudfoundry.nozzle.auctioneer.LockHeld.v1_locks_auctioneer_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.auctioneer.LockHeldDuration.v1_locks_auctioneer_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.auctioneer.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.auctioneer.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.auctioneer.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.auctioneer.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.auctioneer.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.auctioneer.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.auctioneer.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.auctioneer.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.bbs.ConvergenceLRPDuration
(gauge)
Time the BBS took to run its LRP convergence pass
shown as nanosecond
cloudfoundry.nozzle.bbs.ConvergenceLRPRuns
(gauge)
Cumulative number of times BBS has run its LRP convergence pass.
shown as job
cloudfoundry.nozzle.bbs.ConvergenceTaskDuration
(gauge)
Time the BBS took to run its Task convergence pass
shown as nanosecond
cloudfoundry.nozzle.bbs.ConvergenceTaskRuns
(gauge)
Cumulative number of times the BBS has run its Task convergence pass.
shown as job
cloudfoundry.nozzle.bbs.ConvergenceTasksKicked
(gauge)
Cumulative number of times the BBS has updated a Task during its Task convergence pass.
shown as job
cloudfoundry.nozzle.bbs.ConvergenceTasksPruned
(gauge)
Cumulative number of times the BBS has deleted a malformed Task during its Task convergence pass.
shown as job
cloudfoundry.nozzle.bbs.CrashedActualLRPs
(gauge)
Total number of LRP instances that have crashed.
shown as instance
cloudfoundry.nozzle.bbs.CrashingDesiredLRPs
(gauge)
Total number of DesiredLRPs that have at least one crashed instance.
shown as instance
cloudfoundry.nozzle.bbs.Domain.cf_apps
(gauge)
Whether the domain name (Domain.<domain-name>) is up to date. So that instances from that domain have been synchronized with DesiredLRPs for Diego to run. 1 means the domain is up-to-date. No data means it is not.
shown as monitor
cloudfoundry.nozzle.bbs.Domain.cf_tasks
(gauge)
Whether the domain name (Domain.<domain-name>) is up to date. So that instances from that domain have been synchronized with DesiredLRPs for Diego to run. 1 means the domain is up-to-date. No data means it is not.
shown as monitor
cloudfoundry.nozzle.bbs.ETCDLeader
(gauge)
Index of the leader node in the etcd cluster
shown as item
cloudfoundry.nozzle.bbs.ETCDRaftTerm
(gauge)
Raft term of the etcd cluster
shown as unit
cloudfoundry.nozzle.bbs.ETCDReceivedBandwidthRate
(gauge)
Number of bytes per second received by the follower etcd node
shown as byte
cloudfoundry.nozzle.bbs.ETCDReceivedRequestRate
(gauge)
Number of requests per second received by the follower etcd node
shown as byte
cloudfoundry.nozzle.bbs.ETCDSentBandwidthRate
(gauge)
Number of bytes per second sent by the leader etcd node
shown as byte
cloudfoundry.nozzle.bbs.ETCDSentRequestRate
(gauge)
Number of requests per second sent by the leader etcd node
shown as byte
cloudfoundry.nozzle.bbs.ETCDWatchers
(gauge)
Number of watchers on the etcd cluster
shown as operation
cloudfoundry.nozzle.bbs.LockHeld.v1_locks_bbs_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.bbs.LockHeldDuration.v1_locks_bbs_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.bbs.LRPsClaimed
(gauge)
Total number of LRP instances that have been claimed by some cell.
shown as instance
cloudfoundry.nozzle.bbs.LRPsDesired
(gauge)
Total number of LRP instances desired across all LRPs.
shown as instance
cloudfoundry.nozzle.bbs.LRPsExtra
(gauge)
Total number of LRP instances that are no longer desired but still have a BBS record.
shown as instance
cloudfoundry.nozzle.bbs.LRPsMissing
(gauge)
Total number of LRP instances that are desired but have no record in the BBS.
shown as instance
cloudfoundry.nozzle.bbs.LRPsRunning
(gauge)
Total number of LRP instances that are running on cells.
shown as instance
cloudfoundry.nozzle.bbs.LRPsUnclaimed
(gauge)
Total number of LRP instances that have not yet been claimed by a cell.
shown as instance
cloudfoundry.nozzle.bbs.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.bbs.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.bbs.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.bbs.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.bbs.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.bbs.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.bbs.MetricsReportingDuration
(gauge)
Time it took to report periodic metrics.
shown as nanosecond
cloudfoundry.nozzle.bbs.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.bbs.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.bbs.RequestCount
(gauge)
Cumulative number of requests the BBS has handled through its API.
shown as request
cloudfoundry.nozzle.bbs.RequestLatency
(gauge)
Time the BBS took to handle requests to its API endpoints
shown as nanosecond
cloudfoundry.nozzle.bbs.TasksCompleted
(gauge)
Total number of Tasks that have completed.
shown as job
cloudfoundry.nozzle.bbs.TasksPending
(gauge)
Total number of Tasks that have not yet been placed on a cell.
shown as job
cloudfoundry.nozzle.bbs.TasksResolving
(gauge)
Total number of Tasks locked for deletion.
shown as job
cloudfoundry.nozzle.bbs.TasksRunning
(gauge)
Total number of Tasks running on cells.
shown as job
cloudfoundry.nozzle.cc.failed_job_count.total
(gauge)

shown as
cloudfoundry.nozzle.cc.http_status.1xx
(gauge)
Number of HTTP response status codes of type 1xx
shown as response
cloudfoundry.nozzle.cc.http_status.2XX
(gauge)
Number of HTTP response status codes of type 2XX
shown as response
cloudfoundry.nozzle.cc.http_status.3xx
(gauge)
Number of HTTP response status codes of type 3xx
shown as response
cloudfoundry.nozzle.cc.http_status.4xx
(gauge)
Number of HTTP response status codes of type 4xx
shown as response
cloudfoundry.nozzle.cc.http_status.5xx
(gauge)
Number of HTTP response status codes of type 5xx
shown as response
cloudfoundry.nozzle.cc.http_status.5XX
(gauge)
Number of HTTP response status codes of type 5XX
shown as response
cloudfoundry.nozzle.cc.job_queue_length.total
(gauge)
Jobs in the job queue
shown as item
cloudfoundry.nozzle.cc.log_count.all
(gauge)
The total number of log messages of all severity levels
shown as entry
cloudfoundry.nozzle.cc.log_count.debug
(gauge)
Number of log messages of severity debug
shown as entry
cloudfoundry.nozzle.cc.log_count.debug1
(gauge)
Number of log messages of severity debug1
shown as entry
cloudfoundry.nozzle.cc.log_count.debug2
(gauge)
Number of log messages of severity debug2
shown as entry
cloudfoundry.nozzle.cc.log_count.error
(gauge)
Number of log messages of severity error
shown as entry
cloudfoundry.nozzle.cc.log_count.fatal
(gauge)
Number of log messages of severity fatal
shown as entry
cloudfoundry.nozzle.cc.log_count.info
(gauge)
Number of log messages of severity info
shown as entry
cloudfoundry.nozzle.cc.log_count.off
(gauge)
Number of log messages of severity off
shown as entry
cloudfoundry.nozzle.cc.log_count.warn
(gauge)
Number of log messages of severity warn
shown as entry
cloudfoundry.nozzle.cc.requests.completed
(gauge)
Number of requests that have been processed.
shown as request
cloudfoundry.nozzle.cc.requests.outstanding
(gauge)
Number of request that are currently being processed.
shown as request
cloudfoundry.nozzle.cc.tasks_running.count
(gauge)
Number of currently running tasks.
shown as job
cloudfoundry.nozzle.cc.tasks_running.memory_in_mb
(gauge)
Memory being consumed by all currently running tasks.
shown as mebibyte
cloudfoundry.nozzle.cc.thread_info.event_machine.connection_count
(gauge)
Number of open connections to event machine.
shown as connection
cloudfoundry.nozzle.cc.thread_info.event_machine.resultqueue.num_waiting
(gauge)
Number of scheduled tasks in the result.
shown as job
cloudfoundry.nozzle.cc.thread_info.event_machine.resultqueue.size
(gauge)
Number of unscheduled tasks in the result.
shown as job
cloudfoundry.nozzle.cc.thread_info.event_machine.threadqueue.num_waiting
(gauge)
Number of scheduled tasks in the threadqueue.
shown as job
cloudfoundry.nozzle.cc.thread_info.event_machine.threadqueue.size
(gauge)
Number of unscheduled tasks in the threadqueue.
shown as job
cloudfoundry.nozzle.cc.thread_info.thread_count
(gauge)
Total number of threads that are either runnable or stopped.
shown as thread
cloudfoundry.nozzle.cc.total_users
(gauge)
Total number of users ever created including inactive users.
shown as unit
cloudfoundry.nozzle.cc.vitals.cpu
(gauge)
Percentage of CPU used by the Cloud Controller process.
shown as percent
cloudfoundry.nozzle.cc.vitals.cpu_load_avg
(gauge)
System CPU load averaged over the last 1 minute according to the OS.
shown as
cloudfoundry.nozzle.cc.vitals.mem_bytes
(gauge)
The RSS bytes (resident set size) or real memory of the Cloud Controller process.
shown as byte
cloudfoundry.nozzle.cc.vitals.mem_free_bytes
(gauge)
Total memory available according to the OS.
shown as byte
cloudfoundry.nozzle.cc.vitals.mem_used_bytes
(gauge)
Total memory used (active + wired) according to the OS.
shown as byte
cloudfoundry.nozzle.cc.vitals.num_cores
(gauge)
The number of CPUs of a host machine.
shown as cpu
cloudfoundry.nozzle.cc.vitals.uptime
(gauge)
Uptime in seconds
shown as second
cloudfoundry.nozzle.cc_uploader.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.cc_uploader.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.cc_uploader.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.cc_uploader.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.cc_uploader.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.cc_uploader.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.cc_uploader.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.cc_uploader.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.DopplerServer.dropsondeListener.receivedByteCount
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.dropsondeListener.receivedMessageCount
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.dropsondeUnmarshaller.containerMetricReceived
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.dropsondeUnmarshaller.counterEventReceived
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.dropsondeUnmarshaller.httpStartStopReceived
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.dropsondeUnmarshaller.logMessageTotal
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.dropsondeUnmarshaller.valueMetricReceived
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.httpServer.receivedMessages
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.LinuxFileDescriptor
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.listeners.receivedEnvelopes
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.listeners.totalReceivedByteCount
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.listeners.totalReceivedMessageCount
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.DopplerServer.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.DopplerServer.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.DopplerServer.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.DopplerServer.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.DopplerServer.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.DopplerServer.messageRouter.numberOfDumpSinks
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.DopplerServer.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.DopplerServer.sentEnvelopes
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.sentMessagesFirehose
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.signatureVerifier.validSignatures
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.udpListener.receivedByteCount
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.udpListener.receivedMessageCount
(gauge)

shown as
cloudfoundry.nozzle.DopplerServer.Uptime
(gauge)
Uptime in seconds
shown as second
cloudfoundry.nozzle.etcd.CompareAndDeleteFail
(gauge)
CompareAndDeleteFail operations count
shown as operation
cloudfoundry.nozzle.etcd.CompareAndDeleteSuccess
(gauge)
CompareAndDeleteSuccess operations count
shown as operation
cloudfoundry.nozzle.etcd.CompareAndSwapFail
(gauge)
CompareAndSwapFail operations count
shown as operation
cloudfoundry.nozzle.etcd.CompareAndSwapSuccess
(gauge)
CompareAndSwapSuccess operations count
shown as operation
cloudfoundry.nozzle.etcd.CreateFail
(gauge)
CreateFail operations count
shown as operation
cloudfoundry.nozzle.etcd.CreateSuccess
(gauge)
CreateSuccess operations count
shown as operation
cloudfoundry.nozzle.etcd.DeleteFail
(gauge)
DeleteFail operations count
shown as operation
cloudfoundry.nozzle.etcd.DeleteSuccess
(gauge)
DeleteSuccess operations count
shown as operation
cloudfoundry.nozzle.etcd.EtcdIndex
(gauge)
Etcd Index
shown as item
cloudfoundry.nozzle.etcd.ExpireCount
(gauge)
ExpireCount operations count
shown as operation
cloudfoundry.nozzle.etcd.Followers
(gauge)
number of etcd followers
shown as item
cloudfoundry.nozzle.etcd.GetsFail
(gauge)
GetsFail operations count
shown as operation
cloudfoundry.nozzle.etcd.GetsSuccess
(gauge)
GetsSuccess operations count
shown as operation
cloudfoundry.nozzle.etcd.IsLeader
(gauge)
1 if it is the leader. 0 if it is not
shown as monitor
cloudfoundry.nozzle.etcd.logSenderTotalMessagesRead
(gauge)
Lifetime number of application log messages
shown as message
cloudfoundry.nozzle.etcd.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.etcd.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.etcd.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.etcd.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.etcd.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.etcd.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.etcd.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.etcd.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.etcd.RaftIndex
(gauge)
Raft index of the etcd cluster
shown as item
cloudfoundry.nozzle.etcd.RaftTerm
(gauge)
Raft term of the etcd cluster
shown as item
cloudfoundry.nozzle.etcd.ReceivedAppendRequests
(gauge)
The number of append requests this node has recieved
shown as request
cloudfoundry.nozzle.etcd.ReceivingBandwidthRate
(gauge)
Number of bytes per second this node is receiving (follower only)
shown as byte
cloudfoundry.nozzle.etcd.ReceivingRequestRate
(gauge)
Number of requests per second this node is receiving (follower only)
shown as byte
cloudfoundry.nozzle.etcd.SendingBandwidthRate
(gauge)
Number of bytes per second this node is sending (leader only)
shown as byte
cloudfoundry.nozzle.etcd.SendingRequestRate
(gauge)
Number of requests per second this node is sending (leader only)
shown as byte
cloudfoundry.nozzle.etcd.SentAppendRequests
(gauge)
Number of requests that this node has sent
shown as request
cloudfoundry.nozzle.etcd.SetsFail
(gauge)
SetsFail operation count
shown as operation
cloudfoundry.nozzle.etcd.SetsSuccess
(gauge)
SetsSuccess operation count
shown as operation
cloudfoundry.nozzle.etcd.UpdateFail
(gauge)
UpdateFail operation count
shown as operation
cloudfoundry.nozzle.etcd.UpdateSuccess
(gauge)
UpdateSuccess operation count
shown as operation
cloudfoundry.nozzle.etcd.Watchers
(gauge)
Watchers operation count
shown as operation
cloudfoundry.nozzle.file_server.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.file_server.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.file_server.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.file_server.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.file_server.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.file_server.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.file_server.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.file_server.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.garden_linux.BackingStores
(gauge)
Number of container backing store files.
shown as file
cloudfoundry.nozzle.garden_linux.DepotDirs
(gauge)
Number of directories in the Garden depot.
shown as file
cloudfoundry.nozzle.garden_linux.LoopDevices
(gauge)
Number of attached loop devices.
shown as item
cloudfoundry.nozzle.garden_linux.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.garden_linux.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.garden_linux.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.garden_linux.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.garden_linux.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.garden_linux.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.garden_linux.MetricsReporting
(gauge)
How long it took to emit the BackingStores; DepotDirs; and LoopDevices metrics.
shown as nanosecond
cloudfoundry.nozzle.garden_linux.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.garden_linux.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.gorouter.latency
(gauge)
Time in milliseconds that the Gorouter took to handle requests to its application endpoints.
shown as millisecond
cloudfoundry.nozzle.gorouter.latency.CloudController
(gauge)
Time in milliseconds that the Gorouter took to handle requests from a component to its endpoints.
shown as millisecond
cloudfoundry.nozzle.gorouter.latency.route_emitter
(gauge)
Time in milliseconds that the Gorouter took to handle requests from a component to its endpoints.
shown as millisecond
cloudfoundry.nozzle.gorouter.logSenderTotalMessagesRead
(gauge)
Lifetime number of application log messages
shown as message
cloudfoundry.nozzle.gorouter.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.gorouter.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.gorouter.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.gorouter.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.gorouter.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.gorouter.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.gorouter.ms_since_last_registry_update
(gauge)
Time in millisecond since the last route register has been been received.
shown as millisecond
cloudfoundry.nozzle.gorouter.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.gorouter.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.gorouter.registry_message
(gauge)
Time in milliseconds that the Gorouter took to handle requests to its application endpoints.
shown as millisecond
cloudfoundry.nozzle.gorouter.registry_message.
(gauge)
Lifetime number of route register messages received for a component.
shown as message
cloudfoundry.nozzle.gorouter.registry_message.CloudController
(gauge)
Lifetime number of route register messages received for a component.
shown as message
cloudfoundry.nozzle.gorouter.registry_message.redis_broker
(gauge)
Lifetime number of route register messages received for a component.
shown as message
cloudfoundry.nozzle.gorouter.registry_message.route_emitter
(gauge)
Lifetime number of route register messages received for a component.
shown as message
cloudfoundry.nozzle.gorouter.rejected_requests
(gauge)
Lifetime number of bad requests received on Gorouter.
shown as request
cloudfoundry.nozzle.gorouter.requests.CloudController
(gauge)
Lifetime number of requests received for a component
shown as request
cloudfoundry.nozzle.gorouter.requests.route_emitter
(gauge)
Lifetime number of requests received for a component
shown as request
cloudfoundry.nozzle.gorouter.responses
(gauge)
Lifetime number of HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.1xx
(gauge)
Lifetime number of 1xx HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.1XX
(gauge)
Lifetime number of 1XX HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.2xx
(gauge)
Lifetime number of 2xx HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.3xx
(gauge)
Lifetime number of 3xx HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.3XX
(gauge)
Lifetime number of 3XX HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.4xx
(gauge)
Lifetime number of 4xx HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.4XX
(gauge)
Lifetime number of 4XX HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.5xx
(gauge)
Lifetime number of 5xx HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.5XX
(gauge)
Lifetime number of 5XX HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.XXX
(gauge)
Lifetime number of XXX HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.responses.xxx
(gauge)
Lifetime number of xxx HTTP responses.
shown as response
cloudfoundry.nozzle.gorouter.route_lookup_time
(gauge)
Time in nanoseconds to look up a request URL in the route table.
shown as nanosecond
cloudfoundry.nozzle.gorouter.routed_app_requests
(gauge)
The collector sums up requests for all dea-{index} components for its output metrics.
shown as route
cloudfoundry.nozzle.gorouter.total_requests
(gauge)
Lifetime number of requests received.
shown as request
cloudfoundry.nozzle.gorouter.total_routes
(gauge)
Current number of routes registered.
shown as route
cloudfoundry.nozzle.gorouter.unregistry_message
(gauge)
Lifetime number of route unregister messages received for each component.
shown as message
cloudfoundry.nozzle.gorouter.uptime
(gauge)
Uptime in seconds
shown as second
cloudfoundry.nozzle.gorouter.websocket_failures
(gauge)
Lifetime number of WebSocket failures.
shown as response
cloudfoundry.nozzle.gorouter.websocket_upgrades
(gauge)
Lifetime number of WebSocket upgrades.
shown as connection
cloudfoundry.nozzle.LoggregatorTrafficController.LinuxFileDescriptor
(gauge)

shown as
cloudfoundry.nozzle.LoggregatorTrafficController.listeners.receivedEnvelopes
(gauge)

shown as
cloudfoundry.nozzle.LoggregatorTrafficController.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.LoggregatorTrafficController.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.LoggregatorTrafficController.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.LoggregatorTrafficController.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.LoggregatorTrafficController.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.LoggregatorTrafficController.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.LoggregatorTrafficController.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.LoggregatorTrafficController.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.LoggregatorTrafficController.Uptime
(gauge)
Uptime in seconds
shown as second
cloudfoundry.nozzle.MetronAgent.DopplerForwarder.sentMessages
(gauge)
Lifetime number of messages sent to Doppler regardless of protocol.
shown as message
cloudfoundry.nozzle.MetronAgent.dropsondeAgentListener.receivedByteCount
(gauge)
Lifetime number of bytes of Dropsonde messages read by UDP socket.
shown as byte
cloudfoundry.nozzle.MetronAgent.dropsondeAgentListener.receivedMessageCount
(gauge)
Lifetime number of Dropsonde messages read by UDP socket.
shown as message
cloudfoundry.nozzle.MetronAgent.dropsondeMarshaller.sentEnvelopes
(gauge)
Lifetime number of sent envelopes
shown as payload
cloudfoundry.nozzle.MetronAgent.dropsondeUnmarshaller.containerMetricReceived
(gauge)
Lifetime number of ContainerMetric messages unmarshalled.
shown as message
cloudfoundry.nozzle.MetronAgent.dropsondeUnmarshaller.counterEventReceived
(gauge)
Lifetime number of CounterEvent messages unmarshalled.
shown as event
cloudfoundry.nozzle.MetronAgent.dropsondeUnmarshaller.httpStartStopReceived
(gauge)
Lifetime number of HttpStartStop messages unmarshalled.
shown as event
cloudfoundry.nozzle.MetronAgent.dropsondeUnmarshaller.logMessageTotal
(gauge)
Lifetime number of LogMessage messages unmarshalled.
shown as message
cloudfoundry.nozzle.MetronAgent.dropsondeUnmarshaller.receivedEnvelopes
(gauge)
Lifetime number of received envelopes
shown as payload
cloudfoundry.nozzle.MetronAgent.dropsondeUnmarshaller.valueMetricReceived
(gauge)
Lifetime number of ValueMetric messages unmarshalled.
shown as message
cloudfoundry.nozzle.MetronAgent.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.MetronAgent.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.MetronAgent.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.MetronAgent.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.MetronAgent.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.MetronAgent.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.MetronAgent.MessageAggregator.counterEventReceived
(gauge)
Lifetime number of CounterEvents aggregated in Metron.
shown as event
cloudfoundry.nozzle.MetronAgent.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.MetronAgent.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.MetronAgent.udp.sentByteCount
(gauge)
Lifetime number of sent bytes to Doppler over UDP.
shown as byte
cloudfoundry.nozzle.MetronAgent.udp.sentMessageCount
(gauge)
Lifetime number of sent messages to Doppler over UDP.
shown as message
cloudfoundry.nozzle.nsync_bulker.DesiredLRPSyncDuration
(gauge)
Time in nanoseconds that the nsync-bulker took to synchronize CF apps and Diego DesiredLRPs.
shown as nanosecond
cloudfoundry.nozzle.nsync_bulker.LockHeld.v1_locks_nsync_bulker_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.nsync_bulker.LockHeldDuration.v1_locks_nsync_bulker_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.nsync_bulker.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.nsync_bulker.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.nsync_bulker.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.nsync_bulker.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.nsync_bulker.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.nsync_bulker.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.nsync_bulker.NsyncInvalidDesiredLRPsFound
(gauge)

shown as
cloudfoundry.nozzle.nsync_bulker.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.nsync_bulker.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.nsync_listener.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.nsync_listener.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.nsync_listener.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.nsync_listener.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.nsync_listener.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.nsync_listener.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.nsync_listener.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.nsync_listener.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.rep.CapacityRemainingContainers
(gauge)
Remaining number of containers this cell can host.
shown as container
cloudfoundry.nozzle.rep.CapacityRemainingDisk
(gauge)
Remaining amount in MiB of disk available for this cell to allocate to containers.
shown as mebibyte
cloudfoundry.nozzle.rep.CapacityRemainingMemory
(gauge)
Remaining amount in MiB of memory available for this cell to allocate to containers.
shown as mebibyte
cloudfoundry.nozzle.rep.CapacityTotalContainers
(gauge)
Total number of containers this cell can host.
shown as container
cloudfoundry.nozzle.rep.CapacityTotalDisk
(gauge)
Time in nanoseconds that the nsync-bulker took to synchronize CF apps and Diego DesiredLRPs.
shown as mebibyte
cloudfoundry.nozzle.rep.CapacityTotalMemory
(gauge)
Total amount in MiB of disk available for this cell to allocate to containers.
shown as mebibyte
cloudfoundry.nozzle.rep.ContainerCount
(gauge)
Number of containers hosted on the cell.
shown as container
cloudfoundry.nozzle.rep.logSenderTotalMessagesRead
(gauge)
Lifetime number of application log messages
shown as message
cloudfoundry.nozzle.rep.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.rep.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.rep.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.rep.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.rep.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.rep.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.rep.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.rep.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.rep.RepBulkSyncDuration
(gauge)
Time in nanoseconds that the cell rep took to synchronize the ActualLRPs it has claimed with its actual garden containers.
shown as nanosecond
cloudfoundry.nozzle.rep.UnhealthyCell
(gauge)
Whether the cell has failed to pass its healthcheck against the garden backend. 0 signifies healthy and 1 signifies unhealthy.
shown as monitor
cloudfoundry.nozzle.route_emitter.ConsulDownMode
(gauge)

shown as
cloudfoundry.nozzle.route_emitter.LockHeld.v1_locks_route_emitter_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.route_emitter.LockHeldDuration.v1_locks_route_emitter_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.route_emitter.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.route_emitter.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.route_emitter.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.route_emitter.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.route_emitter.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.route_emitter.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.route_emitter.MessagesEmitted
(gauge)
The cumulative number of registration messages that this process has sent.
shown as message
cloudfoundry.nozzle.route_emitter.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.route_emitter.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.route_emitter.RouteEmitterSyncDuration
(gauge)
Time in nanoseconds that the active route-emitter took to perform its synchronization pass.
shown as nanosecond
cloudfoundry.nozzle.route_emitter.RoutesRegistered
(gauge)
Cumulative number of route registrations emitted from the route-emitter as it reacts to changes to LRPs.
shown as route
cloudfoundry.nozzle.route_emitter.RoutesSynced
(gauge)
Cumulative number of route registrations emitted from the route-emitter during its periodic route-table synchronization.
shown as route
cloudfoundry.nozzle.route_emitter.RoutesTotal
(gauge)
Number of routes in the route-emitter's routing table.
shown as route
cloudfoundry.nozzle.route_emitter.RoutesUnregistered
(gauge)
Cumulative number of route unregistrations emitted from the route-emitter as it reacts to changes to LRPs.
shown as route
cloudfoundry.nozzle.routing_api.key_refresh_events
(gauge)
Total number of events when fresh token was fetched from UAA.
shown as event
cloudfoundry.nozzle.routing_api.LockHeld.v1_locks_routing_api_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.routing_api.LockHeldDuration.v1_locks_routing_api_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.routing_api.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.routing_api.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.routing_api.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.routing_api.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.routing_api.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.routing_api.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.routing_api.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.routing_api.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.routing_api.total_http_routes
(gauge)

shown as
cloudfoundry.nozzle.routing_api.total_http_subscriptions
(gauge)

shown as
cloudfoundry.nozzle.routing_api.total_tcp_routes
(gauge)

shown as
cloudfoundry.nozzle.routing_api.total_tcp_subscriptions
(gauge)

shown as
cloudfoundry.nozzle.routing_api.total_token_errors
(gauge)

shown as
cloudfoundry.nozzle.slowConsumerAlert
(gauge)
If the nozzle is processing metrics too slow this is 1 otherwise 0
shown as monitor
cloudfoundry.nozzle.ssh_proxy.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.ssh_proxy.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.ssh_proxy.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.ssh_proxy.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.ssh_proxy.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.ssh_proxy.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.ssh_proxy.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.ssh_proxy.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.stager.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.stager.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.stager.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.stager.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.stager.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.stager.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.stager.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.stager.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.syslog_drain_binder.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.syslog_drain_binder.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.syslog_drain_binder.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.syslog_drain_binder.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.syslog_drain_binder.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.syslog_drain_binder.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.syslog_drain_binder.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.syslog_drain_binder.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.syslog_drain_binder.pollCount
(gauge)
Number of times the syslog drain binder has polled the cloud controller for syslog drain bindings
shown as event
cloudfoundry.nozzle.syslog_drain_binder.totalDrains
(gauge)
Number of syslog drains returned by cloud controller.
shown as resource
cloudfoundry.nozzle.tcp_emitter.LockHeld.v1_locks_tcp_emitter_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.tcp_emitter.LockHeldDuration.v1_locks_tcp_emitter_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.tcp_emitter.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.tcp_emitter.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tcp_emitter.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tcp_emitter.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.tcp_emitter.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.tcp_emitter.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.tcp_emitter.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.tcp_emitter.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.tcp_router.AverageConnectTimeMs
(gauge)
Average backend response time (in ms).
shown as millisecond
cloudfoundry.nozzle.tcp_router.AverageQueueTimeMs
(gauge)
Average time spent in queue (in ms).
shown as millisecond
cloudfoundry.nozzle.tcp_router.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.tcp_router.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tcp_router.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tcp_router.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.tcp_router.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.tcp_router.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.tcp_router.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.tcp_router.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.tcp_router.TotalBackendConnectionErrors
(gauge)
Total number of backend connection errors.
shown as error
cloudfoundry.nozzle.tcp_router.TotalCurrentQueuedRequests
(gauge)
otal number of requests unassigned in queue.
shown as request
cloudfoundry.nozzle.totalMessagesReceived
(gauge)
Total number of messages received by the nozzle
shown as message
cloudfoundry.nozzle.totalMetricsSent
(gauge)
Total number of metrics sent to Datadog by the nozzle
shown as message
cloudfoundry.nozzle.tps_listener.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.tps_listener.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tps_listener.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tps_listener.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.tps_listener.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.tps_listener.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.tps_listener.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.tps_listener.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.tps_watcher.LockHeld.v1_locks_tps_watcher_lock
(gauge)
0 means the lock is not held not held 1 means it is.
shown as monitor
cloudfoundry.nozzle.tps_watcher.LockHeldDuration.v1_locks_tps_watcher_lock
(gauge)
The time in nanoseconds that the lock has been held.
shown as nanosecond
cloudfoundry.nozzle.tps_watcher.memoryStats.lastGCPauseTimeNS
(gauge)
Last GC pause in NS
shown as nanosecond
cloudfoundry.nozzle.tps_watcher.memoryStats.numBytesAllocated
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tps_watcher.memoryStats.numBytesAllocatedHeap
(gauge)
Bytes allocated and not yet freed
shown as byte
cloudfoundry.nozzle.tps_watcher.memoryStats.numBytesAllocatedStack
(gauge)
Number of bytes in the stack
shown as byte
cloudfoundry.nozzle.tps_watcher.memoryStats.numFrees
(gauge)
Number of frees
shown as item
cloudfoundry.nozzle.tps_watcher.memoryStats.numMallocs
(gauge)
Number of mallocs
shown as item
cloudfoundry.nozzle.tps_watcher.numCPUS
(gauge)
Number of CPUs usable by current process
shown as cpu
cloudfoundry.nozzle.tps_watcher.numGoRoutines
(gauge)
Number of existing goroutines
shown as item
cloudfoundry.nozzle.uaa.audit_service.client_authentication_count
(gauge)
Number of successful client authentication attempts since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.client_authentication_failure_count
(gauge)
Number of failed client authentication attempts since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.principal_authentication_failure_count
(gauge)
Number of failed non-user authentication attempts since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.principal_not_found_count
(gauge)
Number of times non-user was not found since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.user_authentication_count
(gauge)
Number of successful authentications by the user since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.user_authentication_failure_count
(gauge)
Number of failed user authentication attempts since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.user_not_found_count
(gauge)
Number of times the user was not found since the last startup.
shown as event
cloudfoundry.nozzle.uaa.audit_service.user_password_changes
(gauge)
Number of successful password changes by the user since the last startups
shown as event
cloudfoundry.nozzle.uaa.audit_service.user_password_failures
(gauge)
Number of failed password changes by the user since the last startup.
shown as event
bosh.healthmonitor.system.healthy
(gauge)
The status—1 for up, 0 for down—of a job on a given node, tagged by job, e.g. 'job:api_1'.
shown as
bosh.healthmonitor.system.cpu.user
(gauge)
The user space CPU usage of a node.
shown as
bosh.healthmonitor.system.cpu.sys
(gauge)
The system CPU usage of a node.
shown as
bosh.healthmonitor.system.cpu.wait
(gauge)
The CPU wait for a node.
shown as
bosh.healthmonitor.system.load.1m
(gauge)
The one minute load average for a node.
shown as
bosh.healthmonitor.system.mem.percent
(gauge)
The percentage memory usage of a node.
shown as percent
bosh.healthmonitor.system.mem.kb
(gauge)
The memory usage of a node in KiB.
shown as kibibyte
bosh.healthmonitor.system.swap.percent
(gauge)
The percentage swap usage of a node.
shown as percent
bosh.healthmonitor.system.swap.kb
(gauge)
The swap usage of a node in KiB.
shown as kibibyte
bosh.healthmonitor.system.disk.system.percent
(gauge)
The percentage disk usage of a node's system disk.
shown as percent
bosh.healthmonitor.system.disk.system.inode_percent
(gauge)
The percentage inode usage of a node's system disk.
shown as percent
bosh.healthmonitor.system.disk.ephemeral.percent
(gauge)
The percentage disk usage of a node's ephemeral disk.
shown as percent
bosh.healthmonitor.system.disk.ephemeral.inode_percent
(gauge)
The percentage inode usage of a node's ephemeral disk.
shown as percent
bosh.healthmonitor.system.disk.persistent.percent
(gauge)
The percentage disk usage of a node's persistent disk.
shown as percent
bosh.healthmonitor.system.disk.persistent.inode_percent
(gauge)
The percentage inode usage of a node's persistent disk.
shown as percent