ElasticSearch
Dash が新機能を発表!インシデントマネジメント、Continuous Profiler など多数の機能が追加されました! Dash イベントで発表された新機能!

ElasticSearch

Agent Check Agentチェック

Supported OS: Linux Mac OS Windows

Elasitc search ダッシュボード

概要

Elasticsearch クラスターの健全性について、全体的なステータスから JVM のヒープ使用量まで、クラスター内のすべての情報を最新の状態で把握します。レプリカを回復したり、クラスターに容量を追加したり、構成を調整したりする必要があるときに通知を受けます。その後、クラスターメトリクスがどのように反応するかを追跡します。

Datadog Agent の Elasticsearch チェックは、検索とインデックス化のパフォーマンス、メモリ使用量とガベージコレクション、ノード可用性、シャード統計、ディスク容量とパフォーマンス、保留状態のタスクなど多数のメトリクスを収集します。Agent は、クラスターの全体的なステータスに関するイベントとサービスチェックも送信します。

セットアップ

インストール

Elasticsearch チェックは Datadog Agent パッケージに含まれています。追加のインストールは必要ありません。

コンフィギュレーション

ホスト

ホストで実行中の Agent に対してこのチェックを構成するには:

メトリクスの収集
  1. Elasticsearch のメトリクスを収集するには、Agent の構成ディレクトリのルートにある conf.d/ フォルダーの elastic.d/conf.yaml ファイルを編集します。使用可能なすべての構成オプションについては、サンプル elastic.d/conf.yaml を参照してください。

    init_config:
    
    instances:
      ## @param url - string - required
      ## The URL where Elasticsearch accepts HTTP requests. This is used to
      ## fetch statistics from the nodes and information about the cluster health.
      #
      - url: http://localhost:9200
    

    :

    • クラスターの外で実行されている 1 つの Datadog Agent からのみ Elasticsearch メトリクスを収集する場合は (ホステッド Elasticsearch を使用する場合など)、cluster_statstrue に設定します。

    • Agent レベルのタグは、Agent を実行していないクラスターのホストには適用されません。すべての メトリクスが一定のタグを持つようにするには、<integration>.d/conf.yaml でインテグレーションレベルのタグを使用します。

      init_config:
      instances:
        - url: "%%env_MONITOR_ES_HOST%%"
          username: "%%env_MONITOR_ES_USER%%"
          password: *********
          auth_type: basic
          cluster_stats: true
          tags:
          - service.name:elasticsearch
          - env:%%env_DD_ENV%%
      
    • AWS Elasticsearch サービスに Agent の Elasticsearch インテグレーションを使用するには、url パラメーターを AWS Elasticsearch stats の URL に設定します。

    • Amazon ES コンフィギュレーション API へのすべてのリクエストには、署名が必要です。詳細は、AWS ドキュメントを参照してください。

    • aws の認証タイプは、boto3 に依存して .aws/credentials から自動的に AWS 認証情報を収集します。conf.yamlauth_type: basic を使用して、認証情報を username: <USERNAME>password: <PASSWORD> で定義します。

  2. Agent を再起動します

トレースの収集

Datadog APM は、Elasticsearch と統合して分散システム全体のトレースを確認します。Datadog Agent v6 以降では、トレースの収集はデフォルトで有効化されています。トレースの収集を開始するには、以下の手順に従います。

  1. Datadog でトレースの収集を有効にします
  2. ElasticSearch へのリクエストを作成するアプリケーションをインスツルメントします
ログの収集

Agent バージョン 6.0 以降で利用可能

  1. Datadog Agent で、ログの収集はデフォルトで無効になっています。以下のように、datadog.yaml ファイルでこれを有効にします。

    logs_enabled: true
    
  2. 検索スローログを収集してスローログのインデックスを作成するには、Elasticsearch 設定を構成します。デフォルトでは、スローログは有効になっていません。

    • 特定のインデックス <インデックス> のインデックススローログを構成するには

      curl -X PUT "localhost:9200/<INDEX>/_settings?pretty" -H 'Content-Type: application/json' -d' {
        "index.indexing.slowlog.threshold.index.warn": "0ms",
        "index.indexing.slowlog.threshold.index.info": "0ms",
        "index.indexing.slowlog.threshold.index.debug": "0ms",
        "index.indexing.slowlog.threshold.index.trace": "0ms",
        "index.indexing.slowlog.level": "trace",
        "index.indexing.slowlog.source": "1000"
      }
      
    • 特定のインデックス <インデックス> の検索スローログを構成するには

      curl -X PUT "localhost:9200/<INDEX>/_settings?pretty" -H 'Content-Type: application/json' -d' {
        "index.search.slowlog.threshold.query.warn": "0ms",
        "index.search.slowlog.threshold.query.info": "0ms",
        "index.search.slowlog.threshold.query.debug": "0ms",
        "index.search.slowlog.threshold.query.trace": "0ms",
        "index.search.slowlog.threshold.fetch.warn": "0ms",
        "index.search.slowlog.threshold.fetch.info": "0ms",
        "index.search.slowlog.threshold.fetch.debug": "0ms",
        "index.search.slowlog.threshold.fetch.trace": "0ms"
      }
      
  3. Elasticsearch のログの収集を開始するには、次の構成ブロックを elastic.d/conf.yaml ファイルに追加します。

    logs:
      - type: file
        path: /var/log/elasticsearch/*.log
        source: elasticsearch
        service: "<SERVICE_NAME>"
    
    • インスタンスを追加して、スローログの収集を開始します。

      - type: file
        path: "/var/log/elasticsearch/\
              <CLUSTER_NAME>_index_indexing_slowlog.log"
        source: elasticsearch
        service: "<SERVICE_NAME>"
      
      - type: file
        path: "/var/log/elasticsearch/\
              <CLUSTER_NAME>_index_search_slowlog.log"
        source: elasticsearch
        service: "<SERVICE_NAME>"
      

      path パラメーターと service パラメーターの値を変更し、環境に合わせて構成してください。

  4. Agent を再起動します

コンテナ化

コンテナ環境の場合は、オートディスカバリーのインテグレーションテンプレートのガイドを参照して、次のパラメーターを適用してください。

メトリクスの収集
パラメーター
<インテグレーション名>elastic
<初期コンフィギュレーション>空白または {}
<インスタンスコンフィギュレーション>{"url": "https://%%host%%:9200"}
トレースの収集

コンテナ化されたアプリケーションの APM は、Agent v6 以降を実行するホストでサポートされていますが、トレースの収集を開始するには、追加のコンフィギュレーションが必要です。

Agent コンテナで必要な環境変数

パラメーター
<DD_API_KEY>api_key
<DD_APM_ENABLED>true
<DD_APM_NON_LOCAL_TRAFFIC>true

利用可能な環境変数とコンフィギュレーションの完全なリストについては、Kubernetes アプリケーションのトレースおよび Kubernetes Daemon のセットアップを参照してください。

次に、アプリケーションコンテナをインスツルメントし、Agent コンテナの名前に DD_AGENT_HOST を設定します。

ログの収集

Agent バージョン 6.0 以降で利用可能

Datadog Agent で、ログの収集はデフォルトで無効になっています。有効にする方法については、Kubernetes ログ収集のドキュメントを参照してください。

パラメーター
<LOG_CONFIG>{"source": "elasticsearch", "service": "<サービス名>"}

検証

Agent の status サブコマンドを実行し、Checks セクションで elastic を探します。

収集データ

デフォルトでは、次のすべてのメトリクスが Agent によって送信されるわけではありません。すべてのメトリクスを送信するには、上述のように elastic.yaml でフラグを構成します。

  • pshard_stats は、elasticsearch.primaries.* および elasticsearch.indices.count メトリクスを送信します。
  • index_stats は、elasticsearch.index.* メトリクスを送信します。
  • pending_task_stats は、elasticsearch.pending_* メトリクスを送信します。

バージョン 6.3.0 以降で、すべての elasticsearch.thread_pool.write.* メトリクスを収集するには、Elasticsearch 構成で xpack.monitoring.collection.enabled 構成を true に設定します。Elasticsearch のリリースノートで Monitoring のセクションを参照してください。

メトリクス

elasticsearch.active_primary_shards
(gauge)
The number of active primary shards in the cluster.
Shown as shard
elasticsearch.active_shards
(gauge)
The number of active shards in the cluster.
Shown as shard
elasticsearch.breakers.fielddata.estimated_size_in_bytes
(gauge)
The estimated size in bytes of the field data circuit breaker.
Shown as byte
elasticsearch.breakers.fielddata.overhead
(gauge)
The constant multiplier for byte estimations of the field data circuit breaker.
elasticsearch.breakers.fielddata.tripped
(gauge)
The number of times the field data circuit breaker has tripped.
elasticsearch.breakers.parent.estimated_size_in_bytes
(gauge)
The estimated size in bytes of the parent circuit breaker.
Shown as byte
elasticsearch.breakers.parent.overhead
(gauge)
The constant multiplier for byte estimations of the parent circuit breaker.
elasticsearch.breakers.parent.tripped
(gauge)
The number of times the parent circuit breaker has tripped.
elasticsearch.breakers.request.estimated_size_in_bytes
(gauge)
The estimated size in bytes of the request circuit breaker.
Shown as byte
elasticsearch.breakers.request.overhead
(gauge)
The constant multiplier for byte estimations of the request circuit breaker.
elasticsearch.breakers.request.tripped
(gauge)
The number of times the request circuit breaker has tripped.
elasticsearch.breakers.inflight_requests.tripped
(gauge)
The number of times the inflight circuit breaker has tripped.
elasticsearch.breakers.inflight_requests.overhead
(gauge)
The constant multiplier for byte estimations of the inflight circuit breaker.
elasticsearch.breakers.inflight_requests.estimated_size_in_bytes
(gauge)
The estimated size in bytes of the inflight circuit breaker.
Shown as byte
elasticsearch.cache.field.evictions
(gauge)
The total number of evictions from the field data cache.
Shown as eviction
elasticsearch.cache.field.size
(gauge)
The size of the field cache.
Shown as byte
elasticsearch.cache.filter.count
(gauge)
The number of items in the filter cache.
Shown as item
elasticsearch.cache.filter.evictions
(gauge)
The total number of evictions from the filter cache.
Shown as eviction
elasticsearch.cache.filter.size
(gauge)
The size of the filter cache.
Shown as byte
elasticsearch.cluster_status
(gauge)
The elasticsearch cluster health as a number: red = 0, yellow = 1, green = 2
elasticsearch.docs.count
(gauge)
The total number of documents in the cluster across all shards.
Shown as document
elasticsearch.docs.deleted
(gauge)
The total number of documents deleted from the cluster across all shards.
Shown as document
elasticsearch.fielddata.evictions
(gauge)
The total number of evictions from the fielddata cache.
Shown as eviction
elasticsearch.fielddata.size
(gauge)
The size of the fielddata cache.
Shown as byte
elasticsearch.flush.total
(gauge)
The total number of index flushes to disk since start.
Shown as flush
elasticsearch.flush.total.time
(gauge)
The total time spent flushing the index to disk.
Shown as second
elasticsearch.fs.total.available_in_bytes
(gauge)
The total number of bytes available to this Java virtual machine on this file store.
Shown as byte
elasticsearch.fs.total.disk_io_op
(gauge)
The total I/O operations on the file store.
Shown as operation
elasticsearch.fs.total.disk_io_size_in_bytes
(gauge)
Total bytes used for all I/O operations on the file store.
Shown as byte
elasticsearch.fs.total.disk_read_size_in_bytes
(gauge)
The total bytes read from the file store.
Shown as byte
elasticsearch.fs.total.disk_reads
(gauge)
The total number of reads from the file store.
Shown as read
elasticsearch.fs.total.disk_write_size_in_bytes
(gauge)
The total bytes written to the file store.
Shown as byte
elasticsearch.fs.total.disk_writes
(gauge)
The total number of writes to the file store.
Shown as write
elasticsearch.fs.total.free_in_bytes
(gauge)
The total number of unallocated bytes in the file store.
Shown as byte
elasticsearch.fs.total.total_in_bytes
(gauge)
The total size in bytes of the file store.
Shown as byte
elasticsearch.get.current
(gauge)
The number of get requests currently running.
Shown as request
elasticsearch.get.exists.time
(gauge)
The total time spent on get requests where the document existed.
Shown as second
elasticsearch.get.exists.total
(gauge)
The total number of get requests where the document existed.
Shown as request
elasticsearch.get.missing.time
(gauge)
The total time spent on get requests where the document was missing.
Shown as second
elasticsearch.get.missing.total
(gauge)
The total number of get requests where the document was missing.
Shown as request
elasticsearch.get.time
(gauge)
The total time spent on get requests.
Shown as second
elasticsearch.get.total
(gauge)
The total number of get requests.
Shown as request
elasticsearch.http.current_open
(gauge)
The number of current open HTTP connections.
Shown as connection
elasticsearch.http.total_opened
(gauge)
The total number of opened HTTP connections.
Shown as connection
elasticsearch.id_cache.size
(gauge)
The size of the id cache
Shown as byte
elasticsearch.indexing.delete.current
(gauge)
The number of documents currently being deleted from an index.
Shown as document
elasticsearch.indexing.delete.time
(gauge)
The total time spent deleting documents from an index.
Shown as second
elasticsearch.indexing.delete.total
(gauge)
The total number of documents deleted from an index.
Shown as document
elasticsearch.indexing.index.current
(gauge)
The number of documents currently being indexed to an index.
Shown as document
elasticsearch.indexing.index.time
(gauge)
The total time spent indexing documents to an index.
Shown as second
elasticsearch.indexing.index.total
(gauge)
The total number of documents indexed to an index.
Shown as document
elasticsearch.indices.count
(gauge)
The number of indices in the cluster.
Shown as index
elasticsearch.indices.indexing.index_failed
(gauge)
The number of failed indexing operations.
elasticsearch.indices.indexing.throttle_time
(gauge)
The total time indexing waited due to throttling.
Shown as millisecond
elasticsearch.indices.query_cache.evictions
(gauge)
The number of query cache evictions.
Shown as eviction
elasticsearch.indices.query_cache.hit_count
(gauge)
The number of query cache hits.
Shown as hit
elasticsearch.indices.query_cache.memory_size_in_bytes
(gauge)
The memory used by the query cache.
Shown as byte
elasticsearch.indices.query_cache.miss_count
(gauge)
The number of query cache misses.
Shown as miss
elasticsearch.indices.recovery.current_as_source
(gauge)
The number of ongoing recoveries for which a shard serves as a source.
elasticsearch.indices.recovery.current_as_target
(gauge)
The number of ongoing recoveries for which a shard serves as a target.
elasticsearch.indices.recovery.throttle_time
(gauge)
The total time recoveries waited due to throttling.
Shown as millisecond
elasticsearch.indices.request_cache.evictions
(gauge)
The number of request cache evictions.
Shown as eviction
elasticsearch.indices.request_cache.hit_count
(gauge)
The number of request cache hits.
Shown as hit
elasticsearch.indices.request_cache.memory_size_in_bytes
(gauge)
The memory used by the request cache.
Shown as byte
elasticsearch.indices.request_cache.miss_count
(gauge)
The number of request cache misses.
Shown as miss
elasticsearch.indices.segments.count
(gauge)
The number of segments in an index shard.
Shown as segment
elasticsearch.indices.segments.doc_values_memory_in_bytes
(gauge)
The memory used by doc values.
Shown as byte
elasticsearch.indices.segments.fixed_bit_set_memory_in_bytes
(gauge)
The memory used by fixed bit set.
Shown as byte
elasticsearch.indices.segments.index_writer_max_memory_in_bytes
(gauge)
The maximum memory used by the index writer.
Shown as byte
elasticsearch.indices.segments.index_writer_memory_in_bytes
(gauge)
The memory used by the index writer.
Shown as byte
elasticsearch.indices.segments.memory_in_bytes
(gauge)
The memory used by index segments.
Shown as byte
elasticsearch.indices.segments.norms_memory_in_bytes
(gauge)
The memory used by norms.
Shown as byte
elasticsearch.indices.segments.stored_fields_memory_in_bytes
(gauge)
The memory used by stored fields.
Shown as byte
elasticsearch.indices.segments.term_vectors_memory_in_bytes
(gauge)
The memory used by term vectors.
Shown as byte
elasticsearch.indices.segments.terms_memory_in_bytes
(gauge)
The memory used by terms.
Shown as byte
elasticsearch.indices.segments.version_map_memory_in_bytes
(gauge)
The memory used by the segment version map.
Shown as byte
elasticsearch.indices.translog.operations
(gauge)
The number of operations in the transaction log.
Shown as operation
elasticsearch.indices.translog.size_in_bytes
(gauge)
The size of the transaction log.
Shown as byte
elasticsearch.initializing_shards
(gauge)
The number of shards that are currently initializing.
Shown as shard
elasticsearch.merges.current
(gauge)
The number of currently active segment merges.
Shown as merge
elasticsearch.merges.current.docs
(gauge)
The number of documents across segments currently being merged.
Shown as document
elasticsearch.merges.current.size
(gauge)
The size of the segments currently being merged.
Shown as byte
elasticsearch.merges.total
(gauge)
The total number of segment merges.
Shown as merge
elasticsearch.merges.total.docs
(gauge)
The total number of documents across all merged segments.
Shown as document
elasticsearch.merges.total.size
(gauge)
The total size of all merged segments.
Shown as byte
elasticsearch.merges.total.time
(gauge)
The total time spent on segment merging.
Shown as second
elasticsearch.number_of_data_nodes
(gauge)
The number of data nodes in the cluster.
Shown as node
elasticsearch.number_of_nodes
(gauge)
The total number of nodes in the cluster.
Shown as node
elasticsearch.pending_tasks_priority_high
(gauge)
The number of high priority pending tasks.
Shown as task
elasticsearch.pending_tasks_priority_urgent
(gauge)
The number of urgent priority pending tasks.
Shown as task
elasticsearch.pending_tasks_time_in_queue
(gauge)
The average time spent by tasks in the queue.
Shown as millisecond
elasticsearch.pending_tasks_total
(gauge)
The total number of pending tasks.
Shown as task
elasticsearch.primaries.docs.count
(gauge)
The total number of documents in the primary shards.
Shown as document
elasticsearch.primaries.docs.deleted
(gauge)
The total number of documents deleted from the primary shards.
Shown as document
elasticsearch.primaries.flush.total
(gauge)
The total number of index flushes to disk from the primary shards since start.
Shown as flush
elasticsearch.primaries.flush.total.time
(gauge)
The total time spent flushing the index to disk from the primary shards.
Shown as second
elasticsearch.primaries.get.current
(gauge)
The number of get requests currently running on the primary shards.
Shown as request
elasticsearch.primaries.get.exists.time
(gauge)
The total time spent on get requests from the primary shards where the document existed.
Shown as request
elasticsearch.primaries.get.exists.total
(gauge)
The total number of get requests on primary shards where the document existed.
Shown as request
elasticsearch.primaries.get.missing.time
(gauge)
The total time spent on get requests from the primary shards where the document was missing.
Shown as second
elasticsearch.primaries.get.missing.total
(gauge)
The total number of get requests from the primary shards where the document was missing.
Shown as request
elasticsearch.primaries.get.time
(gauge)
The total time spent on get requests from the primary shards.
Shown as second
elasticsearch.primaries.get.total
(gauge)
The total number of get requests from the primary shards.
Shown as request
elasticsearch.primaries.indexing.delete.current
(gauge)
The number of documents currently being deleted from an index on the primary shards.
Shown as document
elasticsearch.primaries.indexing.delete.time
(gauge)
The total time spent deleting documents from an index on the primary shards.
Shown as second
elasticsearch.primaries.indexing.delete.total
(gauge)
The total number of documents deleted from an index on the primary shards.
Shown as document
elasticsearch.primaries.indexing.index.current
(gauge)
The number of documents currently being indexed to an index on the primary shards.
Shown as document
elasticsearch.primaries.indexing.index.time
(gauge)
The total time spent indexing documents to an index on the primary shards.
Shown as second
elasticsearch.primaries.indexing.index.total
(gauge)
The total number of documents indexed to an index on the primary shards.
Shown as document
elasticsearch.primaries.merges.current
(gauge)
The number of currently active segment merges on the primary shards.
Shown as merge
elasticsearch.primaries.merges.current.docs
(gauge)
The number of documents across segments currently being merged on the primary shards.
Shown as document
elasticsearch.primaries.merges.current.size
(gauge)
The size of the segments currently being merged on the primary shards.
Shown as byte
elasticsearch.primaries.merges.total
(gauge)
The total number of segment merges on the primary shards.
Shown as merge
elasticsearch.primaries.merges.total.docs
(gauge)
The total number of documents across all merged segments on the primary shards.
Shown as document
elasticsearch.primaries.merges.total.size
(gauge)
The total size of all merged segments on the primary shards.
Shown as byte
elasticsearch.primaries.merges.total.time
(gauge)
The total time spent on segment merging on the primary shards.
Shown as second
elasticsearch.primaries.refresh.total
(gauge)
The total number of index refreshes on the primary shards.
Shown as refresh
elasticsearch.primaries.refresh.total.time
(gauge)
The total time spent on index refreshes on the primary shards.
Shown as second
elasticsearch.primaries.refresh.external_total
(gauge)
The total number of external index refreshes on the primary shards.
Shown as refresh
elasticsearch.primaries.refresh.external_total.time
(gauge)
The total time spent on external index refreshes on the primary shards.
Shown as second
elasticsearch.primaries.search.fetch.current
(gauge)
The number of query fetches currently running on the primary shards.
Shown as fetch
elasticsearch.primaries.search.fetch.time
(gauge)
The total time spent on query fetches on the primary shards.
Shown as second
elasticsearch.primaries.search.fetch.total
(gauge)
The total number of query fetches on the primary shards.
Shown as fetch
elasticsearch.primaries.search.query.current
(gauge)
The number of currently active queries on the primary shards.
Shown as query
elasticsearch.primaries.search.query.time
(gauge)
The total time spent querying on the primary shards.
Shown as second
elasticsearch.primaries.search.query.total
(gauge)
The total number of queries to the primary shards.
Shown as query
elasticsearch.primaries.store.size
(gauge)
The total size of all the primary shards.
Shown as byte
elasticsearch.process.open_fd
(gauge)
The number of opened file descriptors associated with the current process, or -1 if not supported.
Shown as file
elasticsearch.refresh.total
(gauge)
The total number of index refreshes.
Shown as refresh
elasticsearch.refresh.total.time
(gauge)
The total time spent on index refreshes.
Shown as second
elasticsearch.refresh.external_total
(gauge)
The total number of external index refreshes.
Shown as refresh
elasticsearch.refresh.external_total.time
(gauge)
The total time spent on external index refreshes.
Shown as second
elasticsearch.relocating_shards
(gauge)
The number of shards that are relocating from one node to another.
Shown as shard
elasticsearch.search.fetch.current
(gauge)
The number of search fetches currently running.
Shown as fetch
elasticsearch.search.fetch.open_contexts
(gauge)
The number of active searches.
Shown as query
elasticsearch.search.fetch.time
(gauge)
The total time spent on the search fetch.
Shown as second
elasticsearch.search.fetch.total
(gauge)
The total number of search fetches.
Shown as fetch
elasticsearch.search.query.current
(gauge)
The number of currently active queries.
Shown as query
elasticsearch.search.query.time
(gauge)
The total time spent on queries.
Shown as second
elasticsearch.search.query.total
(gauge)
The total number of queries.
Shown as query
elasticsearch.search.scroll.current
(gauge)
The number of currently active scroll queries.
Shown as query
elasticsearch.search.scroll.time
(gauge)
The total time spent on scroll queries.
Shown as second
elasticsearch.search.scroll.total
(gauge)
The total number of scroll queries.
Shown as query
elasticsearch.store.size
(gauge)
The total size in bytes of the store.
Shown as byte
elasticsearch.thread_pool.bulk.active
(gauge)
The number of active threads in the bulk pool.
Shown as thread
elasticsearch.thread_pool.bulk.queue
(gauge)
The number of queued threads in the bulk pool.
Shown as thread
elasticsearch.thread_pool.bulk.threads
(gauge)
The total number of threads in the bulk pool.
Shown as thread
elasticsearch.thread_pool.bulk.rejected
(gauge)
The number of rejected threads in the bulk pool.
Shown as thread
elasticsearch.thread_pool.bulk.completed
(gauge)
The number of completed threads in the bulk pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_started.active
(gauge)
The number of active threads in the fetch shard started pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_started.threads
(gauge)
The total number of threads in the fetch shard started pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_started.queue
(gauge)
The number of queued threads in the fetch shard started pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_started.rejected
(gauge)
The number of rejected threads in the fetch shard started pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_store.active
(gauge)
The number of active threads in the fetch shard store pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_store.threads
(gauge)
The total number of threads in the fetch shard store pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_store.queue
(gauge)
The number of queued threads in the fetch shard store pool.
Shown as thread
elasticsearch.thread_pool.fetch_shard_store.rejected
(gauge)
The number of rejected threads in the fetch shard store pool.
Shown as thread
elasticsearch.thread_pool.flush.active
(gauge)
The number of active threads in the flush queue.
Shown as thread
elasticsearch.thread_pool.flush.queue
(gauge)
The number of queued threads in the flush pool.
Shown as thread
elasticsearch.thread_pool.flush.threads
(gauge)
The total number of threads in the flush pool.
Shown as thread
elasticsearch.thread_pool.flush.rejected
(gauge)
The number of rejected threads in the flush pool.
Shown as thread
elasticsearch.thread_pool.flush.completed
(gauge)
The number of completed threads in the flush pool.
Shown as thread
elasticsearch.thread_pool.force_merge.active
(gauge)
The number of active threads for force merge operations.
Shown as thread
elasticsearch.thread_pool.force_merge.threads
(gauge)
The total number of threads for force merge operations.
Shown as thread
elasticsearch.thread_pool.force_merge.queue
(gauge)
The number of queued threads for force merge operations.
Shown as thread
elasticsearch.thread_pool.force_merge.rejected
(gauge)
The number of rejected threads for force merge operations.
Shown as thread
elasticsearch.thread_pool.generic.active
(gauge)
The number of active threads in the generic pool.
Shown as thread
elasticsearch.thread_pool.generic.queue
(gauge)
The number of queued threads in the generic pool.
Shown as thread
elasticsearch.thread_pool.generic.threads
(gauge)
The total number of threads in the generic pool.
Shown as thread
elasticsearch.thread_pool.generic.rejected
(gauge)
The number of rejected threads in the generic pool.
Shown as thread
elasticsearch.thread_pool.generic.completed
(gauge)
The number of completed threads in the generic pool.
Shown as thread
elasticsearch.thread_pool.get.active
(gauge)
The number of active threads in the get pool.
Shown as thread
elasticsearch.thread_pool.get.queue
(gauge)
The number of queued threads in the get pool.
Shown as thread
elasticsearch.thread_pool.get.threads
(gauge)
The total number of threads in the get pool.
Shown as thread
elasticsearch.thread_pool.get.rejected
(gauge)
The number of rejected threads in the get pool.
Shown as thread
elasticsearch.thread_pool.get.completed
(gauge)
The number of completed threads in the get pool.
Shown as thread
elasticsearch.thread_pool.index.active
(gauge)
The number of active threads in the index pool.
Shown as thread
elasticsearch.thread_pool.index.queue
(gauge)
The number of queued threads in the index pool.
Shown as thread
elasticsearch.thread_pool.index.threads
(gauge)
The total number of threads in the index pool.
Shown as thread
elasticsearch.thread_pool.index.rejected
(gauge)
The number of rejected threads in the index pool.
Shown as thread
elasticsearch.thread_pool.index.completed
(gauge)
The number of completed threads in the index pool.
Shown as thread
elasticsearch.thread_pool.listener.active
(gauge)
The number of active threads in the listener pool.
Shown as thread
elasticsearch.thread_pool.listener.queue
(gauge)
The number of queued threads in the listener pool.
Shown as thread
elasticsearch.thread_pool.listener.threads
(gauge)
The total number of threads in the listener pool.
Shown as thread
elasticsearch.thread_pool.listener.rejected
(gauge)
The number of rejected threads in the listener pool.
Shown as thread
elasticsearch.thread_pool.listener.completed
(gauge)
The number of completed threads in the listener pool.
Shown as thread
elasticsearch.thread_pool.management.active
(gauge)
The number of active threads in the management pool.
Shown as thread
elasticsearch.thread_pool.management.queue
(gauge)
The number of queued threads in the management pool.
Shown as thread
elasticsearch.thread_pool.management.threads
(gauge)
The total number of threads in the management pool.
Shown as thread
elasticsearch.thread_pool.management.rejected
(gauge)
The number of rejected threads in the management pool.
Shown as thread
elasticsearch.thread_pool.management.completed
(gauge)
The number of completed threads in the management pool.
Shown as thread
elasticsearch.thread_pool.merge.active
(gauge)
The number of active threads in the merge pool.
Shown as thread
elasticsearch.thread_pool.merge.queue
(gauge)
The number of queued threads in the merge pool.
Shown as thread
elasticsearch.thread_pool.merge.threads
(gauge)
The total number of threads in the merge pool.
Shown as thread
elasticsearch.thread_pool.merge.rejected
(gauge)
The number of rejected threads in the merge pool.
Shown as thread
elasticsearch.thread_pool.percolate.active
(gauge)
The number of active threads in the percolate pool.
Shown as thread
elasticsearch.thread_pool.percolate.queue
(gauge)
The number of queued threads in the percolate pool.
Shown as thread
elasticsearch.thread_pool.percolate.threads
(gauge)
The total number of threads in the percolate pool.
Shown as thread
elasticsearch.thread_pool.percolate.rejected
(gauge)
The number of rejected threads in the percolate pool.
Shown as thread
elasticsearch.thread_pool.refresh.active
(gauge)
The number of active threads in the refresh pool.
Shown as thread
elasticsearch.thread_pool.refresh.queue
(gauge)
The number of queued threads in the refresh pool.
Shown as thread
elasticsearch.thread_pool.refresh.threads
(gauge)
The total number of threads in the refresh pool.
Shown as thread
elasticsearch.thread_pool.refresh.rejected
(gauge)
The number of rejected threads in the refresh pool.
Shown as thread
elasticsearch.thread_pool.refresh.completed
(gauge)
The number of completed threads in the refresh pool.
Shown as thread
elasticsearch.thread_pool.search.active
(gauge)
The number of active threads in the search pool.
Shown as thread
elasticsearch.thread_pool.search.queue
(gauge)
The number of queued threads in the search pool.
Shown as thread
elasticsearch.thread_pool.search.threads
(gauge)
The total number of threads in the search pool.
Shown as thread
elasticsearch.thread_pool.search.rejected
(gauge)
The number of rejected threads in the search pool.
Shown as thread
elasticsearch.thread_pool.search.completed
(gauge)
The number of completed threads in the search pool.
Shown as thread
elasticsearch.thread_pool.snapshot.active
(gauge)
The number of active threads in the snapshot pool.
Shown as thread
elasticsearch.thread_pool.snapshot.queue
(gauge)
The number of queued threads in the snapshot pool.
Shown as thread
elasticsearch.thread_pool.snapshot.threads
(gauge)
The total number of threads in the snapshot pool.
Shown as thread
elasticsearch.thread_pool.snapshot.rejected
(gauge)
The number of rejected threads in the snapshot pool.
Shown as thread
elasticsearch.thread_pool.snapshot.completed
(gauge)
The number of completed threads in the snapshot pool.
Shown as thread
elasticsearch.thread_pool.write.active
(gauge)
The number of active threads in the write pool.
Shown as thread
elasticsearch.thread_pool.write.queue
(gauge)
The number of queued threads in the write pool.
Shown as thread
elasticsearch.thread_pool.write.threads
(gauge)
The total number of threads in the write pool.
Shown as thread
elasticsearch.thread_pool.write.rejected
(gauge)
The number of rejected threads in the write pool.
Shown as thread
elasticsearch.thread_pool.write.completed
(gauge)
The number of completed threads in the write pool.
Shown as thread
elasticsearch.transport.rx_count
(gauge)
The total number of packets received in cluster communication.
Shown as packet
elasticsearch.transport.rx_size
(gauge)
The total size of data received in cluster communication.
Shown as byte
elasticsearch.transport.server_open
(gauge)
The number of connections opened for cluster communication.
Shown as connection
elasticsearch.transport.tx_count
(gauge)
The total number of packets sent in cluster communication.
Shown as packet
elasticsearch.transport.tx_size
(gauge)
The total size of data sent in cluster communication.
Shown as byte
elasticsearch.unassigned_shards
(gauge)
The number of shards that are unassigned to a node.
Shown as shard
elasticsearch.delayed_unassigned_shards
(gauge)
The number of shards whose allocation has been delayed.
Shown as shard
jvm.gc.collection_count
(gauge)
The total number of garbage collections run by the JVM.
Shown as garbage collection
jvm.gc.collection_time
(gauge)
The total time spent on garbage collection in the JVM.
Shown as second
jvm.gc.collectors.old.collection_time
(gauge)
The total time spent in major GCs in the JVM that collect old generation objects.
Shown as second
jvm.gc.collectors.old.count
(gauge)
The total count of major GCs in the JVM that collect old generation objects.
Shown as garbage collection
jvm.gc.collectors.young.collection_time
(gauge)
The total time spent in minor GCs in the JVM that collects young generation objects.
Shown as second
jvm.gc.collectors.young.count
(gauge)
The total count of minor GCs in the JVM that collects young generation objects.
Shown as garbage collection
jvm.gc.concurrent_mark_sweep.collection_time
(gauge)
The total time spent on "concurrent mark & sweep" GCs in the JVM.
Shown as second
jvm.gc.concurrent_mark_sweep.count
(gauge)
The total count of "concurrent mark & sweep" GCs in the JVM.
Shown as garbage collection
jvm.gc.par_new.collection_time
(gauge)
The total time spent on "parallel new" GCs in the JVM.
Shown as second
jvm.gc.par_new.count
(gauge)
The total count of "parallel new" GCs in the JVM.
Shown as garbage collection
jvm.mem.heap_committed
(gauge)
The amount of memory guaranteed to be available to the JVM heap.
Shown as byte
jvm.mem.heap_in_use
(gauge)
The amount of memory currently used by the JVM heap as a value between 0 and 1.
jvm.mem.heap_max
(gauge)
The maximum amount of memory that can be used by the JVM heap.
Shown as byte
jvm.mem.heap_used
(gauge)
The amount of memory in bytes currently used by the JVM heap.
Shown as byte
jvm.mem.non_heap_committed
(gauge)
The amount of memory guaranteed to be available to JVM non-heap.
Shown as byte
jvm.mem.non_heap_used
(gauge)
The amount of memory in bytes currently used by the JVM non-heap.
Shown as byte
jvm.mem.pools.young.used
(gauge)
The amount of memory in bytes currently used by the Young Generation heap region.
Shown as byte
jvm.mem.pools.young.max
(gauge)
The maximum amount of memory that can be used by the Young Generation heap region.
Shown as byte
jvm.mem.pools.old.used
(gauge)
The amount of memory in bytes currently used by the Old Generation heap region.
Shown as byte
jvm.mem.pools.old.max
(gauge)
The maximum amount of memory that can be used by the Old Generation heap region.
Shown as byte
jvm.mem.pools.survivor.used
(gauge)
The amount of memory in bytes currently used by the Survivor Space.
Shown as byte
jvm.mem.pools.survivor.max
(gauge)
The maximum amount of memory that can be used by the Survivor Space.
Shown as byte
jvm.threads.count
(gauge)
The number of active threads in the JVM.
Shown as thread
jvm.threads.peak_count
(gauge)
The peak number of threads used by the JVM.
Shown as thread
elasticsearch.index.health
(gauge)
The status of the index
elasticsearch.index.docs.count
(gauge)
The number of documents in the index
Shown as document
elasticsearch.index.docs.deleted
(gauge)
The number of deleted documents in the index
Shown as document
elasticsearch.index.primary_shards
(gauge)
The number of primary shards in the index
Shown as shard
elasticsearch.index.replica_shards
(gauge)
The number of replica shards in the index
Shown as shard
elasticsearch.index.primary_store_size
(gauge)
The store size of primary shards in the index
Shown as byte
elasticsearch.index.store_size
(gauge)
The store size of primary and replica shards in the index
Shown as byte

イベント

Elasticsearch チェックは、Elasticsearch クラスターの全体的なステータスが赤、黄、緑に変化するたびに、Datadog にイベントを送信します。

サービスチェック

elasticsearch.cluster_health:

クラスターステータスが緑色の場合は OK、黄色の場合は Warn、その他の場合は Critical を返します。

elasticsearch.can_connect:

Agent が Elasticsearch に接続してメトリクスを収集できない場合は、Critical を返します。

トラブルシューティング

その他の参考資料

Elasticsearch クラスターを Datadog と統合する方法 (または理由) について理解するには、Datadog のブログ記事を参照してください。