Storm
セキュリティモニタリングが使用可能です セキュリティモニタリングが使用可能です

Storm

Supported OS: Linux Mac OS Windows

概要

Storm サービスからリアルタイムにメトリクスを取得して、以下のことができます。

  • Storm のクラスターメトリクスとトポロジーメトリクスを視覚化して監視できます。
  • Storm のフェイルオーバーとイベントの通知を受けることができます。

セットアップ

Storm チェックは Datadog Agent パッケージに含まれていません

インストール

Agent v6.8 以降を使用している場合は、以下の手順に従って、ホストに Storm チェックをインストールしてください。バージョン 6.8 以前の Agent または Docker Agent でチェックをインストールする場合は、コミュニティインテグレーションのインストールに関する Agent のガイドを参照してください。

  1. 開発ツールキットをインストールします。
  2. integrations-extras リポジトリを複製します。

    git clone https://github.com/DataDog/integrations-extras.git.
  3. ddev 構成を integrations-extras/ パスで更新します。

    ddev config set extras ./integrations-extras
  4. storm パッケージをビルドします。

    ddev -e release build storm
  5. Datadog Agent のダウンロードと起動

  6. 次のコマンドを実行して、Agent でインテグレーション Wheel をインストールします。

    datadog-agent integration install -w <PATH_OF_STORM_ARTIFACT_>/<STORM_ARTIFACT_NAME>.whl
  7. 他のパッケージ化されたインテグレーションと同様にインテグレーションを構成します。

コンフィグレーション

  1. Storm のメトリクス を収集するには、Agent の構成ディレクトリのルートにある conf.d/ フォルダーの storm.d/conf.yaml ファイルを編集します。使用可能なすべての構成オプションについては、サンプル storm.d/conf.yaml を参照してください。

  2. Agent を再起動します

検証

Agent の status サブコマンドを実行し、Checks セクションで storm を探します。

収集データ

メトリクス

storm.bolt.last_60.acked
(gauge)
Number of Acked Tuples
Shown as sample
storm.bolt.last_60.capacity
(gauge)
Bolt Capacity
Shown as fraction
storm.bolt.last_60.emitted
(gauge)
Number of Emitted Tuples
Shown as sample
storm.bolt.last_60.errorLapsedSecs
(gauge)
Number of Seconds Since Last Error
Shown as second
storm.bolt.last_60.executed
(gauge)
Number of Tuples Executed
Shown as sample
storm.bolt.last_60.executeLatency
(gauge)
Bolt Execute Latency
Shown as millisecond
storm.bolt.last_60.executors
(gauge)
Number of Bolt Executors
Shown as thread
storm.bolt.last_60.failed
(gauge)
Number of Failed Tuples
Shown as sample
storm.bolt.last_60.processLatency
(gauge)
Bolt Process Latency
Shown as millisecond
storm.bolt.last_60.requestedCpu
(gauge)
Bolt Requested CPU
Shown as percent
storm.bolt.last_60.requestedMemOffHeap
(gauge)
Bolt Requested Memory Off Heap
Shown as mebibyte
storm.bolt.last_60.requestedMemOnHeap
(gauge)
Bolt Requested Memory On Heap
Shown as mebibyte
storm.bolt.last_60.tasks
(gauge)
Bolt Tasks
Shown as task
storm.bolt.last_60.transferred
(gauge)
Number of Transferred Tuples
Shown as sample
storm.cluster.availCpu
(gauge)
Available Storm Cluster CPU
Shown as core
storm.cluster.availMem
(gauge)
Available Storm Cluster Memory
Shown as mebibyte
storm.cluster.cpuAssignedPercentUtil
(gauge)
Storm Cluster CPU Assigned Percent
Shown as percent
storm.cluster.executorsTotal
(gauge)
Total Storm Cluster Executors
Shown as thread
storm.cluster.memAssignedPercentUtil
(gauge)
Storm Cluster Memory Assigned Percent
Shown as percent
storm.cluster.slotsFree
(gauge)
Total Cluster Slots Available
Shown as process
storm.cluster.slotsTotal
(gauge)
Total Cluster Slots
Shown as process
storm.cluster.slotsUsed
(gauge)
Total Storm Cluster Slots Used
Shown as process
storm.cluster.supervisors
(gauge)
Total Storm Cluster Supervisors
Shown as worker
storm.cluster.tasksTotal
(gauge)
Total Storm Cluster Tasks
Shown as task
storm.cluster.topologies
(gauge)
Number of Storm Topologies
Shown as service
storm.cluster.totalCpu
(gauge)
Total Storm Cluster CPU
Shown as core
storm.cluster.totalMem
(gauge)
Total Storm Cluster Memory
Shown as mebibyte
storm.nimbus.numDead
(gauge)
Number of Dead Nimbus Nodes
Shown as node
storm.nimbus.numFollowers
(gauge)
Number of Follower Nimbus Nodes
Shown as node
storm.nimbus.numLeaders
(gauge)
Number of Leader Nimbus Nodes
Shown as node
storm.nimbus.numOffline
(gauge)
Number of Offline Nimbus Nodes
Shown as node
storm.nimbus.upTimeSeconds
(gauge)
Nimbus Uptime Seconds
Shown as second
storm.spout.last_60.acked
(gauge)
Number of Acked Tuples
Shown as sample
storm.spout.last_60.completeLatency
(gauge)
Spout Complete Latency
Shown as millisecond
storm.spout.last_60.emitted
(gauge)
Number of Emitted Tuples
Shown as sample
storm.spout.last_60.errorLapsedSecs
(gauge)
Number of Seconds Since Last Error
Shown as second
storm.spout.last_60.executors
(gauge)
Number of Spout Executors
Shown as thread
storm.spout.last_60.failed
(gauge)
Number of Failed Tuples
Shown as sample
storm.spout.last_60.requestedCpu
(gauge)
Spout Requested CPU
Shown as percent
storm.spout.last_60.requestedMemOffHeap
(gauge)
Spout Requested Memory Off Heap
Shown as mebibyte
storm.spout.last_60.requestedMemOnHeap
(gauge)
Spout Requested Memory On Heap
Shown as mebibyte
storm.spout.last_60.tasks
(gauge)
Spout Tasks
Shown as task
storm.spout.last_60.transferred
(gauge)
Number of Transferred Tuples
Shown as sample
storm.supervisor.slotsTotal
(gauge)
Total Supervisor Slots
Shown as process
storm.supervisor.slotsUsed
(gauge)
Used Supervisor Slots
Shown as process
storm.supervisor.totalCpu
(gauge)
Total Supervisor CPU
Shown as core
storm.supervisor.totalMem
(gauge)
Total Supervisor Memory
Shown as mebibyte
storm.supervisor.uptimeSeconds
(gauge)
Supervisor Uptime
Shown as second
storm.supervisor.usedCpu
(gauge)
Used Supervisor CPU
Shown as core
storm.supervisor.usedMem
(gauge)
Used Supervisor Memory
Shown as mebibyte
storm.topologyStats.last_60.acked
(gauge)
All Time Acked Tuples
Shown as sample
storm.topologyStats.last_60.assignedCpu
(gauge)
Assigned CPU Percentage
Shown as percent
storm.topologyStats.last_60.assignedMemOffHeap
(gauge)
Off Heap Memory Assigned
Shown as mebibyte
storm.topologyStats.last_60.assignedMemOnHeap
(gauge)
On Heap Memory Assigned
Shown as mebibyte
storm.topologyStats.last_60.assignedTotalMem
(gauge)
Total Memory Assigned
Shown as mebibyte
storm.topologyStats.last_60.completeLatency
(gauge)
All Time Complete Latence
Shown as millisecond
storm.topologyStats.last_60.debug
(gauge)
Boolean indicating if debug mode is enabled.
Shown as sample
storm.topologyStats.last_60.emitted
(gauge)
All Time Emitted Tuples
Shown as sample
storm.topologyStats.last_60.executorsTotal
(gauge)
Total Storm Topology Executors
Shown as thread
storm.topologyStats.last_60.failed
(gauge)
All Time Failed Tuples
Shown as sample
storm.topologyStats.last_60.msgTimeout
(gauge)
Spout Tuple Timeout in Seconds
Shown as second
storm.topologyStats.last_60.numBolts
(gauge)
Total Number of Bolts
Shown as task
storm.topologyStats.last_60.numSpouts
(gauge)
Total Number of Spouts
Shown as task
storm.topologyStats.last_60.replicationCount
(gauge)
Number of Replications
Shown as occurrence
storm.topologyStats.last_60.requestedCpu
(gauge)
Requested Topology CPU resources
Shown as percent
storm.topologyStats.last_60.requestedMemOffHeap
(gauge)
Requested Topology Off Heap Memory resources
Shown as mebibyte
storm.topologyStats.last_60.requestedMemOnHeap
(gauge)
Requested Topology On Heap Memory Resources
Shown as mebibyte
storm.topologyStats.last_60.samplingPct
(gauge)
Metric Sampling Percentage by Storm
Shown as percent
storm.topologyStats.last_60.tasksTotal
(gauge)
Total Number of Tasks
Shown as task
storm.topologyStats.last_60.transferred
(gauge)
All Time Transferred Tuples
Shown as sample
storm.topologyStats.last_60.uptimeSeconds
(gauge)
Total Topology Uptime
Shown as second
storm.topologyStats.last_60.workersTotal
(gauge)
Total Number of Workers
Shown as worker
storm.topologyStats.metrics.bolts.last_60..acked
(gauge)
Number of Tuples Acked by Spout & Stream
Shown as sample
storm.topologyStats.metrics.bolts.last_60.complete_ms_avg
(gauge)
Complete Tuple Latency by Spout & Stream
Shown as millisecond
storm.topologyStats.metrics.bolts.last_60.emitted
(gauge)
Number of Tuples Emitted by Spout & Stream
Shown as sample
storm.topologyStats.metrics.bolts.last_60.executed
(gauge)
Number of Tuples Executed by Spout & Stream
Shown as sample
storm.topologyStats.metrics.bolts.last_60.executed_ms_avg
(gauge)
Execute Tuple Latency by Spout & Stream
Shown as millisecond
storm.topologyStats.metrics.bolts.last_60.failed
(gauge)
Number of Tuples Failed by Spout & Stream
Shown as sample
storm.topologyStats.metrics.bolts.last_60.process_ms_avg
(gauge)
Process Tuple Latency by Spout & Stream
Shown as millisecond
storm.topologyStats.metrics.bolts.last_60.transferred
(gauge)
Number of Tuples Transferred by Spout & Stream
Shown as sample
storm.topologyStats.metrics.spouts.last_60.acked
(gauge)
Number of Tuples Acked by Spout & Stream
Shown as sample
storm.topologyStats.metrics.spouts.last_60.complete_ms_avg
(gauge)
Complete Tuple Latency by Spout & Stream
Shown as millisecond
storm.topologyStats.metrics.spouts.last_60.emitted
(gauge)
Number of Tuples Emitted by Spout & Stream
Shown as sample
storm.topologyStats.metrics.spouts.last_60.executed
(gauge)
Number of Tuples Executed by Spout & Stream
Shown as sample
storm.topologyStats.metrics.spouts.last_60.executed_ms_avg
(gauge)
Execute Tuple Latency by Spout & Stream
Shown as millisecond
storm.topologyStats.metrics.spouts.last_60.failed
(gauge)
Number of Tuples Failed by Spout & Stream
Shown as sample
storm.topologyStats.metrics.spouts.last_60.process_ms_avg
(gauge)
Process Tuple Latency by Spout & Stream
Shown as millisecond
storm.topologyStats.metrics.spouts.last_60.transferred
(gauge)
Number of Tuples Transferred by Spout & Stream
Shown as sample
storm.worker.last_60.assignedCpu
(gauge)
Assigned Worker CPU Percentage
Shown as percent
storm.worker.last_60.assignedMemOffHeap
(gauge)
Off Heap Memory Assigned for a Worker
Shown as mebibyte
storm.worker.last_60.assignedMemOnHeap
(gauge)
On Heap Memory Assigned for a Worker
Shown as mebibyte
storm.worker.last_60.componentNumTasks
(gauge)
Total Number of Component Tasks for a Worker
Shown as task
storm.worker.last_60.executorsTotal
(gauge)
Total Number of Executors for a Worker
Shown as thread
storm.worker.last_60.uptimeSeconds
(gauge)
Worker Uptime
Shown as second

イベント

Storm チェックには、イベントは含まれません。

Service Checks

topology_check.{TOPOLOGY NAME}

チェックは次の内容を返します。

  • OK - トポロジーがアクティブな場合。
  • CRITICAL - トポロジーがアクティブでない場合。

トラブルシューティング

ご不明な点は、Datadog のサポートチームまでお問合せください。