この文書は自動機械翻訳技術を使用して翻訳されています。 正確な翻訳を提供するように努めておりますが、翻訳された内容の完全性、正確性、信頼性については一切保証いたしません。 相違がある場合は、元の英語版 英語 が優先され、正式なテキストとなります。

PromQL式リファレンス

この文書のPromQL式は、アラートの設定に使用できます。

Prometheus時系列データベースのクエリに関する詳細は、公式の Prometheusドキュメントを参照してください。

クラスタメトリクス

クラスタCPU使用率

カタログ Expression

詳細

1 - (avg(irate(node_cpu_seconds_total{mode="idle"}[5m])) by (instance))

まとめ

1 - (avg(irate(node_cpu_seconds_total{mode="idle"}[5m])))

クラスタ負荷平均

カタログ Expression

詳細

<table><tr><td>load1</td><td>sum(node_load1) by (instance) / count(node_cpu_seconds_total{mode="system"}) by (instance)</td></tr><tr><td>load5</td><td>sum(node_load5) by (instance) / count(node_cpu_seconds_total{mode="system"}) by (instance)</td></tr><tr><td>load15</td><td>sum(node_load15) by (instance) / count(node_cpu_seconds_total{mode="system"}) by (instance)</td></tr></table>

まとめ

<table><tr><td>load1</td><td>sum(node_load1) by (instance) / count(node_cpu_seconds_total{mode="system"})</td></tr><tr><td>load5</td><td>sum(node_load5) by (instance) / count(node_cpu_seconds_total{mode="system"})</td></tr><tr><td>load15</td><td>sum(node_load15) by (instance) / count(node_cpu_seconds_total{mode="system"})</td></tr></table>

クラスタメモリ使用率

カタログ Expression

詳細

1 - sum(node_memory_MemAvailable_bytes) by (instance) / sum(node_memory_MemTotal_bytes) by (instance)

まとめ

1 - sum(node_memory_MemAvailable_bytes) / sum(node_memory_MemTotal_bytes)

クラスタディスク使用率

カタログ Expression

詳細

(sum(node_filesystem_size_bytes{device!="rootfs"}) by (instance) - sum(node_filesystem_free_bytes{device!="rootfs"}) by (instance)) / sum(node_filesystem_size_bytes{device!="rootfs"}) by (instance)

まとめ

(sum(node_filesystem_size_bytes{device!="rootfs"}) - sum(node_filesystem_free_bytes{device!="rootfs"})) / sum(node_filesystem_size_bytes{device!="rootfs"})

クラスタディスクI/O

カタログ Expression

詳細

<table><tr><td>read</td><td>sum(rate(node_disk_read_bytes_total[5m])) by (instance)</td></tr><tr><td>written</td><td>sum(rate(node_disk_written_bytes_total[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>read</td><td>sum(rate(node_disk_read_bytes_total[5m]))</td></tr><tr><td>written</td><td>sum(rate(node_disk_written_bytes_total[5m]))</td></tr></table>

クラスタネットワークパケット

カタログ Expression

詳細

<table><tr><td>receive-dropped</td><td>sum(rate(node_network_receive_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr><tr><td>receive-errs</td><td>sum(rate(node_network_receive_errs_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr><tr><td>receive-packets</td><td>sum(rate(node_network_receive_packets_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr><tr><td>transmit-dropped</td><td>sum(rate(node_network_transmit_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr><tr><td>transmit-errs</td><td>sum(rate(node_network_transmit_errs_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr><tr><td>transmit-packets</td><td>sum(rate(node_network_transmit_packets_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>receive-dropped</td><td>sum(rate(node_network_receive_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr><tr><td>receive-errs</td><td>sum(rate(node_network_receive_errs_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr><tr><td>receive-packets</td><td>sum(rate(node_network_receive_packets_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr><tr><td>transmit-dropped</td><td>sum(rate(node_network_transmit_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr><tr><td>transmit-errs</td><td>sum(rate(node_network_transmit_errs_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr><tr><td>transmit-packets</td><td>sum(rate(node_network_transmit_packets_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr></table>

クラスタネットワークI/O

カタログ Expression

詳細

<table><tr><td>receive</td><td>sum(rate(node_network_receive_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr><tr><td>transmit</td><td>sum(rate(node_network_transmit_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>receive</td><td>sum(rate(node_network_receive_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr><tr><td>transmit</td><td>sum(rate(node_network_transmit_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*"}[5m]))</td></tr></table>

ノードのメトリクス

ノードCPU利用率

カタログ Expression

詳細

avg(irate(node_cpu_seconds_total{mode!="idle", instance=~"$instance"}[5m])) by (mode)

まとめ

1 - (avg(irate(node_cpu_seconds_total{mode="idle", instance=~"$instance"}[5m])))

ノード負荷平均

カタログ Expression

詳細

<table><tr><td>load1</td><td>sum(node_load1{instance=~"$instance"}) / count(node_cpu_seconds_total{mode="system",instance="$instance"})</td></tr><tr><td>load5</td><td>sum(node_load5{instance="$instance"}) / count(node_cpu_seconds_total{mode="system",instance="$instance"})</td></tr><tr><td>load15</td><td>sum(node_load15{instance="$instance"}) / count(node_cpu_seconds_total{mode="system",instance=~"$instance"})</td></tr></table>

まとめ

<table><tr><td>load1</td><td>sum(node_load1{instance=~"$instance"}) / count(node_cpu_seconds_total{mode="system",instance="$instance"})</td></tr><tr><td>load5</td><td>sum(node_load5{instance="$instance"}) / count(node_cpu_seconds_total{mode="system",instance="$instance"})</td></tr><tr><td>load15</td><td>sum(node_load15{instance="$instance"}) / count(node_cpu_seconds_total{mode="system",instance=~"$instance"})</td></tr></table>

ノードメモリ利用率

カタログ Expression

詳細

1 - sum(node_memory_MemAvailable_bytes{instance=~"$instance"}) / sum(node_memory_MemTotal_bytes{instance=~"$instance"})

まとめ

`1 - sum(node_memory_MemAvailable_bytes{instance=~"$instance"}) / sum(node_memory_MemTotal_bytes{instance=~"$instance"}) `

ノードディスク利用率

カタログ Expression

詳細

(sum(node_filesystem_size_bytes{device!="rootfs",instance=~"$instance"}) by (device) - sum(node_filesystem_free_bytes{device!="rootfs",instance=~"$instance"}) by (device)) / sum(node_filesystem_size_bytes{device!="rootfs",instance=~"$instance"}) by (device)

まとめ

(sum(node_filesystem_size_bytes{device!="rootfs",instance=~"$instance"}) - sum(node_filesystem_free_bytes{device!="rootfs",instance=~"$instance"})) / sum(node_filesystem_size_bytes{device!="rootfs",instance=~"$instance"})

ノードディスクI/O

カタログ Expression

詳細

<table><tr><td>read</td><td>sum(rate(node_disk_read_bytes_total{instance="$instance"}[5m]))</td></tr><tr><td>written</td><td>sum(rate(node_disk_written_bytes_total{instance="$instance"}[5m]))</td></tr></table>

まとめ

<table><tr><td>read</td><td>sum(rate(node_disk_read_bytes_total{instance="$instance"}[5m]))</td></tr><tr><td>written</td><td>sum(rate(node_disk_written_bytes_total{instance="$instance"}[5m]))</td></tr></table>

ノードネットワークパケット

カタログ Expression

詳細

<table><tr><td>receive-dropped</td><td>sum(rate(node_network_receive_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr><tr><td>receive-errs</td><td>sum(rate(node_network_receive_errs_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr><tr><td>receive-packets</td><td>sum(rate(node_network_receive_packets_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr><tr><td>transmit-dropped</td><td>sum(rate(node_network_transmit_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr><tr><td>transmit-errs</td><td>sum(rate(node_network_transmit_errs_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr><tr><td>transmit-packets</td><td>sum(rate(node_network_transmit_packets_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr></table>

まとめ

<table><tr><td>receive-dropped</td><td>sum(rate(node_network_receive_drop_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance="$instance"}[5m]))</td></tr><tr><td>receive-errs</td><td>sum(rate(node_network_receive_errs_total{device!"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance="$instance"}[5m]))</td></tr><tr><td>receive-packets</td><td>sum(rate(node_network_receive_packets_total{device!"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance="$instance"}[5m]))</td></tr><tr><td>transmit-dropped</td><td>sum(rate(node_network_transmit_drop_total{device!"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance="$instance"}[5m]))</td></tr><tr><td>transmit-errs</td><td>sum(rate(node_network_transmit_errs_total{device!"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance="$instance"}[5m]))</td></tr><tr><td>transmit-packets</td><td>sum(rate(node_network_transmit_packets_total{device!"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m]))</td></tr></table>

ノードネットワークI/O

カタログ Expression

詳細

<table><tr><td>receive</td><td>sum(rate(node_network_receive_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr><tr><td>transmit</td><td>sum(rate(node_network_transmit_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m])) by (device)</td></tr></table>

まとめ

<table><tr><td>receive</td><td>sum(rate(node_network_receive_bytes_total{device!~"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance="$instance"}[5m]))</td></tr><tr><td>transmit</td><td>sum(rate(node_network_transmit_bytes_total{device!"lo | veth.* | docker.* | flannel.* | cali.* | cbr.*",instance=~"$instance"}[5m]))</td></tr></table>

etcdメトリクス

etcdにはリーダーがいます

max(etcd_server_has_leader)

リーダーが変わる回数

max(etcd_server_leader_changes_seen_total)

失敗した提案の数

sum(etcd_server_proposals_failed_total)

GRPCクライアントトラフィック

カタログ Expression

詳細

<table><tr><td>in</td><td>sum(rate(etcd_network_client_grpc_received_bytes_total[5m])) by (instance)</td></tr><tr><td>out</td><td>sum(rate(etcd_network_client_grpc_sent_bytes_total[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>in</td><td>sum(rate(etcd_network_client_grpc_received_bytes_total[5m]))</td></tr><tr><td>out</td><td>sum(rate(etcd_network_client_grpc_sent_bytes_total[5m]))</td></tr></table>

ピアトラフィック

カタログ Expression

詳細

<table><tr><td>in</td><td>sum(rate(etcd_network_peer_received_bytes_total[5m])) by (instance)</td></tr><tr><td>out</td><td>sum(rate(etcd_network_peer_sent_bytes_total[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>in</td><td>sum(rate(etcd_network_peer_received_bytes_total[5m]))</td></tr><tr><td>out</td><td>sum(rate(etcd_network_peer_sent_bytes_total[5m]))</td></tr></table>

DBサイズ

カタログ Expression

詳細

sum(etcd_debugging_mvcc_db_total_size_in_bytes) by (instance)

まとめ

sum(etcd_debugging_mvcc_db_total_size_in_bytes)

アクティブストリーム

カタログ Expression

詳細

<table><tr><td>リースウォッチ</td><td>sum(grpc_server_started_total{grpc_service="etcdserverpb.Lease",grpc_type="bidi_stream"}) by (instance) - sum(grpc_server_handled_total{grpc_service="etcdserverpb.Lease",grpc_type="bidi_stream"}) by (instance)</td></tr><tr><td>ウォッチ</td><td>sum(grpc_server_started_total{grpc_service="etcdserverpb.Watch",grpc_type="bidi_stream"}) by (instance) - sum(grpc_server_handled_total{grpc_service="etcdserverpb.Watch",grpc_type="bidi_stream"}) by (instance)</td></tr></table>

まとめ

<table><tr><td>リース監視</td><td>sum(grpc_server_started_total{grpc_service="etcdserverpb.Lease",grpc_type="bidi_stream"}) - sum(grpc_server_handled_total{grpc_service="etcdserverpb.Lease",grpc_type="bidi_stream"})</td></tr><tr><td>監視</td><td>sum(grpc_server_started_total{grpc_service="etcdserverpb.Watch",grpc_type="bidi_stream"}) - sum(grpc_server_handled_total{grpc_service="etcdserverpb.Watch",grpc_type="bidi_stream"})</td></tr></table>

Raft提案

カタログ Expression

詳細

<table><tr><td>適用済み</td><td>sum(increase(etcd_server_proposals_applied_total[5m])) by (instance)</td></tr><tr><td>コミット済み</td><td>sum(increase(etcd_server_proposals_committed_total[5m])) by (instance)</td></tr><tr><td>保留中</td><td>sum(increase(etcd_server_proposals_pending[5m])) by (instance)</td></tr><tr><td>失敗</td><td>sum(increase(etcd_server_proposals_failed_total[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>適用済み</td><td>sum(increase(etcd_server_proposals_applied_total[5m]))</td></tr><tr><td>コミット済み</td><td>sum(increase(etcd_server_proposals_committed_total[5m]))</td></tr><tr><td>保留中</td><td>sum(increase(etcd_server_proposals_pending[5m]))</td></tr><tr><td>失敗</td><td>sum(increase(etcd_server_proposals_failed_total[5m]))</td></tr></table>

RPCレート

カタログ Expression

詳細

<table><tr><td>合計</td><td>sum(rate(grpc_server_started_total{grpc_type="unary"}[5m])) by (instance)</td></tr><tr><td>失敗</td><td>sum(rate(grpc_server_handled_total{grpc_type="unary",grpc_code!="OK"}[5m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>合計</td><td>sum(rate(grpc_server_started_total{grpc_type="unary"}[5m]))</td></tr><tr><td>失敗</td><td>sum(rate(grpc_server_handled_total{grpc_type="unary",grpc_code!="OK"}[5m]))</td></tr></table>

ディスク操作

カタログ Expression

詳細

<table><tr><td>バックエンドによって呼び出されたコミット</td><td>sum(rate(etcd_disk_backend_commit_duration_seconds_sum[1m])) by (instance)</td></tr><tr><td>WALによって呼び出されたfsync</td><td>sum(rate(etcd_disk_wal_fsync_duration_seconds_sum[1m])) by (instance)</td></tr></table>

まとめ

<table><tr><td>バックエンドによって呼び出されたコミット</td><td>sum(rate(etcd_disk_backend_commit_duration_seconds_sum[1m]))</td></tr><tr><td>WALによって呼び出されたfsync</td><td>sum(rate(etcd_disk_wal_fsync_duration_seconds_sum[1m]))</td></tr></table>

ディスクsync時間

カタログ Expression

詳細

<table><tr><td>WAL</td><td>histogram_quantile(0.99, sum(rate(etcd_disk_wal_fsync_duration_seconds_bucket[5m])) by (instance, le))</td></tr><tr><td>DB</td><td>histogram_quantile(0.99, sum(rate(etcd_disk_backend_commit_duration_seconds_bucket[5m])) by (instance, le))</td></tr></table>

まとめ

<table><tr><td>WAL</td><td>sum(histogram_quantile(0.99, sum(rate(etcd_disk_wal_fsync_duration_seconds_bucket[5m])) by (instance, le)))</td></tr><tr><td>DB</td><td>sum(histogram_quantile(0.99, sum(rate(etcd_disk_backend_commit_duration_seconds_bucket[5m])) by (instance, le)))</td></tr></table>

Kubernetesコンポーネントメトリクス

APIサーバーリクエストレイテンシ

カタログ Expression

詳細

avg(apiserver_request_latencies_sum / apiserver_request_latencies_count) by (instance, verb) /1e+06

まとめ

avg(apiserver_request_latencies_sum / apiserver_request_latencies_count) by (instance) /1e+06

APIサーバーリクエストレート

カタログ Expression

詳細

sum(rate(apiserver_request_count[5m])) by (instance, code)

まとめ

sum(rate(apiserver_request_count[5m])) by (instance)

スケジューリングに失敗したポッド

カタログ Expression

詳細

sum(kube_pod_status_scheduled{condition="false"})

まとめ

sum(kube_pod_status_scheduled{condition="false"})

コントローラーマネージャーキューの深さ

カタログ Expression

詳細

<table><tr><td>ボリューム</td><td>sum(volumes_depth) by instance</td></tr><tr><td>デプロイメント</td><td>sum(deployment_depth) by instance</td></tr><tr><td>レプリカセット</td><td>sum(replicaset_depth) by instance</td></tr><tr><td>サービス</td><td>sum(service_depth) by instance</td></tr><tr><td>サービスアカウント</td><td>sum(serviceaccount_depth) by instance</td></tr><tr><td>エンドポイント</td><td>sum(endpoint_depth) by instance</td></tr><tr><td>デーモンセット</td><td>sum(daemonset_depth) by instance</td></tr><tr><td>ステートフルセット</td><td>sum(statefulset_depth) by instance</td></tr><tr><td>レプリケーションマネージャー</td><td>sum(replicationmanager_depth) by instance</td></tr></table>

まとめ

<table><tr><td>ボリューム</td><td>sum(volumes_depth)</td></tr><tr><td>デプロイメント</td><td>sum(deployment_depth)</td></tr><tr><td>レプリカセット</td><td>sum(replicaset_depth)</td></tr><tr><td>サービス</td><td>sum(service_depth)</td></tr><tr><td>サービスアカウント</td><td>sum(serviceaccount_depth)</td></tr><tr><td>エンドポイント</td><td>sum(endpoint_depth)</td></tr><tr><td>デーモンセット</td><td>sum(daemonset_depth)</td></tr><tr><td>ステートフルセット</td><td>sum(statefulset_depth)</td></tr><tr><td>レプリケーションマネージャー</td><td>sum(replicationmanager_depth)</td></tr></table>

スケジューラーE2Eスケジューリングレイテンシ

カタログ Expression

詳細

histogram_quantile(0.99, sum(scheduler_e2e_scheduling_latency_microseconds_bucket) by (le, instance)) / 1e+06

まとめ

sum(histogram_quantile(0.99, sum(scheduler_e2e_scheduling_latency_microseconds_bucket) by (le, instance)) / 1e+06)

スケジューラーのプリエンプション試行

カタログ Expression

詳細

sum(rate(scheduler_total_preemption_attempts[5m])) by (instance)

まとめ

sum(rate(scheduler_total_preemption_attempts[5m]))

イングレスコントローラー接続

カタログ Expression

詳細

<table><tr><td>読み取り</td><td>sum(nginx_ingress_controller_nginx_process_connections{state="reading"}) by (instance)</td></tr><tr><td>待機中</td><td>sum(nginx_ingress_controller_nginx_process_connections{state="waiting"}) by (instance)</td></tr><tr><td>書き込み</td><td>sum(nginx_ingress_controller_nginx_process_connections{state="writing"}) by (instance)</td></tr><tr><td>受け入れ</td><td>sum(ceil(increase(nginx_ingress_controller_nginx_process_connections_total{state="accepted"}[5m]))) by (instance)</td></tr><tr><td>アクティブ</td><td>sum(ceil(increase(nginx_ingress_controller_nginx_process_connections_total{state="active"}[5m]))) by (instance)</td></tr><tr><td>処理済み</td><td>sum(ceil(increase(nginx_ingress_controller_nginx_process_connections_total{state="handled"}[5m]))) by (instance)</td></tr></table>

まとめ

<table><tr><td>読み取り</td><td>sum(nginx_ingress_controller_nginx_process_connections{state="reading"})</td></tr><tr><td>待機中</td><td>sum(nginx_ingress_controller_nginx_process_connections{state="waiting"})</td></tr><tr><td>書き込み</td><td>sum(nginx_ingress_controller_nginx_process_connections{state="writing"})</td></tr><tr><td>受け入れ</td><td>sum(ceil(increase(nginx_ingress_controller_nginx_process_connections_total{state="accepted"}[5m])))</td></tr><tr><td>アクティブ</td><td>sum(ceil(increase(nginx_ingress_controller_nginx_process_connections_total{state="active"}[5m])))</td></tr><tr><td>処理済み</td><td>sum(ceil(increase(nginx_ingress_controller_nginx_process_connections_total{state="handled"}[5m])))</td></tr></table>

イングレスコントローラーリクエスト処理時間

カタログ Expression

詳細

topk(10, histogram_quantile(0.95,sum by (le, host, path)(rate(nginx_ingress_controller_request_duration_seconds_bucket{host!="_"}[5m]))))

まとめ

topk(10, histogram_quantile(0.95,sum by (le, host)(rate(nginx_ingress_controller_request_duration_seconds_bucket{host!="_"}[5m]))))

Rancherログメトリクス

Fluentdバッファキュー率

カタログ Expression

詳細

sum(rate(fluentd_output_status_buffer_queue_length[5m])) by (instance)

まとめ

sum(rate(fluentd_output_status_buffer_queue_length[5m]))

Fluentd入力率

カタログ Expression

詳細

sum(rate(fluentd_input_status_num_records_total[5m])) by (instance)

まとめ

sum(rate(fluentd_input_status_num_records_total[5m]))

Fluentd出力エラー率

カタログ Expression

詳細

sum(rate(fluentd_output_status_num_errors[5m])) by (type)

まとめ

sum(rate(fluentd_output_status_num_errors[5m]))

Fluentd出力率

カタログ Expression

詳細

sum(rate(fluentd_output_status_num_records_total[5m])) by (instance)

まとめ

sum(rate(fluentd_output_status_num_records_total[5m]))

ワークロードメトリクス

ワークロードCPU使用率

カタログ Expression

詳細

<table><tr><td>CFS制限された秒数</td><td>sum(rate(container_cpu_cfs_throttled_seconds_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>ユーザー秒数</td><td>sum(rate(container_cpu_user_seconds_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>システム秒数</td><td>sum(rate(container_cpu_system_seconds_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>使用秒数</td><td>sum(rate(container_cpu_usage_seconds_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr></table>

まとめ

<table><tr><td>CFS制限された秒数</td><td>sum(rate(container_cpu_cfs_throttled_seconds_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>ユーザー秒数</td><td>sum(rate(container_cpu_user_seconds_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>システム秒数</td><td>sum(rate(container_cpu_system_seconds_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>使用秒数</td><td>sum(rate(container_cpu_usage_seconds_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

ワークロードメモリ使用率

カタログ Expression

詳細

sum(container_memory_working_set_bytes{namespace="$namespace",pod_name=~"$podName", container_name!=""}) by (pod_name)

まとめ

sum(container_memory_working_set_bytes{namespace="$namespace",pod_name=~"$podName", container_name!=""})

ワークロードネットワークパケット

カタログ Expression

詳細

<table><tr><td>受信パケット</td><td>sum(rate(container_network_receive_packets_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>受信ドロップ</td><td>sum(rate(container_network_receive_packets_dropped_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>受信エラー</td><td>sum(rate(container_network_receive_errors_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>送信パケット</td><td>sum(rate(container_network_transmit_packets_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>送信ドロップ</td><td>sum(rate(container_network_transmit_packets_dropped_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>送信エラー</td><td>sum(rate(container_network_transmit_errors_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr></table>

まとめ

<table><tr><td>受信パケット</td><td>sum(rate(container_network_receive_packets_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>受信ドロップ</td><td>sum(rate(container_network_receive_packets_dropped_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>受信エラー</td><td>sum(rate(container_network_receive_errors_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信パケット</td><td>sum(rate(container_network_transmit_packets_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信ドロップ</td><td>sum(rate(container_network_transmit_packets_dropped_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信エラー</td><td>sum(rate(container_network_transmit_errors_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

ワークロードネットワークI/O

カタログ Expression

詳細

<table><tr><td>受信</td><td>sum(rate(container_network_receive_bytes_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>送信</td><td>sum(rate(container_network_transmit_bytes_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr></table>

まとめ

<table><tr><td>受信</td><td>sum(rate(container_network_receive_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信</td><td>sum(rate(container_network_transmit_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

ワークロードディスクI/O

カタログ Expression

詳細

<table><tr><td>読み取り</td><td>sum(rate(container_fs_reads_bytes_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr><tr><td>書き込み</td><td>sum(rate(container_fs_writes_bytes_total{namespace="$namespace",pod_name=~"$podName",container_name!=""}[5m])) by (pod_name)</td></tr></table>

まとめ

<table><tr><td>読み取り</td><td>sum(rate(container_fs_reads_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>書き込み</td><td>sum(rate(container_fs_writes_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

ポッドメトリクス

ポッドCPU使用率

カタログ Expression

詳細

<table><tr><td>CFS制限された秒数</td><td>sum(rate(container_cpu_cfs_throttled_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m])) by (container_name)</td></tr><tr><td>使用秒数</td><td>sum(rate(container_cpu_usage_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m])) by (container_name)</td></tr><tr><td>システム秒数</td><td>sum(rate(container_cpu_system_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m])) by (container_name)</td></tr><tr><td>ユーザー秒数</td><td>sum(rate(container_cpu_user_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m])) by (container_name)</td></tr></table>

まとめ

<table><tr><td>CFS制限された秒数</td><td>sum(rate(container_cpu_cfs_throttled_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m]))</td></tr><tr><td>使用秒数</td><td>sum(rate(container_cpu_usage_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m]))</td></tr><tr><td>システム秒数</td><td>sum(rate(container_cpu_system_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m]))</td></tr><tr><td>ユーザー秒数</td><td>sum(rate(container_cpu_user_seconds_total{container_name!="POD",namespace="$namespace",pod_name="$podName", container_name!=""}[5m]))</td></tr></table>

ポッドメモリ使用率

カタログ Expression

詳細

sum(container_memory_working_set_bytes{container_name!="POD",namespace="$namespace",pod_name="$podName",container_name!=""}) by (container_name)

まとめ

sum(container_memory_working_set_bytes{container_name!="POD",namespace="$namespace",pod_name="$podName",container_name!=""})

ポッドネットワークパケット

カタログ Expression

詳細

<table><tr><td>受信パケット</td><td>sum(rate(container_network_receive_packets_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>受信ドロップ</td><td>sum(rate(container_network_receive_packets_dropped_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>受信エラー</td><td>sum(rate(container_network_receive_errors_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信パケット</td><td>sum(rate(container_network_transmit_packets_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信ドロップ</td><td>sum(rate(container_network_transmit_packets_dropped_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信エラー</td><td>sum(rate(container_network_transmit_errors_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

まとめ

<table><tr><td>受信パケット</td><td>sum(rate(container_network_receive_packets_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>受信ドロップ</td><td>sum(rate(container_network_receive_packets_dropped_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>受信エラー</td><td>sum(rate(container_network_receive_errors_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信パケット</td><td>sum(rate(container_network_transmit_packets_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信ドロップ</td><td>sum(rate(container_network_transmit_packets_dropped_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信エラー</td><td>sum(rate(container_network_transmit_errors_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

ポッドネットワーク I/O

カタログ Expression

詳細

<table><tr><td>受信</td><td>sum(rate(container_network_receive_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信</td><td>sum(rate(container_network_transmit_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

まとめ

<table><tr><td>受信</td><td>sum(rate(container_network_receive_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>送信</td><td>sum(rate(container_network_transmit_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

ポッドディスク I/O

カタログ Expression

詳細

<table><tr><td>読み取り</td><td>sum(rate(container_fs_reads_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m])) by (container_name)</td></tr><tr><td>書き込み</td><td>sum(rate(container_fs_writes_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m])) by (container_name)</td></tr></table>

まとめ

<table><tr><td>読み取り</td><td>sum(rate(container_fs_reads_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr><tr><td>書き込み</td><td>sum(rate(container_fs_writes_bytes_total{namespace="$namespace",pod_name="$podName",container_name!=""}[5m]))</td></tr></table>

コンテナメトリクス

コンテナCPU使用率

カタログ Expression

cfsスロットル秒数

sum(rate(container_cpu_cfs_throttled_seconds_total{namespace="$namespace",pod_name="$podName",container_name="$containerName"}[5m]))

使用秒数

sum(rate(container_cpu_usage_seconds_total{namespace="$namespace",pod_name="$podName",container_name="$containerName"}[5m]))

システム秒数

sum(rate(container_cpu_system_seconds_total{namespace="$namespace",pod_name="$podName",container_name="$containerName"}[5m]))

ユーザー秒数

sum(rate(container_cpu_user_seconds_total{namespace="$namespace",pod_name="$podName",container_name="$containerName"}[5m]))

コンテナメモリ使用率

sum(container_memory_working_set_bytes{namespace="$namespace",pod_name="$podName",container_name="$containerName"})

コンテナディスク I/O

カタログ Expression

読む

sum(rate(container_fs_reads_bytes_total{namespace="$namespace",pod_name="$podName",container_name="$containerName"}[5m]))

write

sum(rate(container_fs_writes_bytes_total{namespace="$namespace",pod_name="$podName",container_name="$containerName"}[5m]))