Apache Spark - Performance Metrics
Monitors spark metrics using Prometheus in Kubernetes
Spark Metrics Dashboard :- Having Spark Driver / Executor Memory Consumption and other related metrics in Kubernetes using JMX Exporter and Prometheus Service Discovery Including Network I/O and Disk Read/Write Metrics for Spark Driver , Executors and Shuffle Service
Add Labels to Spark Driver and Executor accordingly for Prometheus to fetch metrics through service discovery
Data source config
Collector config:
Dashboard revisions
Upload an updated version of an exported dashboard.json file from Grafana
Revision | Decscription | Created | |
---|---|---|---|
Download |
Get this dashboard
Data source:
Dependencies: