[Dashboard Request] AWS MSK Cluster

[makeavish]

Dashboard Name

AWS MSK Cluster Monitoring Dashboard

---

Expected Dashboard Sections and Panels

Section: Broker Metrics

• Panel: Broker CPU Usage - Displays the CPU utilization for each broker in the MSK cluster.
• Panel: Broker Memory Usage - Shows memory consumption by each MSK broker.
• Panel: Network Traffic In/Out - Displays the network traffic in and out for each MSK broker.
• Panel: Disk Usage - Displays the disk space used by each MSK broker.
• Panel: Broker Disk Throughput - Shows the read/write throughput on the disk for each MSK broker.

Section: Topic Metrics

• Panel: Messages In Per Second - Displays the number of messages sent to each topic per second.
• Panel: Messages Out Per Second - Displays the number of messages consumed from each topic per second.
• Panel: Bytes In Per Second - Shows the volume of data produced to each topic per second.
• Panel: Bytes Out Per Second - Shows the volume of data consumed from each topic per second.

Section: Partition Metrics

• Panel: Under-Replicated Partitions - Displays the count of under-replicated partitions across the MSK cluster.
• Panel: Partition ISR - Shows the count of in-sync replicas for each partition.
• Panel: Partition Count - Displays the number of partitions per topic across the cluster.

Section: Consumer Metrics

• Panel: Consumer Lag - Displays the lag for each consumer group in the MSK cluster.
• Panel: Consumer Error Rate - Shows the error rate for consumer requests across the MSK cluster.

Section: AWS Metrics (CloudWatch Integration)

• Panel: CPU Credit Usage - Shows the CPU credit usage for MSK brokers (for burstable instances).
• Panel: Burst Balance - Displays the CPU burst balance for MSK brokers.
• Panel: Network I/O - Shows the network input/output for the MSK brokers as tracked by AWS CloudWatch.

---

Expected Dashboard Variables

• deployment.environment

---

Additional Comments or Requirements

• This dashboard should provide comprehensive monitoring for AWS MSK clusters
• The dashboard should integrate with AWS CloudWatch metrics for enhanced visibility into instance-level performance (CPU, network, etc.).

---

📋 Notes

Please review the CONTRIBUTING.md for guidelines on dashboard structure, naming conventions, and how to submit a pull request.

Refer to this grafana dashboard for reference. Also refer to AWS docs: https://aws.amazon.com/about-aws/whats-new/2023/04/apache-kafka-aws-distro-opentelemetry/

[makeavish]

/bounty 150

[algora-pbc]

💎 $150 bounty • SigNoz

Steps to solve:

1. Start working: Comment /attempt #6036 with your implementation plan
2. Submit work: Create a pull request including /claim #6036 in the PR body to claim the bounty
3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to SigNoz/signoz!

Add a bounty • Share on socials

Attempt	Started (GMT+0)	Solution
🟢 @ayushdiitr	Sep 19, 2024, 7:03:52 PM	WIP

[ayushdiitr]

/attempt #6036

Options

• Cancel my attempt