Card #3414 · Grafana
Grafana alerting failures and notification delivery issues
Users are experiencing various failures in the alerting pipeline, including backend timeout errors, 500/503 internal server errors, and certificate issues. Additionally, there are significant problems with notification delivery to Slack and Telegram, specifically regarding missing alert data and failing image uploads.
Pain score
0.24/ 1.00 · weighted product of four components
Reach1.00distinct authors (log-normalized)
Recency1.00freshness decay, half-life months
Engagement0.83upvotes + comments, normalized
Monetization0.50willingness-to-pay cues in evidence
§ Evidence — 6 verified quotes
Failed to send slack notification” logger=alerting.notifier.slack error=“Post https://hooks.slack.com/services/###########/#############/##############: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)”
The error we get is: Error: tsdb.HandleRequest() error Request failed status: 500 Internal Server Error
when building an alert threshold in the dashboard, it fails due to a certificate error.
I have isolated the problem to ‘Include Image’ checkbox. I am able to receive the alerts and image in email notification no issue. So i guess the problem is with Telegram webhook with image.
Why grafana is sending blank message ? There should be alert data
error=“tsdb.HandleRequest() error Request failed status: 503 Service Unavailable” changing state to=alerting
Comments are a Pro feature — join the conversation, share what you've shipped, hear what others are building.
Upgrade to Pro