Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Per Bucket Monitor History bar remains green with active alerts in particular conditions #1800

Open
thmsbp opened this issue Feb 24, 2025 · 0 comments
Labels
bug Something isn't working untriaged

Comments

@thmsbp
Copy link

thmsbp commented Feb 24, 2025

What is the bug?
Per Bucket Monitor History bar remains green with active alerts in particular conditions.
The visualization is this one (from Opensearch playground platform)
https://playground.opensearch.org/app/alerting#/monitors/yDYZA5MBUtEtjXPzRt-E?alertState=ALL&dataSourceId=&from=0&monitorIds=yDYZA5MBUtEtjXPzRt-E&monitorType=cluster_metrics_monitor&search=&severityLevel=ALL&size=20&sortDirection=desc&sortField=start_time

When an alert is triggered the first time, the red bar appears in the Monitor history.
On a second execution of the Monitor query, the alert is triggered again as depuped (not new anymore)

With no "throttle" defined, it may trigger a lot of deduped alerts every minute.

When the issue is terminated/complete, the red part disappears from monitoring history bar.
More commonly, if the user check this history 5min after a solved issue, the issue is not present in the history bar.

How can one reproduce the bug?

  • Create a "per bucket" monitor
  • With a query every 2min
  • Have test data to trigger the alert
  • Set test data to trigger the alert
  • Check the monitor history (red part should be visible)
  • Wait 4min (deduped alerts are generated)
  • Set test data to not have the alert anymore
  • Wait 2min
  • Check the monitor history (red part is not visible anymore = bug)

What is the expected behavior?
A clear and concise description of what you expected to happen.

What is your host/environment?

  • OS: RH8 and RH9
  • Version: 2.13
  • Plugins: Security

Do you have any screenshots?
No particular screenshot, the history bar of the following page is green even if there was a triggered alert.
https://playground.opensearch.org/app/alerting#/monitors/yDYZA5MBUtEtjXPzRt-E?alertState=ALL&dataSourceId=&from=0&monitorIds=yDYZA5MBUtEtjXPzRt-E&monitorType=cluster_metrics_monitor&search=&severityLevel=ALL&size=20&sortDirection=desc&sortField=start_time

Do you have any additional context?
No

@thmsbp thmsbp added bug Something isn't working untriaged labels Feb 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working untriaged
Projects
None yet
Development

No branches or pull requests

1 participant