Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feat]: Add Alerting support #37

Open
1 task
AmanAgarwal041 opened this issue Feb 6, 2024 · 0 comments
Open
1 task

[Feat]: Add Alerting support #37

AmanAgarwal041 opened this issue Feb 6, 2024 · 0 comments
Assignees
Labels
Alerts Client Issue related to OpenLIT Client ✋ Up for Grabs The issue is Up for Grabs 🚀 Feature New feature or request

Comments

@AmanAgarwal041
Copy link
Contributor

AmanAgarwal041 commented Feb 6, 2024

🚀 What's the Problem?

In our current setup with the Doku, and monitoring OpenAI API Calls, we lack the ability to proactively monitor and react to critical metrics such as usage spikes, approaching request limit thresholds, and other relevant statistics that are pivotal for maintaining operational stability and cost management. Without real-time alerts, teams are often reactive rather than proactive, leading to disrupted services or unnecessary expenses.

💡 Your Dream Solution

A robust, configurable alerting system within LLM Observability that allows users to:

  1. **Pre-built Alerts:**Alerts should be prebuilt into Doku with proper default thresholds
  2. Set Custom Thresholds: Users should be able to define custom thresholds for various metrics (e.g., number of requests, usage spikes) beyond which alerts would be triggered.
  3. Multi-Channel Alerts: Alerts should be dispatchable through multiple channels, including email, SMS, Slack, or webhooks, to ensure prompt notifications. We can start with email and Slack maybe?
  4. Comprehensive Dashboard: An integrated dashboard that displays current metrics, historical data, and alert configuration settings for easy monitoring and management.

🤔 Seen anything similar?

Similar to Prometheus AlertManager where user can silence alerts, send to different channels etc.

🖼️ Pictures or Drawings

Share any picture or drawing that shows your idea if you have.

👐 Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!
@AmanAgarwal041 AmanAgarwal041 added 🚀 Feature New feature or request ✋ Up for Grabs The issue is Up for Grabs labels Feb 6, 2024
@patcher99 patcher99 added the Client Issue related to OpenLIT Client label Mar 12, 2024
@patcher99 patcher99 changed the title feat: add alerts for limit reaches [Feat]: Add Alerting support Mar 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Alerts Client Issue related to OpenLIT Client ✋ Up for Grabs The issue is Up for Grabs 🚀 Feature New feature or request
Projects
Status: Todo
Development

No branches or pull requests

2 participants