Aguru AI Howto
Aguru AI is an on-premises software solution that provides comprehensive monitoring, security, and optimization tools for LLM-based applications with features like behavior tracking, anomaly detection, and performance optimization.
View MoreHow to Use Aguru AI
Download Aguru Safeguard Package: Sign up on the Aguru website to download the full package. Early adopters can get free access.
Install the Software: Install Aguru Safeguard locally on your system to ensure data privacy and security.
Configure Infrastructure: Follow the README.md instructions to configure your infrastructure to route LLM traffic through a reverse proxy. No modifications to application code are required.
Access Interface: Navigate to http://localhost:5000 to access the Aguru Safeguard interface.
Monitor LLM Traffic: Once set up, Aguru Safeguard will automatically begin monitoring your LLM traffic and detecting anomalies.
Set Up Alerts: Configure alerts to be forwarded to your preferred alerting system (like Splunk or DataDog) for monitoring potential anomalies.
Use Playground: Experiment with specific prompts in the Playground to observe how the system detects anomalies and use insights to enhance your AI applications.
Optional: Activate LLM Router: If desired, activate the LLM Router feature to automatically direct prompts to the most cost-effective models while maintaining optimal performance.
Aguru AI FAQs
Aguru Safeguard is an on-premises software that monitors LLM behavior, performance, and security. It provides actionable insights into critical aspects of LLM operations while ensuring data remains private and secure through local installation.
View More