Arch Features
Arch is an intelligent Layer 7 gateway built on Envoy Proxy that provides secure handling, robust observability, and seamless integration of prompts with APIs for building fast, robust, and personalized AI agents.
View MoreKey Features of Arch
Arch is an intelligent Layer 7 gateway designed for handling AI/LLM applications, built on Envoy Proxy. It provides comprehensive prompt management capabilities including jailbreak detection, API integration, LLM routing, and observability features. The platform uses purpose-built LLMs to handle critical tasks like function calling, parameter extraction, and secure prompt processing, while offering standards-based monitoring and traffic management features.
Built-in Function Calling: Engineered with purpose-built LLMs to handle fast, cost-effective API calling and parameter extraction from prompts for building agentic and RAG applications
Prompt Security: Centralizes prompt guardrails and provides automatic jailbreak attempt detection without requiring custom code implementation
Advanced Traffic Management: Manages LLM calls with smart retries, automatic failover, and resilient upstream connections for ensuring continuous availability
Enterprise-grade Observability: Implements W3C Trace Context standard for complete request tracing and provides comprehensive metrics for monitoring latency, token usage, and error rates
Use Cases of Arch
AI-Powered Weather Forecasting: Integration with weather services to provide intelligent weather forecasting through natural language processing
Insurance Agent Automation: Building automated insurance agents that can handle customer queries and process insurance-related tasks
Network Management Assistant: Creating networking co-pilots that help operators understand traffic flow and manage network operations through natural language interactions
Enterprise API Integration: Seamlessly connecting AI capabilities with existing enterprise APIs while maintaining security and observability
Pros
Built on proven Envoy Proxy technology for reliable performance
Comprehensive security features with built-in jailbreak detection
Standards-based observability making it enterprise-ready
Cons
Potential search visibility issues due to name confusion with Arch Linux
Requires Docker and specific technical prerequisites for setup
Limited documentation and community resources as a newer project
View More