Arch Howto
Arch is an intelligent Layer 7 gateway built on Envoy Proxy that provides secure handling, robust observability, and seamless integration of prompts with APIs for building fast, robust, and personalized AI agents.
View MoreHow to Use Arch
Install Prerequisites: Ensure you have Docker (v24), Docker compose (v2.29), Python (v3.10), and Poetry (v1.8.3) installed on your system. Poetry is needed for local development.
Create Python Virtual Environment: Create and activate a new Python virtual environment using: python -m venv venv && source venv/bin/activate (or venv\Scripts\activate on Windows)
Install Arch CLI: Install the Arch gateway CLI tool using pip: pip install archgw
Create Configuration File: Create a configuration file (e.g., arch_config.yaml) defining your LLM providers, prompt targets, endpoints, and other settings like system prompts and parameters
Configure LLM Providers: In the config file, set up your LLM providers (e.g., OpenAI) with appropriate access keys and model settings
Define Prompt Targets: Configure prompt targets in the config file, specifying endpoints, parameters, and descriptions for each target function
Set Up Endpoints: Define your application endpoints in the config file, including connection settings and timeouts
Initialize Client: Create an OpenAI client instance pointing to Arch gateway (e.g., base_url='http://127.0.0.1:12000/v1') in your application code
Make API Calls: Use the configured client to make API calls through Arch, which will handle routing, security, and observability
Monitor Performance: Use Arch's built-in observability features to monitor metrics, traces, and logs for your LLM interactions
Arch FAQs
Arch is an intelligent Layer 7 gateway designed to protect, observe, and personalize LLM applications with APIs. It's built on Envoy Proxy and engineered with purpose-built LLMs for secure handling, robust observability, and seamless integration of prompts with APIs.
Latest AI Tools Similar to Arch
2000+ ChatGPT Mega-Prompts Bundle
A comprehensive collection of 2,000+ hand-crafted mega-prompts across 8 categories (Marketing, Business, Solopreneur, Writing, Productivity, Education, SEO, and Sales) designed to unlock the full potential of AI chatbots like ChatGPT, Claude and Gemini.
Folderr
Folderr is a comprehensive AI platform that enables users to create custom AI assistants by uploading unlimited files, integrating with multiple language models, and automating workflows through a user-friendly interface.
Peache.ai
Peache.ai is an AI character chat playground that enables users to engage in flirty, witty, and daring conversations with diverse AI personalities through real-time interactions.
TalkPersona
TalkPersona is an AI-powered video chatbot that provides real-time human-like conversation through a virtual talking face with natural voice and lip-sync capabilities.
Popular AI Tools Like Arch
ChatGPT
ChatGPT is an advanced AI-powered chatbot developed by OpenAI that uses natural language processing to engage in human-like conversations and assist with a wide range of tasks.
DuckDuckGo AI Chat
DuckDuckGo AI Chat is a free, anonymous way to access popular AI chatbots like GPT-3.5, Claude, and others while preserving user privacy.
Hello GPT-4o
GPT-4o is OpenAI's new flagship multimodal AI model that can seamlessly reason across audio, vision, and text in real-time with enhanced speed and reduced costs.
Gemini - Google Vids AI
Gemini is Google's most advanced and capable multimodal AI model family that can seamlessly understand and reason across text, images, video, audio, and code to power various AI applications and services.
View More