FuriosaAI Howto
FuriosaAI is a semiconductor company that develops high-performance, energy-efficient AI accelerators specifically designed for LLM and multimodal deployment in data centers.
View MoreHow to Use FuriosaAI
Register for Early Access Program: Contact [email protected] to register for the Early Access Program (EAP) and agree to the End User License Agreement (EULA)
Set up Authentication: After registration, login to FuriosaAI IAM and create a new API key that will be needed for accessing FuriosaAI services
Configure APT Repository: Set up the FuriosaAI APT repository on Ubuntu/Debian by registering the public signing key and configuring the API key authentication
Install Required Packages: Install kernel drivers, firmware, and runtime library via APT package manager using the configured repository
Install SDK: Install Furiosa SDK using pip, which includes compiler, profiler, and other development tools
Install Model Zoo: Install furiosa-models package to access pre-trained and pre-quantized models optimized for FuriosaAI NPUs
Development: Use the Python/C SDK, runtime libraries and command line tools to develop AI applications leveraging FuriosaAI NPU hardware
Model Deployment: Deploy models using furiosa-serving package and utilize the provided APIs for inference on FuriosaAI hardware
FuriosaAI FAQs
FuriosaAI is an AI chip startup company founded in 2017 that creates next-generation NPU (Neural Processing Unit) products for AI deployment, with their latest product being the Furiosa RNGD data center accelerator.
Related Articles
View More