Fish Speech Howto

Fish Speech is an open-source, multilingual text-to-speech model capable of generating high-quality, natural-sounding speech in Chinese, Japanese, and English with customizable voices and emotions.
View More

How to Use Fish Speech

Install dependencies: Install required packages by running: pip3 install torch torchvision torchaudio
Create virtual environment: Create a Python 3.10 virtual environment using conda: conda create -n fish-speech python=3.10
Activate environment: Activate the virtual environment: conda activate fish-speech
Install Fish Speech: Install Fish Speech by running: pip3 install -e .
Download models: Download required models from Hugging Face: huggingface-cli download fishaudio/fish-speech-1.2-sft --local-dir checkpoints/fish-speech-1.2-sft
Run inference: Generate speech by running: python tools/llama/generate.py --text "Your text here" --checkpoint-path "checkpoints/fish-speech-1.2-sft"
Decode audio: Decode the generated tokens to audio using VQGAN: python tools/vqgan/inference.py -i "codes_0.npy" --checkpoint-path "checkpoints/fish-speech-1.2-sft/firefly-gan-vq-fsq-4x1024-42hz-generator.pth"
Start web UI (optional): Launch the web interface by running: python -m tools.webui --llama-checkpoint-path "checkpoints/fish-speech-1.2-sft" --decoder-checkpoint-path "checkpoints/fish-speech-1.2-sft/firefly-gan-vq-fsq-4x1024-42hz-generator.pth"

Fish Speech FAQs

Fish Speech is an open-source text-to-speech (TTS) model developed by Fish Audio. It is trained on 150,000 hours of multilingual audio data and can generate high-quality speech in Chinese, Japanese, and English.

Latest AI Tools Similar to Fish Speech

F5 TTS
F5 TTS
F5-TTS is a state-of-the-art, non-autoregressive text-to-speech system that uses Flow Matching and Diffusion Transformer techniques to generate highly natural and expressive speech with zero-shot voice cloning capabilities.
Notebooklm Podcast
Notebooklm Podcast
NotebookLM Podcast is Google's AI-powered tool that transforms documents, web content, and research materials into engaging podcast-style conversations between two AI hosts, making complex information more accessible through audio format.
Voice-Gen
Voice-Gen
Voice-Gen is an all-in-one AI platform that combines voice generation, image creation, and video production capabilities with flexible pay-as-you-go pricing and support for multiple languages.
Rift Podcast
Rift Podcast
Rift Podcast is an AI-powered application that transforms web content into personalized audio podcasts, offering exclusive insights curated from various tech platforms and delivered in just 15 minutes daily.

Popular AI Tools Like Fish Speech

CapCut
CapCut
CapCut is a free, all-in-one video editing and graphic design tool powered by AI that enables users to create high-quality content across multiple platforms.
Clipchamp
Clipchamp
Clipchamp is an easy-to-use online video editor with professional features, AI-powered tools, and templates that allows anyone to create high-quality videos without expertise.
Vidnoz
Vidnoz
Vidnoz is an AI-powered video creation platform that enables users to quickly generate professional-quality videos with lifelike avatars, natural voices, and customizable templates.
Speechify
Speechify
Speechify is the leading AI text-to-speech app that converts written text into natural-sounding audio across multiple platforms and devices.