ChatGLM Howto
ChatGLM is an open-source bilingual (Chinese-English) large language model series developed by Zhipu AI and Tsinghua KEG, featuring smooth dialogue capabilities and low deployment thresholds.
View MoreHow to Use ChatGLM
Install required packages: Install the necessary Python packages by running: pip install protobuf transformers==4.30.2 cpm_kernels torch>=2.0 gradio mdtex2html sentencepiece accelerate
Import the model and tokenizer: Use the following code to import ChatGLM:
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True).half().cuda()
Generate a response: Generate a response by calling the chat method:
response, history = model.chat(tokenizer, "你好", history=[])
print(response)
Continue the conversation: To continue the conversation, pass the history to subsequent calls:
response, history = model.chat(tokenizer, "晚上睡不着应该怎么办", history=history)
print(response)
Use the web interface: For a more user-friendly experience, visit https://chatglm.cn to use the web interface of the larger ChatGLM model
Download mobile app: Scan the QR code on the ChatGLM website to download the mobile app for iOS or Android
ChatGLM FAQs
ChatGLM is an open bilingual language model based on the General Language Model (GLM) framework. It is trained on both Chinese and English data and optimized for question-answering and dialogue tasks.
Related Articles
Popular Articles
Microsoft Ignite 2024: Unveiling Azure AI Foundry Unlocking The AI Revolution
Nov 21, 2024
10 Amazing AI Tools For Your Business You Won't Believe in 2024
Nov 21, 2024
7 Free AI Tools for Students to Boost Productivity in 2024
Nov 21, 2024
OpenAI Launches ChatGPT Advanced Voice Mode on the Web
Nov 20, 2024
View More