C Transformers
C Transformers 程式庫為 GGML 模型提供 Python 繫結。
此範例說明如何使用 LangChain 與 C Transformers 模型互動。
安裝
%pip install --upgrade --quiet ctransformers
載入模型
from langchain_community.llms import CTransformers
llm = CTransformers(model="marella/gpt-2-ggml")
API 參考：CTransformers
產生文字
print(llm.invoke("AI is going to"))
串流
from langchain_core.callbacks import StreamingStdOutCallbackHandler
llm = CTransformers(
model="marella/gpt-2-ggml", callbacks=[StreamingStdOutCallbackHandler()]
)
response = llm.invoke("AI is going to")
LLMChain
from langchain.chains import LLMChain
from langchain_core.prompts import PromptTemplate
template = """Question: {question}
Answer:"""
prompt = PromptTemplate.from_template(template)
llm_chain = LLMChain(prompt=prompt, llm=llm)
response = llm_chain.run("What is AI?")
API 參考：LLMChain | PromptTemplate