ChatGPFree
Follow Along Code For This Video:
https://www.youtube.com/watch?v=7p73uO3kG50
Remember to install the Ctransformers version that matches your gpu
Also remember to download the model and then update the model path for whichever model you wish to try
Resources:
- HTMX Server Sent Events : https://htmx.org/extensions/server-sent-events/
- Flask Streaming Responses: https://flask.palletsprojects.com/en/2.3.x/patterns/streamin
- CTransformers Installation Docs: https://github.com/marella/ctransformers
- Langchain Docs: https://python.langchain.com/docs/get_started/introduction
- Original Mistral Model Card : https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1?text=Write+a+poem+about+openai%0A%0AOpenAI+-+A+future+so+bright%0AA+tool+that+can+make+things+right%0AWith+G
- The Bloke's Quantized Mistral Models: https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF
