This document provides a step-by-step guide to install and run the Llama 3.1:8B model on your local machine and configure a chatbot which can read document file and answer questions.
Before you begin, ensure you have the following installed:
- Python (version 3.8 or higher)
- Pip (Python package installer)
- Git (for cloning repositories)
- VSCode (recommended for editing and debugging code)
Ollama is required to run Llama models. Follow these steps based on your OS:
- Download the Ollama installer from the official Ollama website.
- Run the installer and follow the on-screen instructions.
- Verify installation by opening Terminal / PowerShell and running:
ollama --version
https://ollama.com/library/llama3.1:8b
- Open Terminal or Command Prompt based on your OS.
- Run the following command to install and run the Llama 3.1:8B model locally:
ollama run llama3.1:8b
git clone [email protected]:VinayRajput/Chatbot-with-llama3.1-8b.git
pip install --upgrade --quiet langchain-openai langchain
pip install streamlit
pip install python-dotenv langchain-community
pip install -U langchain_chroma
pip install -U langchain-ollama
pip install langchain-community
pip install pypdf
streamlit run app.py