FileGPT: Local cognitive search over a pdf

Steps to run the model locally

• clone this repository

     git clone https://github.com/allthatido/FileGPT.git
  

• Navigate to the models folder

• Download the LLama family model (GGML V3 only) you want to test. Refer to README.md in the models folder. Huggingface is a good source for these.

• install dependencies. If you get an error for the below command, install each library indivisually using pip install. Windows users may have to install latest Visual C++ libraries from here and CMake from here. If you have a Nvidia GPU use cuBLAS to speed up inference. Install llama-cpp-python as described here

     pip install -r requirements.txt
  

• Start streamlit app

     streamlit run app.py
  

• Open browser and go to http://localhost:8501/