LLMs

A simple LLM playground for OpenAI, Replicate, and Perplexity's latest online models with caching supported

llm.py is referenced from danielgross/python-llm

Installation

Setup ur credentials:

REPLICATE_API_TOKEN=
OPENAI_API_KEY=
PPLX_API_KEY=

Rename .env.local to .env

Install requirements

pip install -r requirements.txt

Run test

python llm.py

Run app

streamlit run app.py

Links

Find supported models below

• pplx-api
• Language models – Replicate
• Models - OpenAI API