LLMs

The repository comprises various language models, encompassing both smaller models such as Sentence-BERT, Universal Sentence Encoder(USE).. as well as larger models like LlaMa2,GPT-Ada.... This repository serves as a demonstration of how to generate sentence or document embeddings using these language models. One key advantage of this repository is its facilitation of straightforward model output comparison, enabling users to easily decide which model best aligns with their specific task.

LLM models:

LLM model and their demonstration showed

Smaller models:

• Sentence Bert (SBert)
• Universal Sentence Encoders (USE)
• InferSent
• LASER
• Doc2Vec

Larger Models

• GPT3 - ADA
• LlaMa-2
• GPTNeo
• Bloom

Many more models to come.....

ToDo

1. Add colab demonstration
2. Add Prompting demonstration
3. Add more writeup
4. How to run, command line and packages as well