Skip to content

Lightning is an ultra-fast AI chatbot powered by Groq LPUs (Language Processing Units), offering one of the fastest inference speeds on the market as of April 2024. With its advanced natural language processing capabilities and lightning-fast response times, Lightning provides an unparalleled conversational experience.

License

Notifications You must be signed in to change notification settings

MaxMLang/lightningfast-ai-chat

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Lightning Chatbot

Supports Meta AI's new Llama 3 Model!

Lightning Chatbot Logo

GitHub Stars GitHub Issues GitHub Pull Requests License

Lightning is an ultra-fast AI chatbot powered by Groq LPUs (Language Processing Units), offering one of the fastest inference speeds on the market as of April 2024. With its advanced natural language processing capabilities and lightning-fast response times, Lightning provides an unparalleled conversational experience.

Features

  • ⚡ Ultra-fast inference powered by Groq LPUs
  • 🎨 Customizable model selection and conversational memory length
  • 💬 Seamless conversation history tracking
  • 🌐 Easy deployment using Streamlit web framework

Available Models

  • 🦙 Llama3-70B-8192: Experience high-end performance with this large-scale model, ideal for complex language tasks and deep learning insights.
  • 🦙 Llama3-8B-8192: Harness robust capabilities with this more accessible version of Llama3, perfect for a wide range of AI applications.
  • 🌟 Mixtral-8x7B-32768: Leverage the power of ensemble modeling with Mixtral's extensive capacity for nuanced understanding and response generation.
  • 🦙 Llama2-70B-4096: Utilize the proven effectiveness of Llama2 for comprehensive language processing and application development.
  • 💎 Gemma-7B-IT: Explore specialized interactions and tech-focused solutions with Gemma, tailored for IT and technical content.

Installation

  1. Clone the repository:git clone https://github.com/MaxMLang/lightningfast-ai-chat.git
  2. Navigate to the project directory:
cd lightningfast-ai-chat
  1. Install the required dependencies:
pip install -r requirements.txt
  1. Set up the Groq API key:
  • Create a .env file in the project directory.

  • Add the following line to the .env file, replacing your_api_key with your actual Groq API key:

    GROQ_API_KEY=your_api_key
    
  1. Run the chatbot:
streamlit run app.py
  1. Open the provided URL in your web browser to access the Lightning Chatbot interface.

Usage

  1. Choose a language model from the sidebar.
  2. Adjust the conversational memory length using the slider in the sidebar.
  3. Type your question or message in the input field and press Enter.
  4. Lightning will generate a response using the selected model and display it in the chat interface.
  5. Continue the conversation by entering more questions or messages.

License

This project is licensed under the MIT License.

Acknowledgements

  • Groq for providing the lightning-fast LPUs.
  • Langchain for the powerful language modeling capabilities.
  • Streamlit for the intuitive web framework.

About

Lightning is an ultra-fast AI chatbot powered by Groq LPUs (Language Processing Units), offering one of the fastest inference speeds on the market as of April 2024. With its advanced natural language processing capabilities and lightning-fast response times, Lightning provides an unparalleled conversational experience.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages