Jarvis

Jarvis is a private AI assistant that allows you to conduct conversations in written and full voice form. Jarvis is connected to the user's private data and can perform tasks, e.g. setting meetings in Google Calendar

Report Bug · Request Feature

Articles

• https://medium.com/@kacperwlodarczyk/jarvis-the-history-of-my-private-assistant-f802e09b2c96

System Architecture

Jarvis consists of 2 repositories:

• Desktop https://github.com/DEENUU1/jarvis-desktop
• Core/Backend (current)

jarvis.mp4

System architecture

How agent works

How embedding works

Features

• Access on multiple devices - the application backend is hosted on an AWS EC2 instance, so in the future, in addition to the Desktop application, it will also be possible to create a mobile application.
• Conversation history saved in SQLite database
• RAG by saving conversation history to a vector database (Pinecone), as well as the ability to import data from files in various formats and saving data from multiple databases with Notion
• Integration with make.com, currently used to support Google calendar and create notes in Notion
• Agent integration with the Duckduckgo search engine, weather data, current date, news, wikipedia
• Possibility of voice conversation with the assistant by using Whisper to transcribe audio into text
• Ability to convert text to speech to read AI responses

Technologies:

Backend

• Python
  • Langchain
  • FastAPI
• AWS
  • EC2
  • ElasticIP
• Databases:
  • Pinecone (vector)
  • SQLite (history of conversations)
• Docker
• Docker-compose
• Nginx
• Make.com

Desktop

• Rust
  • Tauri
• Typescript
• React
  • Next.js

Installation

Backend

1. Clone repository

git clone https://github.com/DEENUU1/jarvis-backend.git

2. Create .env file

cp .env_example .env

3. Run docker-compose

docker-compose build
docker-compose up

Desktop

1. Clone repository

git clone https://github.com/DEENUU1/jarvis-desktop.git

2. Change directory

cd jarvis

3. Create .env.local file

cp .env.local_example .env.local

4. Install packages

npm i

5. Build app

npm run tauri dev

Other

In ./blueprint directory u can find all blueprints which I made in make.com

Authors

• @DEENUU1

License

See LICENSE.txt for more information.