Label Studio is a multi-type data labeling and annotation tool with standardized output format

Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.

An orchestration platform for the development, production, and observation of data assets.

A high-throughput and memory-efficient inference and serving engine for LLMs

Here lies the resources and topics necessary for the role of Data Scientist and Machine Learning

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

Build MLOps Pipelines in Minutes

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

an experimental iOS app that uses nightly ML Operations to train models and predict river flows (forecasting)

This repository contains the notes, practice and sample outputs, homeworks, etc, from DataTalks.Club's MLOps Zoomcamp 2024 Cohort

🦄 Unitxt: a python library for getting data fired up and set for training and evaluation

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

Turns Data and AI algorithms into production-ready web applications in no time.

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.