A Fully Deployable React-Native mobile app that seeks to classify incoming messages in messaging apps into important or disturbing categories. using a Multi-Modal Machine Learning Architecture to achieve Text classification, Image classification and YouTube Video Link classification.
Analyzing Hateful Memes/ (Resources:- Hateful Memes Challenge)
The purpose of this project is to build an NLP model to make reading medical abtracts easier.
PyTorch Data loaders and abstraction for multi-modal data.
Deep Learning for Music & Audio - Multi modal project
A multimodal that uses both text and Images to tells what will be the expected emotion of the viewer of the news.
Example of a multimodal (end-to-end) deep learning model with transformers architecture
Showcases ongoing, and completed projects within various research themes.
Leveraging Meteorological data and All-Sky Images to create a multimodal model for better forecasting of Solar Irradiance parameters.
Accepted at The Web Conference 2024.
Multi-learning
Deeplearning utils for multimodal research
Code and Models for Binding Text, Images, Graphs, and Audio for Music Representation Learning
Visual Question Answering (VQA) Model
Dynamic Multimodal Inference [CMU Spring 2024 Course Project : 11-785 Introduction to Deep Learning]
Semi-Supervised Learning (SSL)
Using a 3D Nearby Self-Attention Transformer to leverage the spatiotemporal nature of video for representation learning.
API to infer automated disease detection and report generation from medical images.
Add a description, image, and links to the multimodal-deep-learning topic page so that developers can more easily learn about it.
To associate your repository with the multimodal-deep-learning topic, visit your repo's landing page and select "manage topics."