π» Data Engineer | π§ AI/ML Enthusiast | βοΈ Cloud Explorer
- π I'm a Computer Engineering graduate from Mumbai University
- πΌ Previously worked as a Data Engineer at Khushibaby, focused on health data pipelines and analytics
- π Iβve built end-to-end ETL pipelines using tools like Airflow, Dagster, Mage, Spark, and Kafka
- π± Currently experimenting with Azure Databricks, PySpark, and Delta Lake for building scalable pipelines
- π― Goal: Transition into advanced AI/ML Engineering roles in the cloud/data space
- π§© Interested in real-time data processing, large-scale data warehousing, and model deployment
Languages:
Python
| SQL
| Java
| C/C++
Data Engineering:
Apache Airflow
| Mage.ai
| Dagster
| Spark
| Kafka
| Pandas
| Delta Lake
Cloud & Tools:
Azure Databricks
| GCP (BigQuery, GCS)
Docker
| Kubernetes
| Git
| VSCode
| Jupyter
End-to-end pipeline using GCP + Mage AI + Looker Studio
- Loaded raw NYC taxi data into GCS.
- Performed transformations using Mage and stored results in BigQuery
- Visualized KPIs and trends using Looker Studio
- π GitHub Repo
Final Year Academic Project β Deep Learning-based Fire Detection System
- A fire detection model utilizing Python, TensorFlow, and Keras
- Compiled and preprocessed a varied dataset of fire and non-fire scenes
- Designed and trained a Convolutional Neural Network (CNN) for accurate image classification
- Integrated the model seamlessly with a camera using OpenCV, demonstrating practical application of computer vision skills
- Databricks Delta Lake & PySpark
- Real-time & near real-time data processing techniques
- Building a real-time weather data pipeline using OpenWeatherMap API β Azure Event Hub β Databricks Structured Streaming β Delta Lake on ADLS Gen2 for analytics and ML readiness.
- π§ Email: ishamhatre.work@email.com
- πΌ LinkedIn
Thanks for visiting my profile! Feel free to connect or collaborate! π€