Rust MiniDFS (local HDFS) Testcontainer
-
Updated
May 27, 2024 - Rust
Rust MiniDFS (local HDFS) Testcontainer
This project aims to address Egypt's energy challenges by leveraging data-driven solutions. With increasing demand from urban centers and industries, conventional approaches such as random power cuts have proven ineffective. To tackle this issue, we are adopting a proactive strategy grounded in data analytics.
A tool for scale and performance testing of HDFS with a specific focus on the NameNode.
News Sentiment Analysis using ETL pipeline
Data Engineering Project with Hadoop HDFS and Kafka
The Ararajuba script aims to identify whether Optimized Row Columnar files in the Hadoop Distributed File System are corrupted, for this purpose it uses the count method and analyzes the difference in schemas in the tables.
Simulation of a Hadoop distributed file system
WIP: hdfs/libhdfs drop-in replacements without Java
BigData Engineering Capstone Project with Tech-stack : Linux, MySQL, sqoop, HDFS, Hive, Impala, SparkSQL, SparkML, git
Big Data project. Web client for HDFS. Working in the terminal. Has ability to manipulate local and Hadoop storage
Yelp data analysis using HBase Java API and building a QA application
Map-Reduce paradigm in Apache Hadoop for KNN algorithm based on Kaggle Titanic Dataset
This is old repository from my archive . Hope this might help me in near future
MapReduce Python Example
Add a description, image, and links to the hdfs-dfs topic page so that developers can more easily learn about it.
To associate your repository with the hdfs-dfs topic, visit your repo's landing page and select "manage topics."