hadoop online cloud storage front-end web UI

Exercise of using MapReduce to parse a CSV file

The projects implemented as a part of the Cloud Computing course using Big Data Technologies

A python implementation of matrix multiplication using Hadoop streaming API

Simulating a consultancy project for Repsol, the repository contains both the code notebook and the analysis.

Leverage the power of Apache Spark for large-scale data processing and analysis

This is an automated hadoop cluster building tool,which implements distributed computing for creating the cluster over the network. This is implemented in python 2.7

Experiments with Big data

MapReduce in Cluster.

MapReduce Job Count Image URL Frequencies from Nodes

An Ansible Role to Configure and setup Hadoop Client Node.

Hadoop map reduce practice

Un TP qui vise à familiariser les apprenants avec le système de fichiers distribué Hadoop (HDFS). Les objectifs spécifiques comprennent le démarrage des processus Hadoop, la création d'une structure d'arborescence dans le HDFS, la manipulation de fichiers en utilisant des commandes Hadoop.

Some code during learning Hadoop.

This engine will be the core of our monitoring mechanism. This engine will use the benefits of machine learning to provide a better solution with dynamic parameters.

Android App

In this project, we used both Hadoop / MapReduce and Spark to do distributed computing. The first task was to perform a series of operations using a Mapper and Reduce java file that was implemented on a Hadoop server. The second task was to perform similar operations, but on Spark instead.

Big Data Analysis on Netflix Prize Dataset with Hadoop