Backup de mi preparación para el examen CCA175 de Cloudera

Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources

大数据组件学习代码

Service to continually import iasWorld backend data to Parquet using Apache Sqoop

A handful of cheatsheets and programming tips.

Analyze the Chinook music database using Hive in Hadoop.

大数据入门指南 ⭐

End to end big data project, that aims to show how to implement different big data layers, from the infrastructure layer to the end user one. [HADOOP][Spark][Kafka][Cassandra][Ansible][Jupyter][Docker]

Online Advertising Platform - a comprehensive big data project

📊 📑This project provides a step-by-step big data analytics applied in the retail industry through the use of a variety of big data technologies. such as HDFS, Hive and Spark..

Developed a batch ETL pipeline to extract, transform, and load transactional data from RDS to Redshift. Used Sqoop to ingest data from RDS to HDFS, PySpark to transform and load data to S3, and Redshift to create and query dimension & fact tables. Performed analytical queries to identify ATMs with inactive transactions, ATM failures by weather, etc

Completed a big data project using Hadoop, HBase, and Sqoop to ingest, process, and analyze a large dataset of taxi ride data on an AWS EMR cluster. Developed MapReduce codes to perform a variety of tasks. Exported the results of each MapReduce task to an RDS instance for visualization and analysis.

A project to create a Hive data warehouse for E-commerce in AWS and perform data analysis.

In this project I build a batch ETL pipeline to read transactional data from Amazon RDS, transform it to a usable format and then load it into an Amazon S3 bucket. The data is then loaded into Redshift Tables, after which I perform analytical queries on the loaded data to gain insights.

Performed business operations using Big data technologies: AWS EMR, AWS RDS (MySQL), Hadoop, Apache Scoop, Apache HBase, MapReduce

Spar Nord, a Danish bank, optimizes ATM refill frequency by observing withdrawal behavior and dependent factors. The project builds a batch ETL pipeline to load the data into Redshift Data Mart for analytical queries.

Analysed New York City's Yellow taxi data set with Big Data tools such as Hadoop, HBase, Sqoop, MapReduce and AWS Cloud Infrastructure.

Performed end-to-end big data analysis on E-Commerce Sales & Walmart Stock data, extracting valuable insights for impactful reporting.

Listed steps about how to move data from Mysql to HIVE using Sqoop and Hive to Mysql using sqoop.