#

hdfs

Here are 915 public repositories matching this topic...

guangie88 / hdfs-to-local

Go program to copy/sync directory recursively from HDFS server to local storage.

go golang sync copy sync-files hdfs hdfs-dfs

Updated Jan 9, 2018
Go

andrea-muti / hadoop-ecosystem-projects

Various projects exploring the Hadoop Ecosystem

hadoop hbase zookeeper hdfs mapreduce

Updated Dec 31, 2018
Java

avaiyang / Hadoop-HDFS-MapReduce

python big-data hadoop hdfs hadoop-mapreduce

Updated Mar 1, 2018
Python

RobinOfSky / Data-development

本仓库主要记录robin的数据开发方面的笔记以及自己学习心得

mysql python java scala spark yarn deep-learning hive storm hbase spark-streaming hdfs mapreduce flink

Updated Sep 6, 2019
Python

potatoshoe / cs435

Big Data

spark hadoop map-reduce hdfs

Updated Nov 16, 2018
Java

gandalf1819 / Risk-Factor-Identification-using-Truck-Fleet-Sensor-Data

Computed truck mileage, driver risk factor using Hive and Pig to understand the risk the company is under from fatigue of drivers and over-used trucks and visualized the sensor data using Tableau to observe the impact of the factors on driver’s performance

sql hive hadoop excel rdbms hdfs tableau pig-latin

Updated Sep 4, 2019
PigLatin

s3ni0r / spark-dojo

Dojo for Scala and Hadoop

docker elasticsearch scala kafka spark hive sbt docker-compose hdfs hadoop-3

Updated May 26, 2019
Shell

surbhitawasthi / MiniProject-AadharCensusDataValidation

A small code to validate the Census data on the basis of Aadhar Data

java hdfs apache-hadoop mapred

Updated Apr 29, 2019
Java

MaksimIvanovPerm / webhdfs

bash interface to HDFS through webhdfs api

bash oracle hdfs bash-script webhdfs oracle-database awr atop webhdfs-api

Updated May 13, 2020
Shell

jim113 / Advanced-Database-Topics-NTUA

Advanced Topics Databases, NTUA 2019-2020

map-reduce pyspark hdfs kmeans-clustering

Updated Jun 28, 2020
Python

vamshikallem / Image-Classification-and-Reverse-Image-Search-on-Google-Open-Image-Dataset

Motive of this project is to handle huge amounts of data using various tools and frameworks of Big Data technologies. Creating Local directory in UMBC cluster, setting up HDFS and Spark frameworks, initializing, setting virtual environment and configuring. Creating directories for pretrained weight files, importing tensorflow and Keras applicati…

pyspark hdfs pretrained-models spark-sql keras-tensorflow reverseimagesearch googleopenimagedata imageranking

Updated Aug 23, 2020
Jupyter Notebook

hyeongonkim / Practices-in-Big-Data

Kookmin Univ. Computer Science, Practices in Big Data, Homework

big-data hadoop n-grams pyspark hdfs mapreduce kookmin-university korean-nlp

Updated Jun 18, 2021
C

datnguyenzzz / Microservices_architecture

The one rules them all

mysql redis flask django kafka akka-http spring hadoop storm rabbitmq zookeeper hdfs akka-streams

Updated May 31, 2022
Java

MengmSun / hadoop-in-docker

Hadoop in docker cluster, created by docker-compose. Create Hadoop cluster in less than 5mins.

docker hadoop docker-compose hdfs hadoop-cluster hadoop-docker hdfs-docker hdfs-cluster

Updated Apr 17, 2022
Shell

hnijad / spark-yarn-docker

3 node spark cluster on top of yarn using docker

docker spark yarn hadoop hdfs

Updated Jul 13, 2022
Shell

oldBuho / Python

No privacy disclosure

python sql spark hadoop ec2 bigdata s3 jupyter-notebook hdfs parquet dataanalysis dataanalytics

Updated Mar 21, 2023
Jupyter Notebook

Cori1109 / local-hashicorp-stack

Local Hashicorp Stack for DevOps Development without Hypervisor or Cloud

spark packer ubuntu virtualbox consul terraform hdfs hashicorp nomad

Updated Feb 14, 2023
HCL

emelis-ptr / SABD1

Progetto: Sistemi e Architetture per Big Data

java docker big-data spark hdfs covid19

Updated Mar 17, 2023
Java

HDZ12 / Big-Data-System

个人的大数据体系

big-data hadoop nosql hbase hdfs mapreduce

Updated Dec 17, 2023
Java

amccurry / pack

Hdfs Block Storage System

docker docker-container driver mount hdfs block-storage volume volume-plugin docker-volume-driver hdfs-cluster

Updated Jul 15, 2022
Java

Improve this page

Add a description, image, and links to the hdfs topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the hdfs topic, visit your repo's landing page and select "manage topics."