SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

More than 2000+ Data engineer interview questions.

Big data projects implemented by Maniram yadav

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers

Tutorials on Big Data essentials: Hadoop, MapReduce, Spark.

Instructions on setting up Hadoop, HDFS, java, sbt, kafka, scala, spark and flume on Ubuntu 18.04

Helm chart for Apache Hadoop using multi-arch docker images

A Java Hdfs client example and full Kerberos example for call hadoop commands directly in java code or on your local machine.

Our Hadoop starter-kit repository contains Hadoop configurations, OCI image templates, Kubernetes YAML templates, AWS CloudFormation templates, Chef cookbooks, and Shell scripts needed to automate and run Hadoop cluster nodes as containerized as well as non-containerized workloads.

Installation and configuration of Hadoop on Google Colaboratory

Marathon on yarn

This Hadoop project involves analysing the airline datasets to solve a few problem statements.

Mammoth is a container based hadoop distributed system log analyzer. Sponsed by Mantech and Naver Cloud Platform.

MapReduce Python Example

Toy Hadoop cluster combining various SQL-on-Hadoop variants

Vehicle Fuel Hadoop MapReduce