Data Streaming Nanodegree

Data Streaming Nanodegree by Udacity Notes and Exercises

Notes on usage

Many of the files called "solution" are done for streamed based on ClickEvents. Once marked "solved" are done for some part with the examples of Purchases events as in the video, but later also with ClickEvents.

Name		Name	Last commit message	Last commit date
Latest commit History 56 Commits
Actions in Spark		Actions in Spark
Aggregating Data with KSQL [7.5]		Aggregating Data with KSQL [7.5]
Build a Kafka Consumer [2.6]		Build a Kafka Consumer [2.6]
Complex Records in Avro [3.3]		Complex Records in Avro [3.3]
Configure a Producer [2.4]		Configure a Producer [2.4]
Consuming Avro Data via REST Proxy [4.7]		Consuming Avro Data via REST Proxy [4.7]
Create RDD and DataFrame		Create RDD and DataFrame
Creating a Stream with KSQL [7.1]		Creating a Stream with KSQL [7.1]
Creating a Table with KSQL [7.2]		Creating a Table with KSQL [7.2]
Data Streaming without Schemas [3.1]		Data Streaming without Schemas [3.1]
Data Wrangling with Spark		Data Wrangling with Spark
Defining an Avro Record [3.2]		Defining an Avro Record [3.2]
Deserialization in Faust [6.2]		Deserialization in Faust [6.2]
Establishing a Schema Spark Streaming		Establishing a Schema Spark Streaming
Example Spark SQL		Example Spark SQL
Explore How Kafka Works [2.1]		Explore How Kafka Works [2.1]
Hadoop MapReduce		Hadoop MapReduce
Hopping Windows [6.8]		Hopping Windows [6.8]
Integrating Schema Registry [3.4]		Integrating Schema Registry [3.4]
Kafka Connect FileStream Source [4.2]		Kafka Connect FileStream Source [4.2]
Kafka Connect JDBC Source [4.3]		Kafka Connect JDBC Source [4.3]
Kafka Python Library [1.2]		Kafka Python Library [1.2]
Output Sinks		Output Sinks
Practice with Consumer Offsets [2.5]		Practice with Consumer Offsets [2.5]
Procedural vs Functional in Python		Procedural vs Functional in Python
Processors & Operations [6.5]		Processors & Operations [6.5]
Producing Avro Data via REST Proxy [4.6]		Producing Avro Data via REST Proxy [4.6]
Producing JSON Data via REST Proxy [4.5]		Producing JSON Data via REST Proxy [4.5]
Project - Optimizing Public Transportation		Project - Optimizing Public Transportation
Project - SF Crime Statistics with Spark Streaming		Project - SF Crime Statistics with Spark Streaming
Querying with KSQL [7.3]		Querying with KSQL [7.3]
Quiz - Data Wrangling with DataFrames		Quiz - Data Wrangling with DataFrames
Quiz - Data Wrangling with SparkSQL		Quiz - Data Wrangling with SparkSQL
REST Proxy Metadata API [4.4]		REST Proxy Metadata API [4.4]
Reading and Writing Data with Spark DataFrames		Reading and Writing Data with Spark DataFrames
Serialization in Faust [6.3]		Serialization in Faust [6.3]
Session Windowing with KSQL [7.4]		Session Windowing with KSQL [7.4]
Spark maps and lazy evaluation		Spark maps and lazy evaluation
State Management Spark Streaming		State Management Spark Streaming
Streaming - Create a Kafka Producer Server [Incomplete]		Streaming - Create a Kafka Producer Server [Incomplete]
Streaming - Kafka Data Source API [Incomplete]		Streaming - Kafka Data Source API [Incomplete]
Streaming - Offsets & Triggers [Incomplete]		Streaming - Offsets & Triggers [Incomplete]
Streaming - Progress Reports in Spark Console [Incomplete]		Streaming - Progress Reports in Spark Console [Incomplete]
Streams [6.4]		Streams [6.4]
Structured Streaming APIs Joins		Structured Streaming APIs Joins
Synchronous or Asynchronous [2.3]		Synchronous or Asynchronous [2.3]
Tables in Faust [6.6]		Tables in Faust [6.6]
Topic Creation [2.2]		Topic Creation [2.2]
Transformations in DAGs		Transformations in DAGs
Transformations in Spark		Transformations in Spark
Tumbling Windows [6.7]		Tumbling Windows [6.7]
Using Kafka CLI Tools [1.1]		Using Kafka CLI Tools [1.1]
Using the Kafka Connect API [4.1]		Using the Kafka Connect API [4.1]
Watermark Spark Streaming		Watermark Spark Streaming
Your First Faust Application [6.1]		Your First Faust Application [6.1]
.gitignore		.gitignore
README.md		README.md
requirements.txt		requirements.txt

eshnil2000/streaming_nd

Folders and files

Latest commit

History

Repository files navigation

Data Streaming Nanodegree

Notes on usage

About

Topics

Resources

Stars

Watchers

Forks

Languages