Skip to content

This code makes you go through, how to write a Kafka consumer program to append data to HDFS using Eclipse and Horton Work Sanbox

Notifications You must be signed in to change notification settings

AshrithGande/KafkaConsumerHDFSAppend

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 

Repository files navigation

KafkaConsumerHDFSAppend

This code makes you go through, how to write a Kafka consumer program to append data to HDFS using Eclipse and Horton Work Sanbox

The File App.java Includes a java code to fetch data from Kafka Topic and calls a method of HDFSAppendTrial, to store the data in file saved on HDFS.

App.java file where we set properties of consumer, create a KafkaConsumer and set the required configurations, coreSite path, hdfsSite path, and path for the file where consumer data needs to be appended, which are helpful to create filesystem using other methods of other class called HDFSAppendTrial.Java.

pom.xml sets the depedencies required for a maven project and plugins that are to be use.

If Any suggestions of edits or to make my code more appropriate is appreciated !

About

This code makes you go through, how to write a Kafka consumer program to append data to HDFS using Eclipse and Horton Work Sanbox

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages