Skip to content

Detailed about how we can dynamically load columns in HIVE using AVRO.

License

Notifications You must be signed in to change notification settings

ashok-amsamani/Hive-Schema-Evolution

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

Hive-Schema-Evolution

Detailed about how we can dynamically load columns in HIVE using AVRO.

Follow the steps given in query.hql

Concepts Covered:

  1. How to execute sql script file in mysql.
  2. Sqoop import with split-by, delete-target-dir, --as-avrodatafile
  3. Downloading avro jar from MAVEN.
  4. Extracting avro schema using avro jar.
  5. AVRO hive table creation
  6. Sqoop Incremental append and hive schema expansion

About

Detailed about how we can dynamically load columns in HIVE using AVRO.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages