Skip to content

Listed steps about how to move data from Mysql to HIVE using Sqoop and Hive to Mysql using sqoop.

License

Notifications You must be signed in to change notification settings

ashok-amsamani/HIVE-SQOOP-Integration

Repository files navigation

HIVE-SQOOP-Integration

Listed steps about how to move data from Mysql to HIVE using Sqoop and Hive to Mysql using sqoop.

Follow steps given in script.txt. It has HIVE/SQOOP/Linux and Hadoop scripts. You should have a knowledge on where to run what to try this excercise.

It covers:

  1. My sql (create databse, table, execute script file)
  2. Sqoop Import (--direct, --enclosed-by)
  3. Hive (CSV Serde, External table, various fields delimiter, avro, view, hive data to hdfs as file,)
  4. Hadoop (mkdir, put)
  5. Sqoop Export (records.per.statement, staging table

About

Listed steps about how to move data from Mysql to HIVE using Sqoop and Hive to Mysql using sqoop.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published