Skip to content

jayanmuralidharan/hadoop3windowsbuild

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Hadoop 3 Build for Windows

Unofficial Precompiled Windows build of the hadoop-release-3.0.0-RC1 based on instructions in https://github.com/apache/hadoop/blob/trunk/BUILDING.txt
Built on windows server 2016 with windows sdk 7.1 , maven 3.5.2, protocolbuffer 2.5.0 , cmake 3.10.1, zlib 1.2.11
Note: The build in this repo excludes hadoop-3.0.0\share folder which contains bulk of the jars which can be sourced from alternate platform builds.

Download and Setup Hadoop Windows Binaries :

mkdir c:\hdp
cd c:\hdp
git clone https://github.com/jayanmuralidharan/hadoop3windowsbuild.git
cd hadoop3windowsbuild
Extract windows binaries
unzip hadoop-3.0.0.zip

Setup Environment variables:

set HADOOP_HOME=c:\hdp\hadoop3windowsbuild\hadoop-3.0.0
Make sure you have JDK 8 installed. Modify %HADOOP_HOME%\etc\hadoop\hadoop-env.cmd to use windows short path for the jdk folder as below:
set JAVA_HOME=C:\Progra~1\Java\jdk1.8.0_131

Add rest of jar dependencies from standard build

curl -O http://apache.claz.org/hadoop/common/hadoop-3.0.0/hadoop-3.0.0.tar.gz
tar -xzvf hadoop-3.0.0.tar.gz
Copy over only the 'share' folder that contains the jars to the HADOOP_HOME directory
Add %HADOOP_HOME%\bin to PATH variable.

Releases

No releases published

Packages

No packages published