Skip to content

jayanmuralidharan/hadoop2windowsbuild

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Hadoop 2 Build for Windows

Unofficial Precompiled Windows build of the hadoop-releases [2.7.5 ; 2.8.3 ; 2.9.0] based on instructions in https://github.com/apache/hadoop/blob/trunk/BUILDING.txt
Built on windows server 2016 with windows sdk 7.1 , maven 3.5.2, protocolbuffer 2.5.0 , cmake 3.10.1, zlib 1.2.11
Note: The build in this repo excludes hadoop-2.x.x\share folder which contains bulk of the jars which can be sourced from alternate platform builds.

Download and Setup Hadoop Windows Binaries :

mkdir c:\hdp
cd c:\hdp
git clone https://github.com/jayanmuralidharan/hadoop2windowsbuild.git
cd hadoop2windowsbuild
Extract windows binaries
unzip hadoop-2.x.x.zip

Setup Environment variables:

set HADOOP_HOME=c:\hdp\hadoop2windowsbuild\hadoop-2.x.x
Make sure you have JDK 8 installed. Modify %HADOOP_HOME%\etc\hadoop\hadoop-env.cmd to use windows short path for the jdk folder as below:
set JAVA_HOME=C:\Progra~1\Java\jdk1.8.0_131

Add rest of jar dependencies from standard build

curl -O http://apache.claz.org/hadoop/common/hadoop-2.7.5/hadoop-2.7.5.tar.gz
tar -xzvf hadoop-2.7.5.tar.gz
Copy over only the 'share' folder that contains the jars to the HADOOP_HOME directory
Add %HADOOP_HOME%\bin to PATH variable.

About

Hadoop 2 Build for Windows

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published