Pages

Thursday 4 August 2016

Important Commands

All Hadoop commands are invoked by the $HADOOP_HOME/bin/hadoop command. Running the Hadoop script without any arguments prints the description for all commands.
Usage : hadoop [--config confdir] COMMAND

The following table lists the options available and their description.

Options
Description
namenode -format
Formats the DFS filesystem.
secondarynamenode
Runs the DFS secondary namenode.
namenode
Runs the DFS namenode.
datanode
Runs a DFS datanode.
dfsadmin
Runs a DFS admin client.
mradmin
Runs a Map-Reduce admin client.
fsck
Runs a DFS filesystem checking utility.
fs
Runs a generic filesystem user client.
balancer
Runs a cluster balancing utility.
oiv
Applies the offline fsimage viewer to an fsimage.
fetchdt
Fetches a delegation token from the NameNode.
jobtracker
Runs the MapReduce job Tracker node.
pipes
Runs a Pipes job.
tasktracker
Runs a MapReduce task Tracker node.
historyserver
Runs job history servers as a standalone daemon.
job
Manipulates the MapReduce jobs.
queue
Gets information regarding JobQueues.
version
Prints the version.
jar <jar>
Runs a jar file.
distcp <srcurl> <desturl>
Copies file or directories recursively.
distcp2 <srcurl> <desturl>
DistCp version 2.
archive -archiveName NAME -p
Creates a hadoop archive.
<parent path> <src>* <dest>

classpath
Prints the class path needed to get the Hadoop jar and the required libraries.
daemonlog
Get/Set the log level for each daemon
 

No comments:

Post a Comment