当前位置: 代码迷 >> 综合 >> HDFS和Zookeeper的常用命令
  详细解决方案

HDFS和Zookeeper的常用命令

热度:2   发布时间:2024-02-01 18:08:14.0

zookeeper: 

1)使用help命令可查看ZooKeeper的shell操作可用的命令,如下:

[zk: localhost:2181(CONNECTED) 13] help
ZooKeeper -server host:port cmd argsstat path [watch]set path data [version]ls path [watch]delquota [-n|-b] pathls2 path [watch]setAcl path aclsetquota -n|-b val pathhistory redo cmdnoprintwatches on|offdelete path [version]sync pathlistquota pathrmr pathget path [watch]create [-s] [-e] path data acladdauth scheme authquit getAcl pathclose connect host:port

 (2)查看当前Znode下包含的内容:ls path 

[zk: localhost:2181(CONNECTED) 14] ls /
[zookeeper, new_dir]

(3)查看当前节点详细的数据:ls2 path 

[zk: localhost:2181(CONNECTED) 15] ls2 /
[zookeeper, new_dir]
cZxid = 0x0
ctime = Thu Jan 01 08:00:00 CST 1970
mZxid = 0x0
mtime = Thu Jan 01 08:00:00 CST 1970
pZxid = 0x100000004
cversion = 2
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 0
numChildren = 2

(4)创建普通节点(必须在创建节点时有数据):create path data 

[zk: localhost:2181(CONNECTED) 18] create /new_dir "123"
Created /new_dir

(5)获得节点的值:get path 

[zk: localhost:2181(CONNECTED) 19] get /new_dir
123
cZxid = 0x100000006
ctime = Mon Jul 27 23:22:54 CST 2020
mZxid = 0x100000006
mtime = Mon Jul 27 23:22:54 CST 2020
pZxid = 0x100000006
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 3
numChildren = 0

(6)修改节点的值

[zk: localhost:2181(CONNECTED) 20] set /new_dir "456"
cZxid = 0x100000006
ctime = Mon Jul 27 23:22:54 CST 2020
mZxid = 0x100000007
mtime = Mon Jul 27 23:38:46 CST 2020
pZxid = 0x100000006
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 3
numChildren = 0

(7)创建序列节点

[zk: localhost:2181(CONNECTED) 21] create -s /new_dir/dir 1233
Created /new_dir/dir0000000000
[zk: localhost:2181(CONNECTED) 22] create -s /new_dir/dir 1233
Created /new_dir/dir0000000001
[zk: localhost:2181(CONNECTED) 23] 

(8)删除节点

[zk: localhost:2181(CONNECTED) 23] delete /new_dir/dir000000000dir0000000000   dir0000000001
[zk: localhost:2181(CONNECTED) 23] delete /new_dir/dir0000000000
[zk: localhost:2181(CONNECTED) 24] ls /new_dir/dir0000000001
[]
[zk: localhost:2181(CONNECTED) 25] 

Hdfs

-help             功能:输出这个命令参数手册-ls                  功能:显示目录信息示例: hadoop fs -ls hdfs://hadoop-server01:9000/备注:这些参数中,所有的hdfs路径都可以简写-->hadoop fs -ls /   等同于上一条命令的效果-mkdir              功能:在hdfs上创建目录示例:hadoop fs  -mkdir  -p  /aaa/bbb/cc/dd-moveFromLocal     (这里的本地为虚拟机本地,千万别以为是电脑本机的本地)       功能:从本地剪切粘贴到hdfs示例:hadoop  fs  - moveFromLocal  /home/hadoop/a.txt  /aaa/bbb/cc/dd-moveToLocal              功能:从hdfs剪切粘贴到本地示例:hadoop  fs  - moveToLocal   /aaa/bbb/cc/dd  /home/hadoop/a.txt--appendToFile  功能:追加一个文件到已经存在的文件末尾示例:hadoop  fs  -appendToFile  ./hello.txt  hdfs://hadoop-server01:9000/hello.txt可以简写为:Hadoop  fs  -appendToFile  ./hello.txt  /hello.txt-cat  功能:显示文件内容  示例:hadoop fs -cat  /hello.txt-tail                 功能:显示一个文件的末尾示例:hadoop  fs  -tail  /weblog/access_log.1-text                  功能:以字符形式打印一个文件的内容示例:hadoop  fs  -text  /weblog/access_log.1-chgrp-chmod-chown功能:linux文件系统中的用法一样,对文件所属权限示例:hadoop  fs  -chmod  666  /hello.txthadoop  fs  -chown  someuser:somegrp   /hello.txt-copyFromLocal    功能:从本地文件系统中拷贝文件到hdfs路径去示例:hadoop  fs  -copyFromLocal  ./jdk.tar.gz  /aaa/-copyToLocal      功能:从hdfs拷贝到本地示例:hadoop fs -copyToLocal /aaa/jdk.tar.gz-cp              功能:从hdfs的一个路径拷贝hdfs的另一个路径示例: hadoop  fs  -cp  /aaa/jdk.tar.gz  /bbb/jdk.tar.gz.2-mv                     功能:在hdfs目录中移动文件示例: hadoop  fs  -mv  /aaa/jdk.tar.gz  /-get              功能:等同于copyToLocal,就是从hdfs下载文件到本地示例:hadoop fs -get  /aaa/jdk.tar.gz-getmerge             功能:合并下载多个文件示例:比如hdfs的目录 /aaa/下有多个文件:log.1, log.2,log.3,...hadoop fs -getmerge /aaa/log.* ./log.sum-put                功能:等同于copyFromLocal示例:hadoop  fs  -put  /aaa/jdk.tar.gz  /bbb/jdk.tar.gz.2-rm                功能:删除文件或文件夹示例:hadoop fs -rm -r /aaa/bbb/-rmdir                 功能:删除空目录示例:hadoop  fs  -rmdir   /aaa/bbb/ccc-df               功能:统计文件系统的可用空间信息示例:hadoop  fs  -df  -h  /-du功能:统计文件夹的大小信息示例:hadoop fs -du -s -h /1805c/*-count         功能:统计一个指定目录下的文件节点数量示例:hadoop fs -count /aaa/

 

  相关解决方案