docker 单机hadoop 20220723 sequenceiq/hadoop-docker:2.6.0

docker 单机hadoop 20220723 sequenceiq/hadoop-docker:2.6.0

安装环境centos7.2docker 18.06.0-ce(这个安装参考我的另外一篇博客首先关闭防火墙systemctl stop firewalld.service #停止firewallsystemctl disable firewalld.service #禁止firewall开机启动下载hadoop镜像

docker pull sequenceiq/hadoop-docker:2.6.0查看镜像

docker images运行hadoop

docker run -i -t -p 50070:50070 -p 19000:19000 -p 8088:8088 -p 8040:8040 -p 8042:8042 -p 49707:49707 -p 50010:50010 -p 50075:50075 -p 50090:50090 sequenceiq/hadoop-docker:2.6.0 /etc/bootstrap.sh -bash测试是否安装成功先进入hadoop容器

docker exec -it ${CONTAINER ID} /bin/bash执行完成docker run 也就是上一步,该步骤可以省略

cd /usr/local/hadoop-2.6.0bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar grep input output 'dfs[a-z.]+'如果执行mapreduce程序说明安装成功可以打开浏览器查看宿主机IP:50070

docker安装完毕为了正常使用还需安装以下东西

vi /etc/profile在最底部加入下面内容

export HADOOP_HOME="/usr/local/hadoop-2.6.0"export PATH=$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH保存:wq使得配置生效

source /etc/profile查看命令行是否能用

hadoop versiondocker命令行安装完毕测试jar文件在hadoop中启动上传一个jar到宿主机我用hadoop-mapreduce-examples-2.6.0.jar(这个可以自己在网上下一个)拷贝jar文件到容器docker cp 要拷贝的文件路径 容器名：要拷贝到容器里面对应的路径

docker cp /root/hadoop-mapreduce-examples-2.6.0.jar b7d7f88574fb:/usr/local/hadoop-2.6.0查看是否成功

docker exec -it b7d7f88574fb /bin/bashcd /usr/local/hadoop-2.6.0ls上传一个文件到hdfs

vi a.txt输入下面内容

canglaoshi is mylovexiaoze is mylovewutenglan is mylove保存hadoop创建文件夹

hadoop fs -mkdir -p /wordcount/inputhadoop fs -put a.txt /wordcount/inputhadoop jar    share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar                wordcount /wordcount/input /wordcount/output

查看输出内容

hadoop fs -cat /wordcount/output/part-r-00000

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。