OS type : Linux
OS version :
CentOS 6.3
HADOOP type : Cloudera hadoop 4.0 (
CDH4)
企殊磯磯 ′ れ 覃伎
CentOS 6.2
CDH4襯 蟠ロ螻 給. 讌襷 郁規れ 貉危郁 豕企 6.2覯 れ覃 伎 殊企れ ′ 覈詩 覓語螳 蟆 蠏碁 6.3朱 讌給.
企殊磯磯 れ(CDH) 伎
os :
CentOS 6.3 蠍 れ [ /boot 200M, swap 16G, / 襾語覈 ] //swap 16G 襷 .. 覲 伎 ..
node setting : [ Core i7, 16G ram, 1TB HDD, 1Gbit LAN ] *5, Gbit switch
OS 蠍磯蓋 ろ語 れれ 覈 伎り 螳螻 讌.
0. 覈 碁 伎 ssh 磯 ろ.
chkconfig sshd on
service sshd start
1. namenode /etc/hosts 企ろ磯 覓苦 豌 碁れ ip 譯殊 語ろ れ 豈.
ex)
127.0.0.1 localhost
192.168.0.1 namenode
192.168.0.2 secondnode
192.168.0.3 datanode1
192.168.0.3 datanode2
192.168.0.3 datanode3
192.168.0.3 datanode4
2. hostnames.cfg 殊 燕.
伎 hosts れ 蟆螻 螳 襦 螳 覯 語ろ れ襷 k.
namenode
secondnode
datanode1
datanode2
datanode3
datanode4
3. ssh key襯 燕螻 螳 碁 覲旧.
a. ssh key
ssh-keygen -t rsa -P ""
b. 襦貉 ssh key襯 螳 碁る 覲旧
ろ襴渚 ろ(hostnames.cfg )
sh copy_id.sh
copy_key.sh
for i in $(cat hostnames.cfg)
do
ssh-copy-id -i ~/.ssh/id_rsa.pub $i
done
ろ yes , passwd, yes , passwd, yes. 蟾讌 覦覲
譬襭 ssh datanode2 螳 碁る 讌
4. total_setting.sh 殊 覦 ろ . (hostnames.cfg 手骸 螳 襴 ろ)
total_setting.sh
for i in $(cat hostnames.cfg)
do
ssh $i hostname -I;
ssh $i sed -i "s/localhost.localdomain/$i/g" /etc/sysconfig/network;
scp /etc/selinux/config $i:/etc/selinux/config;
scp /etc/hosts $i:/etc/hosts;
ssh $i chkconfig iptables off;
ssh $i chkconfig ip6tables off;
ssh $i service iptables stop;
ssh $i service ip6tables stop;
echo "--------------------done";
# ssh $i shutdown -r now;
done
total_setting 伎
a. 螳 碁れ hostname hostnames.cfg 企朱 谿朱覲蟆
b. 螳 碁れ selinux れ disabled
c. local /etc/hosts 伎 螳 碁襦 覲旧
d. 螳 碁れ 覲伎 伎(iptables, ip6tables)
5. cloudera-manager-installer.bin れ
./cloudera-manager-installer.bin
cloudera-manager-installer.bin
6. れ 讌
殊伎殊 next next 一
襭 cloudera manager れ 碁 ip 7180碁 .(Chrome 觚殊一 豢豌)
ex)
192.168.0.1:7180
蠍磯蓋 企 れ admin / admin
れ 讌 螳 碁覲 role れ
inspector fail 覦 -> 螳 碁 れ (ろ襴渚 ろ 襦 讌 れ )