_ | 覦覈襦 | 豕蠏手 | 殊螳 | 譯殊碁
FrontPage › HDFS

Contents

1 hadoop fs
2 hadoop dfsadmin
3 Requested data length 80848523 is longer than maximum configured RPC length 67108864
4 谿瑚襭


1 hadoop fs #

stdinput (pipe; |) 襦 hdfs ロ蠍


cat test.txt | hadoop fs -put - /tmp

2 hadoop dfsadmin #

螳 碁れ 螻 讌 危エ覲伎.
hadoop dfsadmin -report

huser@nameNode:~$ hadoop dfsadmin -report
Warning: $HADOOP_HOME is deprecated.

Configured Capacity: 80319594496 (74.8 GB)
Present Capacity: 63944634368 (59.55 GB)
DFS Remaining: 63753732096 (59.38 GB)
DFS Used: 190902272 (182.06 MB)
DFS Used%: 0.3%
Under replicated blocks: 40
Blocks with corrupt replicas: 0
Missing blocks: 0

-------------------------------------------------
Datanodes available: 4 (4 total, 0 dead)

Name: 192.168.136.5:50010
Decommission Status : Normal
Configured Capacity: 20079898624 (18.7 GB)
DFS Used: 47538176 (45.34 MB)
Non DFS Used: 4093796352 (3.81 GB)
DFS Remaining: 15938564096(14.84 GB)
DFS Used%: 0.24%
DFS Remaining%: 79.38%
Last contact: Wed Nov 28 09:01:22 KST 2012


Name: 192.168.136.4:50010
Decommission Status : Normal
Configured Capacity: 20079898624 (18.7 GB)
DFS Used: 47890432 (45.67 MB)
Non DFS Used: 4093718528 (3.81 GB)
DFS Remaining: 15938289664(14.84 GB)
DFS Used%: 0.24%
DFS Remaining%: 79.37%
Last contact: Wed Nov 28 09:01:21 KST 2012


Name: 192.168.136.6:50010
Decommission Status : Normal
Configured Capacity: 20079898624 (18.7 GB)
DFS Used: 47534080 (45.33 MB)
Non DFS Used: 4093710336 (3.81 GB)
DFS Remaining: 15938654208(14.84 GB)
DFS Used%: 0.24%
DFS Remaining%: 79.38%
Last contact: Wed Nov 28 09:01:21 KST 2012


Name: 192.168.136.7:50010
Decommission Status : Normal
Configured Capacity: 20079898624 (18.7 GB)
DFS Used: 47939584 (45.72 MB)
Non DFS Used: 4093734912 (3.81 GB)
DFS Remaining: 15938224128(14.84 GB)
DFS Used%: 0.24%
DFS Remaining%: 79.37%
Last contact: Wed Nov 28 09:01:22 KST 2012


huser@nameNode:~$

3 Requested data length 80848523 is longer than maximum configured RPC length 67108864 #

一危 碁 れ碁 觚襦 襴碁ゼ 蟆譴 , 襴 蠍郁 覓 貉れ 覦 .
HDFS ろ襴讌 豈朱 一危 碁 3 iSCIS ろ襴讌襯 れ企螻 .
蠏碁 一危 碁 3螳 觜伎.

Socket Reader #1 for port 8022: readAndProcess from client 10.1.113.126 threw exception [java.io.IOException: Requested data length 80848523 is longer than maximum configured RPC length 67108864.  RPC came from 10.1.113.126]
java.io.IOException: Requested data length 80848523 is longer than maximum configured RPC length 67108864.  RPC came from 10.1.113.126
    at org.apache.hadoop.ipc.Server$Connection.checkDataLength(Server.java:1610)
    at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1672)
    at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:896)
    at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:752)
    at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:723)

2螳 螳 れ.
  • ipc.maximum.data.length
  • ipc.maximum.response.length

--谿瑚: https://velog.io/@km1031kim/ipc.maximum.data.length-ipc.maximum.response.length


蠍 蠍郁鍵..
企: : るジ讓曙 襦螻豺 企Ν 譯殊語. 襦螻豺
EditText : Print : Mobile : FindPage : DeletePage : LikePages : Powered by MoniWiki : Last modified 2023-02-24 19:39:12

磯Μ螳 覲牛讌 覿 磯Μ 螳螳 讌讌襦 苦 ロ伎 朱 豪麹蟆 り螳螻 碁. 蠏 豈 襷れ 覈企. (蟾蠍)