매핑 후 Hadoop 클러스터가 중지됩니다.

세 대의 컴퓨터로 구성된 hadoop 클러스터가 있습니다. 내가 hadoop 20 G 파일에 넣어, 난 hadoop 시작하고 매핑 후 중지합니다.매핑 후 Hadoop 클러스터가 중지됩니다.

: 작동하지 않는 모든 CPU를 매핑 한 후

"13/08/22 8시 9분 34초 정보의 mapred.JobClient지도 100 %가 11 % 감소". 하루는 기다릴 수는 있지만 다시 시작할 수는 없습니다.

어떻게해야합니까?

2013년 8월 22일 14 : 15 : 32,503 INFO org.apache.hadoop.mapred.MapTask

이 내 로그 파일의 마지막 10 행이며,지도는 100 %이며, 감소 할 때 11 %이다 : 지도 출력 플러시 시작
2013-08-22 14 : 15 : 32,542 정보 org.apache.hadoop.mapred.MapTask : 완료 유출 67
2013-08-22 14 : 15 : 32,552 정보 org.apache.hadoop. 합병 : 68 개의 정렬 된 세그먼트 합치기
2013-08-22 14:15:32,558 정보 org.apache.hadoop.mapred.Merger : 합계 68 개의 중간 세그먼트 5 개 병합
2013-08-22 14 : 15 : 32,622 INFO org.apache.hadoop.mapred.Merger : 64 개의 세그먼트가 총 크기의 왼쪽에있는 마지막 병합 통과까지 : 1600710 바이트
2013-08-22 14 : 15 : 32,708 정보 org.apache.hadoop.mapred.Task : 태스크 : attempt_201308221308_0002_m_000302_0이 완료되었습니다. 그리고 커밋하는 중임
2013-08-22 14 : 15 : 32,717 정보 org.apache.hadoop.mapred.Task : 작업 '시도 _201308221308_0002_m_000302_0'완료.
2013-08-22 14 : 15 : 32,759 INFO org.apache.hadoop.mapred.TaskLogsTruncater : mapRetainSize = -1 및 reduceRetainSize = -1을 사용하여 로그의 truncater 초기화
2013-08-22 14 : 15 : 32,774 정보 org.apache.hadoop.io.nativeio.NativeIO : 캐시 시간 초과가 14400 초인 사용자 맵핑에 대한 UID에 대한 초기화 된 캐시.
2013년 8월 22일 14 : 15 : 32,774 INFO org.apache.hadoop.io.nativeio.NativeIO :

는 지도 마스터 하둡 스레드 덤프의 내 아이, 네이티브 구현에서 UID 1000있어 사용자 이름 llobocki입니다

때 ~ 마스터 20 MiB 크기

2013-08-23 11:37:26 
Full thread dump Java HotSpot(TM) 64-Bit Server VM (23.25-b01 mixed mode): 

"Attach Listener" daemon prio=10 tid=0x0000000000f85800 nid=0x3873 waiting on condition [0x0000000000000000] 
    java.lang.Thread.State: RUNNABLE 

"Thread for polling Map Completion Events" daemon prio=10 tid=0x00007fc32860c800 nid=0x1d7a waiting on condition [0x00007fc31c183000] 
    java.lang.Thread.State: TIMED_WAITING (sleeping) 
    at java.lang.Thread.sleep(Native Method) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2882) 

"Thread for merging in memory files" daemon prio=10 tid=0x00007fc32860a800 nid=0x1d78 in Object.wait() [0x00007fc31c284000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd6dd7c8> (a java.lang.Object) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$ShuffleRamManager.waitForDataToMerge(ReduceTask.java:1197) 
    - locked <0x00000005bd6dd7c8> (a java.lang.Object) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$InMemFSMergeThread.run(ReduceTask.java:2760) 

"Thread for merging on-disk files" daemon prio=10 tid=0x00007fc328608000 nid=0x1d77 in Object.wait() [0x00007fc31c385000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd713988> (a java.util.TreeSet) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTask.java:2654) 
    - locked <0x00000005bd713988> (a java.util.TreeSet) 

"MapOutputCopier attempt_201308230927_0001_r_000000_0.4" prio=10 tid=0x00007fc328606800 nid=0x1d76 in Object.wait() [0x00007fc31c486000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd762eb0> (a java.util.ArrayList) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1324) 
    - locked <0x00000005bd762eb0> (a java.util.ArrayList) 

"MapOutputCopier attempt_201308230927_0001_r_000000_0.3" prio=10 tid=0x00007fc328602000 nid=0x1d75 in Object.wait() [0x00007fc31c587000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd762eb0> (a java.util.ArrayList) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1324) 
    - locked <0x00000005bd762eb0> (a java.util.ArrayList) 

"MapOutputCopier attempt_201308230927_0001_r_000000_0.2" prio=10 tid=0x00007fc328600000 nid=0x1d73 in Object.wait() [0x00007fc31c688000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd762eb0> (a java.util.ArrayList) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1324) 
    - locked <0x00000005bd762eb0> (a java.util.ArrayList) 

"MapOutputCopier attempt_201308230927_0001_r_000000_0.1" prio=10 tid=0x00007fc3285ff000 nid=0x1d72 in Object.wait() [0x00007fc31c789000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd762eb0> (a java.util.ArrayList) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1324) 
    - locked <0x00000005bd762eb0> (a java.util.ArrayList) 

"MapOutputCopier attempt_201308230927_0001_r_000000_0.0" prio=10 tid=0x00007fc3285f8800 nid=0x1d70 in Object.wait() [0x00007fc31c88a000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd762eb0> (a java.util.ArrayList) 
    at java.lang.Object.wait(Object.java:503) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1324) 
    - locked <0x00000005bd762eb0> (a java.util.ArrayList) 

"communication thread" daemon prio=10 tid=0x00007fc3285d2000 nid=0x1d53 in Object.wait() [0x00007fc31c9b3000] 
    java.lang.Thread.State: TIMED_WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd762e90> (a java.lang.Object) 
    at org.apache.hadoop.mapred.Task$TaskReporter.run(Task.java:658) 
    - locked <0x00000005bd762e90> (a java.lang.Object) 
    at java.lang.Thread.run(Thread.java:724) 

"Timer for 'ReduceTask' metrics system" daemon prio=10 tid=0x00007fc3285b1000 nid=0x1d49 in Object.wait() [0x00007fc31cbb5000] 
    java.lang.Thread.State: TIMED_WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd919a30> (a java.util.TaskQueue) 
    at java.util.TimerThread.mainLoop(Timer.java:552) 
    - locked <0x00000005bd919a30> (a java.util.TaskQueue) 
    at java.util.TimerThread.run(Timer.java:505) 

"Thread for syncLogs" daemon prio=10 tid=0x00007fc328494000 nid=0x1d3e waiting on condition [0x00007fc31cebd000] 
    java.lang.Thread.State: TIMED_WAITING (sleeping) 
    at java.lang.Thread.sleep(Native Method) 
    at org.apache.hadoop.mapred.Child$3.run(Child.java:139) 

"IPC Client (47) connection to /127.0.0.1:35127 from job_201308230927_0001" daemon prio=10 tid=0x00007fc328492800 nid=0x1d3d in Object.wait() [0x00007fc31cfbe000] 
    java.lang.Thread.State: TIMED_WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd721b60> (a org.apache.hadoop.ipc.Client$Connection) 
    at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:747) 
    - locked <0x00000005bd721b60> (a org.apache.hadoop.ipc.Client$Connection) 
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:789) 

"Service Thread" daemon prio=10 tid=0x00007fc3280f4000 nid=0x1cf7 runnable [0x0000000000000000] 
    java.lang.Thread.State: RUNNABLE 

"C2 CompilerThread1" daemon prio=10 tid=0x00007fc3280f1800 nid=0x1cf5 waiting on condition [0x0000000000000000] 
    java.lang.Thread.State: RUNNABLE 

"C2 CompilerThread0" daemon prio=10 tid=0x00007fc3280ee800 nid=0x1cf4 waiting on condition [0x0000000000000000] 
    java.lang.Thread.State: RUNNABLE 

"Signal Dispatcher" daemon prio=10 tid=0x00007fc3280ec800 nid=0x1cf3 runnable [0x0000000000000000] 
    java.lang.Thread.State: RUNNABLE 

"Finalizer" daemon prio=10 tid=0x00007fc32809e000 nid=0x1ce5 in Object.wait() [0x00007fc2c1b7f000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd6fb1f8> (a java.lang.ref.ReferenceQueue$Lock) 
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135) 
    - locked <0x00000005bd6fb1f8> (a java.lang.ref.ReferenceQueue$Lock) 
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151) 
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189) 

"Reference Handler" daemon prio=10 tid=0x00007fc32809c000 nid=0x1ce4 in Object.wait() [0x00007fc2c1c80000] 
    java.lang.Thread.State: WAITING (on object monitor) 
    at java.lang.Object.wait(Native Method) 
    - waiting on <0x00000005bd6fade8> (a java.lang.ref.Reference$Lock) 
    at java.lang.Object.wait(Object.java:503) 
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133) 
    - locked <0x00000005bd6fade8> (a java.lang.ref.Reference$Lock) 

"main" prio=10 tid=0x00007fc32800b000 nid=0x1cc8 waiting on condition [0x00007fc32dc3a000] 
    java.lang.Thread.State: TIMED_WAITING (sleeping) 
    at java.lang.Thread.sleep(Native Method) 
    at org.apache.hadoop.mapred.ReduceTask$ReduceCopier.fetchOutputs(ReduceTask.java:2191) 
    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:386) 
    at org.apache.hadoop.mapred.Child$4.run(Child.java:255) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at javax.security.auth.Subject.doAs(Subject.java:415) 
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) 
    at org.apache.hadoop.mapred.Child.main(Child.java:249) 

"VM Thread" prio=10 tid=0x00007fc328094800 nid=0x1cdf runnable 

"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007fc328018800 nid=0x1ccc runnable 

"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007fc32801a800 nid=0x1cce runnable 

"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007fc32801c800 nid=0x1cd7 runnable 

"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007fc32801e000 nid=0x1cd8 runnable 

"VM Periodic Task Thread" prio=10 tid=0x00007fc3280fe800 nid=0x1cf8 waiting on condition 

JNI global references: 224

인터넷 트래픽을 매핑하는 동안,하지만 시작을 줄일 때, 인터넷 트래픽은 아래 킬로바이트 3에 간다 : 100 %와 감소는 11 %입니다.

내 기계의

iostat를. 지도 중

마스터 :지도하는 동안

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdb    0.00  0.00 0.00 7.00  0.00  0.02  6.29  0.48 68.43 68.29 47.80 
sda    0.00  0.00 43.00 7.00  5.38  0.02 221.04  0.22 4.42 2.78 13.90 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 43.00 3.00  5.38  0.01 239.83  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdb    0.00 14.00 0.00 53.00  0.00  1.34 51.66  1.58 29.77 5.38 28.50 
sda    3.00 14.00 34.00 53.00  4.62  1.34 140.34  1.27 14.55 3.84 33.40 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 37.00 62.00  4.62  1.32 122.99  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00

슬레이브 :

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sda    2.00  0.00 12.00 4.00  1.75  0.01 225.25  0.76 47.50 25.19 40.30 
sdb    0.00  0.00 0.00 6.00  0.00  0.02  6.00  0.09 20.00 14.67 8.80 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 14.00 2.00  1.75  0.01 225.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sda    0.00  0.00 28.00 4.00  3.50  0.01 224.81  0.39 12.28 7.16 22.90 
sdb    0.00  0.00 5.00 3.00  0.42  0.01 110.25  0.25 31.50 22.12 17.70 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 33.00 0.00  3.92  0.00 243.39  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00

마스터가 정지 :

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdb    0.00  0.00 8.00 1.00  1.00  0.00 228.44  0.03 3.44 3.00 2.70 
sda    0.00  0.00 0.00 1.00  0.00  0.00  8.00  0.01 13.00 13.00 1.30 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdb    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.01 0.62 0.50 0.40 
sda    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdb    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.02 2.38 2.38 1.90 
sda    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdb    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.01 0.75 0.50 0.40 
sda    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00

노예가 중지 :

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sda    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.01 1.38 1.12 0.90 
sdb    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sda    0.00  0.00 7.00 0.00  0.88  0.00 256.00  0.01 0.71 0.57 0.40 
sdb    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 7.00 0.00  0.88  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 

Filesystem:    rMB_nor/s wMB_nor/s rMB_dir/s wMB_dir/s rMB_svr/s wMB_svr/s  ops/s rops/s wops/s 

Device:   rrqm/s wrqm/s  r/s  w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util 
sdd    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sda    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.01 0.75 0.62 0.50 
sdb    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
sdc    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md1    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md2    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00 
md3    0.00  0.00 8.00 0.00  1.00  0.00 256.00  0.00 0.00 0.00 0.00 
md0    0.00  0.00 0.00 0.00  0.00  0.00  0.00  0.00 0.00 0.00 0.00

출처

2013-08-22 llobocki

당신이 당신의 감속기 메모리 나 디스크 공간을 상회 한 수 있음. 얼마나 많은 감속기를 사용하고 있습니까? –

기본 설정이 있습니다. "conf/mapred-site.xml"파일을 변경할 수 있습니까? – llobocki

계속 진행하면서 각 tasktracker 실행 노드에 충분한 메모리와 디스크 공간이 있는지 확인하십시오. –

나는 내 문제를 해결했습니다./etc/hosts에 잘못된 값이 있습니다.이전

: 이제

ip alias

는 :

ip domain alias

출처

2013-08-27 07:16:20 llobocki

매핑 후 Hadoop 클러스터가 중지됩니다.

답변

관련 문제