2014-02-07 1 views
3

hadoop 사용 및 kerberos 인증으로 dse를 구성했습니다. 하지만이 오류가 로그에 표시됩니다. dse hadoop fs 명령과 nodetool 명령을 실행할 수 있지만 맵 축소 작업을 실행할 수는 없습니다.hadoop 사용 및 kerberos 사용이 가능한 datastax enterprise의 오류

ERROR [TASK-TRACKER-INIT] 2014-02-07 20:45:03,813 TaskTrackerRunner.java (line 128) Hadoop Task Tracker caused an exception in state STARTING: 
java.io.IOException: Cannot run program "/usr/share/dse/hadoop/native/Linux-amd64- 64/bin/task-controller" (in directory "."): error=13, Permission denied 
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1041) 
    at org.apache.hadoop.util.Shell.startProcess(Shell.java:199) 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:225) 
    at org.apache.hadoop.util.Shell.run(Shell.java:182) 
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:401) 
    at org.apache.hadoop.mapred.LinuxTaskController.setup(LinuxTaskController.java:137) 
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1470) 
    at com.datastax.bdp.hadoop.mapred.TaskTrackerRunner.initService(TaskTrackerRunner.java:104) 
    at com.datastax.bdp.hadoop.mapred.TaskTrackerRunner.initService(TaskTrackerRunner.java:31) 
    at com.datastax.bdp.hadoop.mapred.ServiceRunner.run(ServiceRunner.java:121) 
    at java.lang.Thread.run(Thread.java:724) 
Caused by: java.io.IOException: error=13, Permission denied 
    at java.lang.UNIXProcess.forkAndExec(Native Method) 
    at java.lang.UNIXProcess.<init>(UNIXProcess.java:135) 
    at java.lang.ProcessImpl.start(ProcessImpl.java:130) 
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1022) 
    ... 10 more 
ERROR [Thrift:8] 2014-02-07 20:45:12,624 TNegotiatingServerTransport.java (line 293) An error occurred during transport negotiation 
com.datastax.bdp.transport.common.TTransportNegotiationException: Improper authentication type requested. Requested auth: No authentication with service principal: FRAMED_TRANSPORT_FAKE_PRINCIPAL, Allowed auth: Kerberos 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getUnderlyingFactory(TNegotiatingServerTransport.java:485) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.handleTransportNegotiation(TNegotiatingServerTransport.java:286) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.open(TNegotiatingServerTransport.java:192) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:517) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:408) 
    at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:193) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:724) 
ERROR [Thrift:8] 2014-02-07 20:45:12,625 TNegotiatingServerTransport.java (line 524) Failed to open server transport. 
com.datastax.bdp.transport.common.TTransportNegotiationException: An error occurred during transport negotiation 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.handleTransportNegotiation(TNegotiatingServerTransport.java:294) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.open(TNegotiatingServerTransport.java:192) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:517) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:408) 
    at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:193) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:724) 
Caused by: com.datastax.bdp.transport.common.TTransportNegotiationException: Improper authentication type requested. Requested auth: No authentication with service principal: FRAMED_TRANSPORT_FAKE_PRINCIPAL, Allowed auth: Kerberos 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getUnderlyingFactory(TNegotiatingServerTransport.java:485) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.handleTransportNegotiation(TNegotiatingServerTransport.java:286) 
    ... 7 more 
ERROR [Thrift:8] 2014-02-07 20:45:12,626 CustomTThreadPoolServer.java (line 219) Error occurred during processing of message. 
java.lang.RuntimeException: Failed to open server transport: unknown 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:525) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:408) 
    at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:193) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:724) 
Caused by: com.datastax.bdp.transport.common.TTransportNegotiationException: An error occurred during transport negotiation 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.handleTransportNegotiation(TNegotiatingServerTransport.java:294) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.open(TNegotiatingServerTransport.java:192) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getTransport(TNegotiatingServerTransport.java:517) 
    ... 5 more 
Caused by: com.datastax.bdp.transport.common.TTransportNegotiationException: Improper authentication type requested. Requested auth: No authentication with service principal: FRAMED_TRANSPORT_FAKE_PRINCIPAL, Allowed auth: Kerberos 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport$Factory.getUnderlyingFactory(TNegotiatingServerTransport.java:485) 
    at com.datastax.bdp.transport.server.TNegotiatingServerTransport.handleTransportNegotiation(TNegotiatingServerTransport.java:286) 
    ... 7 more 
WARN [TASK-TRACKER-INIT] 2014-02-07 20:45:13,828 MetricsSystemImpl.java (line 200) Source name ugi already exists! 

이 작업 컨트롤러 : - -이 :

다음

로그입니다

-rwsr-X --- 1 개 루트 카산드라 40,111 1월 9일 18시 14분/USR/주/DSE/하둡/기본/리눅스 amd64-64/빈/작업 컨트롤러

내가 DSE를 사용하고 3.2.3 자바 1.7.0_25

내가 cassandra.yaml, dse.yaml, 코어를 site.xml, mapre-site.xml 파일에 적절하게 구성한은/etc/기본/DSE 파일

답변

2

루트 홈 디렉토리에서 데몬을 시작하지 마십시오. 이상하게 들리지만 루트 홈 디렉토리 이외의 데몬을 시작하십시오.

0

는/usr/share/dse/hadoop/native/Linux-amd64-64/bin/task-controller "(디렉토리". ") : error = 13, Permission denied java.lang.ProcessBuilder.start (ProcessBuilder.java:1041)

위의 내용은 사용자에게 실행 권한이 없음을 명확히 보여줍니다. 사용자에게 실행 권한이 있도록 사용 권한을 변경하십시오. chmod를 사용하여 권한을 변경하십시오.

+0

음 그 파일의 권한을 4750 이외의 다른 것으로 변경할 수 없으며 소유자는 root 여야합니다. 나는 그 전에도 다음과 같은 오류를 보았습니다 "task-controller는 777 대신 chmod 4750이어야합니다" – Rock