2012-04-04 2 views
2

HBase에서 문제가 발생합니다. 내가 hadoop을 시작하려고하면 아무런 문제없이 시작됩니다.하지만 HBase가 작동하지 않습니다 .DataNode, HRegionServer, secondaryNameNode 등은 모두 작동하지만 hbase을 시작하면 HMaster가 실행되지 않습니다. 가끔 예외가 발생합니다. "RegionServer가 프로세스 # xyz. 멈추라. 이상한 일은 HBase 로그에 "Matser started"라고 인쇄되어 있지만, 우리가 확인해도 시작이 아닙니다. 문제를 찾고 있지만 이해할 수 없습니다. 단서를 찾으면 안내하십시오. HBase와의 로그의 iptables m처럼Hbase HMaster가 실행되고 있지 않습니다.

netstat -nltp 

또는 방화벽하여 수신 포트를 확인할 수 있습니다

Wed Apr 4 17:48:46 PKT 2012 Starting master on hbase 
ulimit -n 1024 
2012-04-04 17:48:48,804 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=60000 
2012-04-04 17:48:49,185 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server Responder: starting 
2012-04-04 17:48:49,191 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 60000: starting 
2012-04-04 17:48:49,199 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: starting 
2012-04-04 17:48:49,203 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: starting 
2012-04-04 17:48:49,204 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: starting 
2012-04-04 17:48:49,213 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: starting 
2012-04-04 17:48:49,213 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: starting 
2012-04-04 17:48:49,271 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: starting 
2012-04-04 17:48:49,272 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: starting 
2012-04-04 17:48:49,275 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: starting 
2012-04-04 17:48:49,278 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: starting 
2012-04-04 17:48:49,280 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: starting 
2012-04-04 17:48:49,396 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT 
2012-04-04 17:48:49,400 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=hbase.ifkaar.com 
2012-04-04 17:48:49,400 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_20 
2012-04-04 17:48:49,400 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc. 
2012-04-04 17:48:49,400 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-openjdk/jre 
2012-04-04 17:48:49,400 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/opt/ifkaar/hbase-0.90.4/bin/../conf:/usr/lib/jvm/java-6-openjdk/lib/tools.jar:/opt/ifkaar/hbase-0.90.4/bin/..:/opt/ifkaar/hbase-0.90.4/bin/../hbase-0.90.4.jar:/opt/ifkaar/hbase-0.90.4/bin/../hbase-0.90.4-tests.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/activation-1.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/asm-3.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/avro-1.3.3.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-cli-1.2.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-codec-1.4.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-configuration-1.6.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-el-1.0.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-httpclient-3.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-lang-2.5.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-logging-1.1.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/commons-net-1.4.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/core-3.1.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/guava-r06.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/hadoop-core-0.20.205.0.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/hadoop-gpl-compression-0.2.0-dev.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jackson-core-asl-1.5.5.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jackson-jaxrs-1.5.5.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jackson-mapper-asl-1.4.2.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jackson-xc-1.5.5.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jasper-compiler-5.5.23.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jasper-runtime-5.5.23.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jaxb-api-2.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jaxb-impl-2.1.12.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jersey-core-1.4.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jersey-json-1.4.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jersey-server-1.4.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jettison-1.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jetty-6.1.26.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jetty-util-6.1.26.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jruby-complete-1.6.0.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jsp-2.1-6.1.14.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jsp-api-2.1-6.1.14.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/jsr311-api-1.1.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/log4j-1.2.16.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/protobuf-java-2.3.0.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/servlet-api-2.5-6.1.14.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/slf4j-api-1.5.8.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/slf4j-log4j12-1.5.8.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/stax-api-1.0.1.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/thrift-0.2.0.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/xmlenc-0.52.jar:/opt/ifkaar/hbase-0.90.4/bin/../lib/zookeeper-3.3.2.jar 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=/usr/lib/jvm/java-6-openjdk/jre/lib/i386/client:/usr/lib/jvm/java-6-openjdk/jre/lib/i386:/usr/lib/jvm/java-6-openjdk/jre/../lib/i386:/usr/java/packages/lib/i386:/usr/lib/jni:/lib:/usr/lib 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=i386 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.32-38-generic 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=ifkaar 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/ifkaar 
2012-04-04 17:48:49,401 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/opt/ifkaar/hbase-0.90.4/bin 
2012-04-04 17:48:49,403 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=master:60000 
2012-04-04 17:48:49,469 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 
2012-04-04 17:48:49,506 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 
2012-04-04 17:48:49,688 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x1367d66702b0000, negotiated timeout = 180000 
2012-04-04 17:48:49,740 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=hbase.ifkaar.com:60000 
2012-04-04 17:48:49,784 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision 
2012-04-04 17:48:49,784 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser 
2012-04-04 17:48:49,784 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate 
2012-04-04 17:48:49,784 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl 
2012-04-04 17:48:49,784 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date 
2012-04-04 17:48:49,784 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision 
2012-04-04 17:48:49,800 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user 
2012-04-04 17:48:49,800 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion 
2012-04-04 17:48:49,800 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url 
2012-04-04 17:48:49,800 INFO org.apache.hadoop.hbase.metrics: MetricsString added: version 
2012-04-04 17:48:49,801 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo 
2012-04-04 17:48:49,802 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo 
2012-04-04 17:48:49,802 INFO org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized 
2012-04-04 17:48:49,939 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=hbase.ifkaar.com:60000 
2012-04-04 17:48:52,204 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 0 time(s). 
2012-04-04 17:48:53,205 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 1 time(s). 
2012-04-04 17:48:54,206 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 2 time(s). 
2012-04-04 17:48:55,207 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 3 time(s). 
2012-04-04 17:48:56,207 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 4 time(s). 
2012-04-04 17:48:57,208 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 5 time(s). 
2012-04-04 17:48:58,209 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 6 time(s). 
2012-04-04 17:48:59,210 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 7 time(s). 
2012-04-04 17:49:00,211 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 8 time(s). 
2012-04-04 17:49:01,212 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 9 time(s). 
2012-04-04 17:49:01,216 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown. 
java.net.ConnectException: Call to localhost/127.0.0.1:54310 failed on connection exception: java.net.ConnectException: Connection refused 
    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1071) 
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) 
    at $Proxy6.getProtocolVersion(Unknown Source) 
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396) 
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379) 
    at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:118) 
    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:222) 
    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:187) 
    at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89) 
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1328) 
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:65) 
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346) 
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:244) 
    at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187) 
    at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:364) 
    at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:81) 
    at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:346) 
    at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:282) 
Caused by: java.net.ConnectException: Connection refused 
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) 
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592) 
    at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) 
    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:604) 
    at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434) 
    at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560) 
    at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184) 
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1046) 
    ... 17 more 
2012-04-04 17:49:01,221 INFO org.apache.hadoop.hbase.master.HMaster: Aborting 
2012-04-04 17:49:01,221 DEBUG org.apache.hadoop.hbase.master.HMaster: Stopping service threads 
2012-04-04 17:49:01,222 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60000 
2012-04-04 17:49:01,222 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: exiting 
2012-04-04 17:49:01,222 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: exiting 
2012-04-04 17:49:01,222 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: exiting 
2012-04-04 17:49:01,223 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: exiting 
2012-04-04 17:49:01,223 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: exiting 
2012-04-04 17:49:01,223 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: exiting 
2012-04-04 17:49:01,223 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: exiting 
2012-04-04 17:49:01,223 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: exiting 
2012-04-04 17:49:01,224 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: exiting 
2012-04-04 17:49:01,224 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: exiting 
2012-04-04 17:49:01,224 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server listener on 60000 
2012-04-04 17:49:01,228 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder 
2012-04-04 17:49:01,300 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down 
2012-04-04 17:49:01,301 INFO org.apache.zookeeper.ZooKeeper: Session: 0x1367d66702b0000 closed 
2012-04-04 17:49:01,301 INFO org.apache.hadoop.hbase.master.HMaster: HMaster main thread exiting 
Wed Apr 4 17:49:38 PKT 2012 Stopping hbase (via master) 

답변

1

내 생각, 로그에서이 라인,

2012-04-04 17:48:52,204 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 0 time(s). 

는 포트 54310에서 네임 노드에 연결하는 데 묶는하고 실패한 것을 말한다.

브라우저에 이것을 입력하여 확인하고 사용중인 정확한 포트를 말해 줄 수 있습니까?

**http://localhost:50070** 

당신은 네임 노드 같은 것을 볼 수 있습니다 '로컬 호스트를 :?'을 첫 번째 줄로 사용하고 '? '은 (는) 귀하의 namenode 포트입니다.

1

당신은 아래에 주어진 또한이 원인이됩니다.

0

때로는 Hbase이 예상대로 작동하지 않는다고해서 모든 것을 수행 한 후에도 ... 거기에는 여러 가지 이유가있을 수 있습니다. 때때로 설정을 수행하는 동안 뭔가 부족합니다. 때로는 모든 예방 조치로 모든 것을 수행 한 후에도 작동하지 않습니다. 사용자가 제공 한 로그는 HMaster가 네임 노드와 통신 할 수 없음을 나타냅니다./etc/hosts 파일을보십시오. "127.0.1.1"을 제거하고 "127.0.0.1"로 지정하십시오. 또한 HADOOP_HOME에서 "hadoop-core"jar 파일을 복사하고 HADOOP_HOME/lib 디렉토리에서 Hbase/lib 디렉토리로 "common-configurations"jar 파일을 복사하십시오. 또한 core-site.xml 및 hbase-site.xml의 속성을 한 번 확인하십시오.

+0

지난 6 개월 동안 정상적으로 작동했습니다. 하지만 지금은 주인이 우리에게 몇 가지 문제를 일으키고 있습니다. –

1

의사 배포 모드에서 hbase로 설정하려는 경우, 가장 가능성이 높은 이유로 인해 hadoop이 $ PATH에 추가됩니다.

$ PATH에서 hadoop home을 삭제하면 가상 분산 모드에서 hbase를 시작할 수 있습니다.

기본적으로 일부 사람들은 .bashrc에 hadoop home을 추가합니다.

.bashrc에 추가하면 hadoop 홈이 제거됩니다.

관련 문제