1. 홈
  2. 질의 응답
  3. 로컬 호스트의 Solr을 사용하여 ZooKeeper에 연결할 수 없습니다.

로컬 호스트의 Solr을 사용하여 ZooKeeper에 연결할 수 없습니다.

2017-12-20 13 views
0

Solr 6을 사용 중이며 채우려고합니다.로컬 호스트의 Solr을 사용하여 ZooKeeper에 연결할 수 없습니다.

object testChildDocToSolr { 
    def main(args: Array[String]): Unit = { 

    setProperty("hadoop.home.dir", "c:\\winutils\\") 
    val sparkSession = SparkSession.builder() 
     .appName("spark-solr-tester") 
     .master("local") 
     .config("spark.ui.enabled", "false") 
     .config("spark.default.parallelism", "1") 
     .getOrCreate() 

    val sc = sparkSession.sparkContext 
    val collectionName = "testChildDocument" 
    val testDf = sparkSession.read.json("./child_documents.json") 
    testDf.printSchema() 
    testDf.show() 

    val zkHost = "localhost:8983" 
    val solrOpts = Map(
     "zkhost" -> zkHost, 
     "collection" -> collectionName, 
     "gen_uniq_key" -> "true", 
     "gen_uniq_child_key" -> "true", 
     "child_doc_fieldname" -> "tags" 
    ) 

    testDf.write.format("solr").options(solrOpts).mode(Overwrite).save() 

    // Explicit commit to make sure all docs are visible 
    val solrCloudClient = SolrSupport.getCachedCloudClient(zkHost) 
    solrCloudClient.commit(collectionName, true, true) 

    val solrDf = sparkSession.read.format("solr").options(solrOpts).load() 
    solrDf.show() 
    sc.stop() 
    } 

}

나는 오류 받고 있어요 :

Exception in thread "main" com.google.common.util.concurrent.UncheckedExecutionException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:8983 within 10000 ms

내가 을 사육사에 연결할 수 없습니다 것 같다 내가 돈을 는 여기에 내가 자리에 넣어 주요 스칼라입니다 이유를 모르겠다 ...

여기 내 전체 로그 :

[info] Loading project definition from C:\Users\ebelloei\Documents\Ice\DocToSolr\project 
[info] Loading settings from build.sbt ... 
[info] Set current project to DocToSolr (in build file:/C:/Users/ebelloei/Documents/Ice/DocToSolr/) 
[info] Compiling 1 Scala source to C:\Users\ebelloei\Documents\Ice\DocToSolr\target\scala-2.11\classes ... 
[info] Done compiling. 
[info] Packaging C:\Users\ebelloei\Documents\Ice\DocToSolr\target\scala-2.11\doctosolr_2.11-0.1.jar ... 
[info] Done packaging. 
[info] Running (fork) Example.testChildDocToSolr 
[info] 2017-12-20 15:09:10,436 [main] WARN NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
[info] 2017-12-20 15:09:11,152 [main] INFO log - Logging initialized @2334ms 
[info] root 
[info] |-- dates: array (nullable = true) 
[info] | |-- element: string (containsNull = true) 
[info] |-- status: string (nullable = true) 
[info] |-- tags: array (nullable = true) 
[info] | |-- element: struct (containsNull = true) 
[info] | | |-- bar: string (nullable = true) 
[info] | | |-- foo: long (nullable = true) 
[info] | | |-- parent: string (nullable = true) 
[info] |-- user: string (nullable = true) 
[info] +--------------------+------+--------------------+----+ 
[info] |    dates|status|    tags|user| 
[info] +--------------------+------+--------------------+----+ 
[info] |[2017-05-02, 2017...| OK|[[val1,123,a], [v...| a| 
[info] |[2017-04-29, 2017...| OK|[[val1,789,b], [v...| b| 
[info] +--------------------+------+--------------------+----+ 
[error] Exception in thread "main" com.google.common.util.concurrent.UncheckedExecutionException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:8983 within 10000 ms 
[error]  at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) 
[error]  at com.google.common.cache.LocalCache.get(LocalCache.java:3932) 
[error]  at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3936) 
[error]  at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4806) 
[error]  at com.lucidworks.spark.util.SolrSupport$.getCachedCloudClient(SolrSupport.scala:190) 
[error]  at com.lucidworks.spark.util.SolrSupport$.getSolrBaseUrl(SolrSupport.scala:194) 
[error]  at com.lucidworks.spark.SolrRelation.insert(SolrRelation.scala:671) 
[error]  at solr.DefaultSource.createRelation(DefaultSource.scala:27) 
[error]  at org.apache.spark.sql.execution.datasources.DataSource.write(DataSource.scala:472) 
[error]  at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:48) 
[error]  at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:58) 
[error]  at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:56) 
[error]  at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:74) 
[error]  at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:117) 
[error]  at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:117) 
[error]  at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:138) 
[error]  at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) 
[error]  at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:135) 
[error]  at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:116) 
[error]  at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:92) 
[error]  at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:92) 
[error]  at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:610) 
[error]  at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:233) 
[error]  at Example.testChildDocToSolr$.main(Main.scala:39) 
[error]  at Example.testChildDocToSolr.main(Main.scala) 
[error] Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:8983/solr within 10000 ms 
[error]  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:183) 
[error]  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:117) 
[error]  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:107) 
[error]  at org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:226) 
[error]  at org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:131) 
[error]  at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudSolrClient.java:631) 
[error]  at com.lucidworks.spark.util.SolrSupport$.getSolrCloudClient(SolrSupport.scala:168) 
[error]  at com.lucidworks.spark.util.SolrSupport$.getNewSolrCloudClient(SolrSupport.scala:186) 
[error]  at com.lucidworks.spark.util.CacheCloudSolrClient$$anon$1.load(SolrSupport.scala:37) 
[error]  at com.lucidworks.spark.util.CacheCloudSolrClient$$anon$1.load(SolrSupport.scala:35) 
[error]  at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) 
[error]  at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) 
[error]  at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) 
[error]  at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) 
[error]  ... 24 more 
[error] Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:8983/solr within 10000 ms 
[error]  at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:233) 
[error]  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:175) 
[error]  ... 37 more 
[error] java.lang.RuntimeException: Nonzero exit code returned from runner: 1 
[error]  at sbt.ForkRun.processExitCode$1(Run.scala:29) 
[error]  at sbt.ForkRun.run(Run.scala:38) 
[error]  at sbt.Defaults$.$anonfun$bgRunTask$5(Defaults.scala:1155) 
[error]  at sbt.Defaults$.$anonfun$bgRunTask$5$adapted(Defaults.scala:1150) 
[error]  at sbt.internal.BackgroundThreadPool.$anonfun$run$1(DefaultBackgroundJobService.scala:359) 
[error]  at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12) 
[error]  at scala.util.Try$.apply(Try.scala:209) 
[error]  at sbt.internal.BackgroundThreadPool$BackgroundRunnable.run(DefaultBackgroundJobService.scala:282) 
[error]  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[error]  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[error]  at java.lang.Thread.run(Thread.java:748) 
[error] (compile:run) Nonzero exit code returned from runner: 1 
[error] Total time: 26 s, completed 20 déc. 2017 15:09:25 
1. Waiting for source changes... (press enter to interrupt)

그리고 내 Zoo.cfg :

# The number of milliseconds of each tick 
tickTime=2000 
# The number of ticks that the initial 
# synchronization phase can take 
initLimit=10 
# The number of ticks that can pass between 
# sending a request and getting an acknowledgement 
syncLimit=5 

# the directory where the snapshot is stored. 
# dataDir=/opt/zookeeper/data 
# NOTE: Solr defaults the dataDir to <solrHome>/zoo_data 

# the port at which the clients will connect 
# clientPort=8983 
# NOTE: Solr sets this based on zkRun/zkHost params

나는이 정말 새로운 그리고 난 분명 뭔가가있어 만약 내가 같은 문제를 가진 사람을 찾을 수 없기 때문에 모른다 .

출처

2017-12-20 Evans Belloeil

답변

0

당신은 사육사 연결 정보로 Solr 호스트와 포트를 제공합니다. Zookeeper와 Solr은 별도의 데몬이므로 별도의 포트에서 실행됩니다. Zookeeper를 외부에서 Zookeeper 설치로 실행하는 경우 기본 포트는 2181 (localhost:2181)입니다. Solr에 내장 된 포트를 사용하는 경우 포트는 Solr의 포트 + 1000, 일반적으로 9983 (따라서 localhost:9983)입니다.

출처

2017-12-20 14:39:00 MatsLindh

+0

Solr에 포함 된 것을 사용하고 있으므로 zkHost를 다음과 같이 변경하려고합니다. val zkHost = "localhost : 9983",하지만 여전히 동일한 문제입니다. 내 zoo.cfg 파일의 클라이언트 포트를 8983으로 변경했는데 문제가 될 수 있습니까? –

+0

Solr은 기본적으로 8983에서 실행되므로 작동하지 않습니다. 'netstat -a'를 실행하여 어느 포트가 청취 중인지 표시하십시오. – MatsLindh

+0

그래, 더 많은 문제를 피하기 위해 내 zoo.cfg를 2181로 변경 했으므로 포트 8983이 발행되었지만 아무것도 없으며 동물원을 시작할 수 없습니까? 나는이 일을 처음 접해서 미안해. –

관련 문제

 관련 문제