Google Cloud Dataflow의 Apache beam

Google Cloud Dataflow에서 작업을 실행하려고하지만 배포가 작동하지 않습니다. 작업은 DirectRunner를 사용하여 잘 실행하지만 최대한 빨리 흐름 주자로 전환 나는 다음과 같은 예외가 얻을 : 실행Google Cloud Dataflow의 Apache beam

[WARNING] 
java.lang.reflect.InvocationTargetException 
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
     at java.lang.reflect.Method.invoke(Method.java:498) 
     at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293) 
     at java.lang.Thread.run(Thread.java:745) 
Caused by: java.lang.IllegalArgumentException: No Runner was specified and the DirectRunner was not found on the classpath. 
Specify a runner by either: 
    Explicitly specifying a runner by providing the 'runner' property 
    Adding the DirectRunner to the classpath 
    Calling 'PipelineOptions.setRunner(PipelineRunner)' directly 
     at org.apache.beam.sdk.options.PipelineOptions$DirectRunner.create(PipelineOptions.java:286) 
     at org.apache.beam.sdk.options.PipelineOptions$DirectRunner.create(PipelineOptions.java:276) 
     at org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:575) 
     at org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:516) 
     at org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:155) 
     at org.apache.beam.sdk.options.PipelineOptionsValidator.validate(PipelineOptionsValidator.java:70) 
     at org.apache.beam.sdk.runners.PipelineRunner.fromOptions(PipelineRunner.java:44) 
     at org.apache.beam.sdk.Pipeline.create(Pipeline.java:138) 
     at my.package.SalesTransactions.main(SalesTransactions.java:218)

내 명령을 :

mvn compile exec:java -Dexec.mainClass=my.package.SalesTransactions -Dexec.args="--runner=DataflowRunner --project=my-project --tempLocation=gs://my-project/tmp" -Pdataflow-runner

출처

2017-04-05 Jimmy

pom.xml을 공유하거나 데이터 흐름 러너에 대한 종속성을 추가했는지 확인할 수 있습니까? –

사용 된 maven 프로파일을 보여주는 pom.xml 추출물을 추가했습니다. – jimmy

내 실수를 발견했다. DirectRunner에서 DataFlowRunner로 전환 할 때 프로필 런타임 종속성 대신 pom.xml에 종속성을 추가해야했습니다.

<dependency> 
     <groupId>org.apache.beam</groupId> 
     <artifactId>beam-runners-google-cloud-dataflow-java</artifactId> 
     <version>${beam.version}</version> 
    </dependency>

출처

2017-04-06 14:10:30 Jimmy

Google Cloud Dataflow의 Apache beam

답변

관련 문제