하이브에있는 파일에 스크립트 출력을 작성하십시오.

Question

5 개의 쿼리 세트가있는 스크립트가 있습니다. 스크립트를 실행하고 출력을 파일에 기록하고 싶습니다. 하이브라이의 cli에서 어떤 명령을 내 보내야합니까? 감사

Answer 1

샘플 쿼리 파일 (3 개 쿼리) :

ramisetty의 @ 갈망 : ~/my_tmp $ 고양이 queries.q

show databases; --query1 
use my_db; --query2 
INSERT OVERWRITE LOCAL DIRECTORY './outputLocalDir' --query3    
select * from students where branch = "ECE";  --query3 

실행 HIVE :

ramisetty @ aspire : ~/my_tmp $ 하이브

하이브 (기본값)>출처 ./queries.q;

--output of Q1 on console----- 

Time taken: 7.689 seconds 

--output of Q2 on console ----- 

Time taken: 1.689 seconds 
____________________________________________________________ 
Total MapReduce jobs = 1 
Launching Job 1 out of 1 
Number of reduce tasks is set to 0 since there's no reduce operator 
Starting Job = job_201401251835_0004, Tracking URL = http://localhost:50030/jobdetails.jsp?jobid=job_201401251835_0004 
Kill Command = /home/ramisetty/VJDATA/hadoop-1.0.4/libexec/../bin/hadoop job -kill job_201401251835_0004 
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0 
2014-01-25 19:06:56,689 Stage-1 map = 0%, reduce = 0% 
2014-01-25 19:07:05,868 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 2.07 sec 
2014-01-25 19:07:14,047 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 2.07 sec 
2014-01-25 19:07:15,059 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 2.07 sec 
MapReduce Total cumulative CPU time: 2 seconds 70 msec 
Ended Job = job_201401251835_0004 
**Copying data to local directory outputLocalDir 
Copying data to local directory outputLocalDir** 
2 Rows loaded to outputLocalDir 
MapReduce Jobs Launched: 
Job 0: Map: 1 Cumulative CPU: 2.07 sec HDFS Read: 525 HDFS Write: 66 SUCCESS 
Total MapReduce CPU Time Spent: 2 seconds 70 msec 
OK 
firstname secondname dob score branch 
Time taken: 32.44 seconds 

---

출력 파일 :

고양이 ./outputLocalDir/000000_0