sqoop 将hive表内容导入mysql 出错~~~为毛啊
sqoop export --connect jdbc:mysql://192.168.1.10:3306/trans_db --username root --password root --table ex_trans --export-dir /user/hive/warehouse/ga_mis.db/ex_tst_like --input-fields-terminated-by '\t' --input-lines-terminated-by '\n'
我运行上述命令 会报如下错误 请教您一下
17/05/18 16:58:41 INFO mapreduce.Job: Counters: 12
Job Counters
Failed map tasks=1
Killed map tasks=3
Launched map tasks=3
Data-local map tasks=3
Total time spent by all maps in occupied slots (ms)=12240
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=12240
Total vcore-milliseconds taken by all map tasks=12240
Total megabyte-milliseconds taken by all map tasks=12533760
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
17/05/18 16:58:41 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
17/05/18 16:58:41 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.0415 seconds (0 bytes/sec)
17/05/18 16:58:41 INFO mapreduce.ExportJobBase: Exported 0 records.
17/05/18 16:58:41 ERROR tool.ExportTool: Error during export:
Export job failed!
at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:442)
at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
我运行上述命令 会报如下错误 请教您一下
17/05/18 16:58:41 INFO mapreduce.Job: Counters: 12
Job Counters
Failed map tasks=1
Killed map tasks=3
Launched map tasks=3
Data-local map tasks=3
Total time spent by all maps in occupied slots (ms)=12240
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=12240
Total vcore-milliseconds taken by all map tasks=12240
Total megabyte-milliseconds taken by all map tasks=12533760
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
17/05/18 16:58:41 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
17/05/18 16:58:41 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.0415 seconds (0 bytes/sec)
17/05/18 16:58:41 INFO mapreduce.ExportJobBase: Exported 0 records.
17/05/18 16:58:41 ERROR tool.ExportTool: Error during export:
Export job failed!
at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:442)
at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
...全文
相关推荐
sqoop从mysql中导入数据到parquet格式的hive中
sqoop导入数据到hive
sqoop从mysql到hive的时间字段问题
一、问题发现与分析 问题: 用公司的大数据平台导数,已经开发上线一个多月的一批报表,突然有同事说有个报表数据不准。出在时间字段上。 分析: 1、先看了原数据MySQL字段类型为datetime,目标字段为string类型; 2、经发现所有时间的差距都是8小时,怀疑是因为时区转换的原因; 3、对比其他表,看看是大范围现象还是特殊情况,发现其他的同样情况字段的一样没有问题 二、解决办法 经过对比:sqoop在转换MySQL的datatime字段类型为hive的string时会出现问题:默认先转为对应时间戳,再转换为北京市区时间,就会使时间多8小时。 解决办法有两个: 1、在sql里将时间字段转换为
使用shell脚本执行hive、sqoop命令的方法
今天小编就为大家分享一篇使用shell脚本执行hive、sqoop命令的方法,具有很好的参考价值,希望对大家有所帮助。一起跟随小编过来看看吧
sqoop 从 hive 导到mysql遇到的问题.docx
sqoop 从 hive 导到mysql遇到的问题.docx
数据同步Sqoop用法之mysql与Hive导入导出.docx
数据同步Sqoop用法之mysql与Hive导入导出.docx


