sqoop导数据

[fancs2006]

使用sqoop往mysql数据库导数据报错了
[XXXXX]$ sqoop export --connect jdbc:mysql://XXX:21/tmpdb --username XXX --password XXX --table app_order_amount_day --export-dir /XXX/tmp_order_app_amount --input-fields-terminated-by '\001'
14/10/20 20:58:11 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
14/10/20 20:58:11 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/10/20 20:58:11 INFO tool.CodeGenTool: Beginning code generation
14/10/20 20:58:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `app_order_amount_day` AS t LIMIT 1
14/10/20 20:58:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `app_order_amount_day` AS t LIMIT 1
14/10/20 20:58:12 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce
14/10/20 20:58:12 INFO orm.CompilationManager: Found hadoop core jar at: /usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar
Note: /tmp/sqoop-bigs/compile/c2e8868af7608d93150513e0cc15b970/app_order_amount_day.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
14/10/20 20:58:14 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-bigs/compile/c2e8868af7608d93150513e0cc15b970/app_order_amount_day.jar
14/10/20 20:58:14 INFO mapreduce.ExportJobBase: Beginning export of app_order_amount_day
14/10/20 20:58:15 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
14/10/20 20:58:16 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
14/10/20 20:58:17 WARN conf.Configuration: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
14/10/20 20:58:17 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
14/10/20 20:58:17 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
14/10/20 20:58:17 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
14/10/20 20:58:18 INFO input.FileInputFormat: Total input paths to process : 1
14/10/20 20:58:18 INFO input.FileInputFormat: Total input paths to process : 1
14/10/20 20:58:18 INFO mapreduce.JobSubmitter: number of splits:4
14/10/20 20:58:18 WARN conf.Configuration: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
14/10/20 20:58:18 WARN conf.Configuration: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
14/10/20 20:58:18 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
14/10/20 20:58:18 WARN conf.Configuration: mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
14/10/20 20:58:18 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
14/10/20 20:58:18 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
14/10/20 20:58:18 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
14/10/20 20:58:18 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
14/10/20 20:58:18 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
14/10/20 20:58:18 WARN conf.Configuration: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
14/10/20 20:58:18 WARN conf.Configuration: mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
14/10/20 20:58:18 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
14/10/20 20:58:19 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1412850382932_176713
14/10/20 20:58:19 INFO client.YarnClientImpl: Submitted application application_1412850382932_176713 to ResourceManager at /10.8.75.1:8032
14/10/20 20:58:20 INFO mapreduce.Job: The url to track the job: http://SH02SVR2882.hadoop.sh2.ctripcorp.com:8088/proxy/application_1412850382932_176713/
14/10/20 20:58:20 INFO mapreduce.Job: Running job: job_1412850382932_176713
14/10/20 20:58:25 INFO mapreduce.Job: Job job_1412850382932_176713 running in uber mode : false
14/10/20 20:58:25 INFO mapreduce.Job: map 0% reduce 0%
14/10/20 20:59:32 INFO mapreduce.Job: Task Id : attempt_1412850382932_176713_m_000003_0, Status : FAILED
Error: java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

14/10/20 21:01:52 INFO mapreduce.Job: Task Id : attempt_1412850382932_176713_m_000000_2, Status : FAILED
Error: java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1121)
at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:355)
at com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2479)
at com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2516)
at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2301)
at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:834)
at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:416)
at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:317)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:185)
at org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:278)
at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.<init>(AsyncSqlRecordWriter.java:76)
at org.apache.sqoop.mapreduce.ExportOutputFormat$ExportRecordWriter.<init>(ExportOutputFormat.java:95)
at org.apache.sqoop.mapreduce.ExportOutputFormat.getRecordWriter(ExportOutputFormat.java:77)
... 8 more
Caused by: java.net.ConnectException: Connection timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:218)
at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:259)
at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:305)
... 26 more

14/10/20 21:02:53 INFO mapreduce.Job: map 50% reduce 0%
14/10/20 21:02:53 INFO mapreduce.Job: Job job_1412850382932_176713 failed with state FAILED due to: Task failed task_1412850382932_176713_m_000001
Job failed as tasks failed. failedMaps:1 failedReduces:0

14/10/20 21:02:54 INFO mapreduce.Job: Counters: 6
Job Counters
Failed map tasks=13
Launched map tasks=16
Other local map tasks=15
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=858151
Total time spent by all reduces in occupied slots (ms)=0
14/10/20 21:02:54 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
14/10/20 21:02:54 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 277.1573 seconds (0 bytes/sec)
14/10/20 21:02:54 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
14/10/20 21:02:54 INFO mapreduce.ExportJobBase: Exported 0 records.
14/10/20 21:02:54 ERROR tool.ExportTool: Error during export: Export job failed!

[skyWalker_ONLY]

telnet mysql的地址和端口号，还有检查mysql是否启动

[人生偌只如初见]

可能是连接mysql没有得到响应，连接超时。测试下MySQL的连接情况，也可以试试jdbc:mysql://localhost:3306/test?useUnicode=true&characterEncoding=UTF-8&autoReconnect=true&failOverReadOnly=false