Hadoop中的HDFS文件系统内部如何解压ZIP文件

2014-11-07 03:44:21 2.2k 阅读 AI 写同款 · GEO 优化AI 选题数据监测一键分发 ›

SpringBoot Hadoop HDFS目录文件下载 @RequestMapping(value = "/downDir", method = {RequestMethod.POST, RequestMethod.GET}) public ResponseEntity<byte[]> downDir(@RequestParam("dirPath") String dirPath, HttpServletRequest r... 阅读详情

一、命令不支持解压文件，这种就弃用了

二、那调用HDFS的java api，这段是从网上找来的关于HDFS文件解压的代码，

//使用文件扩展名来推断二来的codec来对文件进行解压缩
public static void uncompress1(String uri) throws IOException{
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(URI.create(uri), conf);

Path inputPath = new Path(uri);
CompressionCodecFactory factory = new CompressionCodecFactory(conf);
CompressionCodec codec = factory.getCodec(inputPath);
if(codec == null){
System.out.println("no codec found for " + uri);
System.exit(1);
}
String outputUri = CompressionCodecFactory.removeSuffix(uri, codec.getDefaultExtension());
InputStream in = null;
OutputStream out = null;
try {
in = codec.createInputStream(fs.open(inputPath));
out = fs.create(new Path(outputUri));
IOUtils.copyBytes(in, out, conf);
} finally{
IOUtils.closeStream(out);
IOUtils.closeStream(in);
}
}
但是不支持zip格式的文件解压，下面两行代码
CompressionCodecFactory factory = new CompressionCodecFactory(conf);
CompressionCodec codec = factory.getCodec(inputPath);
运行后codec为空，不能获取到压缩方式，English网站有位bro说hadoop不支持zip格式的压缩跟解压