重新编译hadoop2.2.0遇到的问题

_柴哥_ 2014-02-07 07:06:53
[hadoop@hadoop-m hadoop-2.2.0-src]$ mvn clean package -DskipTests -Pdist,native,docs -Dtar
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hadoop:hadoop-project:pom:2.2.0
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-enforcer-plugin @ line 943, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hadoop:hadoop-project-dist:pom:2.2.0
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-enforcer-plugin @ org.apache.hadoop:hadoop-project:2.2.0, /usr/local/src/hadoop-2.2.0-src/hadoop-project/pom.xml, line 943, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hadoop:hadoop-common:jar:2.2.0
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ line 463, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
... ... ...
[ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.0: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.0 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org: Name or service not known: Unknown host repo.maven.apache.org: Name or service not known -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException


==================分割线==================
1、环境
操作系统:centos 6.5 64位
已安装的软件包

apache-ant-1.9.2-bin.tar
findbugs-2.0.2.tar
apache-maven-3.0.5-bin.tar
lzo-2.06.tar
hadoop-2.2.0-src.tar
cmake-2.8.6.tar
jdk-7u51-linux-x64.rpm
protobuf-2.5.0.tar

2、针对这个错误
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-enforcer-plugin @ org.apache.hadoop:hadoop-project:2.2.0, /usr/local/src/hadoop-2.2.0-src/hadoop-project/pom.xml, line 943, column 15

查看/usr/local/src/hadoop-2.2.0-src/hadoop-project/pom.xml

943 <plugin>
944 <groupId>org.apache.maven.plugins</groupId>
945 <artifactId>maven-enforcer-plugin</artifactId>
946 <executions>
947 <execution>
948 <id>depcheck</id>
949 <configuration>
950 <rules>
951 <DependencyConvergence>
952 <uniqueVersions>true</uniqueVersions>
953 </DependencyConvergence>
954 </rules>
955 </configuration>
956 <goals>
957 <goal>enforce</goal>
958 </goals>
959 <phase>verify</phase>
960 </execution>
961 </executions>
962 </plugin>

[root@hadoop-m src]# grep org.apache.maven.plugins -n /usr/local/src/hadoop-2.2.0-src/hadoop-project/pom.xml
726: <groupId>org.apache.maven.plugins</groupId>
735: <groupId>org.apache.maven.plugins</groupId>
745: <groupId>org.apache.maven.plugins</groupId>
750: <groupId>org.apache.maven.plugins</groupId>
755: <groupId>org.apache.maven.plugins</groupId>
760: <groupId>org.apache.maven.plugins</groupId>
765: <groupId>org.apache.maven.plugins</groupId>
775: <groupId>org.apache.maven.plugins</groupId>
790: <groupId>org.apache.maven.plugins</groupId>
805: <groupId>org.apache.maven.plugins</groupId>
810: <groupId>org.apache.maven.plugins</groupId>
820: <groupId>org.apache.maven.plugins</groupId>
839: <groupId>org.apache.maven.plugins</groupId>
858: <groupId>org.apache.maven.plugins</groupId>
896: <groupId>org.apache.maven.plugins</groupId>
936: <groupId>org.apache.maven.plugins</groupId>
944: <groupId>org.apache.maven.plugins</groupId>
1007: <groupId>org.apache.maven.plugins</groupId>
1027: <groupId>org.apache.maven.plugins</groupId>
1047: <groupId>org.apache.maven.plugins</groupId>
1064: <groupId>org.apache.maven.plugins</groupId>
1079: <groupId>org.apache.maven.plugins</groupId>
1100: <groupId>org.apache.maven.plugins</groupId>

这个问题应该怎么解决呢
...全文
1307 9 打赏 收藏 转发到动态 举报
写回复
用AI写文章
9 条回复
切换为时间正序
请发表友善的回复…
发表回复
u014359285 2014-03-26
  • 打赏
  • 举报
 回复
楼主：出现的问题与你的一模一样，不知道楼主最后如何解决的
飞火流云 2014-03-21
  • 打赏
  • 举报
 回复
请问有什么解决办法没?
飞火流云 2014-03-21
  • 打赏
  • 举报
 回复
同问，我也遇到这个问题了, 把错误贴出来: mvn -e clean package -Pdist -DskipTests -Dtar [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.0: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.0 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org: Unknown host repo.maven.apache.org -> [Help 1] org.apache.maven.plugin.PluginResolutionException: Plugin org.apache.maven.plugins:maven-site-plugin:3.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.0 at org.apache.maven.plugin.internal.DefaultPluginDependenciesResolver.resolve(DefaultPluginDependenciesResolver.java:129) at org.apache.maven.plugin.internal.DefaultMavenPluginManager.getPluginDescriptor(DefaultMavenPluginManager.java:142) at org.apache.maven.plugin.internal.DefaultMavenPluginManager.getMojoDescriptor(DefaultMavenPluginManager.java:261) at org.apache.maven.plugin.DefaultBuildPluginManager.getMojoDescriptor(DefaultBuildPluginManager.java:185) at org.apache.maven.lifecycle.internal.DefaultLifecycleExecutionPlanCalculator.calculateLifecycleMappings(DefaultLifecycleExecutionPlanCalculator.java:280) at org.apache.maven.lifecycle.internal.DefaultLifecycleExecutionPlanCalculator.calculateMojoExecutions(DefaultLifecycleExecutionPlanCalculator.java:193) at org.apache.maven.lifecycle.internal.DefaultLifecycleExecutionPlanCalculator.calculateExecutionPlan(DefaultLifecycleExecutionPlanCalculator.java:112) at org.apache.maven.lifecycle.internal.DefaultLifecycleExecutionPlanCalculator.calculateExecutionPlan(DefaultLifecycleExecutionPlanCalculator.java:129) at org.apache.maven.lifecycle.internal.BuilderCommon.resolveBuildPlan(BuilderCommon.java:92) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) Caused by: org.sonatype.aether.resolution.ArtifactDescriptorException: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.0 at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:296) at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:186) at org.sonatype.aether.impl.internal.DefaultRepositorySystem.readArtifactDescriptor(DefaultRepositorySystem.java:279) at org.apache.maven.plugin.internal.DefaultPluginDependenciesResolver.resolve(DefaultPluginDependenciesResolver.java:115) ... 25 more Caused by: org.sonatype.aether.resolution.ArtifactResolutionException: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.0 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:538) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:216) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolveArtifact(DefaultArtifactResolver.java:193) at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:281) ... 28 more Caused by: org.sonatype.aether.transfer.ArtifactTransferException: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.0 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org at org.sonatype.aether.connector.wagon.WagonRepositoryConnector$4.wrap(WagonRepositoryConnector.java:951) at org.sonatype.aether.connector.wagon.WagonRepositoryConnector$4.wrap(WagonRepositoryConnector.java:941) at org.sonatype.aether.connector.wagon.WagonRepositoryConnector$GetTask.run(WagonRepositoryConnector.java:669) at org.sonatype.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:60) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:636) Caused by: org.apache.maven.wagon.TransferFailedException: repo.maven.apache.org at org.apache.maven.wagon.shared.http4.AbstractHttpClientWagon.fillInputData(AbstractHttpClientWagon.java:892) at org.apache.maven.wagon.StreamWagon.getInputStream(StreamWagon.java:116) at org.apache.maven.wagon.StreamWagon.getIfNewer(StreamWagon.java:88) at org.apache.maven.wagon.StreamWagon.get(StreamWagon.java:61) at org.sonatype.aether.connector.wagon.WagonRepositoryConnector$GetTask.run(WagonRepositoryConnector.java:601) ... 4 more Caused by: java.net.UnknownHostException: repo.maven.apache.org at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:866) at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1245) at java.net.InetAddress.getAllByName0(InetAddress.java:1196) at java.net.InetAddress.getAllByName(InetAddress.java:1127) at java.net.InetAddress.getAllByName(InetAddress.java:1063) at org.apache.maven.wagon.providers.http.httpclient.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) at org.apache.maven.wagon.providers.http.httpclient.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:278) at org.apache.maven.wagon.providers.http.httpclient.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:162) at org.apache.maven.wagon.providers.http.httpclient.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294) at org.apache.maven.wagon.providers.http.httpclient.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645) at org.apache.maven.wagon.providers.http.httpclient.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480) at org.apache.maven.wagon.providers.http.httpclient.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906) at org.apache.maven.wagon.providers.http.httpclient.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805) at org.apache.maven.wagon.shared.http4.AbstractHttpClientWagon.execute(AbstractHttpClientWagon.java:746) at org.apache.maven.wagon.shared.http4.AbstractHttpClientWagon.fillInputData(AbstractHttpClientWagon.java:886) ... 8 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
boy 2014-02-11
  • 打赏
  • 举报
 回复
http://blog.csdn.net/tx18/article/details/18561045或http://bbs.csdn.net/topics/390695834 一步一步地照做即可
_柴哥_ 2014-02-09
  • 打赏
  • 举报
 回复
貌似是虚拟机无法连上外网导致的
_柴哥_ 2014-02-09
  • 打赏
  • 举报
 回复
感谢版主提供的帮助 根据链接的内容修改配置文件后 不再出现插件标签唯一性冲突的错误 但是出现了插件依赖性的问题 [hadoop@hadoop-m hadoop-2.2.0-src]$ mvn clean install –DskipTests ... ... [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.0: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.0 from/to nexus-osc (http://maven.oschina.net/content/groups/public/): maven.oschina.net: Name or service not known: Unknown host maven.oschina.net: Name or service not known -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException 如果把按照版主提供帖子中关于settings.xml中的maven配置国内镜像部分删掉,用maven默认设置则会出现这样的问题 [hadoop@hadoop-m hadoop-2.2.0-src]$ mvn clean install –DskipTests ... ... [ERROR] Plugin org.apache.maven.plugins:maven-site-plugin:3.0 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-site-plugin:jar:3.0: Could not transfer artifact org.apache.maven.plugins:maven-site-plugin:pom:3.0 from/to central (http://repo.maven.apache.org/maven2): repo.maven.apache.org: Name or service not known: Unknown host repo.maven.apache.org: Name or service not known -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException 应该怎么搞定呢
hxwhou 2014-02-09
  • 打赏
  • 举报
 回复
可以参考这篇文章：http://blog.csdn.net/canlets/article/details/18709969
撸大湿 2014-02-09
  • 打赏
  • 举报
 回复
不能连外网，很麻烦 什么虚拟机？Vm吗？ 最简单的办法就是添加一块网卡，把网卡设置成NAT就能连外网了
撸大湿 2014-02-08
  • 打赏
  • 举报
 回复
如何编译2.2，可以参考置顶汇总贴 别忘了打Patch :https://issues.apache.org/jira/browse/HADOOP-10110
Hadoop 2.2.0 64位native文件（重编译）
Hadoop 2.2.0版本中在64为linux系统上运行所需要的native库文件。需要时用此native文件夹覆盖Hadoop 2.2.0中native文件夹即可。
hadoop2.2.0 64bit 重新编译
hadoop官网上面下载的Hadoop2.2.0 是32位的，现在将我自己重新编译的64bit发上来，这个是百度网盘分享的下载地址http://pan.baidu.com/s/1jG5KOCm，由于限制上传文件大小，所以只好如此了。
大数据视频_Hadoop视频教程（上）
本课程中你将学习到，Hadoop完全分布式集群搭建、Hadoop源码编译、HDFS的Shell操作、HDFS的API操作、HDFS的IO流操作、HDFS读写数据流程、NameNode和SecondaryNameNode工作机制、DataNode工作机制、集群节点动态服役...
hadoop2.2.0 eclipse-kepler 编译插件
hadoop2.2.0 eclipse插件-重新编译过。hadoop用的是hadoop2.2.0版本，eclipse用的是 eclipse-kepler。 插件 eclipse-kepler
hadoop2.2.0的64位安装包
Hadoop官网上下载的hadoop-2.2.0安装包是32位的，直接运行在64位的linux系统上会有问题，所以需要自己将hadoop-2.2.0安装包编译为64位。
Hadoop生态社区

20,809

社区成员

4,691

社区内容

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区，致力于有Hadoop，hive，Spark，Hbase，Flink，ClickHouse，Kafka，数据仓库，大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今

加载中

查看更多榜单
社区公告
暂无公告

试试用AI创作助手写篇文章吧

+ 用AI写文章