使用clousera-manager安装CDH 报错~求高手帮忙给解答下

aslincy 2014-03-24 04:43:16
使用cloudera-manager进行CDH4的安装,
主机安装过程报错::
安装失败。 无法接收 Agent 发出的检测信号。

请确保主机的名称已正确配置。
请确保端口 7182 可在 Cloudera Manager Server 上访问(检查防火墙规则)。
请确保正在添加的主机上的端口 9000 和 9001 空闲。
检查正在添加的主机上 /var/log/cloudera-scm-agent/ 中的代理日志(某些日志可在安装详细信息中找到)。

详细log:

无法接收 Agent 发出的检测信号。 (当前步骤)


正在启动 Cloudera Manager Agent...
BEGIN /sbin/service cloudera-scm-agent status | grep running
server_host=192.168.123.10
END (1)
BEGIN /sbin/service cloudera-scm-agent start
正在启动 cloudera-scm-agent:[60G[[0;32m确定[0;39m]
END (0)
agent logs:
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/'
END (0)
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/'
>> self.conn.connect()
>> File "/usr/lib64/python2.6/httplib.py", line 720, in connect
>> self.timeout)
>> File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
>> raise error, msg
>>error: [Errno 111] Connection refused
>>[24/Mar/2014 14:55:53 +0000] 7202 MainThread agent ERROR Heartbeating to localhost:7182 failed.
>>Traceback (most recent call last):
>> File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 741, in send_heartbeat
>> self.master_port)
>> File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 471, in __init__
>> self.conn.connect()
>> File "/usr/lib64/python2.6/httplib.py", line 720, in connect
>> self.timeout)
>> File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
>> raise error, msg
>>error: [Errno 111] Connection refused
>>[24/Mar/2014 14:56:53 +0000] 7202 MainThread agent ERROR Heartbeating to localhost:7182 failed.

>>Traceback (most recent call last):
>> File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 741, in send_heartbeat



有没有哪位大侠遇到过, 给解答下~~感激不尽~








...全文
18378 12 打赏 收藏 转发到动态 举报
写回复
用AI写文章
12 条回复
切换为时间正序
请发表友善的回复…
发表回复
zhuqitian 2016-11-26
  • 打赏
  • 举报
回复
解决这个问题简单的,是因为有进程占用了: ps aux | grep super [root@localhost cm-5.7.0]# ps aux | grep super root 18949 0.0 0.1 223624 12996 ? Ss 11:16 0:00 /opt/cm-5.7.0/lib64/cmf/agent/build/env/bin/python /opt/cm-5.7.0/lib64/cmf/agent/build/env/bin/supervisord root 23390 0.0 0.0 112656 972 pts/0 S+ 11:37 0:00 grep --color=auto super [root@localhost cm-5.7.0]# kill 18949 /opt/cm-5.7.0/etc/init.d/cloudera-scm-agent stop /opt/cm-5.7.0/etc/init.d/cloudera-scm-server stop 这样就可了
freedomroad 2016-10-28
  • 打赏
  • 举报
回复
@aslincy
freedomroad 2016-10-28
  • 打赏
  • 举报
回复
楼主解决了吗,我试过/etc/hosts和/etc/sysconfig/network没有问题,然后service cloudera-scm-agent restart还是报同样的错误 以下是cloudera-scm-agent.log的日志提示: [28/Oct/2016 10:58:17 +0000] 8600 MainThread ntp_monitor INFO Using timeout of 2.000000 [28/Oct/2016 10:58:17 +0000] 8600 MainThread dns_names INFO Using timeout of 30.000000 [28/Oct/2016 10:58:17 +0000] 8600 MainThread __init__ INFO Created DNS monitor. [28/Oct/2016 10:58:17 +0000] 8600 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880 [28/Oct/2016 10:58:17 +0000] 8600 MainThread __init__ INFO Importing metric schema from file /usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.2-py2.6.egg/cmf/monitor/schema.json [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/process [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/flood [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Supervisor version: 3.0 [28/Oct/2016 10:58:18 +0000] 8600 MainThread agent INFO Connecting to previous supervisor: agent-1423-1477564898. [28/Oct/2016 10:58:18 +0000] 8600 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes. [28/Oct/2016 10:58:18 +0000] 8600 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes. [28/Oct/2016 10:58:18 +0000] 8600 MainThread _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Bus STARTING [28/Oct/2016 10:58:18 +0000] 8600 MainThread _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Started monitor thread '_TimeoutMonitor'. [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging ERROR [28/Oct/2016:10:58:18] ENGINE Error in HTTP server: shutting down Traceback (most recent call last): File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/process/servers.py", line 187, in _start_http_thread self.httpserver.start() File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1825, in start raise socket.error(msg) error: No socket could be created on ('work3', 9000) -- [Errno 99] Cannot assign requested address [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Bus STOPPING [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO [28/Oct/2016:10:58:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('work3', 9000)) already shut down [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Stopped thread '_TimeoutMonitor'. [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Bus STOPPED [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Bus EXITING [28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO [28/Oct/2016:10:58:18] ENGINE Bus EXITED 请问如何解决呢 高了好几天了,我还试过删除/etc/yum.repose.d/目录下面的cloudera-manager.repo.~*删除了,但还是宝同样的错误提示:无法接受到agent的检测信号。
aliceshen1982 2014-07-21
  • 打赏
  • 举报
回复
也碰到这个问题,做了两个修改: 1 hosts里增加了域名,如 172.1.12.12 test.com test,之前没有test.com hostname修改为test.com 2.这样修改后还是有两个host报上述错误,看日志发现 No such file or directory: '/var/lib/cloudera-scm-agent/uuid' ( 我的cloudera-scm-agent.out日志里是这么提示的)。然后手工建了cloudera-scm-agent,设置777,这一步就通过了
HCTsai 2014-06-19
  • 打赏
  • 举报
回复
解決方法很簡單,主機不能用IP,要用 Hostname 1.修改 hosts 檔案,新增 ip 與 hostname的對應。 2.安裝 CDH時,使用 hostname 取代 ip
CoptimT 2014-06-04
  • 打赏
  • 举报
回复
1.配置hosts: 127.0.0.1 hd-01.com hd-01 192.168.x.x hd-01.com 2.选择主机的时候不要填IP:127.0.0.1, 要填主机名:hd-01.com 注意:我是cloudera namager安装cdh伪分布式 解决: >>error: [Errno 111] Connection refused >>[24/Mar/2014 14:56:53 +0000] 7202 MainThread agent ERROR Heartbeating to localhost:7182 failed.
alan666zuo 2014-05-16
  • 打赏
  • 举报
回复
我也遇到的同样的问题,不过我是单机安装,也就是只有一个主节点,你解决了吗?
aslincy 2014-04-02
  • 打赏
  • 举报
回复
最好自己在本地搭YUM源, 我是用把rpm都下载到本地了。做了yum源然后安装的。。这样就没有下载的问题了。
sanguomi 2014-03-27
  • 打赏
  • 举报
回复
今天下午拿这个安装了下,老是安装到40%左右出错,一看错误日志, 是下载速度太慢了,拿那几个下载地址去下了几个rpm包,然后安装,安装到最后提示数据库初始化错误, 很诡异。 明天再弄弄。
aslincy 2014-03-27
  • 打赏
  • 举报
回复
忘了说一句, 改了host以后, 重启下 cloudera-scm-agent服务。
aslincy 2014-03-27
  • 打赏
  • 举报
回复
还没完全解决。 我看到agent的log里,有 Failed to collect java-based DNS names这样的一句话, 我修改了hosts文件, 把给节点配了域,类似这样: 127.0.0.1 hd-01.com hd-01 这样改了以后, 我的hadoop节点2, 和节点3 , 成功了。。但是主节点 还是报那个agent的错误。 目前还没找到彻底解决的方法,你可以试试在你的环境下好用不。 要是你找到什么方法,也知会下我吧。谢了哥们~
-无-为- 2014-03-26
  • 打赏
  • 举报
回复
遇到同样的问题,哥们儿你的解决了没有 " 安装失败。 无法接收 Agent 发出的检测信号。 请确保主机的名称已正确配置。 请确保端口 7182 可在 Cloudera Manager Server 上访问(检查防火墙规则)。 请确保正在添加的主机上的端口 9000 和 9001 空闲。 检查正在添加的主机上 /var/log/cloudera-scm-agent/ 中的代理日志(某些日志可在安装详细信息中找到)"

20,808

社区成员

发帖
与我相关
我的任务
社区描述
Hadoop生态大数据交流社区,致力于有Hadoop,hive,Spark,Hbase,Flink,ClickHouse,Kafka,数据仓库,大数据集群运维技术分享和交流等。致力于收集优质的博客
社区管理员
  • 分布式计算/Hadoop社区
  • 涤生大数据
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧