workflow怎么添加计划没用

Boil_ou 2018-12-17 08:21:21
workflow怎么添加计划
...全文
30 回复 打赏 收藏 转发到动态 举报
写回复
用AI写文章
回复
切换为时间正序
请发表友善的回复…
发表回复
hadoop权威指南第三版发行说明: 第三版会在2012年5月发行。你现在可以预定一份电子版,或购买“Early Release”版,买了这版送正式版。(这话对国人基本没用,呵呵!) 下面大概说说这本书的一些改动。 第三版添加了哪些新东西? 第三版内容覆盖hadoop发行包1.x(原0.20版),也包括0.22,0.23版。书中所有的例子都已经在这些版本上运行过, 除了少数例外的情况,都已经在文中标注了。其实每一版的新特性都在第一章的"Hadoop Releases"描述了。 这一版大部分例子用新API,由于旧版API仍在广泛使用,所以在旁注中仍然讨论它,旧版的实现代码可以在这本书的网站找到。 hadoop 0.23的主要变化是使用了new MapReduce runtime, MapReduce 2,是一个基于新的分布式资源管理系统的YARN,第六章讲如何工作,第七章讲如何应用。 书中包括了更多的mapreduce资料,比如用maven打包MapReduce,设置java环境变量,写MRUnit测试单元(第五章介绍),还有一些更深入的特性,比如输出的提交,分布式缓存等(第8章),任务内存监控(第9章),第4章新增了通过mapreduce job处理avro 数据,第5章介绍了用oozie运行简单的workflow 工作流。 (很遗憾没有coodenater的介绍) 第3章在讲HDFS时介绍了高可用性,联合特性,及新的WebHDFS和HttpFS文件系统。 Pig, Hive, Sqoop, and ZooKeeper这几个框架的最新版的特性和修改都有扩展介绍。 这本书还有许多修改和提高。 原文: Third Edition The third edition is due to be published in May 2012. You can pre-order a copy, or buy the “Early Release” ebook today (you will receive the final ebook version when it is available for no extra charge). The following section is from the book’s preface, and outlines the changes in the third edition. What’s New in the Third Edition? The third edition covers the 1.x (formerly 0.20) release series of Apache Hadoop, as well as the newer 0.22 and 0.23 series. With a few exceptions, which are noted in the text, all the examples in this book run against these versions. The features in each release series are described at a high-level in "Hadoop Releases" in Chapter 1. This edition uses the new MapReduce API for most of the examples. Since the old API is still in widespread use, it continues to be discussed in the text alongside the new API, and the equivalent code using the old API can be found on the book’s website. The major change in Hadoop 0.23 is the new MapReduce runtime, MapReduce 2, which is built on a new distributed resource management system called YARN. This edition includes new sections covering MapReduce on YARN: how it works (Chapter 6) and how to run it (Chapter 9). There is more MapReduce material too, including development practices like packaging MapReduce jobs with Maven, setting the user’s Java classpath, and writing tests with MRUnit (all in Chapter 5); and more depth on features such as output committers, the distributed cache (both in Chapter 8), and task memory monitoring (Chapter 9). There is a new section on writing MapReduce jobs to process Avro data (Chapter 4), and on running a simple MapReduce workflow in Oozie (Chapter 5). The chapter on HDFS (Chapter 3) now has introductions to High Availability, Federation, and the new WebHDFS and HttpFS filesystems. The chapters on Pig, Hive, Sqoop, and ZooKeeper have all been expanded to cover the new features and changes in their latest releases. In addition, numerous corrections and improvements have been made throughout the book.

246

社区成员

发帖
与我相关
我的任务
社区描述
讨论 Informatica 数据集成相关技术、数据隐私保护相关技术
社区管理员
  • 数据集成社区
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧