E-MapReduce
开发指南 / 目录
文档版本：20190322
III
3.1 参数说明......................................................................................................................... 35
3.2 MapReduce开发手册......................................................................................................36
3.2.1 在MapReduce中使用OSS................................................................................. 36
3.2.2 Word Count.......................................................................................................36
3.2.3 使用Maven工程来管理MR作业..........................................................................38
3.3 Hive开发手册.................................................................................................................. 43
3.3.1 在Hive中使用OSS............................................................................................. 43
3.3.2 使用Tez作为计算引擎........................................................................................44
3.4 Pig开发手册.................................................................................................................... 46
3.5 Hadoop Streaming......................................................................................................... 49
3.6 Hive+TableStore.............................................................................................................50
3.6.1 Hive接入TableStore.......................................................................................... 50
3.6.2 数据类型转换.....................................................................................................52
3.6.3 附录................................................................................................................... 52
3.7 MR+TableStore.............................................................................................................. 52
3.7.1 MR接入TableStore............................................................................................ 52
3.7.2 附录................................................................................................................... 55
4 HBase开发手册.................................................................................... 56
4.1 HBase配置......................................................................................................................56
4.2 访问HBase......................................................................................................................57
4.3 示例.................................................................................................................................58
5 HBase备份........................................................................................... 60
6 数据传输软件-Sqoop............................................................................62
6.1 安装Sqoop...................................................................................................................... 62
6.2 数据传输......................................................................................................................... 62
6.2.1 从Mysql到HDFS................................................................................................ 63
6.2.2 从HDFS到Mysql................................................................................................ 63
6.2.3 从Mysql到Hive...................................................................................................64
6.2.4 从Hive到Mysql...................................................................................................64
6.2.5 从Mysql到OSS.................................................................................................. 65
6.2.6 从OSS到Mysql.................................................................................................. 65
6.2.7 使用SQL作为导入条件...................................................................................... 66
7 E-MapReduce SDK发布说明...............................................................68
7.1 说明.................................................................................................................................68
7.2 v1.4.1.............................................................................................................................. 69
7.3 V1.4.0............................................................................................................................. 69
7.4 V1.3.2............................................................................................................................. 69
7.5 V1.3.1............................................................................................................................. 70
7.6 V1.3.0............................................................................................................................. 70
7.7 v1.1.3.1........................................................................................................................... 70
