3、通过datax同步oracle相关-oracle到hdfs
需积分: 0 134 浏览量
2023-05-29
10:25:53
上传
评论
收藏 135KB PDF 举报
DataX3.0系列文章
1、datax3.0部署与验证
2、mysql相关同步-mysql同步到mysql、mysql和hdfs相互同步
3、oracle相关同步-oracle到hdfs
4、sybase相关同步-sybase到hdfs
5、ETL工具的比较(DataPipeline，Kettle，Talend，Informatica，Datax ，Oracle Goldeng
@TOC
本文介绍oracle的相关同步，oracle同步到hdfs中。
本文分为三部分，即配置文件模板、配置文件和提交任务。
本文的前提：数据库对应的表已经建好。
一、配置文件模板
[root@bd-node-05 job]# python ../bin/datax.py -r oraclereader -w hdfswriter
DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
Please refer to the oraclereader document:
https://github.com/alibaba/DataX/blob/master/oraclereader/doc/oraclereader.md
Please refer to the hdfswriter document:
https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md
Please save the following configuration as a json file and use
python {DATAX_HOME}/bin/datax.py {JSON_FILE_NAME}.json
to run the job.
{
"job": {
"content": [
{
"reader": {
"name": "oraclereader",
"parameter": {
"column": [],
"connection": [
{
"jdbcUrl": [],
"table": []
}
],
"password": "",
"username": ""
剩余13页未读，继续阅读
资源评论
