<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<template encoding-version="1.3">
<description></description>
<groupId>4b687720-0188-1000-d936-03403d156463</groupId>
<name>PostgresqlToMySql指定表多表_CDC增量数据实时同步</name>
<snippet>
<processGroups>
<id>5149ff38-ecdc-3862-0000-000000000000</id>
<parentGroupId>b7c95683-65bf-3f4f-0000-000000000000</parentGroupId>
<position>
<x>0.0</x>
<y>0.0</y>
</position>
<comments></comments>
<contents>
<connections>
<id>0c00d9a4-d1b0-305a-0000-000000000000</id>
<parentGroupId>5149ff38-ecdc-3862-0000-000000000000</parentGroupId>
<versionedComponentId>b2a6d9f5-aa8a-375a-a49f-ea3d003eca1f</versionedComponentId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>f271fea9-7f66-3eb5-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>88424e5b-c09d-3d51-91bd-5b4ffbbd2cd4</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>9a09e5d9-7596-3c9c-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>d8cf5d79-923d-383a-872b-377749a40e6b</versionedComponentId>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>19a23ee9-41f6-3f58-0000-000000000000</id>
<parentGroupId>5149ff38-ecdc-3862-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>9a09e5d9-7596-3c9c-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>d8cf5d79-923d-383a-872b-377749a40e6b</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>c71baee8-bce3-3071-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>1a968768-a1b1-36af-0000-000000000000</id>
<parentGroupId>5149ff38-ecdc-3862-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>eb7fd0f7-e8d0-3c9c-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>split</selectedRelationships>
<source>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>bcb424ec-1032-3b1e-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>2a7b4423-b636-3ee6-0000-000000000000</id>
<parentGroupId>5149ff38-ecdc-3862-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>a9cc8e39-fa69-3521-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>1c42a3d0-e62e-3f11-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>2adfd364-8451-3c1a-0000-000000000000</id>
<parentGroupId>5149ff38-ecdc-3862-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5149ff38-ecdc-3862-0000-000000000000</groupId>
<id>bdb5f2ab-fd6f-30f9-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>23e2b413-7d92-344e-9c63-4941cfdce579</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
没有合适的资源?快使用搜索试试~ 我知道了~
NIFI大数据处理-PostgresqlToMySql指定表多表-CDC增量数据实时同步.zip
共1个文件
xml:1个
1.该资源内容由用户上传,如若侵权请联系客服进行举报
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
版权申诉
5星 · 超过95%的资源 1 下载量 59 浏览量
2023-06-12
17:08:28
上传
评论
收藏 10KB ZIP 举报
温馨提示
这个项目花费了我比较多的心血,NIFI还是挺好用的,主要是很灵活,可以自己定制,我感觉比一些做CDC的工具,会更灵活一些,但是学习门槛高,现在用的还不是那么的多,很多东西需要自己去查阅官网去自己学习,然后,很多代码需要不停的尝试,才能知道对应的处理器,最终是应该如何使用. 上面的资源我弄了一个星期,终于实现了,把数据从postgresql数据库可以动态的,实时,读取postgresql的cdc数据然后根据cdc的内容,进行数据增量的同步到mysql数据库中去,而且还添加了,cdc数据的分页功能,如果cdc数据内容特别多就不用担心了. 然后还添加了数据表过滤的功能,比如你只想同步一个数据库中的3张表,那么这里面我已经帮你实现了,然后如果你想同步一个数据库中的所有的表,我也已经帮你实现了,你下载以后,直接导入到nifi中,然后配置好自己的数据源就可以直接使用了.
资源推荐
资源详情
资源评论
收起资源包目录
PostgresqlToMySql指定表多表_CDC增量数据实时同步.zip (1个子文件)
PostgresqlToMySql指定表多表_CDC增量数据实时同步.xml 153KB
共 1 条
- 1
资源评论
- SaDaTa2023-07-16怎么能有这么好的资源!只能用感激涕零来形容TAT...
添柴程序猿
- 粉丝: 2926
- 资源: 84
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功