热门标签 | HotTags
当前位置:  开发笔记 > 编程语言 > 正文

oracle并行拆分,goldengateogg常用调优方法–并行处理与进程拆分

为了提高性能,我们分别配置了五个replicat进程来对数据进行插入操作Oracle数据库的replicatADDREPLICATrep1,EXTTRAILhomeo

为了提高性能,我们分别配置了五个replicat进程来对数据进行插入操作

Oracle数据库的replicat

ADD REPLICAT rep1, EXTTRAIL /home/oracle/ogg/dirdat/ma, BEGIN now

ADD REPLICAT rep2, EXTTRAIL /home/oracle/ogg/dirdat/ma, BEGIN now

ADD REPLICAT rep3, EXTTRAIL /home/oracle/ogg/dirdat/ma, BEGIN now

ADD REPLICAT rep4, EXTTRAIL /home/oracle/ogg/dirdat/ma, BEGIN now

ADD REPLICAT rep5, EXTTRAIL /home/oracle/ogg/dirdat/ma, BEGIN now

REPLICAT rep1

USERID goldengate,PASSWORD goldengate

ASSUMETARGETDEFS

REPERROR (default,abend)

DBOPTIONS LIMITROWS DEFERREFCONST

BATCHSQL BATCHESPERQUEUE 1000, BATCHTRANSOPS 2000 ,OPSPERBATCH 6000 , OPSPERQUEUE 6000

GROUPTRANSOPS 20000

ALLOWNOOPUPDATES

DDL include all

map test.T_BILL_BALANCE_DETAIL_201112_0, target settle.T_BILL_BALANCE_DETAIL_201112_0 , FILTER (@RANGE (1, 5));

map test.T_BILL_BALANCE_DETAIL_201112_1, target settle.T_BILL_BALANCE_DETAIL_201112_1 , FILTER (@RANGE (1, 5));

map test.T_BILL_BALANCE_DETAIL_201112_2, target settle.T_BILL_BALANCE_DETAIL_201112_2 , FILTER (@RANGE (1, 5));

map test.T_BILL_BALANCE_DETAIL_201112_3, target settle.T_BILL_BALANCE_DETAIL_201112_3 , FILTER (@RANGE (1, 5));

map test.T_BILL_BALANCE_DETAIL_201112_4, target settle.T_BILL_BALANCE_DETAIL_201112_4 , FILTER (@RANGE (1, 5));

map test.T_ACCOUNT_1, target settle.T_ACCOUNT_1;

map test.T_SERVICE_1, target settle.T_SERVICE_1;

map test.T_CUSTOMER_1, target settle.T_CUSTOMER_1;

MAP TEST.TF01 ,TARGET SETTLE.TF01 , COLMAP (F2=F2,F4=F4,F6=F6,F1=@COLSTAT (NULL),F3=@COLSTAT (NULL),F5=@COLSTAT (NULL),dd=@datenow (

));

MAP TEST.*, TARGET SETTLE.*;

REPLICAT rep2

USERID goldengate,PASSWORD goldengate

ASSUMETARGETDEFS

REPERROR (default,abend)

DBOPTIONS LIMITROWS DEFERREFCONST

BATCHSQL BATCHESPERQUEUE 1000, BATCHTRANSOPS 2000 ,OPSPERBATCH 6000 , OPSPERQUEUE 6000

GROUPTRANSOPS 20000

DDL exclude all

map test.T_BILL_BALANCE_DETAIL_201112_0, target settle.T_BILL_BALANCE_DETAIL_201112_0 , FILTER (@RANGE (2, 5));

map test.T_BILL_BALANCE_DETAIL_201112_1, target settle.T_BILL_BALANCE_DETAIL_201112_1 , FILTER (@RANGE (2, 5));

map test.T_BILL_BALANCE_DETAIL_201112_2, target settle.T_BILL_BALANCE_DETAIL_201112_2 , FILTER (@RANGE (2, 5));

map test.T_BILL_BALANCE_DETAIL_201112_3, target settle.T_BILL_BALANCE_DETAIL_201112_3 , FILTER (@RANGE (2, 5));

map test.T_BILL_BALANCE_DETAIL_201112_4, target settle.T_BILL_BALANCE_DETAIL_201112_4 , FILTER (@RANGE (2, 5));

REPLICAT rep3

USERID goldengate,PASSWORD goldengate

ASSUMETARGETDEFS

REPERROR (default,abend)

DBOPTIONS LIMITROWS DEFERREFCONST

BATCHSQL BATCHESPERQUEUE 1000, BATCHTRANSOPS 2000 ,OPSPERBATCH 6000 , OPSPERQUEUE 6000

GROUPTRANSOPS 20000

DDL exclude all

map test.T_BILL_BALANCE_DETAIL_201112_0, target settle.T_BILL_BALANCE_DETAIL_201112_0 , FILTER (@RANGE (3, 5));

map test.T_BILL_BALANCE_DETAIL_201112_1, target settle.T_BILL_BALANCE_DETAIL_201112_1 , FILTER (@RANGE (3, 5));

map test.T_BILL_BALANCE_DETAIL_201112_2, target settle.T_BILL_BALANCE_DETAIL_201112_2 , FILTER (@RANGE (3, 5));

map test.T_BILL_BALANCE_DETAIL_201112_3, target settle.T_BILL_BALANCE_DETAIL_201112_3 , FILTER (@RANGE (3, 5));

map test.T_BILL_BALANCE_DETAIL_201112_4, target settle.T_BILL_BALANCE_DETAIL_201112_4 , FILTER (@RANGE (3, 5));

REPLICAT rep4

USERID goldengate,PASSWORD goldengate

ASSUMETARGETDEFS

REPERROR (default,abend)

DBOPTIONS LIMITROWS DEFERREFCONST

BATCHSQL BATCHESPERQUEUE 1000, BATCHTRANSOPS 2000 ,OPSPERBATCH 6000 , OPSPERQUEUE 6000

GROUPTRANSOPS 20000

DDL exclude all

map test.T_BILL_BALANCE_DETAIL_201112_0, target settle.T_BILL_BALANCE_DETAIL_201112_0 , FILTER (@RANGE (4, 5));

map test.T_BILL_BALANCE_DETAIL_201112_1, target settle.T_BILL_BALANCE_DETAIL_201112_1 , FILTER (@RANGE (4, 5));

map test.T_BILL_BALANCE_DETAIL_201112_2, target settle.T_BILL_BALANCE_DETAIL_201112_2 , FILTER (@RANGE (4, 5));

map test.T_BILL_BALANCE_DETAIL_201112_3, target settle.T_BILL_BALANCE_DETAIL_201112_3 , FILTER (@RANGE (4, 5));

map test.T_BILL_BALANCE_DETAIL_201112_4, target settle.T_BILL_BALANCE_DETAIL_201112_4 , FILTER (@RANGE (4, 5));

REPLICAT rep5

USERID goldengate,PASSWORD goldengate

ASSUMETARGETDEFS

REPERROR (default,abend)

DBOPTIONS LIMITROWS DEFERREFCONST

BATCHSQL BATCHESPERQUEUE 1000, BATCHTRANSOPS 2000 ,OPSPERBATCH 6000 , OPSPERQUEUE 6000

GROUPTRANSOPS 20000

DDL exclude all

map test.T_BILL_BALANCE_DETAIL_201112_0, target settle.T_BILL_BALANCE_DETAIL_201112_0 , FILTER (@RANGE (5, 5));

map test.T_BILL_BALANCE_DETAIL_201112_1, target settle.T_BILL_BALANCE_DETAIL_201112_1 , FILTER (@RANGE (5, 5));

map test.T_BILL_BALANCE_DETAIL_201112_2, target settle.T_BILL_BALANCE_DETAIL_201112_2 , FILTER (@RANGE (5, 5));

map test.T_BILL_BALANCE_DETAIL_201112_3, target settle.T_BILL_BALANCE_DETAIL_201112_3 , FILTER (@RANGE (5, 5));

map test.T_BILL_BALANCE_DETAIL_201112_4, target settle.T_BILL_BALANCE_DETAIL_201112_4 , FILTER (@RANGE (5, 5));

mysql 数据库的replicat

replicat rep1

DBOPTIONS HOST 127.0.0.1, CONNECTIONPORT 3306

TARGETDB ogg,userid goldengate,password goldengate

SOURCEDEFS /home/oracle/ogg/mysql/dirdef/record.def

reperror (default,abend)

MAP TEST.TESTSQL, TARGET OGG.TESTSQL;

MAP TEST.T_BILL_BALANCE_DETAIL_201112_9, TARGET OGG.T_BILL_BALANCE_DETAIL_201112_9 , FILTER (@RANGE (1, 5));

replicat rep2

DBOPTIONS HOST 127.0.0.1, CONNECTIONPORT 3306

TARGETDB ogg,userid goldengate,password goldengate

SOURCEDEFS /home/oracle/ogg/mysql/dirdef/record.def

reperror (default,abend)

MAP TEST.T_BILL_BALANCE_DETAIL_201112_9, TARGET OGG.T_BILL_BALANCE_DETAIL_201112_9 , FILTER (@RANGE (2, 5));

replicat rep3

DBOPTIONS HOST 127.0.0.1, CONNECTIONPORT 3306

TARGETDB ogg,userid goldengate,password goldengate

SOURCEDEFS /home/oracle/ogg/mysql/dirdef/record.def

reperror (default,abend)

MAP TEST.T_BILL_BALANCE_DETAIL_201112_9, TARGET OGG.T_BILL_BALANCE_DETAIL_201112_9 , FILTER (@RANGE (3, 5));

replicat rep4

DBOPTIONS HOST 127.0.0.1, CONNECTIONPORT 3306

TARGETDB ogg,userid goldengate,password goldengate

SOURCEDEFS /home/oracle/ogg/mysql/dirdef/record.def

reperror (default,abend)

MAP TEST.T_BILL_BALANCE_DETAIL_201112_9, TARGET OGG.T_BILL_BALANCE_DETAIL_201112_9 , FILTER (@RANGE (4, 5));



推荐阅读
  • 本文详细介绍了Java中org.neo4j.helpers.collection.Iterators.single()方法的功能、使用场景及代码示例,帮助开发者更好地理解和应用该方法。 ... [详细]
  • UNP 第9章:主机名与地址转换
    本章探讨了用于在主机名和数值地址之间进行转换的函数,如gethostbyname和gethostbyaddr。此外,还介绍了getservbyname和getservbyport函数,用于在服务器名和端口号之间进行转换。 ... [详细]
  • 本文详细介绍了 Apache Jena 库中的 Txn.executeWrite 方法,通过多个实际代码示例展示了其在不同场景下的应用,帮助开发者更好地理解和使用该方法。 ... [详细]
  • 本文介绍如何使用Objective-C结合dispatch库进行并发编程,以提高素数计数任务的效率。通过对比纯C代码与引入并发机制后的代码,展示dispatch库的强大功能。 ... [详细]
  • 题目Link题目学习link1题目学习link2题目学习link3%%%受益匪浅!-----&# ... [详细]
  • Explore a common issue encountered when implementing an OAuth 1.0a API, specifically the inability to encode null objects and how to resolve it. ... [详细]
  • 本文详细介绍如何使用Python进行配置文件的读写操作,涵盖常见的配置文件格式(如INI、JSON、TOML和YAML),并提供具体的代码示例。 ... [详细]
  • 本文介绍了Java并发库中的阻塞队列(BlockingQueue)及其典型应用场景。通过具体实例,展示了如何利用LinkedBlockingQueue实现线程间高效、安全的数据传递,并结合线程池和原子类优化性能。 ... [详细]
  • 题目描述:给定n个半开区间[a, b),要求使用两个互不重叠的记录器,求最多可以记录多少个区间。解决方案采用贪心算法,通过排序和遍历实现最优解。 ... [详细]
  • 使用 Azure Service Principal 和 Microsoft Graph API 获取 AAD 用户列表
    本文介绍了一段通用代码示例,该代码不仅能够操作 Azure Active Directory (AAD),还可以通过 Azure Service Principal 的授权访问和管理 Azure 订阅资源。Azure 的架构可以分为两个层级:AAD 和 Subscription。 ... [详细]
  • 本文深入探讨了 Java 中的 Serializable 接口,解释了其实现机制、用途及注意事项,帮助开发者更好地理解和使用序列化功能。 ... [详细]
  • 本文详细介绍了如何构建一个高效的UI管理系统,集中处理UI页面的打开、关闭、层级管理和页面跳转等问题。通过UIManager统一管理外部切换逻辑,实现功能逻辑分散化和代码复用,支持多人协作开发。 ... [详细]
  • 本文详细探讨了VxWorks操作系统中双向链表和环形缓冲区的实现原理及使用方法,通过具体示例代码加深理解。 ... [详细]
  • Android 渐变圆环加载控件实现
    本文介绍了如何在 Android 中创建一个自定义的渐变圆环加载控件,该控件已在多个知名应用中使用。我们将详细探讨其工作原理和实现方法。 ... [详细]
  • C++构造函数与初始化列表详解
    本文深入探讨了C++中构造函数的初始化列表,包括赋值与初始化的区别、初始化列表的使用规则、静态成员初始化等内容。通过实例和调试证明,详细解释了初始化列表在对象创建时的重要性。 ... [详细]
author-avatar
Aerotic
这个家伙很懒,什么也没留下!
PHP1.CN | 中国最专业的PHP中文社区 | DevBox开发工具箱 | json解析格式化 |PHP资讯 | PHP教程 | 数据库技术 | 服务器技术 | 前端开发技术 | PHP框架 | 开发工具 | 在线工具
Copyright © 1998 - 2020 PHP1.CN. All Rights Reserved | 京公网安备 11010802041100号 | 京ICP备19059560号-4 | PHP1.CN 第一PHP社区 版权所有