在配置GoldenGate同步DDL语句(2)中我们针对多种DDL语句在GoldenGate环境中的同步进行了测试,但在默认情况下replicat在复制DDL语句失败时不会在replicat report或者ggserr.log等日志文件中产生该DDL失败的具体信息,这就会导致我们在发现DDL同步有error的情况下无法了解失败的原因。之后又去翻官方的文档,在中找到了DDLOPTIONS参数:

Use the DDLOPTIONS parameter to configure aspects of DDL processing other than filtering

and string substitution. You can use multiple DDLOPTIONS statements, but using one is

recommended. If using multiple DDLOPTIONS statements, make each of them unique so that

one does not override the other. Multiple DDLOPTIONS statements are executed in the order

listed.

这个参数可用的选项很多,我们需要用到的是REPORT选项:

Valid for Extract and Replicat (Oracle and Teradata).

Controls whether or not expanded DDL processing

information is written to the report file. The default of

NOREPORT reports basic DDL statistics. REPORT adds the

parameters being used and a step-by-step history of the

operations that were processed

在replicat的参数文件中添加上"DDLOPTIONS REPORT",可以让replicat在同步DDL语句时若出现问题,将该问题的详细情况记录到该replicat的report 文件中,以便找出DDL复制失败的root cause。

GGSCI (rh3.oracle.com) 9> view params rep1

replicat rep1

userid maclean,password maclean

ASSUMETARGETDEFS

discardfile /s01/discard/rep1.log,append,megabytes 10

-- Support DDL here

DDL INCLUDE ALL

DDLERROR DEFAULT IGNORE RETRYOP MAXRETRIES 3 RETRYDELAY 5

DDLOPTIONS REPORT

map sender.* , target receiver.*;

GGSCI (rh3.oracle.com) 10> stop replicat rep1

Sending STOP request to REPLICAT REP1 ...

Request processed.

GGSCI (rh3.oracle.com) 11> start replicat rep1

Sending START request to MANAGER ...

REPLICAT REP1 starting

在源端创建一外部表

SQL> CREATE TABLE extgg

2 ORGANIZATION EXTERNAL

3 (TYPE oracle_datapump

4 DEFAULT DIRECTORY dgg

5 LOCATION ('extgg.dat'))

6 AS

7 select * from dba_objects;

Table created.

之后检查replicat的report信息可以发现DDL复制失败的详细SQL语句等信息:

GGSCI (rh3.oracle.com) 12> view report rep1

***********************************************************************

Oracle GoldenGate Delivery for Oracle

Version 11.1.1.0.0 Build 078

Linux, x64, 64bit (optimized), Oracle 10 on Jul 28 2010 15:58:11

Copyright (C) 1995, 2010, Oracle and/or its affiliates. All rights reserved.

Starting at 2010-12-10 05:54:32

***********************************************************************

...............

2010-12-09 09:10:13 INFO OGG-01408 Restoring current schema for DDL operation to [MACLEAN].

2010-12-09 09:10:13 INFO OGG-00482 DDL found, operation [CREATE

GLOBAL TEMPORARY TABLE "SENDER"."SYS_TEMP_0FD9D6609_2B3F4ED" ("OWNER" VARCHAR2(30),

"OBJECT_NAME" VARCHAR2(128),"SUBOBJECT_NAME" VARCHAR2(30),"OBJECT_ID"

NUMBER,"DATA_OBJECT_ID" NUMBER,"OBJECT_TYPE" VARCHAR2(19),"CREATED" DATE,"LAST_DDL_TIME" DATE,

"TIMESTAMP" VARCHA R2(19),"STATUS" VARCHAR2(7),"TEMPORARY" VARCHAR2(1),

"GENERATED" VARCHAR2(1),"SECONDARY" VARCHAR2(1) ) IN_MEMORY_METADATA

CURSOR_SPECIFIC_SEGMENT STORAGE (OBJNO 4254950

921 ) NOPARALLEL (size 456)].

2010-12-09 09:10:13 INFO OGG-00489 DDL is of mapped scope, after mapping new operation

[CREATE GLOBAL TEMPORARY TABLE "RECEIVER"."SYS_TEMP_0FD9D6609_2B3F4ED"

("OWNER" VARCHAR2(30),"OBJECT_NAME" VARCHAR2(128),"SUBOBJECT_NAME"

VARCHAR2(30),"OBJECT_ID" NUMBER,"DATA_OBJECT_ID" NUMBER,"OBJECT_TYPE"

VARCHAR2(19),"CREATED" DATE,"LAST_DDL_TIME" DATE,"TIMESTAMP" VARCHAR2(19),

"STATUS" VARCHAR2(7),"TEMPORARY" VARCHAR2(1),

"GENERATED" VARCHAR2(1),"SECONDARY" VARCHAR2(1) ) IN_MEMORY_METADATA CURSOR_SPECIF

IC_SEGMENT STORAGE (OBJNO 4254950921 ) NOPARALLEL (size 458)].

2010-12-09 09:10:13 INFO OGG-00487 DDL operation included [INCLUDE ALL], optype [CREATE],

objtype [TABLE], objowner [RECEIVER], objname [SYS_TEMP_0FD9D6609_2B3F4E

D].

2010-12-09 09:10:13 INFO OGG-01407 Setting current schema for DDL operation to [SYS].

2010-12-09 09:10:13 INFO OGG-00484 Executing DDL operation.

2010-12-09 09:10:18 INFO OGG-00495 DDL error ignored for next retry: error code

[DEFAULT],

filter [include all (default)], error text [Error code [900],

ORA-00900: invalid SQL statement, SQL CREATE GLOBAL TEMPORARY TABLE "RECEIVER"."SYS_TEMP_0FD9D6609_2B3F4ED"

("OWNER" VARCHAR2(30),"OBJECT_NAME" VARCHAR2(128),"SUBOBJECT_NAME" V

ARCHAR2(30),"OBJECT_ID" NUMBER,"DATA_OBJECT_ID" NUMBER,"OBJECT], retry [1].

2010-12-09 09:10:18 INFO OGG-01407 Setting current schema for DDL operation to [SYS].

2010-12-09 09:10:18 INFO OGG-00484 Executing DDL operation trying again due to RETRYOP parameter.

2010-12-09 09:10:23 INFO OGG-00495 DDL error ignored for next retry: error code [DEFAULT],

filter [include all (default)], error text

[Error code [900], ORA-00900

: invalid SQL statement, SQL CREATE GLOBAL TEMPORARY TABLE "RECEIVER"."SYS_TEMP_0FD9D6609_2B3F4ED"

("OWNER" VARCHAR2(30),"OBJECT_NAME" VARCHAR2(128),"SUBOBJECT_NAME" V

ARCHAR2(30),"OBJECT_ID" NUMBER,"DATA_OBJECT_ID" NUMBER,"OBJECT], retry [2].

2010-12-09 09:10:23 INFO OGG-01407 Setting current schema for DDL operation to [SYS].

另外需要注意的是如create table as select这样的建表DDL语句应该被杜绝使用,因为在goldengate复制环境中create table as select语句仍会以DDL形式被应用,这就导致源端和目标的端的数据不一致,如:

/* 源端中dba_object视图共有52046行数据 */

SQL> select count(*) from dba_objects;

COUNT(*)

----------

52046

SQL> create table ddlproblem as select * from dba_objects;

Table created.

SQL> select count(*) from ddlproblem;

COUNT(*)

----------

52047

而在目标端的复制情况:

SQL> desc ddlproblem

Name Null? Type

----------------------------------------- -------- ----------------------------

OWNER VARCHAR2(30)

OBJECT_NAME VARCHAR2(128)

SUBOBJECT_NAME VARCHAR2(30)

OBJECT_ID NUMBER

DATA_OBJECT_ID NUMBER

OBJECT_TYPE VARCHAR2(19)

CREATED DATE

LAST_DDL_TIME DATE

TIMESTAMP VARCHAR2(19)

STATUS VARCHAR2(7)

TEMPORARY VARCHAR2(1)

GENERATED VARCHAR2(1)

SECONDARY VARCHAR2(1)

SQL> select count(*) from ddlproblem;

COUNT(*)

----------

51008

/* 因为replicat在目标端仅是简单的执行"create table as select"的建表DDL语句,

而源端和目标端中这个被select的对象中的数据并不一致,因而CTAS操作只会导致

2端的数据不一致

*/

goldengate ddl mysql_配置GoldenGate同步DDL语句(3)相关推荐

  1. mysql ogg kafka_Oracle goldengate 实现mysql到kafka同步配置

    一.oracle goldengate技术架构 Oracle GoldenGate 实现原理是通过抽取源端的redo log 或者 archive log ,然后通过TCP/IP投递到目标端,最后解析 ...

  2. goldengate mysql_使用GoldenGate实现MySQL到Oracle的数据实时同步

    step 1: 配置mysql修改配置文件my.ini #for goldengate log-bin = "C:/mysql/logbin/logbin.log" binlog- ...

  3. oracle GoldenGate 的参数配置

    1       GoldenGate简要说明 GoldenGate现在是业内成熟的数据容灾与复制产品,经过多年的发展与完善,现在已经成为业内事实上的标准之一. GoldenGate软件是一种基于日志的 ...

  4. 【大数据实时数据同步】超级详细的生产环境OGG(GoldenGate)12.2实时异构同步Oracle数据部署方案(中)

    系列文章目录 [大数据实时数据同步]超级详细的生产环境OGG(GoldenGate)12.2实时异构同步Oracle数据部署方案(上) [大数据实时数据同步]超级详细的生产环境OGG(GoldenGa ...

  5. pm961 mysql_Oracle GoldenGate学习之--异构平台同步(Mysql到Oracle)

    Oracle GoldenGate学习之--异构平台同步(Mysql到Oracle) 如图所示:源端采用Mysql库,目标端采用Oracle库 一.OGG安装配置(源端) 1.OGG下载 https: ...

  6. 【clickhouse】配置ClickHouse分布式DDL记录自动清理

    文章目录 1.概述 1.概述 转载:配置ClickHouse分布式DDL记录自动清理 在ClickHouse集群中,我们可以在DDL语句上附加ON CLUSTER <cluster_name&g ...

  7. mysql ddl dml 导出_MySQL:DDL和DML语句,弄明白了吗?

    语句分类 DDL(Data Definition Languages)语句:即数据库定义语句,用来创建数据库中的表.索引.视图.存储过程.触发器等,常用的语句关键字有:CREATE,ALTER,DRO ...

  8. goldengate java_配置Goldengate向JMS(ActiveMQ)发布消息

    配置Goldengate向JMS(ActiveMQ)发布消息 通过Goldengate的Application Adpater可以方便的向JMS队列发送消息,其他应用程序通过订阅JMS消息 来对数据作 ...

  9. oracle goldengate学习笔记,Oracle GoldenGate 学习教程

    二.配置和使用 阅读导航 配置和使用GoldenGate的步骤 1 配置数据库支持GoldenGate 1.1 OGG用户和权限分配 1.2 数据库附加日志 1.2.1 数据库级别的附加日志 1.2. ...

最新文章

  1. 阿里云虚拟主机数据库主机怎么看
  2. Asp.net生成Excel文件并下载(解决使用迅雷下载页面而不是文件的问题)
  3. ora00600内部错误代码oracle,ORA-00600: 内部错误代码, 参数: [13013]
  4. Js+Css打造的红色经典伸缩菜单代码
  5. python基础 dict和set
  6. Linux服务器重启后crs_stat -t 命令无法正常使用以及解决思路
  7. ASP.NET Core 集成测试中模拟登录用户的一种姿势
  8. SQLite学习手册
  9. html5 应用框架,基于HTML5移动应用框架的研究及应用
  10. “串标围标”,是如何被识破的?
  11. 方言 —— 各地方言
  12. 20180312顺序查找
  13. Hive metastore整体代码分析及详解
  14. 彻底弄懂 Http 缓存机制 - 基于缓存策略三要素分解法
  15. 转--计算几何常用算法概览
  16. 计算机网络英语求职信范文大全,英文求职信
  17. 金融资产收益率计算中百分比收益率和对数收益率有什么区别?
  18. 纯电动汽车整车控制器(VCU)详细介绍
  19. C语言实践项目:2019年个税计算器
  20. docker镜像的获取删除和查看镜像信息历史记录清理残余镜像

热门文章

  1. 国际通用计算机语言有哪些,计算机语言有哪些 计算机语言分为哪三类
  2. Neutron-常用配置-学习笔记
  3. 计算机技能节大赛广播稿,苦练技能广播稿(52页)-原创力文档
  4. 愤怒的TryCatch
  5. java打包好的jar包在Linux服务器上指定端口并后台运行命令
  6. 详解prototype、__proto__和constructor
  7. Spring-Session实现session共享原理及解析
  8. jquery拖动DIV
  9. 将E-R图转换为关系模型的方法
  10. 【算法分析与设计】平面最近点对(含最近距离、最近点对、第一次分割点集合的输出)