环境： 主库 11.2.0.3  RAC 2个节点

备库 11.2.0.3  active data guard

os redhat 5.7 x64

故障描述：

连续2天下午，备库异常挂掉，重启备库恢复，相关日志如下：

asm alert 日志报

Tue Jan 29 16:35:49 2013

WARNING: client [sanddb:sanddbdg] not responsive for 192s; state=0x1. killing pid 367

Tue Jan 29 16:36:49 2013

WARNING: client [sanddb:sanddbdg] cleanup delayed; waited 252s, pid 367 mbr 0x0

Tue Jan 29 16:37:50 2013

WARNING: client [sanddb:sanddbdg] cleanup delayed; waited 312s, pid 367 mbr 0x0

Tue Jan 29 16:38:50 2013

WARNING: client [sanddb:sanddbdg] cleanup delayed; waited 372s, pid 367 mbr 0x0

oracle alert 日志报：

Tue Jan 29 16:34:40 2013

System State dumped to trace file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_ora_32504.trc

Errors in file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_ora_32504.trc:

Tue Jan 29 16:39:22 2013

NOTE: Deferred communication with ASM instance

Tue Jan 29 16:39:22 2013

NOTE: ASMB terminating

Errors in file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_pr00_648.trc:

ORA-01041: internal error. hostdef extension doesn't exist

ORA-03113: end-of-file on communication channel

Process ID:

Session ID: 430 Serial number: 213

Errors in file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_asmb_361.trc:

ORA-15064: communication failure with ASM instance

ORA-03135: connection lost contact

Process ID:

Session ID: 289 Serial number: 879

NOTE: deferred map free for map id 421843

Errors in file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_asmb_361.trc:

ORA-15064: communication failure with ASM instance

ORA-03135: connection lost contact

Process ID:

Session ID: 289 Serial number: 879

Some DDE async actions failed or were cancelled

ASMB (ospid: 361): terminating the instance due to error 15064

Tue Jan 29 16:39:23 2013

System state dump requested by (instance=1, osid=361 (ASMB)), summary=[abnormal instance termination].

Errors in file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_pr00_648.trc:

ORA-00313: open failed for members of log group 32 of thread 2

ORA-00312: online log 32 thread 2: '+DATA/sanddb/standbylog/stdbyredo12.log'

ORA-17503: ksfdopn:2 Failed to open file +DATA/sanddb/standbylog/stdbyredo12.log

ORA-03113: end-of-file on communication channel

Process ID:

Session ID: 430 Serial number: 213

System State dumped to trace file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_diag_321.trc

Tue Jan 29 16:39:23 2013

opiodr aborting process unknown ospid (579) as a result of ORA-1092

Tue Jan 29 16:39:23 2013

opiodr aborting process unknown ospid (583) as a result of ORA-1092

Tue Jan 29 16:39:23 2013

ORA-1092 : opitsk aborting process

Tue Jan 29 16:39:23 2013

ORA-1092 : opitsk aborting process

NOTE: Deferred communication with ASM instance

Errors in file /u01/app/oracle/diag/rdbms/sanddbdg/sanddb/trace/sanddb_pr00_648.trc:

ORA-01041: internal error. hostdef extension doesn't exist

NOTE: deferred map free for map id 371853

Dumping diagnostic data in directory=[cdmp_20130129163923], requested by (instance=1, osid=361 (ASMB)), summary=[abnormal instance termination].

Instance terminated by ASMB, pid = 361

TRACE文件AWK分析后：

Starting Systemstate 1

..............................................................................

.....................................

Ass.Awk Version 1.0.9 - Processing sanddb_ora_32504.trc

System State 1

~~~~~~~~~~~~~~~~

1:

2:  0: waiting for 'pmon timer'

3:  0: waiting for 'latch free'        [Latch 60010d08]

4:  0: waiting for 'VKTM Logical Idle Wait'

5:  0: waiting for 'rdbms ipc message'

6:  0: waiting for 'DIAG idle wait'

7:  0: waiting for 'rdbms ipc message'

8:  0: waiting for 'DIAG idle wait'

9:  0: waiting for 'rdbms ipc message'

10: 0: waiting for 'rdbms ipc message'

11: 0: waiting for 'rdbms ipc message'

12: 0: waiting for 'rdbms ipc message'

13: 0: waiting for 'smon timer'

14: 0: waiting for 'rdbms ipc message'

15: 0: waiting for 'rdbms ipc message'

16: 0: waiting for 'ASM file metadata operation'[Latch 601098b8]

17: 0: waiting for 'latch: shared pool'[Latch 601098b8]

18: 0: waiting for 'rdbms ipc message'

19:

20:

21: 0: waiting for 'wait for unread message on broadcast channel'

22: 0: waiting for 'SQL*Net message from client'

23:                                    [Latch 6000a018]

24: 0: waiting for 'class slave wait'

25: 0: waiting for 'rdbms ipc message'

26: 0: waiting for 'rdbms ipc message'

27: 0: waiting for 'rdbms ipc message'

28: 0: waiting for 'rdbms ipc message'

29: 0: waiting for 'rdbms ipc message'

30: 0: waiting for 'class slave wait'

31: 0: waiting for 'RFS dispatch'      [Enqueue CF-00000000-00000000]

32: 0: waiting for 'RFS dispatch'      [Enqueue CF-00000000-00000000]

33: 0: waiting for 'class slave wait'

34: 0: waiting for 'RFS dispatch'

Cmd: Select

35: 0: waiting for 'RFS dispatch'

36: 0: waiting for 'SQL*Net message from client'

37: 0: waiting for 'SQL*Net message from client'

38: 0: waiting for 'buffer busy waits' (0x5,0x4b3,0x2a)

Cmd: Select

39: 0: waiting for 'SQL*Net message from client'

40: 0: waiting for 'class slave wait'

41: 0: waiting for 'Disk file operations I/O'

42: 0: waiting for 'parallel recovery slave next change'

43: 0: waiting for 'parallel recovery slave next change'

44: 0: waiting for 'parallel recovery slave next change'

45: 0: waiting for 'latch: shared pool'[Latch 601098b8]

46: 0: waiting for 'class slave wait'

47: 0: waiting for 'SQL*Net message from client'

48:                                    [Latch 6000a018]

49: 0: waiting for 'SQL*Net message from client'

50: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

51: 0: waiting for 'latch: shared pool'[Latch 601098b8]

52: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

53: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

54: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

55:                                    [Latch 601098b8]

56:                                    [Latch 601098b8]

57: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

58:                                    [Latch 601098b8]

59: 0: waiting for 'SQL*Net message from client'

60: 0: waiting for 'buffer busy waits' (0x5,0x4b3,0x2a)

Cmd: Select

61:

62: 0: waiting for 'latch: shared pool'[Latch 601098b8]

63: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

64: 0: waiting for 'latch: shared pool'[Latch 601098b8]

65: 0: waiting for 'library cache load lock'

66: 0: waiting for 'library cache load lock'

67: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

68: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

69: 0: waiting for 'library cache: mutex X'

70: 0: waiting for 'latch: shared pool'[Latch 601098b8]

71:

Cmd: Select

72: 0: waiting for 'library cache: mutex X'

73: 0: waiting for 'latch: shared pool'[Latch 601098b8]

74: 0: waiting for 'latch: shared pool'[Latch 601098b8]

75: 0: waiting for 'library cache load lock'

76: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

77: 0: waiting for 'buffer busy waits' (0x5,0x4b3,0x2a)

Cmd: Select

78: 0: waiting for 'latch: shared pool'[Latch 601098b8]

79: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

80: 0: waiting for 'latch: shared pool'[Latch 601098b8]

Cmd: Select

81:                                    [Latch 601098b8]

82:                                    [Latch 601098b8]

83:                                    [Latch 601098b8]

84:                                    [Latch 601098b8]

85:                                    [Latch 601098b8]

86:                                    [Latch 601098b8]

87:                                    [Latch 6000a018]

88:                                    [Latch 6000a018]

89:                                    [Latch 6000a018]

90:                                    [Latch 601098b8]

91:                                    [Latch 60010d08]

92:                                    [Latch 60010d08]

93:                                    [Latch 60010d08]

94:                                    [Latch 60010d08]

95:                                    [Latch 60010d08]

96:                                    [Latch 60010d08]

97:                                    [Latch 60010d08]

98:                                    [Latch 601098b8]

99:                                    [Latch 60010f38]

100:                                   [Latch 60010f38]

101:                                   [Latch 60010f38]

102:                                   [Latch 60010f38]

103:                                   [Latch 60010f38]

104:                                   [Latch 60010f38]

105:                                   [Latch 60010f38]

106:                                   [Latch 60010f38]

107:                                   [Latch 60010f38]

108:                                   [Latch 60010f38]

109:                                   [Latch 60010f38]

110:                                   [Latch 60010f38]

111:                                   [Latch 60010f38]

112:                                   [Latch 60010f38]

113:                                   [Latch 60010f38]

114:                                   [Latch 60010f38]

115:                                   [Latch 60010f38]

Blockers

~~~~~~~~

Above is a list of all the processes. If they are waiting for a resource

then it will be given in square brackets. Below is a summary of the

waited upon resources, together with the holder of that resource.

Notes:

~~~~~

o A process id of '???' implies that the holder was not found in the

systemstate.

Resource Holder State

Latch 60010d08    ??? Blocker

Latch 601098b8    ??? Blocker

Latch 6000a018    ??? Blocker

Enqueue CF-00000000-00000000    12: 0: waiting for 'rdbms ipc message'

Enqueue CF-00000000-00000000    41: 0: waiting for 'Disk file operations I/O'

Latch 60010f38    ??? Blocker

Object Names

~~~~~~~~~~~~

Latch 60010d08   OS process allocation

Latch 601098b8  Child shared pool

Latch 6000a018   call allocation

Enqueue CF-00000000-00000000

Latch 60010f38        holding    (efd=3) 60010f38  OS process: req

113914 Lines Processed.

各位老大给点建议，目前连接到备库做查询的有几个应用，希望能找到具体的问题进程。

oracle 绑定变量模糊查询,求助-ACTIVE DG 异常shutdown相关推荐

  1. Oracle 绑定变量 详解 .

    之前整理过一篇有关绑定变量的文章,不太详细,重新补充一下. Oracle 绑定变量 http://blog.csdn.net/tianlesoftware/archive/2009/10/17/467 ...

  2. Oracle绑定变量分级（Bind Graduation）

    Oracle绑定变量分级(Bind Graduation) 绑定变量分级(Bind Graduation)是指Oracle在PL/SQL代码中会根据文本型绑定变量的定义长度而将这些文本型绑定变量分为四 ...

  3. oracle绑定变量写法,关于Oracle绑定变量的个人理解及使用场景

    关于Oracle绑定变量 摘自--Oracle 11g concept 中英文对照版 使用了绑定变量能提高性能主要是因为这样做可以尽量避免不必要的硬解析而节约了时间,同时节约了大量的CPU资源. 绑定 ...

  4. java绑定变量怎么加_在JAVA 源程序中编写SQL语句时使用ORACLE 绑定变量

    在JAVA中的SQL 语句的编写方面,没有使用ORACLE 绑定变量,很大程度上降低了数据库的性能,表现在两个方面: 1.SQL语句硬分析(Hard Parse)太多,严重消耗CPU资源,延长了SQL ...

  5. oracle绑定变量赋值,Oracle教程之绑定变量

    绑定变量是指在sql语句的条件中使用变量而不是常量.比如shared pool里有两条sql语句, select * from tab1 where col1=1; select * from tab ...

  6. oracle变量绑定代码,Oracle 绑定变量

    oracle 中,对于一个提交的sql语句,存在两种可选的解析过程,一种叫做硬解析,一种叫做软解析.https://www.cndba.cn/Dave/article/1275 一个硬解析需要经解析, ...

  7. ORACLE 绑定变量用法总结

    http://blog.csdn.net/wh62592855/article/details/4778343 之前对ORACLE中的变量一直没个太清楚的认识,比如说使用:.&.&&a ...

  8. oracle绑定变量过多,oracle - 在SQL Plus中使用绑定变量并返回多行？ - 堆栈内存溢出...

    这是一个愚蠢的问题,但我似乎无法解决. 我有一个查询在OCI程序中引起麻烦,因此我想在SQL * Plus中手动运行它以检查是否有任何区别. 这是查询: select e.label as doc_n ...

  9. 浅谈Oracle绑定变量

    绑定变量在OLTP环境下,被广泛的使用:这源于OLTP的特点和sql语句的执行过程,OLTP典型的事务短,类似的sql语句执行率高,并发大:oracle在执行sql语句前会对sql语句进行hash运算 ...

最新文章

  1. 盘点2020中国IT上市企业100强，贵司上榜了吗？
  2. Ubuntu12.04安装中文字体,解决导出图片乱码
  3. 物联网带着诚意扑面而来
  4. C语言求最大公约数与最小公倍数
  5. python 分位数计算代码_Python数据分析第十一节 数据运算
  6. 汤涛院士：科技强，必须应用数学强
  7. apache多域名绑定手记
  8. 视频会议十大开源编解码项目排行
  9. php面试题汇总一(基础篇附答案)
  10. 陕西机关事业单位工勤计算机考试成绩,2020年陕西省机关事业单位工人技术等级岗位考核公告发布 6月22日开始报名 9月中旬以后考核...
  11. Linux（RedHat）下Weblogic 12C静默安装
  12. linux命令行终端设置tab补全文件名或路径不区分大小写（大小写不敏感）
  13. ACM之java速成
  14. STM8S003F3 开发环境搭建
  15. 路由技术 -- 路由策略（Routing Policy）与策略路由（PBR,Policy-based Routing）技术
  16. 移动硬盘\U盘在使用过程中0x80070570 文件或目录损坏且无法读取 CHKDSK 修复方法
  17. 教你长高 男的没有1米8的 女的没1.65都要看啊
  18. Zip4j 压缩包加密压缩与解压
  19. 【已解决】winmm.dll被报病毒的解决方案
  20. 档案十防环境控制设备之3D可视化管控一体化平台图片鉴赏

热门文章

  1. C语言实现封装、继承、多态
  2. 吴涛 ：低延迟传输协议和新Codec将成为热点
  3. LeetCode——树：层次遍历、前中后序遍历
  4. 腾讯绝悟AI完全体限时开放体验，研究登上国际顶会与顶刊
  5. 腾讯数平团队 荣获第15届国际文档分析与识别竞赛七项冠军
  6. 腾讯 AI Lab Robotics X 主任张正友博士：计算机视觉的三生三世 | CCF-GAIR 2019
  7. http和socket之长连接和短连接区别
  8. 安装 CORD 之前需要了解的术语
  9. HTTPS性能分析小工具HTTPStat
  10. WebStorm使用TypeScript