标签云
asm恢复 bbed bootstrap$ dul kcbzib_kcrsds_1 kccpb_sanity_check_2 kcratr_nab_less_than_odr MySQL恢复 ORA-00312 ORA-00704 ORA-00742 ORA-01110 ORA-01200 ORA-01555 ORA-01578 ORA-01595 ORA-600 2662 ORA-600 2663 ORA-600 3020 ORA-600 4000 ORA-600 4137 ORA-600 4193 ORA-600 4194 ORA-600 16703 ORA-600 kcbzib_kcrsds_1 ORA-600 KCLCHKBLK_4 ORA-600 kcratr_nab_less_than_odr ORA-600 kdsgrp1 ORA-15042 ORA-15196 ORACLE 12C oracle dul ORACLE PATCH Oracle Recovery Tools oracle加密恢复 oracle勒索 oracle勒索恢复 oracle异常恢复 Oracle 恢复 ORACLE恢复 ORACLE数据库恢复 oracle碎片 OSD-04016 YOUR FILES ARE ENCRYPTED 比特币加密文章分类
- Others (2)
- 中间件 (2)
- WebLogic (2)
- 操作系统 (112)
- 数据库 (1,868)
- DB2 (22)
- MySQL (82)
- Oracle (1,694)
- Data Guard (53)
- EXADATA (8)
- GoldenGate (24)
- ORA-xxxxx (168)
- ORACLE 12C (72)
- ORACLE 18C (6)
- ORACLE 19C (15)
- ORACLE 21C (3)
- Oracle 23ai (8)
- Oracle ASM (72)
- Oracle Bug (8)
- Oracle RAC (56)
- Oracle 安全 (6)
- Oracle 开发 (28)
- Oracle 监听 (29)
- Oracle备份恢复 (651)
- Oracle安装升级 (107)
- Oracle性能优化 (62)
- 专题索引 (5)
- 勒索恢复 (90)
- PostgreSQL (37)
- pdu工具 (7)
- PostgreSQL恢复 (13)
- SQL Server (34)
- SQL Server恢复 (14)
- TimesTen (7)
- 达梦数据库 (5)
- 达梦恢复 (3)
- 生活娱乐 (2)
- 至理名言 (11)
- 虚拟化 (2)
- VMware (2)
- 软件开发 (50)
- Asp.Net (9)
- JavaScript (12)
- PHP (2)
- 小工具 (33)
-
最近发表
- 分享一例运行在aix上的sap系统数据库恢复过程
- OBET-Oracle Block Editor Tool使用说明
- 几乎动用了所有手段的Oracle故障恢复
- Oracle Block Edit Tool (obet) 功能增强–2026.07
- Oracle 19c 202607补丁(RUs+OJVM)-19.32
- Patch_SCN快速修复ORA-01555数据库open故障
- 快速处理 ORA-01210: data file header is media corrupt 故障
- ORA-00314: log 3 of thread 1, expected sequence# N doesn’t match 0
- 记录block 0损坏,数据文件大量坏块,使用不当数据库版本恢复等各种操作之后的故障处理
- 需要注意:dbv 检测controlfile可能不准
- 达梦数据库redo异常强制拉库
- dd破坏包含50多个pdb的asm 磁盘组恢复
- Oracle数据库系统回滚段异常处理-ORA-600 4137/4193
- 使用deepseek进行Oracle恢复,引起重大故障
- 接手一个只差临门一脚的数据库恢复
- 硬件故障后数据文件大小不对故障处理—Oracle碎片扫描恢复
- 1.5T MySQL数据库完美恢复
- WARNING: detected duplicate paths to the same disk导致crs无法正常启动故障解决
- asm dd 10M导致system文件部分坏块修复
- Oracle 19c 202604补丁(RUs+OJVM)-19.31
标签归档:clssnmRcfgMgrThread
CSSD signal 11 in thread clssnmRcfgMgrThread故障处理
一个客户,集群无法启动,只能启动到如下状态

查看cssd日志有CSSD signal 11 in thread clssnmRcfgMgrThread报错
2025-02-21 18:21:25.500: [ CSSD][2788693760]clssnmDoSyncUpdate: node(2) is transitioning from joining state to active state
2025-02-21 18:21:25.500: [ CSSD][2788693760]clssnmDoSyncUpdate: Wait for 0 vote ack(s)
2025-02-21 18:21:25.500: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:25.700: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:25.901: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:25.995: [ CSSD][2801538816]clssnmvDiskPing: Writing with status 0x2, timestamp 1740133285/5870104
2025-02-21 18:21:25.997: [ CSSD][2799818496]clssnmvDiskKillCheck: not evicted, file /dev/dm-4 flags 0x00000000,
kill block unique 0, my unique 1740133265
2025-02-21 18:21:26.000: [ CSSD][2793424640]clssgmWaitOnEventValue: after CmInfo State val 3, eval 2 waited 500
2025-02-21 18:21:26.101: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:26.302: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:26.497: [ CSSD][2801538816]clssnmvDiskPing: Writing with status 0x2, timestamp 1740133286/5870604
2025-02-21 18:21:26.502: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:26.702: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:26.902: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk
2025-02-21 18:21:26.997: [ CSSD][2799818496]clssnmvDiskKillCheck: not evicted, file /dev/dm-4 flags 0x00000000,
kill block unique 0, my unique 1740133265
2025-02-21 18:21:26.997: [ CSSD][2801538816]clssnmvDiskPing: Writing with status 0x2, timestamp 1740133286/5871114
2025-02-21 18:21:27.000: [ CSSD][2793424640]clssgmWaitOnEventValue: after CmInfo State val 3, eval 2 waited 0
2025-02-21 18:21:27.102: [ CSSD][2788693760]clssnmCheckDskInfo: Checking disk info...
2025-02-21 18:21:27.102: [ CSSD][2788693760]clssnmCheckDskInfo: diskTimeout set to (200000)ms
2025-02-21 18:21:27.103: [ CSSD][2788693760]###################################
2025-02-21 18:21:27.103: [ CSSD][2788693760]clssscExit: CSSD signal 11 in thread clssnmRcfgMgrThread
2025-02-21 18:21:27.103: [ CSSD][2788693760]###################################
2025-02-21 18:21:27.103: [ CSSD][2788693760](:CSSSC00012:)clssscExit: A fatal error occurred and the CSS daemon is terminating abnormally
2025-02-21 18:21:27.103: [ CSSD][2788693760]
----- Call Stack Trace -----
2025-02-21 18:21:27.103: [ CSSD][2788693760]calling call entry argument values in hex
2025-02-21 18:21:27.103: [ CSSD][2788693760]location type point (? means dubious value)
2025-02-21 18:21:27.103: [ CSSD][2788693760]-------------------- -------- -------------------- ----------------------------
2025-02-21 18:21:27.109: [ CSSD][2788693760]clssscExit()+745 call kgdsdst() 000000000 ? 000000000 ?
2025-02-21 18:21:27.109: [ CSSD][2788693760] 7F9EA637A650 ? 7F9EA637A728 ?
2025-02-21 18:21:27.109: [ CSSD][2788693760] 7F9EA637F1D0 ? 000000003 ?
2025-02-21 18:21:27.109: [ CSSD][2788693760]s0clsssc_sighandler call clssscExit() 001FB9FA0 ? 000000002 ?
2025-02-21 18:21:27.109: [ CSSD][2788693760]()+616 7F9EA637A650 ? 7F9EA637A728 ?
2025-02-21 18:21:27.109: [ CSSD][2788693760] 7F9EA637F1D0 ? 000000003 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]__sighandler() call s0clsssc_sighandler 00000000B ? 000000002 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] () 7F9EA637A650 ? 7F9EA637A728 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA637F1D0 ? 000000003 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmCheckSplit()+ signal __sighandler() 001BEE8A8 ? 000000000 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]378 002039A80 ? 000000001 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 0004D2B40 ? 7F9EA63803C0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmCheckDskInfo( call clssnmCheckSplit() 001FB9FA0 ? 001DC83F0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760])+387 000030D40 ? 000000001 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 0004D2B40 ? 7F9EA63803C0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmDoSyncUpdate( call clssnmCheckDskInfo( 001FB9FA0 ? 001DC83F0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760])+4692 ) 000000001 ? 000000001 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 0004D2B40 ? 7F9EA63803C0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmLocalJoinEven call clssnmDoSyncUpdate( 001FB9FA0 ? 001DC83F0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]t()+3992 ) FFFFFFFFFFFFFFFF ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA63803C0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmRcfgMgrThread call clssnmLocalJoinEven 001FB9FA0 ? 001DC83F0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]()+2290 t() FFFFFFFFFFFFFFFF ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA63803C0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]clssscthrdmain()+25 call clssnmRcfgMgrThread 001FB9FA0 ? 001DC83F0 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760]3 () FFFFFFFFFFFFFFFF ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ?
2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA63803C0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760]start_thread()+209 call clssscthrdmain() 001FB9FA0 ? 001DC83F0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] FFFFFFFFFFFFFFFF ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] 7F9EA63803C0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760]clone()+109 call start_thread() 7F9EA6381700 ? 001DC83F0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] FFFFFFFFFFFFFFFF ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] 7F9EA63803C0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760]0000000000000000 call clone() 7F9EA6381700 ? 001DC83F0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] FFFFFFFFFFFFFFFF ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760] 7F9EA63803C0 ?
2025-02-21 18:21:27.111: [ CSSD][2788693760]
2025-02-21 18:21:27.111: [ CSSD][2788693760]--------------------- Binary Stack Dump ---------------------
这里提示表决盘超时,尝试启动nocrs貌似,在表决盘存在的情况下,启动依旧失败,通过处理让启动过程不读表决盘,启动nocrs模式成功,并mount其他业务磁盘组



确认其他磁盘没有问题,重建crs磁盘组
SQL> create diskgroup OCR external redundancy disk '/dev/dm-4' force attribute 'COMPATIBLE.ASM' = '11.2.0'; # ocrconfig -restore /u01/app/11.2.0.3/grid/cdata/scan/backup00.ocr # crsctl replace votedisk +OCR SQL> create spfile from pfile='/tmp/pfile.asm';
然后重启crs恢复正常

加我微信(17813235971)
加我QQ(107644445)

