标签云
asm 恢复 asm恢复 bbed bootstrap$ dul In Memory kcbzib_kcrsds_1 kccpb_sanity_check_2 kfed MySQL恢复 ORA-00312 ORA-00607 ORA-00704 ORA-01110 ORA-01555 ORA-01578 ORA-08103 ORA-600 2662 ORA-600 2663 ORA-600 3020 ORA-600 4000 ORA-600 4137 ORA-600 4193 ORA-600 4194 ORA-600 16703 ORA-600 kcbzib_kcrsds_1 ORA-600 KCLCHKBLK_4 ORA-15042 ORA-15196 ORACLE 12C oracle dul ORACLE PATCH Oracle Recovery Tools oracle加密恢复 oracle勒索 oracle勒索恢复 oracle异常恢复 ORACLE恢复 Oracle 恢复 ORACLE数据库恢复 oracle 比特币 OSD-04016 YOUR FILES ARE ENCRYPTED 勒索恢复 比特币加密文章分类
- Others (2)
- 中间件 (2)
- WebLogic (2)
- 操作系统 (100)
- 数据库 (1,600)
- DB2 (22)
- MySQL (70)
- Oracle (1,465)
- Data Guard (49)
- EXADATA (7)
- GoldenGate (21)
- ORA-xxxxx (158)
- ORACLE 12C (72)
- ORACLE 18C (6)
- ORACLE 19C (13)
- ORACLE 21C (3)
- Oracle 23ai (2)
- Oracle ASM (65)
- Oracle Bug (7)
- Oracle RAC (47)
- Oracle 安全 (6)
- Oracle 开发 (27)
- Oracle 监听 (27)
- Oracle备份恢复 (530)
- Oracle安装升级 (84)
- Oracle性能优化 (62)
- 专题索引 (5)
- 勒索恢复 (75)
- PostgreSQL (18)
- PostgreSQL恢复 (6)
- SQL Server (27)
- SQL Server恢复 (8)
- TimesTen (7)
- 达梦数据库 (2)
- 生活娱乐 (2)
- 至理名言 (11)
- 虚拟化 (2)
- VMware (2)
- 软件开发 (36)
- Asp.Net (9)
- JavaScript (12)
- PHP (2)
- 小工具 (19)
-
最近发表
- Oracle 发布计划—包含Oracle 23ai版本
- Oracle 23ai 变化之—-默认数据文件变为bigfile
- PostgreSQL解析wal日志之—walminer
- Oracle 19c/21c最新patch信息-202404
- PostgreSQL恢复系列:pg_filedump批量处理
- PostgreSQL部分主要字典信息
- PostgreSQL恢复系列:pg_filedump恢复字典构造
- PostgreSQL 16 源码安装
- ORA-00742 ORA-00312 恢复
- 数据库open成功后报ORA-00353 ORA-00354错误引起的一系列问题(本质ntfs文件系统异常)
- ORA-600 ktsiseginfo1故障
- ORA-00600: internal error code, arguments: [16703], [1403], [4] 原因
- 最近遇到几起ORA-600 16703故障(tab$被清空),请引起重视
- ORA-600 2662快速恢复之Patch scn工具
- TNS-12518: TNS:listener could not hand off client connection
- ora.storage无法启动报ORA-12514故障处理
- 断电引起文件scn异常数据库恢复
- ORA-16188: LOG_ARCHIVE_CONFIG settings inconsistent with previously started instance
- .[hudsonL@cock.li].mkp勒索加密数据库完美恢复
- 模拟带库实现rman远程备份
月归档:四月 2019
tab$被恶意删除sys用户之外记录
数据库open成功,但是alert日志报大量ORA-00600错误
Sun Apr 14 14:30:46 2019 SMCO started with pid=53, OS id=6761 Completed: ALTER DATABASE OPEN /* db agent *//* {1:65047:2} */ Sun Apr 14 14:30:49 2019 Starting background process CJQ0 Sun Apr 14 14:30:49 2019 CJQ0 started with pid=54, OS id=6776 Setting Resource Manager plan SCHEDULER[0x32DF]:DEFAULT_MAINTENANCE_PLAN via scheduler window Setting Resource Manager plan DEFAULT_MAINTENANCE_PLAN via parameter Sun Apr 14 14:30:52 2019 Starting background process VKRM Sun Apr 14 14:30:52 2019 VKRM started with pid=37, OS id=6809 Sun Apr 14 14:30:54 2019 Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_j000_6811.trc (incident=288633): ORA-00600: internal error code, arguments: [kkpo_rcinfo_defstg:delseg], [84638], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/incident/incdir_288633/xifenfei1_j000_6811_i288633.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details. Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_j000_6811.trc: ORA-00600: internal error code, arguments: [kkpo_rcinfo_defstg:delseg], [84638], [], [], [], [], [], [], [], [], [], [] ORA-06512: at "APEX_030200.WWV_FLOW_MAIL", line 695 ORA-06512: at line 1 Sun Apr 14 14:30:57 2019 Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_j000_7491.trc (incident=288658): ORA-00600: 内部错误代码, 参数: [16659], [kqldtu], [INS], [0], [206196], [], [], [], [], [], [], [] Incident details in: /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/incident/incdir_288658/xifenfei1_j000_7491_i288658.trc Sun Apr 14 14:34:10 2019 Dumping diagnostic data in directory=[cdmp_20190414143410], requested by (instance=1, osid=7491 (J000)), summary=[incident=288658]. Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details. Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_j000_7491.trc: ORA-00600: 内部错误代码, 参数: [16659], [kqldtu], [INS], [0], [206196], [], [], [], [], [], [], [] ORA-06512: 在 "WEBCSMS.P_YGERROR", line 3 Sun Apr 14 14:39:08 2019 Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_j000_8515.trc (incident=288593): ORA-00600: 内部错误代码, 参数: [kdfReserveSingle_1], [0], [65280], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/incident/incdir_288593/xifenfei1_j000_8515_i288593.trc ORA-06512: 在 line 1 Sun Apr 14 14:52:14 2019 Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_j001_11062.trc (incident=288705): ORA-00600: internal error code, arguments: [16607], [0x3CFB04C90], [257], [9], [0x000000000], [], [], [], [], [], [], [] Incident details in: /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/incident/incdir_288705/xifenfei1_j001_11062_i288705.trc Errors in file /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/trace/xifenfei1_ora_16712.trc (incident=288597): ORA-00600: 内部错误代码, 参数: [16607], [0x3C7CEA678], [1281], [9], [0x000000000], [], [], [], [], [], [], [] Incident details in: /oracle/oracle/oracle/diag/rdbms/xifenfei/xifenfei1/incident/incdir_288597/xifenfei1_ora_16712_i288597.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details.
报错比较多,客户还反馈登录数据库之后,发现所有的表都丢失。第一反应可能数据字典损坏了,然后让客户查看备库,现在dg的备库也一样表都丢失了,进一步确认字典可能异常,让客户提供system文件进行本地分析.发现DBMS_SUPPORT_DBMONITOR触发器调用DBMS_SUPPORT_DBMONITORP存储过程,和警告:互联网中有oracle介质被注入恶意程序导致—ORA-600 16703中的名称非常类似,但是有点不一样,以前的恶意脚本中都是被注入并且触发之后,数据库无法正常启动,这次数据库能够正常open成功.分析恶意脚本,确认原因
确实这次的恶意脚本是在2016年8月份被创建在库中,在600天之后重启被触发,而且是删除非sys的tab$中记录.知道了恶意脚本的源头,那恢复就比较容易,直接通过批量bbed程序对tab$反删除可以实现比较完美恢复.原则上这样的故障可以实现数据库完美恢复,原库继续使用.
ORACLE Instance XFF (pid = 18) – Error 600 encountered while recovering transaction
分享一次由于一个表异常导致数据库报类似:ORACLE Instance XFF (pid = 18) – Error 600 encountered while recovering transaction故障的案例
一个10.2.0.4的数据库,正常运行的库突然出现如下错误
Sun Apr 07 11:07:12 2019 Thread 1 advanced to log sequence 602883 (LGWR switch) Current log# 3 seq# 602883 mem# 0: L:\ORADATA\XFF\REDO03.LOG Sun Apr 07 11:10:38 2019 Thread 1 advanced to log sequence 602884 (LGWR switch) Current log# 1 seq# 602884 mem# 0: L:\ORADATA\XFF\REDO01.LOG Sun Apr 07 11:11:56 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\udump\XFF_ora_22956.trc: ORA-00600: 内部错误代码, 参数: [ktspgfb-1], [], [], [], [], [], [], [] Sun Apr 07 11:12:46 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\udump\XFF_ora_27408.trc: ORA-00600: 内部错误代码, 参数: [kcbnew_3], [0], [1], [168354056], [], [], [], [] Sun Apr 07 11:13:57 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\udump\XFF_ora_6632.trc: ORA-00600: 内部错误代码, 参数: [ktspgfb-1], [], [], [], [], [], [], []
过一段时间报,然后实例直接crash
Tue Apr 09 07:47:35 2019 ORACLE Instance XFF (pid = 18) - Error 600 encountered while recovering transaction (1, 1) on object 113718002. Tue Apr 09 07:47:35 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_smon_12948.trc: ORA-00600: internal error code, arguments: [kcbgcur_3], [168454497], [8], [4], [0], [], [], [] Tue Apr 09 07:55:23 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_pmon_22652.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:24 2019 PMON: terminating instance due to error 474 Tue Apr 09 07:55:24 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_lgwr_28608.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:34 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_psp0_12544.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:34 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_j000_5216.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:35 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_ckpt_28204.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:36 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_mman_9320.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:44 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_q002_24384.trc: ORA-00474: SMON process terminated with error Tue Apr 09 07:55:53 2019 Errors in file c:\oracle\product\10.2.0\admin\XFF\bdump\XFF_reco_24124.trc: ORA-00474: SMON process terminated with error
根据以上报错,数据库crash的原因是由于undo异常导致,通过对undo进行重建,解决掉异常undo,但是业务运行之后,一样的问题又重现,最后通过分析确认是对象异常导致
SQL> create table XFF.T_XIFENFEI_xff as select * from XFF.T_XIFENFEI; create table XFF.T_XIFENFEI_xff as select * from XFF.T_XIFENFEI * ERROR at line 1: ORA-00600: internal error code, arguments: [kcbz_check_objd_typ], [0], [0], [1], [], [], [], [] 屏蔽相关block obj的check之后 SQL> create table XFF.T_XIFENFEI_xff as select * from XFF.T_XIFENFEI; create table XFF.T_XIFENFEI_xff as select * from XFF.T_XIFENFEI * ERROR at line 1: ORA-00600: internal error code, arguments: [ktspScanInit-l1], [], [], [], [],[], [], []
比较明显该表对象出现逻辑异常,通过基于rowid的方式对该表数据进行抽取
SQL> create table XFF.T_XIFENFEI_new 2 as 3 select * from XFF.T_XIFENFEI where 1=0; Table created. SQL> set serveroutput on SQL> set concat off SQL> DECLARE 2 nrows number; 3 rid rowid; 4 dobj number; 5 ROWSPERBLOCK number; 6 BEGIN 7 ROWSPERBLOCK:=1000; 8 nrows:=0; 9 select data_object_id into dobj 10 from dba_objects 11 where owner = 'XFF' 12 and object_name = 'T_XIFENFEI' 13 ; 14 for i in (select relative_fno, block_id, block_id+blocks-1 totblocks 15 from dba_extents 16 where owner = 'XFF' 17 and segment_name = 'T_XIFENFEI' 18 order by extent_id) 19 loop 20 for br in i.block_id..i.totblocks loop 21 for j in 1..ROWSPERBLOCK loop 22 begin 23 rid := dbms_rowid.ROWID_CREATE(1,dobj,i.relative_fno, br , j-1); 24 insert into XFF.T_XIFENFEI_NEW 25 select /*+ ROWID(A) */ * 26 from XFF.T_XIFENFEI A 27 where rowid = rid; 28 if sql%rowcount = 1 then nrows:=nrows+1; end if; 29 if (mod(nrows,10000)=0) then commit; end if; 30 exception when others then null; 31 end; 32 end loop; 33 end loop; 34 end loop; 35 COMMIT; 36 dbms_output.put_line('Total rows: '||to_char(nrows)); 37 END; 38 / Total rows: 227000 PL/SQL procedure successfully completed.
再次观察数据库恢复正常,也不再crash和报错,恢复完成
发表在 Oracle备份恢复
标签为 kcbgcur_3, kcbnew_3, kcbz_check_objd_typ, ktspgfb-1, ktspScanInit-l1, ORA-00474
评论关闭
linux资源限制导致数据库异常
一起由于liunx系统资源限制导致数据库无法启动案例分享
数据库启动报ORA-01157错
SQL> startup ORACLE instance started. Total System Global Area 3340451840 bytes Fixed Size 2217952 bytes Variable Size 1862273056 bytes Database Buffers 1459617792 bytes Redo Buffers 16343040 bytes Database mounted. ORA-01157: cannot identify/lock data file 5 - see DBWR trace file ORA-01110: data file 5: '/home/oracle/oradata/XIFENFEI.dbf'
该错误一般是由于文件丢失或者路径错误导致
alert日志显示
Sun Apr 07 20:57:03 2019 ALTER DATABASE OPEN Sun Apr 07 20:57:03 2019 Errors in file /dbdata/oracle/diag/rdbms/orcl/orcl/trace/orcl_dbw0_2681.trc: ORA-01157: cannot identify/lock data file 5 - see DBWR trace file ORA-01110: data file 5: '/home/oracle/oradata/XIFENFEI.dbf' ORA-27092: size of file exceeds file size limit of the process Additional information: 262144 Additional information: 262145 Errors in file /dbdata/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_2802.trc: ORA-01157: cannot identify/lock data file 5 - see DBWR trace file ORA-01110: data file 5: '/home/oracle/oradata/XIFENFEI.dbf' ORA-1157 signalled during: ALTER DATABASE OPEN... Sun Apr 07 20:57:04 2019 Errors in file /dbdata/oracle/diag/rdbms/orcl/orcl/trace/orcl_m000_2804.trc (incident=38578): ORA-00600: internal error code, arguments: [kcidr_io_check_common_6], [10], [/home/oracle/oradata/XIFENFEI.dbf], [8192], [2], [5], [], [], [], [], [], [] ORA-27092: size of file exceeds file size limit of the process
这里看到提示ORA-27092: size of file exceeds file size limit of the process
查看系统limit配置
[oracle@XFF ~]$ ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) 640000 scheduling priority (-e) 0 file size (blocks, -f) 2097152 pending signals (-i) 128489 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 131072 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 131072 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
一般操作系统block size为1k,这里限制文件大小为2097152=(2G)
查看文件
[oracle@XFF ~]$ ls -l /home/oracle/oradata/XIFENFEI.dbf -rw-r-----. 1 oracle oinstall 2147491840 Apr 7 19:04 /home/oracle/oradata/XIFENFEI.dbf
文件大小为2097160>2097152,导致异常
设置系统对文件大小限制2097152kb
[root@XFF ~]# ulimit -f 102400000 [root@XFF ~]# su - oracle [oracle@XFF ~]$ ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) 640000 scheduling priority (-e) 0 file size (blocks, -f) 102400000 pending signals (-i) 128489 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 131072 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 131072 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
重启数据库,open成功
SQL> shutdown immediate; ORA-01109: database not open Database dismounted. ORACLE instance shut down. SQL> startup ORACLE instance started. Total System Global Area 3340451840 bytes Fixed Size 2217952 bytes Variable Size 1862273056 bytes Database Buffers 1459617792 bytes Redo Buffers 16343040 bytes Database mounted. Database opened.