rmanext:从损坏的 Oracle RMAN 备份中强制提取数据文件

一个单文件 C 程序,无需安装 Oracle、无需数据库实例,直接读取 RMAN 备份片, 尽最大可能还原出可用的 Oracle 数据文件,并用日志和校验工具证明”恢复了什么、缺了什么”。

  • 作者:XiFenFei(惜分飞)
  • 网站:https://www.xifenfei.com
  • 平台:Windows / Linux
  • 依赖:不依赖任何Oracle程序,只要rmanext提取软件即可

一、它解决什么问题

RMAN 备份集损坏、控制文件/目录丢失、数据库无法启动时,常规恢复手段往往走不通:

  • RMAN RESTORE 依赖控制文件、备份集元数据,头部损坏就整体失败;
  • 备份片动辄几十 GB,损坏点之后的数据并非全部无效;
  • 想把某个数据文件单独”捞”出来做取证、比对、挂库、迁移,缺少趁手的工具。

rmanext 的思路是放弃依赖数据库和目录的完整性,直接按块理解备份片:

  1. 识别 RMAN 备份片格式与压缩类型;
  2. 在损坏区之间反复重同步,尽量不中断;
  3. 用每个数据块自身的 kcbh(rdba、块类型、尾部校验)判断它是谁、该放哪;
  4. 按绝对文件号写出 datafile_N.dbf,未恢复的位置保持稀疏/零,不伪造数据;
  5. 输出逐文件日志与汇总,告诉你覆盖率、来源备份片和大致物理位置。

一句话:能救多少救多少,并且说得清楚救了多少。


二、支持的备份与格式

类型 说明 支持情况
none 未压缩备份(RMAN HARD 格式) 支持,默认还原成数据文件原样
basic BASIC 压缩(Oracle 改造版 bzip2) 支持,含损坏流比特级重同步
medium MEDIUM 压缩(zlib) 支持解码
high HIGH 压缩(标准 bzip2) 支持解码
auto 自动探测类型 支持(邻域校验,抗误判)
LOW / LZO Oracle 旧压缩 不支持
TDE / 加密备份 加密备份集 不支持
bigfile / 多文件备份集 多数据文件、跨片 支持

块大小:默认 8192,可用 --blksz 指定 2048/4096/16384/32768;片头损坏时自动探测。


三、核心能力

1. 损坏恢复

  • 压缩流中断后按 HDR 标记重新同步,跳过损坏段继续解;
  • 单个块解码结果先校验再落盘,错误解码不会污染后续对齐;
  • none 片中被伪造成压缩标记的随机字节不会导致提前截断;
  • 自动探测块大小时结合”合法块比例 + HARD 块 rdba 逐块递增”打分。

2. 精准提取

  • --afn 指定绝对文件号(1、1,3、1-10),避免产出无关文件;
  • 目录登记块数作为块号上界,拦掉离谱 rdba 的垃圾块;
  • 目录外文件号直接丢弃,杜绝单块把文件撑到几十 GB。

3. 原样还原

  • none 备份的块默认补全每个数据块的头部信息
  • 输出可直接被 OBET、Oracle dbverify 等工具校验;
  • 需要保留备份原始字节时用 --raw-hard。

4. 并行提取

  • basic:压缩流按字节切段,各 worker 独立 HDR 重同步;
  • none:按物理块区间切分,块自描述,不依赖目录;
  • 结果与串行逐字节一致;重复副本按物理位置取最后一份,结果可重复;
  • Windows/Linux 均可用。

5. 可观测性

  • 每个 datafile_N.dbf 对应 datafile_N.log;
  • 运行结束输出恢复比例、缺失块数、垃圾/校验失败统计;
  • --manifest 可把多次运行的结果追加到同一清单,便于对账;
  • 推荐配合作者的 OBET 工具做 dbv 终检。

四、快速开始

1. 获取

如果需要软件请联系“惜分飞”进行获取

2. 准备备份片清单

list.txt,一行一个备份片路径:

D:/rman/r156ptd0.rman
D:/rman/r156ptd1.rman

同一备份集的多个片按顺序列出,会追加写入同一数据文件。

3. 提取

# basic 备份,提取全部文件,4 线程
rmanext list.txt basic D:\out -j 4

# none 备份,只提 file 1(默认还原成数据文件格式)
rmanext list.txt none D:\out --afn 1

启动时会要求输入启动密码,具体联系“惜分飞”。

4. 校验

具体参考: obet dbv功能


五、完整参数说明

rmanext <list.txt> <en_type> [outdir] [options]

位置参数

参数 说明
<list.txt> 备份片路径清单;# 开头与空行忽略;支持同一备份集多片
<en_type> none / basic / medium / high / auto
[outdir] 输出目录,默认当前目录,自动创建并做写探测

通用选项

参数 说明
-h, --help 显示功能说明、开发者信息、版本与完整帮助,不需要密码
-V, --version 只输出版本号
-f, --force 校验失败的块也写出(默认只写通过校验的块)
-v, --verbose 详细日志:跳过原因、周期性进度等
-j, --jobs N 并行线程数,默认 1;basic/none 生效,Windows/Linux 可用

提取控制

参数 说明
--afn L 只提取指定绝对文件号,如 1、1,3、1-10、7,9-12;隐含 --append
--maxblk N 指定 --afn 目标文件的块号上界,超出丢弃
--all 流式路径提取全部数据文件(不建中间 tmp)
--append 追加写,绝不清理/截断已有 datafile_N.dbf
--raw-hard 保留 none 备份中的原始 HARD kcbh 字节(默认还原成数据文件格式)
--no-bound 关闭”按目录块数做块号上界”的限制(抢救/目录不可信时慎用)
--truncate-stray 恢复旧版杂散文件收缩逻辑(默认关闭)
--range A-B 只处理片内物理块区间 [A,B);basic 流式路径或 none 扫描路径

--range 的单位是备份片物理块号,不是字节。字节范围 = 块号 × 块大小。

块大小

参数 说明
--blksz N 指定块大小:2048/4096/8192/16384/32768,其他值报错退出

优先级:显式 --blksz > 片内 OSD 头 > 首片 OSD/探测值 > 默认 8192。

中间流复用(basic)

参数 说明
--use-tmp 复用 outdir 下的 <片名>.stream/.plain,不再读原始片;仅 basic/auto,不能与 --afn/--all 组合
--regen 已存在 .stream 时不再询问,直接重新生成
--clean 该片处理完删除 .stream/.plain

统计与清单

参数 说明
--manifest F 把每个文件的 placed/present/maxblk/expected/missing 追加写入 F

六、输出文件说明

文件 内容
datafile_<afn>.dbf 提取出的数据文件,稀疏,未恢复位置为 0
datafile_<afn>.log 该文件的恢复概览(来源片、位置区间、数量、覆盖率)
rmanext_summary.log 本次运行全部文件汇总
<片名>.stream / .plain basic 中间流(可选保留/复用/清理)

datafile_N.log 示例

== rmanext 1.5.0 (2026-11-22)  run 2026-11-22 15:58:48
outdir=d:/dbf block_size=8192 file=1
expected_blocks(dir)=262144
expected_size=2.00 GB
-- sources --
piece[1] d:/r156ptd0.rman
  piece_size=15787909120 bytes  blocks=1927235  block_size=8192
  recovered=135949 blocks (1113694208 bytes)
  approx_span=[130..1927233]  (0.01% .. 100.00% of piece)
-- result --
present(distinct)=135948  placed=135949  duplicates=1
expected_blocks=262144  missing_blocks=126196
missing_ranges=2185
coverage=51.86% (present/expected)
pieces_containing_file=1
-- assessment --
- pieces containing this file: 1 (see each piece[k] approx_span)
- missing blocks are absent from output: RMAN-skipped free blocks,
  failed decode/validation, or excluded by --range/--maxblk
- suggest: obet dbv on d:/dbf/datafile_1.dbf to classify remaining blocks

字段含义:

字段 含义
piece[k] 该文件出现在哪个备份片
recovered 本片恢复的块数/字节数
approx_span 发现该文件块时的片内物理块号范围及占整片百分比(含重复副本)
present 输出中不同块号数量
placed 写入次数(重复覆盖会累加)
duplicates 重复写入块数
missing_blocks 目录应有块数 − present
missing_ranges 缺失块组成的连续区间段数
coverage present / expected
pieces_containing_file 横跨几个备份片

missing 只表示”输出中没有”,不等于损坏:可能是 RMAN 未备份的空闲块、 解码/校验失败,或被 --range/--maxblk 排除。数据质量用 dbv 判定。


七、工作流程(内部实现概览)

备份片
  │ 识别 OSD 头 / 块大小 / 压缩类型
  ▼
明文块 ── 直接按 kcbh 落位(none,HARD 规则)
压缩块 ── 拼接净负载 → 解码(basic/high/medium)
  │       损坏处 HDR 重同步 / 比特级抢救
  ▼
校验(kcbh 类型、尾部校验、XOR、目录上界、文件号)
  ▼
按 rdba 定位 (afn, bno) → 稀疏写入 datafile_afn.dbf
  ▼
统计(present/missing/span)→ 日志 / 汇总 / manifest

并行模式:

  • basic:逻辑流按字节分段,worker 独立重同步;
  • none:物理块区间分段,worker 各自扫描;
  • 每块只由起始位所属 worker 写,重复副本按物理位置取最后一份,结果与串行一致。

八、典型使用场景

  1. 备份集损坏,RMAN 无法恢复:直接按块抢救,能救多少救多少;
  2. 只想要某个数据文件:--afn 快速提取,避免几十 GB 无关输出;
  3. 备份/恢复演练与核对:与线上文件逐块比对,验证备份有效性;
  4. 取证与审计:保留原始 HARD 字节(--raw-hard)或还原态文件;
  5. 大备份分片并行:--range + 多进程/-j 提升吞吐;
  6. 跨平台环境:Windows 运维机、Linux 服务器同一套参数。

九、常见问题(FAQ)

Q1:为什么需要启动密码? 为了防止软件被非法利用,破解客户备份导致数据泄露。

Q2:输出文件为什么很大、但大部分是零? datafile_N.dbf 按数据文件原始块号定位,未恢复的位置保持稀疏/零。用 du 看实际占用,或用 dbv 区分”未备份空闲块”和”坏块”。

Q3:dbv 报大量 rdba error? 早期版本 none 输出保留备份 HARD 格式,dbv 按还原态校验会全部报错。1.4.0 起默认还原 kcbh;若用 --raw-hard,dbv 报 rdba error 属预期。

Q4:missing 块是不是坏了? 不是。missing 仅表示输出中没有:RMAN 未备份(最常见)、解码失败、或参数排除。最终以 dbv 为准。

Q5:并行结果和串行会不一样吗? 不会。样本上逐字节一致;重复副本按物理位置取最后一份,保证可重复。

Q6:支持 16K 块吗? 支持,--blksz 16384 或读取片内 OSD;片头损坏时自动探测。

Q7:--range 单位是什么? 备份片物理块号(不是字节),区间 [A,B);字节起点 = A × 块大小。

Q8:能直接挂库吗? 输出为 Oracle 数据文件格式(默认还原 kcbh),可用于 dbverify、块级分析、部分场景的挂库尝试;完整挂库仍受备份完整性、SCN、控制文件等条件约束。


十、限制与注意事项

  • 不支持 LZO(LOW) 压缩、TDE/加密备份集;
  • medium/high 解码已实现,缺少大规模真实样本交叉验证;
  • Linux 版本源码与构建脚本完备,本文实测数据来自 Windows;
  • 未备份块(含 block 0)无法恢复,任何工具都补不回;
  • 仅用于自有/授权环境的备份恢复与取证,请遵守数据安全与合规要求。

十一、版本与作者

  • 软件:rmanext(Oracle RMAN Backup Extractor)
  • 版本:1.5.0(2026-11-22)
  • 作者:XiFenFei(惜分飞)
  • 网站:https://www.xifenfei.com
  • 配套工具:OBET(Oracle Block Editor Tool),提供 dbv、块修复、文件头修复等能力
发表在 小工具 | 标签为 , | 留下评论

恢复案例分享:win丢失数据文件恢复

有客户反馈他们数据库启动失败,具体原因由于system01.dbf文件丢失(文件丢失原因是由于客户清理系统空间时误删除了不少数据文件导致)
ORA-1157-ORA-1110


进一步分析,确认客户使用pdb环境,数据已经全部迁移到pdb中,但是pdb也丢失了很多文件,目前pdb中剩余文件(数量为8个)为:
pdb_dbf

查询数据库中实际文件数量16个数据文件:
pdb_files

由于客户数据在pdb中(我们无需关注root pdb中丢失文件情况,也就是数据库启动报的system丢失),该pdb中本该16个数据文件(通过控制文件查询获取),实际只剩余8个数据文件(磁盘上实际看到的文件),如果要比较好恢复数据,需要把丢失的8个文件恢复出来,通过操作系统层面反删除恢复找出来5个文件
QQ20261113-230002

通过读取文件头信息,确认这些文件
QQ20261113-230102

对这些文件的总体分析,最终确认有三个数据文件无法通过反删除进行恢复,文件号分别是12,51,61三个文件(其中主要的是51,62业务文件,12为users表空间,客户没有写入数据)丢失,对于这种情况,只能请oracle block级别恢复工具OraScan上场,进行碎片级别恢复[OraScan(Oracle 碎片扫描工具)],通过底层扫描找出来没有被破坏的这些文件
orascan-dbf

然后对于这些恢复出来的文件找个新的cdb库直接插入进去,参考:使用DBMS_PDB.RECOVER抢救单个pdb

SQL> BEGIN
  2  DBMS_PDB.RECOVER(PDB_DESCR_FILE=> 'H:\TEMP\1113\XFF.xml', PDB_NAME=>'XFF',
  3  FILENAMES=> '文件1,文件2');
 19  end;
 20  /

PL/SQL 过程已成功完成。

SQL> create pluggable database XFF using 'H:\TEMP\1113\XFF.xml' nocopy;

插接式数据库已创建。

SQL> show pdbs;

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         2 PDB$SEED                       READ ONLY  NO
         3 XFF                            MOUNTED
         4 ORAPDB                         READ WRITE NO
SQL> alter session set container=xff;

会话已更改。

SQL> alter database open ;
alter database open
*
第 1 行出现错误:
ORA-00603: ORACLE server session terminated by fatal error
ORA-00600: internal error code, arguments: [ktcpoptx:!cmt top lvl], [], [], [],
[], [], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], [],
[], [], [], [], [], [], []
进程 ID: 6532
会话 ID: 1714 序列号: 49617

遇到ORA-600 ktcpoptx:!cmt top lvl和ORA-600 kcbzib_kcrsds_1错误,使用patch_scn 工具绕过(修改oracle scn小工具(patch scn)
QQ20261113-185618
数据库打开成功

SQL> conn / as sysdba
已连接。
SQL> alter session set container=xff;

会话已更改。

SQL> show pdbs;

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         3 XFF                            MOUNTED
SQL> alter database open ;

数据库已更改。

SQL> conn / as sysdba
已连接。

SQL> show pdbs;

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         2 PDB$SEED                       READ ONLY  NO
         3 XFF                            READ WRITE NO
         4 ORAPDB                         READ WRITE NO

然后按照客户要求导出数据,完成本次恢复工作.

发表在 Oracle, 非常规恢复 | 标签为 , , , , | 留下评论

记录19c ASM磁盘掉线触发ORA-59048故障处理

在一套Oracle 19c RAC环境中有ocr/vote所在磁盘组有磁盘offline

ASMCMD> lsdg  
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512             512   4096  4194304  24576000  19047940                0        19047940              0             N  DATA/
MOUNTED  EXTERN  N         512             512   4096  4194304   2500608   1043156                0         1043156              0             N  FRA/
MOUNTED  NORMAL  Y         512             512   4096  4194304    102400    101576            51200           25188              1             Y  SYSDG/
ASMCMD> lsdsk -G sysdg
Path

/dev/asm_ocr1
/dev/asm_ocr2

ASMCMD>

在sqlplus中查询具体信息

[grid@dbserver1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Fri Nov 6 19:31:39 2026
Version 19.16.0.0.0

Copyright (c) 1982, 2022, Oracle.  All rights reserved.


Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.16.0.0.0

SQL> col path for a40
SQL> set lines 150
SQL> select disk_number,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,CREATE_DATE,MOUNT_DATE,
   2 name,path from v$asm_disk where group_number=3;

DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    CREATE_DA MOUNT_DAT NAME                  PATH
----------- ------- ------------ ------- -------- --------- --------- --------------------- -------------
          2 MISSING UNKNOWN      OFFLINE FORCING  07-SEP-22 22-OCT-26 _DROPPED_0002_SYSDG
          1 CACHED  MEMBER       ONLINE  NORMAL   07-SEP-22 22-OCT-26 SYSDG_0001           /dev/asm_ocr2
          0 CACHED  MEMBER       ONLINE  NORMAL   07-SEP-22 22-OCT-26 SYSDG_0000           /dev/asm_ocr1

这里显示被丢失的磁盘状态处于missing,而且state=FORCING,磁盘名字变为_DROPPED_0002_SYSDG,这里表现出来的是磁盘应该是不可访问,然后asm 自动踢掉该盘,但是没有正常清除元数据.查询磁盘reblance状态

SQL> SELECT GROUP_NUMBER, OPERATION, STATE, POWER, ERROR_CODE
  2      FROM GV$ASM_OPERATION
  3      WHERE GROUP_NUMBER = 3;

GROUP_NUMBER OPERA STAT      POWER ERROR_CODE
------------ ----- ---- ---------- --------------------------------------------
           3 REBAL WAIT          1
           3 REBAL ERRS          1 ORA-59048
           3 REBAL WAIT          1
           3 REBAL WAIT          1
           3 REBAL WAIT          1
           3 REBAL ERRS          1 ORA-59048
           3 REBAL WAIT          1
           3 REBAL WAIT          1

该磁盘组在reblance的过程中由于遭遇了ORA-59048导致无法清除掉异常磁盘元数据.关于ORA-59048的官方解释

SQL> !oerr ora 59048
59048, 0000, "Redundancy could not be restored in group '%0!s'."
// *Cause:  An attempt to restore redundancy during rebalance failed for some
//          user data or ASM metadata due to the presence of dropping or
//          forcing disks.
// *Action: Add back all the disks in DROPPING or FORCING state. If this is an
//          Oracle appliance, also add back all the missing disks.

出现该问题的原因是由于
In 12.1.0.2 ASM and higher releases, it is not allowed to Normal Drop the Failgroup in a Normal/High Redundancy Diskgroup if it lowers the Failgroup count below 3 for Normal Redundancy Diskgroup and below 5 for High Redundancy Diskgroup.Any attempt to force drop Failgroup will not expel the disks completely and leave the disks in “FORCING” state.
解决该问题官方的建议:
ora-59048


查看asm的alert日志确认该磁盘组当时具体状态,最早确实是由于/dev/asm_ocr3这个盘访问报io错误

2026-10-25T10:20:06.228405+08:00
NOTE: SMON did instance recovery for group FRA domain 2
NOTE: SMON detected lock domain 3 invalid at system inc 4 10/25/26 10:20:05
WARNING: Read Failed. group:3 disk:2 AU:0 offset:0 size:4096
path:/dev/asm_ocr3
	 incarnation:0xf0f3546f asynchronous result:'I/O error' ioreason:2818 why:11
	 subsys:System krq:0x7ffff294e3d8 bufp:0x7ffff2910000 osderr1:0x69b5 osderr2:0x0
	 IO elapsed time: 0 usec Time waited on I/O: 0 usec
NOTE: SMON starting instance recovery of group SYSDG domain 3 inc 4 (mounted) at 10/25/26 10:20:05
NOTE: 10/25/26 10:20:05 SYSDG.F1X0 found on disk 0 au 10 fcn 0.0 datfmt 1
NOTE: 10/25/26 10:20:05 SYSDG.F1X0 found on disk 1 au 10 fcn 0.0 datfmt 1
NOTE: SMON will attempt offline of disk 2 - no header
NOTE: cache initiating offline of disk 2 group SYSDG
NOTE: checking PST: grp = 3
2026-10-25T10:20:06.235215+08:00
GMON checking disk modes for group 3 at 20 for pid 23, osid 67867
2026-10-25T10:20:06.236213+08:00
NOTE: checking PST for grp 3 done.
NOTE: initiating PST update: grp 3 (SYSDG), dsk = 2/0xf0f3546f, mask = 0x6a, op = clear mandatory
2026-10-25T10:20:06.236627+08:00
GMON updating disk modes for group 3 at 21 for pid 23, osid 67867
cluster guid (11de9e990b017f7ebf235441d97d8d20) generated for PST Hbeat for instance 1
WARNING: Write Failed. group:3 disk:2 AU:1 offset:4190208 size:4096
path:/dev/asm_ocr3
	 incarnation:0xf0f3546f synchronous result:'I/O error' ioreason:13825 why:54
	 subsys:System krq:0x7ffff2606068 bufp:0x7ffff7e28000 osderr1:0x69c0 osderr2:0x0
	 IO elapsed time: 0 usec Time waited on I/O: 0 usec
WARNING: found another non-responsive disk 2.4042478703 (SYSDG_0002) that will be offlined 

然后asm 自动踢掉该磁盘,并尝试进行reblance

2026-10-25T10:20:22.547474+08:00
NOTE: cache closing disk 2 of grp 3: SYSDG_0002
2026-10-25T10:20:22.555942+08:00
NOTE: cache closing disk 2 of grp 3: (not open) SYSDG_0002
2026-10-25T10:20:22.558591+08:00
NOTE: PST update grp = 3 completed successfully 
2026-10-25T10:20:24.398958+08:00
Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_ora_24660.trc:
ORA-15078: ASM diskgroup was forcibly dismounted
2026-10-25T10:20:24.489753+08:00
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 2 voting file(s).
NOTE: Voting file relocation is required in diskgroup SYSDG
NOTE: Attempting voting file relocation on diskgroup SYSDG
NOTE: Successful voting file relocation on diskgroup SYSDG
2026-10-25T10:20:24.970204+08:00
WARNING: Disk 2 (SYSDG_0002) in group 3 will be dropped in: (0) secs on ASM inst 1
NOTE: The rdbms compatibility of group SYSDG is 10.1.0.0.0
WARNING: PST-initiated drop of 1 disk(s) in group 3(.2297668793))
2026-10-25T10:20:24.977298+08:00
SQL> alter diskgroup SYSDG drop disk SYSDG_0002 force /* ASM SERVER */ 
2026-10-25T10:20:24.989168+08:00
NOTE: cache closing disk 2 of grp 3: (not open) SYSDG_0002
NOTE: GroupBlock outside rolling migration privileged region
2026-10-25T10:20:25.020909+08:00
NOTE: client +ASM1:+ASM:dbsvr-cluster no longer has group 1 (DATA) mounted
2026-10-25T10:20:25.028211+08:00
NOTE: requesting all-instance membership refresh for group=3
2026-10-25T10:20:25.033193+08:00
GMON updating for reconfiguration, group 3 at 32 for pid 47, osid 37477
2026-10-25T10:20:25.033508+08:00
NOTE: cache closing disk 2 of grp 3: (not open) SYSDG_0002
2026-10-25T10:20:25.036948+08:00
NOTE: group 3 PST updated.
2026-10-25T10:20:25.037055+08:00
NOTE: cache closing disk 2 of grp 3: (not open) SYSDG_0002
2026-10-25T10:20:25.138731+08:00
NOTE: membership refresh pending for group 3/0x88f3a4b9 (SYSDG)
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 2 voting file(s).
NOTE: Voting file relocation is required in diskgroup SYSDG
NOTE: Attempting voting file relocation on diskgroup SYSDG
NOTE: Successful voting file relocation on diskgroup SYSDG
2026-10-25T10:20:25.243884+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-10-25T10:20:25.244375+08:00
GMON querying group 3 at 33 for pid 26, osid 67882
2026-10-25T10:20:25.244593+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-10-25T10:20:25.264523+08:00
SUCCESS: refreshed membership for 3/0x88f3a4b9 (SYSDG)
2026-10-25T10:20:25.265056+08:00
SUCCESS: alter diskgroup SYSDG drop disk SYSDG_0002 force /* ASM SERVER */
2026-10-25T10:20:25.267949+08:00
NOTE: starting rebalance of group 3/0x88f3a4b9 (SYSDG) at power 1
NOTE: starting process ARBA
Starting background process ARBA
2026-10-25T10:20:25.320353+08:00
ARBA started with pid=34, OS id=38626 
NOTE: starting process ARB0
Starting background process ARB0
2026-10-25T10:20:25.348943+08:00
ARB0 started with pid=39, OS id=38628 
NOTE: assigning ARBA to group 3/0x88f3a4b9 (SYSDG) to compute estimates
NOTE: assigning ARB0 to group 3/0x88f3a4b9 (SYSDG) with 1 parallel I/O
NOTE: starting priority rebalance
2026-10-25T10:20:25.741091+08:00
NOTE: 10/25/26 10:20:24 SYSDG.F1X0 copy 3 relocating from 2:10 to 65534:4294967294 at FCN 0.437476
NOTE: header on disk 0 advanced to format #2 using fcn 0.0
NOTE: F1B1 fcn on disk 0 synced at fcn 0.437476
NOTE: header on disk 1 advanced to format #2 using fcn 0.0
NOTE: F1B1 fcn on disk 1 synced at fcn 0.437476
2026-10-25T10:20:27.284097+08:00
NOTE: starting priority rebalance
NOTE: starting priority rebalance
NOTE: stopping process ARB0
NOTE: stopping process ARBA
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 2 voting file(s).
NOTE: Starting expel slave for group 3/0x88f3a4b9 (SYSDG)
2026-10-25T10:20:27.638396+08:00
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
2026-10-25T10:20:27.682346+08:00
GMON updating for reconfiguration, group 3 at 34 for pid 34, osid 38635
2026-10-25T10:20:27.682672+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-10-25T10:20:27.686280+08:00
NOTE: group 3 PST updated.
2026-10-25T10:20:27.686317+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
SUCCESS: grp 3 disk _DROPPED_0002_SYSDG emptied
NOTE: grp 3 disk 2 not expelled because ASM metadata redundancy has 
      not been restored due to an insufficientnumber of failure groups

比较简单的而且安全的做法是客户划分一块新的ocr盘上来,然后udev配置并加入到该磁盘组中即可.但是由于该客户存储没有新空间,只能分析尝试把原盘该加入进来.先确认该盘现在读写是否正常(存储故障已经修复)
1. kfed read 或者dd读取该盘确认正常
2. 由于该盘依旧属于sysdg磁盘组的member,无法直接加入

SQL> alter diskgroup sysdg add disk '/dev/asm_ocr3' ;
alter diskgroup sysdg add disk '/dev/asm_ocr3'
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15033: disk 'DATA01' is already part of diskgroup


SQL> ALTER DISKGROUP SYSDG ADD DISK '/dev/asm_ocr3' 
2026-11-06T19:35:15.741021+08:00
NOTE: GroupBlock outside rolling migration privileged region
2026-11-06T19:35:15.909199+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
NOTE: Assigning number (3,3) to disk (/dev/asm_ocr3)
NOTE: requesting all-instance membership refresh for group=3
2026-11-06T19:35:15.998569+08:00
NOTE: membership refresh pending for group 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:16.018117+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:16.034067+08:00
GMON querying group 3 at 43 for pid 26, osid 67882
2026-11-06T19:35:16.035115+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
GMON querying group 3 at 44 for pid 26, osid 67882
2026-11-06T19:35:16.035967+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:16.097552+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
GMON querying group 3 at 45 for pid 26, osid 67882
2026-11-06T19:35:16.098168+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:16.119434+08:00
SUCCESS: refreshed membership for 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:16.263264+08:00
ORA-15032: not all alterations performed
ORA-15033: disk '/dev/asm_ocr3' belongs to diskgroup "SYSDG"

2026-11-06T19:35:16.263630+08:00
ERROR: ALTER DISKGROUP SYSDG ADD DISK '/dev/asm_ocr3'

3. 直接使用force强制加入,也可以先dd掉磁盘头然后加入

SQL> ALTER DISKGROUP SYSDG ADD FAILGROUP SYSDG_0002 DISK '/dev/asm_ocr3' FORCE REBALANCE POWER 1;

Diskgroup altered.

SQL> SELECT GROUP_NUMBER, OPERATION, STATE, POWER, ERROR_CODE
  2      FROM GV$ASM_OPERATION
  3      WHERE GROUP_NUMBER = 3;

GROUP_NUMBER OPERA STAT      POWER ERROR_CODE
------------ ----- ---- ---------- --------------------------------------------
           3 REBAL REAP          1
           3 REBAL DONE          1
           3 REBAL DONE          1
           3 REBAL DONE          1
           3 REBAL WAIT          1
           3 REBAL WAIT          1
           3 REBAL WAIT          1
           3 REBAL WAIT          1

8 rows selected.

SQL> col path for a40
SQL> set lines 150
SQL> select disk_number,MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,CREATE_DATE,MOUNT_DATE,
   2 name,path from v$asm_disk where group_number=3;

DISK_NUMBER MOUNT_S HEADER_STATU MODE_ST STATE    CREATE_DA MOUNT_DAT NAME         PATH
----------- ------- ------------ ------- -------- --------- --------- ------------ --------------
          1 CACHED  MEMBER       ONLINE  NORMAL   07-SEP-22 22-OCT-26 SYSDG_0001   /dev/asm_ocr2
          3 CACHED  MEMBER       ONLINE  NORMAL   06-NOV-26 06-NOV-26 SYSDG_0003   /dev/asm_ocr3
          0 CACHED  MEMBER       ONLINE  NORMAL   07-SEP-22 22-OCT-26 SYSDG_0000   /dev/asm_ocr1

磁盘成功加入,并且reblance完成,而且_DROPPED_0002_SYSDG磁盘记录也完全清除

[grid@dbserver1 ~]$ asmcmd
ASMCMD> lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512             512   4096  4194304  24576000  19047940                0        19047940              0             N  DATA/
MOUNTED  EXTERN  N         512             512   4096  4194304   2500608   1043156                0         1043156              0             N  FRA/
MOUNTED  NORMAL  N         512             512   4096  4194304    153600    152524            51200           50662              0             Y  SYSDG/
ASMCMD> lsdsk -G sysdg
Path
/dev/asm_ocr1
/dev/asm_ocr2
/dev/asm_ocr3
ASMCMD> 

整个加入磁盘asm alert日志记录

2026-11-06T19:35:31.368323+08:00
SQL> ALTER DISKGROUP SYSDG ADD FAILGROUP SYSDG_0002 DISK '/dev/asm_ocr3' FORCE REBALANCE POWER 1
2026-11-06T19:35:31.369612+08:00
NOTE: GroupBlock outside rolling migration privileged region
2026-11-06T19:35:31.480932+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
NOTE: Assigning number (3,3) to disk (/dev/asm_ocr3)
NOTE: requesting all-instance membership refresh for group=3
NOTE: Disk 3 in group 3 is assigned fgnum=3
NOTE: discarding redo for group 3 disk 3
NOTE: initializing header (replicated) on grp 3 disk SYSDG_0003
NOTE: initializing header on grp 3 disk SYSDG_0003
NOTE: requesting all-instance disk validation for group=3
2026-11-06T19:35:31.544284+08:00
NOTE: skipping rediscovery for group 3/0x88f3a4b9 (SYSDG) on local instance.
2026-11-06T19:35:31.685931+08:00
NOTE: running client discovery for group 3 (reqid:9868412322975013714)
NOTE: requesting all-instance disk validation for group=3
2026-11-06T19:35:31.690689+08:00
NOTE: skipping rediscovery for group 3/0x88f3a4b9 (SYSDG) on local instance.
2026-11-06T19:35:31.798128+08:00
NOTE: running client discovery for group 3 (reqid:9868412322975027894)
NOTE: Allocated 1 DD reserve extents for group 3 (SYSDG)
NOTE: Allocated 2 VAT reserve extents for group 3 (SYSDG).
NOTE: Adding disk 3 (SYSDG_0003) to grp 3 (SYSDG) (12800 AUs)
2026-11-06T19:35:32.800462+08:00
GMON updating for reconfiguration, group 3 at 47 for pid 34, osid 32035
2026-11-06T19:35:32.800767+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
NOTE: group SYSDG: updated PST location: disks 0000 0001 0003
2026-11-06T19:35:32.806670+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:32.806867+08:00
NOTE: group 3 PST updated.
2026-11-06T19:35:32.817316+08:00
NOTE: membership refresh pending for group 3/0x88f3a4b9 (SYSDG)
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 2 voting file(s).
NOTE: Voting file relocation is required in diskgroup SYSDG
2026-11-06T19:35:32.870762+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:32.871172+08:00
GMON querying group 3 at 48 for pid 26, osid 67882
2026-11-06T19:35:32.871938+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
NOTE: cache opening disk 3 of grp 3: SYSDG_0003 path:/dev/asm_ocr3
2026-11-06T19:35:33.135859+08:00
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 2 voting file(s).
NOTE: Voting file relocation is required in diskgroup SYSDG
NOTE: Attempting voting file relocation on diskgroup SYSDG
NOTE: Failed voting file relocation on diskgroup SYSDG
2026-11-06T19:35:33.202862+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:33.203321+08:00
GMON querying group 3 at 49 for pid 26, osid 67882
2026-11-06T19:35:33.203546+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:33.248381+08:00
SUCCESS: refreshed membership for 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:33.249044+08:00
SUCCESS: ALTER DISKGROUP SYSDG ADD FAILGROUP SYSDG_0002 DISK '/dev/asm_ocr3' FORCE REBALANCE POWER 1
2026-11-06T19:35:33.249626+08:00
NOTE: starting rebalance of group 3/0x88f3a4b9 (SYSDG) at power 1
NOTE: starting process ARBA
Starting background process ARBA
2026-11-06T19:35:33.300642+08:00
ARBA started with pid=39, OS id=32653
2026-11-06T19:35:33.300642+08:00
ARBA started with pid=39, OS id=32653
NOTE: starting process ARB0
Starting background process ARB0
2026-11-06T19:35:33.330349+08:00
ARB0 started with pid=40, OS id=32655
NOTE: assigning ARBA to group 3/0x88f3a4b9 (SYSDG) to compute estimates
NOTE: assigning ARB0 to group 3/0x88f3a4b9 (SYSDG) with 1 parallel I/O
NOTE: starting priority rebalance
2026-11-06T19:35:33.862973+08:00
NOTE: group 3, file 1, extent 0: successful reread of 256 block(s)
NOTE: group 3, file 1, extent 0: successful reread of 256 block(s)
NOTE: group 3, file 1, extent 0: successful reread of 256 block(s)
NOTE: group 3, file 1, extent 0: successful reread of 256 block(s)
NOTE: header on disk 3 advanced to format #2 using fcn 0.0
NOTE: F1X0 on disk 3 (fmt 2) relocated at fcn 0.442279: AU 0 -> AU 10
NOTE: 11/06/26 19:35:33 SYSDG.F1X0 copy 3 relocating from 65534:4294967294 to 3:10 at FCN 0.442279
NOTE: F1B1 fcn on disk 0 synced at fcn 0.442279
NOTE: F1B1 fcn on disk 1 synced at fcn 0.442279
…………
NOTE: group 3, file 121, extent 7: successful reread of 256 block(s)
NOTE: group 3, file 121, extent 7: successful reread of 256 block(s)
NOTE: group 3, file 255, extent 2147483648: successful reread of 256 block(s)
NOTE: group 3, file 255, extent 2147483648: successful reread of 256 block(s)
NOTE: group 3, file 255, extent 2147483648: successful reread of 256 block(s)
NOTE: group 3, file 255, extent 2147483648: successful reread of 256 block(s)
2026-11-06T19:35:43.100750+08:00
NOTE: starting priority rebalance
NOTE: Starting expel slave for group 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:43.270964+08:00
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
2026-11-06T19:35:43.373350+08:00
GMON updating for reconfiguration, group 3 at 50 for pid 45, osid 32714
2026-11-06T19:35:43.373665+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:43.375552+08:00
NOTE: group 3 PST updated.
SUCCESS: grp 3 disk _DROPPED_0002_SYSDG emptied
NOTE: Expelling disk 2 (_DROPPED_0002_SYSDG) from grp 3 (SYSDG)
2026-11-06T19:35:43.414788+08:00
GMON updating for reconfiguration, group 3 at 51 for pid 45, osid 32714
2026-11-06T19:35:43.415757+08:00
NOTE: cache closing disk 2 of grp 3: (not open) _DROPPED_0002_SYSDG
2026-11-06T19:35:43.420906+08:00
NOTE: group 3 PST updated.
NOTE: grp 3 disk 2 expelled from the PST.
2026-11-06T19:35:43.528766+08:00
NOTE: membership refresh pending for group 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:43.537768+08:00
GMON querying group 3 at 52 for pid 26, osid 67882
GMON querying group 3 at 53 for pid 26, osid 67882
2026-11-06T19:35:43.559379+08:00
NOTE: Disk _DROPPED_0002_SYSDG in mode 0x0 marked for de-assignment
SUCCESS: refreshed membership for 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:44.127190+08:00
NOTE: starting priority rebalance
NOTE: stopping process ARB0
NOTE: stopping process ARBA
2026-11-06T19:35:44.568463+08:00
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 3 voting file(s).
NOTE: Starting expel slave for group 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:44.593489+08:00
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=3
2026-11-06T19:35:44.607062+08:00
NOTE: membership refresh pending for group 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:44.610642+08:00
GMON querying group 3 at 54 for pid 26, osid 67882
2026-11-06T19:35:44.654503+08:00
SUCCESS: refreshed membership for 3/0x88f3a4b9 (SYSDG)
2026-11-06T19:35:46.278541+08:00
SUCCESS: rebalance completed for group 3/0x88f3a4b9 (SYSDG)
NOTE: Attempting voting file refresh on diskgroup SYSDG
NOTE: Refresh completed on diskgroup SYSDG. Found 3 voting file(s).
发表在 Oracle ASM | 标签为 , | 留下评论