ORACLE在AIX中产生SOFTWARE PROGRAM ABNORMALLY TERMINATED警告原因

发表于 2012 年 5 月 12 日 由 惜分飞

联系：手机/微信(+86 17813235971) QQ(107644445)QQ咨询惜分飞

标题：ORACLE在AIX中产生SOFTWARE PROGRAM ABNORMALLY TERMINATED警告原因

作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]

数据库中发现如下错误
该错误的解决方案:ORA-07445[dbgrmqmqpk_query_pick_key()+0f88]

Dump file /oracle/diag/rdbms/sgerp5/sgerp5/incident/incdir_579300/sgerp5_m000_7602504_i579300.trc
Oracle Database 11g Enterprise Edition Release 11.1.0.6.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
ORACLE_HOME = /oracle/product/11.1.0/db_1
System name:    AIX
Node name:  sgerp5
Release:    1
Version:    6
Machine:    00C8F0564C00
Instance name: sgerp5
Redo thread mounted by this instance: 1
Oracle process number: 138
Unix process pid: 7602504, image: oracle@sgerp5 (m000)
 
*** 2012-05-11 03:52:35.200
*** SESSION ID:(752.5029) 2012-05-11 03:52:35.200
*** CLIENT ID:() 2012-05-11 03:52:35.200
*** SERVICE NAME:(SYS$BACKGROUND) 2012-05-11 03:52:35.200
*** MODULE NAME:(MMON_SLAVE) 2012-05-11 03:52:35.200
*** ACTION NAME:(Auto-Purge Slave Action) 2012-05-11 03:52:35.200
 
Dump continued from file: /oracle/diag/rdbms/sgerp5/sgerp5/trace/sgerp5_m000_7602504.trc
ORA-07445: exception encountered: core dump [dbgrmqmqpk_query_pick_key()+0f88] 
[SIGSEGV] [ADDR:0xB38F0000000049][PC:0x100213C08] [Address not mapped to object] []

errpt错误说明
在产生7445错误的同时观察aix系统错误日志发现SOFTWARE PROGRAM ABNORMALLY TERMINATED错误

sgerp5_[oracle]-->errpt -aj A924A5FC
---------------------------------------------------------------------------
LABEL:          CORE_DUMP
IDENTIFIER:     A924A5FC

Date/Time:       Fri May 11 03:52:55 BEIST 2012
Sequence Number: 471
Machine Id:      00C8F0564C00
Node Id:         sgerp5
Class:           S
Type:            PERM
WPAR:            Global
Resource Name:   SYSPROC         

Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED

Probable Causes
SOFTWARE PROGRAM

User Causes
USER GENERATED SIGNAL

        Recommended Actions
        CORRECT THEN RETRY

Failure Causes
SOFTWARE PROGRAM

        Recommended Actions
        RERUN THE APPLICATION PROGRAM
        IF PROBLEM PERSISTS THEN DO THE FOLLOWING
        CONTACT APPROPRIATE SERVICE REPRESENTATIVE

Detail Data
SIGNAL NUMBER
           6
USER'S PROCESS ID:
               7602504
FILE SYSTEM SERIAL NUMBER
          14
INODE NUMBER
           0      367648
CORE FILE NAME
/oracle/diag/rdbms/sgerp5/sgerp5/cdump/core_7602504/core
PROGRAM NAME
oracle
STACK EXECUTION DISABLED
           0
COME FROM ADDRESS REGISTER
sskgmcrea 0

PROCESSOR ID
  hw_fru_id: 1
  hw_cpu_id: 2

ADDITIONAL INFORMATION
skgdbgcra 224
??
ksdbgcra 3D0
ssexhd 978
??

Symptom Data
REPORTABLE
1
INTERNAL ERROR
0
SYMPTOM CODE
PCSS/SPI2 FLDS/oracle SIG/6 FLDS/skgdbgcra VALU/224

错误原因

This error is logged when a software program abnormally ends and causes a core dump. Users might
not be exiting applications correctly, the system might have been shut down while users were
working in application, or the user's terminal might have locked up and the application stopped
1)这里也就是说如果oracle进程在aix机器上异常终止,并且产生了一个core dump文件,
  就会出现SOFTWARE PROGRAM ABNORMALLY TERMINATED警告信息
2)用户登录系统没有正常退出,而系统被关闭
3)用户强制终止一个一个lock,而导致进程停止

本次AIX日志警告原因:由于进程7602504异常终止(ORA-07445错误)并且产生了 /oracle/diag/rdbms/sgerp5/sgerp5/cdump/core_7602504/core dump 文件,从而有了AIX中的SOFTWARE PROGRAM ABNORMALLY TERMINATED警告信息

此条目发表在 AIX, Oracle 分类目录。将固定链接加入收藏夹。

《ORACLE在AIX中产生SOFTWARE PROGRAM ABNORMALLY TERMINATED警告原因》有 2 条评论

  1. 北京-李振dba 说：
    2015 年 12 月 2 日14:19

    惜分飞,

    errpt -aj A924A5FC –结果反馈如下， 和您这篇文章很相似。 但是我这边报的是， 这个core文件应该是ibm工程师分析吧？
    CORE FILE NAME
    /dev/core

    Failure Causes
    SOFTWARE PROGRAM

    Recommended Actions
    RERUN THE APPLICATION PROGRAM
    IF PROBLEM PERSISTS THEN DO THE FOLLOWING
    CONTACT APPROPRIATE SERVICE REPRESENTATIVE

    Detail Data
    SIGNAL NUMBER
    11
    USER’S PROCESS ID:
    26136384
    FILE SYSTEM SERIAL NUMBER
    1
    INODE NUMBER
    0 448
    CORE FILE NAME
    /dev/core
    PROGRAM NAME
    ps
    STACK EXECUTION DISABLED
    0
    COME FROM ADDRESS REGISTER
    ensureCap 60

  2. 惜分飞 说：
    2012 年 5 月 12 日23:39

    OS Errpt Report ”Software Program Abnormally Terminated!” [ID 340489.1]

    Applies to:
Oracle Concurrent Processing - Version: 11.5.10.2 and later   [Release: 11.5.10 and later ]
Information in this document applies to any platform.

Symptoms
#errpt -a |more
LABEL: CORE_DUMP
IDENTIFIER: B6048838
Date/Time: Tue Nov 1 17:01:05 BEIST 2005
Sequence Number: 13959
Machine Id: 00C93EBE4C00
Node Id: erp
Class: S
Type: PERM
Resource Name: SYSPROC
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SOFTWARE PROGRAM
User Causes
USER GENERATED SIGNAL
Recommended Actions
CORRECT THEN RETRY
Failure Causes
SOFTWARE PROGRAM
Recommended Actions
RERUN THE APPLICATION PROGRAM
IF PROBLEM PERSISTS THEN DO THE FOLLOWING
CONTACT APPROPRIATE SERVICE REPRESENTATIVE
Detail Data
SIGNAL NUMBER
4
USER'S PROCESS ID:
3359504
FILE SYSTEM SERIAL NUMBER
16
INODE NUMBER
64
PROCESSOR ID
13
CORE FILE NAME
/u06/oracle/gmdbappl/core
PROGRAM NAME
f60webmx
ADDITIONAL INFORMATION
??
ixobjhm_h 1690
Symptom Data
REPORTABLE
1
INTERNAL ERROR
0
SYMPTOM CODE
PCSS/SPI2 FLDS/f60webmx SIG/4 FLDS/ixobjhm_h VALU/1690


Verified the issue by the alert log file, which displays:


#errpt -a |more
LABEL: CORE_DUMP
IDENTIFIER: B6048838
Date/Time: Tue Nov 1 17:01:05 BEIST 2005
Sequence Number: 13959
Machine Id: 00C93EBE4C00
Node Id: erp
Class: S
Type: PERM
Resource Name: SYSPROC
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SOFTWARE PROGRAM
User Causes
USER GENERATED SIGNAL
Recommended Actions
CORRECT THEN RETRY
Failure Causes
SOFTWARE PROGRAM
Recommended Actions
RERUN THE APPLICATION PROGRAM
IF PROBLEM PERSISTS THEN DO THE FOLLOWING
CONTACT APPROPRIATE SERVICE REPRESENTATIVE
Detail Data
SIGNAL NUMBER
4
USER'S PROCESS ID:
3359504
FILE SYSTEM SERIAL NUMBER
16
INODE NUMBER
64
PROCESSOR ID
13
CORE FILE NAME
/u06/oracle/gmdbappl/core
PROGRAM NAME
f60webmx
ADDITIONAL INFORMATION
??
ixobjhm_h 1690
Symptom Data
REPORTABLE
1
INTERNAL ERROR
0
SYMPTOM CODE
PCSS/SPI2 FLDS/f60webmx SIG/4 FLDS/ixobjhm_h VALU/1690


Cause
Bug 4601145 SOFTWARE ABNORMALLY TERMINATED ON AIX in it the problem is related to AIX.

The customer needs to ask IBM under what circumstances AIX returns that error message. It is a
message returned by AIX to handle an unexpected end of a process. This was taken out of an IBM
document, AIX System Management Guide - Common Error Report Messages - "Software program
abnormally terminated":

This error is logged when a software program abnormally ends and causes a core dump. Users might
not be exiting applications correctly, the system might have been shut down while users were
working in application, or the user's terminal might have locked up and the application stopped

Solution
To implement the solution, please execute the following steps:
1. Contact IBM.
2. Note 282036.1 Minimum Software Versions and Patches Required to Support Oracle Products on
IBM pSeries to check the patch needed or missing in AIX.