opatch被异常中断后的处理


今天在打一个patch的时候,已经是用opatch执行到了最后一个patch,一时手欠,没看清楚telnet的窗口,不小心按下了ctrl+C,于是,opatch被中断了。汗了,晚节不保啊!

再次执行opatch apply,报错:

$ opatch apply 6163771
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-08_16-29-59PM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
ApplySession applying interim patch '6163771' to OH '/oracle/app/oracle/product/10.2.0/db_1'
 
Running prerequisite checks...
 
OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.
 
 
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/oracle/app/oracle/product/10.2.0/db_1')
 
 
Is the local system ready for patching? [y|n]
Y
User Responded with: Y
Backing up files and inventory (not for auto-rollback) for the Oracle Home
Backing up files affected by the patch '6163771' for restore. This might take a while...
Backing up files affected by the patch '6163771' for rollback. This might take a while...
 
Patching component oracle.rdbms, 10.2.0.4.0...
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfc.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcb.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcl.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfr.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfrb.o"
 
The following actions have failed:
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
 
Do you want to proceed? [y|n]
Y   
User Responded with: Y
Running make for target ioracle
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
 
The following make actions have failed :
 
Re-link fails on target "ioracle".
 
 
Do you want to proceed? [y|n]
Y
User Responded with: Y
ApplySession adding interim patch '6163771' to inventory
 
Verifying the update...
Inventory check OK: Patch ID 6163771 is registered in Oracle Home inventory with proper meta-data.
ApplySession failed: ApplySession failed in system modification phase... 'Verification of patch failed: Error verification failed: ar: kfc.o not found
'
OPatch will attempt to restore the system...
Restoring the Oracle Home...
Checking if OPatch needs to invoke 'make' to restore some binaries...
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
 
--------------------------------------------------------------------------------
Failed to run make commands. They are stored in file '/oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/make.txt'
Invoke these commands manually to restore the binaries in the Oracle Home.
OPatch failed to restore OH '/oracle/app/oracle/product/10.2.0/db_1'. Consult OPatch document to restore the home manually before proceeding.
--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1) OUI-67124:Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
2) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
3) OUI-67124:Re-link fails on target "ioracle".
 
4) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
--------------------------------------------------------------------------------
 
OPatch failed with error code 115
$

用opatch lsinventory检查,发现这个patch还是已经安装上去了的:

$ opatch lsinventory
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-08_17-13-49PM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
Lsinventory Output file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/lsinv/lsinventory2009-04-08_17-13-49PM.txt
 
--------------------------------------------------------------------------------
Installed Top-level Products (2):
 
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
There are 2 products installed in this Oracle Home.
 
 
Interim patches (18) :
 
Patch  6163771      : applied on Wed Apr 08 17:12:16 SGT 2009
   Created on 19 Jun 2008, 17:41:45 hrs US/Pacific
   Bugs fixed:
     6163771
 
Patch  6052226      : applied on Wed Apr 08 17:11:53 SGT 2009
   Created on 15 Sep 2008, 03:10:44 hrs PST8PDT
   Bugs fixed:
     6052226
 
……
 
Patch  5868257      : applied on Wed Apr 08 16:24:42 SGT 2009
   Created on 21 Oct 2008, 11:41:00 hrs PST8PDT
   Bugs fixed:
     5868257
 
 
 
--------------------------------------------------------------------------------
 
OPatch succeeded.
$

ok,既然你已经在完成安装的列表中了,那我卸载可以不?

$ opatch rollback -id 6163771
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-08_18-47-48PM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
RollbackSession rolling back interim patch '6163771' from OH '/oracle/app/oracle/product/10.2.0/db_1'
 
Running prerequisite checks...
 
OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.
 
 
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/oracle/app/oracle/product/10.2.0/db_1')
 
 
Is the local system ready for patching? [y|n]
Y
User Responded with: Y
Backing up files affected by the patch '6163771' for restore. This might take a while...
 
Patching component oracle.rdbms, 10.2.0.4.0...
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfc.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcb.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcl.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfr.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfrb.o"
 
The following actions have failed:
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
 
Do you want to proceed? [y|n]
Y
User Responded with: Y
Running make for target ioracle
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
 
The following make actions have failed :
 
Re-link fails on target "ioracle".
 
 
Do you want to proceed? [y|n]
N         
User Responded with: N
RollbackSession failed: RollbackSession failed in system modification phase... 'Re-link fails on target "ioracle".
'
OPatch will attempt to restore the system...
Restoring the Oracle Home...
Checking if OPatch needs to invoke 'make' to restore some binaries...
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
 
--------------------------------------------------------------------------------
Failed to run make commands. They are stored in file '/oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/make.txt'
Invoke these commands manually to restore the binaries in the Oracle Home.
OPatch failed to restore OH '/oracle/app/oracle/product/10.2.0/db_1'. Consult OPatch document to restore the home manually before proceeding.
--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1) OUI-67124:Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not rolled back /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
2) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
3) OUI-67124:Re-link fails on target "ioracle".
 
4) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
--------------------------------------------------------------------------------
 
OPatch failed with error code 115
$

完蛋了,无论是重新apply还是rollback,都失败了。

在这个情况下,我们可以在$ORACLE_HOME找到一个隐含的文件夹,里面的rollback.sh和make.txt文件,来清楚已经安装的信息,从而让我们重新安装。因为在进行opatch的过程在,在$ORACLE_HOME下有个隐含目录.patch_storage,在这个目录下的对应的目录,

$ cat rollback.sh
#!/bin/sh
# Copyright (c) 2009, Oracle Corporation.  All rights reserved
 
echo This script is going to rollback the changes made to system files on
echo this Oracle Home only. It does not perform any of the following:
echo - Inventory update
echo - Oracle binary re-link
echo - Running init/pre/post scripts
echo - Customized steps performed manually by user
echo Please use this script with supervision from Oracle Technical Support.
echo To rollback a patch, please use "'opatch rollback'".
 echo NOTE: JDK should be present in the Oracle Home to rollback Java Archives.
 
# Get ORACLE_HOME from environment variable "ORACLE_HOME"
OH=${ORACLE_HOME}
 
# Error out if OH is not set
if [ "$OH" = "" ]; then
    echo Oracle Home is not set.
    echo Please set env. variable ORACLE_HOME and try again.
    echo Script failed to proceed.
    exit 1
fi
 
echo "About to modify Oracle Home( $OH )"
echo "Do you want to proceed? [Y/N]"
if [ "$1" = "-silent" ]; then
   response="Y"
else
    read response;
fi
 
if [ $response = "y" ] || [ $response = "Y" ]; then
    echo "User responded with : Y"
else
    echo "User responded with : $response"
    exit 0
fi
 
 
echo Date   Time : `date` >> $OH/cfgtoollogs/opatch/opatch_history.txt
echo Oracle Home : $OH >> $OH/cfgtoollogs/opatch/opatch_history.txt
echo Command     : rollback.sh >> $OH/cfgtoollogs/opatch/opatch_history.txt
 
 
cd $OH/lib
/usr/ccs/bin/ar -rc $OH/lib/libserver10.a $OH/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfc.o
cd $OH/lib
/usr/ccs/bin/ar -rc $OH/lib/libserver10.a $OH/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfcb.o
cd $OH/lib
/usr/ccs/bin/ar -rc $OH/lib/libserver10.a $OH/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfcl.o
cd $OH/lib
/usr/ccs/bin/ar -rc $OH/lib/libserver10.a $OH/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfr.o
cd $OH/lib
/usr/ccs/bin/ar -rc $OH/lib/libserver10.a $OH/.patch_storage/6163771_Jun_19_2008_17_41_45/files/lib/libserver10.a/kfrb.o
echo Rollback script completed.

另一个rollback.sh脚本用于回滚失败的opatch执行过程,和一个make.txt脚本用于回滚编译ioracle的过程:

cd $ORACLE_HOME/rdbms/lib;/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=$ORACLE_HOME

其实我们从回滚脚本可以具体的看到,第一个是将一些kfc.o,kfcb.o,kfcl.o的文件从libserver10.a中抽取出类备份且还原出来。也就是说,在执行opatch的过程是将kfc.o,kfcb.o,kfcl.o等文件写入到libserver10.a文件中的。第二步,重新编译ioracle。

因此,我们可以利用这2个脚本,和利用原来在opatch的时候,做的备份(注意,这里一定要用原来的备份,一定要做原来的kfc.o,kfcb.o,kfcl.o的文件,在后续的操作步骤中,请注意这点。),我们来进行还原操作。
操作步骤为:
情况1,如果你的没有再次执行opatch脚本,即在.patch_storage目录下的rollbak脚本没有被覆盖,你可以:

1.运行rollback脚本:
% sh $ORACLE_HOME/.patch_storage/1234567/rollback_1234567 .sh

注意,可以能会如下报错

./rollback_5901872.sh[89]: System: not found.
  ./rollback_5901872.sh[97]: System: not found.

这个可以不必忽略。

2.运行make脚本

% sh $ORACLE_HOME/.patch_storage/1234567/1234567_make.txt

注,make脚本仅在relink阶段出错的时候才需要使用。

3.重命名脚本的原目录
% mv $ORACLE_HOME/.patch_storage/1234567 $ORACLE_HOME/.patch_storage/1234567.orig

情况2,如果你已经再次执行opatch脚本,即在.patch_storage目录下的rollbak脚本被覆盖了,你需要:

1.从命名你的原路径:

% mv $ORACLE_HOME/.patch_storage/1234567 $ORACLE_HOME

2.重新生成rolback脚本,注意用no_inventory和on_relink参数

% cd <patch directory>
% opatch apply -no_inventory -no_relink

3.将生产的rollback脚本和make脚本移动至原路径,以便利用原来的备份。

% cp $ORACLE_HOME/.patch_storage/1234567/rollback_1234567.sh $ORACLE_HOME/1234567
% cp $ORACLE_HOME/.patch_storage/1234567/1234567_make.txt $ORACLE_HOME/1234567
 
% mv $ORACLE_HOME/.patch_storage/1234567 $ORACLE_HOME/1234567.rereun
% mv $ORACLE_HOME/1234567$ORACLE_HOME/.patch_storage

4.执行rollback脚本和make脚本,注意执行的时候可能会出现和情况1一样的报错,可以忽略。

% sh $ORACLE_HOME/.patch_storage/1234567/rollback_1234567.sh
 
% sh $ORACLE_HOME/.patch_storage/1234567/1234567_make.txt

5.重命名原路径

% mv $ORACLE_HOME/.patch_storage/1234567$ORACLE_HOME/.patch_storage/1234567.orig

我们是属于情况2,因此采用情况2的方法进行回滚:

$
$ pwd
/oracle/app/oracle/product/10.2.0/db_1/.patch_storage
$ mv $ORACLE_HOME/.patch_storage/6163771_Jun_19_2008_17_41_45 $ORACLE_HOME
 
 
$ cd /arch/ora_patch/patch_ia/7409356/6163771
$ opatch apply -no_inventory -no_relink
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : n/a
   from           : n/a
OPatch version    : 10.2.0.4.6
OUI version       : n/a
OUI location      : n/a
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-09_09-45-17AM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
ApplySession applying interim patch '6163771' to OH '/oracle/app/oracle/product/10.2.0/db_1'
 
Running prerequisite checks...
 
OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.
 
 
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/oracle/app/oracle/product/10.2.0/db_1')
 
 
Is the local system ready for patching? [y|n]
Y
User Responded with: Y
Backing up files and inventory (not for auto-rollback) for the Oracle Home
Backing up files affected by the patch '6163771' for restore. This might take a while...
Backing up files affected by the patch '6163771' for rollback. This might take a while...
 
Patching component oracle.rdbms, 10.2.0.4.0...
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfc.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcb.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcl.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfr.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfrb.o"
 
The following actions have failed:
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
 
Do you want to proceed? [y|n]
Y
User Responded with: Y
No relink requested, skip running make for target ioracle
ApplySession skipping inventory update.
 
Verifying the update...
Inventory update verification is skipped.
ApplySession failed: ApplySession failed in system modification phase... 'Verification of patch failed: Error verification failed: ar: kfc.o not found
'
OPatch will attempt to restore the system...
Restoring the Oracle Home...
Checking if OPatch needs to invoke 'make' to restore some binaries...
 
No relink requested, skipping 'make'.
 
OPatch was able to restore your system. Look at log file and timestamp of each file to make sure your system is in the state prior to applying the patch.
--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1) OUI-67124:Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
--------------------------------------------------------------------------------
 
OPatch failed with error code 73
 
$ cp $ORACLE_HOME/.patch_storage/6163771_Jun_19_2008_17_41_45/rollback.sh $ORACLE_HOME/6163771_Jun_19_2008_17_41_45
$ cp $ORACLE_HOME/.patch_storage/6163771_Jun_19_2008_17_41_45/make.txt $ORACLE_HOME/6163771_Jun_19_2008_17_41_45
$
$ mv $ORACLE_HOME/.patch_storage/6163771_Jun_19_2008_17_41_45 $ORACLE_HOME/6163771_Jun_19_2008_17_41_45.rereun_20090409
$ mv $ORACLE_HOME/6163771_Jun_19_2008_17_41_45 $ORACLE_HOME/.patch_storage
$ cd 6163771_Jun_19_2008_17_41_45
$ cd /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45
$ ll
total 12
drwxrwxrwx   5 oracle     dba             96 Apr  9 09:42 backup
-rw-rw-rw-   1 oracle     dba             93 Apr  9 09:49 make.txt
drwxrwxrwx   4 oracle     dba             96 Apr  9 09:42 original_patch
drwxrwxrwx   2 oracle     dba           1024 Apr  9 09:42 rac
-rwxr-xr-x   1 oracle     dba           1401 Apr  9 09:42 restore.sh
-rw-rw-rw-   1 oracle     dba           1401 Apr  9 09:49 rollback.sh
drwxrwxrwx   2 oracle     dba             96 Apr  9 09:29 scratch
$ sh rollback.sh
This script is going to rollback the changes made to system files on
this Oracle Home only. It does not perform any of the following:
- Inventory update
- Oracle binary re-link
- Running init/pre/post scripts
- Customized steps performed manually by user
Please use this script with supervision from Oracle Technical Support.
To rollback a patch, please use 'opatch rollback'.
NOTE: JDK should be present in the Oracle Home to rollback Java Archives.
About to modify Oracle Home( /oracle/app/oracle/product/10.2.0/db_1 )
Do you want to proceed? [Y/N]
Y
User responded with : Y
Rollback script completed.
$
$
$ sh make.txt
        chmod 755 /oracle/app/oracle/product/10.2.0/db_1/bin
 
 - Linking Oracle
        rm -f /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/oracle
         cc +DD64  -Wl,+s -Wl,+n +DD64 -o /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/oracle -L/oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/ -L/oracle/app/oracle/product/10.2.0/db_1/lib/   /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/ssoident.o `if /usr/bin/getconf KERNEL_BITS | grep "64" > /dev/null ; \
                then echo "-Wl,+pi,64M -Wl,+pd,L -Wl,+padtext,16M -Wl,+paddata,1M" ; \
                else echo "" ; fi` -Wl,-E -Wl,-PF,linkorderfile +FPd /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/opimai.o /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/ssoraed.o /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/ttcsoi.o  /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/defopt.o  -Wl,+forceload -lperfsrv10 -Wl,+noforceload /oracle/app/oracle/product/10.2.0/db_1/lib/nautab.o /oracle/app/oracle/product/10.2.0/db_1/lib/naeet.o /oracle/app/oracle/product/10.2.0/db_1/lib/naect.o /oracle/app/oracle/product/10.2.0/db_1/lib/naedhs.o /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/config.o  -lserver10 -lodm10  -lnnet10 -lskgxp10 -lsnls10 -lnls10  -lcore10 -lsnls10  -lnls10 -lcore10 -lsnls10 -lnls10 -lxml10  -lcore10 -lunls10 -lsnls10 -lnls10 -lcore10 -lnls10 -lhasgen10 -lcore10 -lskgxn2 -locr10 -locrb10 -locrutl10   -lhasgen10 -lcore10 -lskgxn2   -lclient10  -lvsn10  -lcommon10 -lgeneric10  -lknlopt `if /usr/ccs/bin/ar tv /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/libknlopt.a | grep xsyeolap.o > /dev/null 2>&1 ; then echo "-loraolap10" ; fi`  -lslax10 -lpls10  -lplp10 -lserver10 -lclient10  -lvsn10  -lcommon10 -lgeneric10 `if [ -f /oracle/app/oracle/product/10.2.0/db_1/lib/libavserver10.a ] ; then echo "-lavserver10" ; else echo "-lavstub10"; fi` `if [ -f /oracle/app/oracle/product/10.2.0/db_1/lib/libavclient10.a ] ; then echo "-lavclient10" ; fi`  -lknlopt -lslax10 -lpls10  -lplp10 -ljox10 -lserver10  /oracle/app/oracle/product/10.2.0/db_1/has/lib/libclsra10.a -ldbcfg10 -locijdbcst10 -lwwg  `cat /oracle/app/oracle/product/10.2.0/db_1/lib/ldflags`    -lnsslb10 -lncrypt10 -lnsgr10 -lnzjs10 -ln10 -lnnz10 -lnl10 -lnro10 `cat /oracle/app/oracle/product/10.2.0/db_1/lib/ldflags`    -lnsslb10 -lncrypt10 -lnsgr10 -lnzjs10 -ln10 -lnnz10 -lnl10 -lmm -lsnls10 -lnls10  -lcore10 -lsnls10  -lnls10 -lcore10 -lsnls10 -lnls10 -lxml10  -lcore10 -lunls10 -lsnls10 -lnls10 -lcore10 -lnls10 `cat /oracle/app/oracle/product/10.2.0/db_1/lib/ldflags`    -lnsslb10 -lncrypt10 -lnsgr10 -lnzjs10 -ln10 -lnnz10 -lnl10 -lnro10 `cat /oracle/app/oracle/product/10.2.0/db_1/lib/ldflags`    -lnsslb10 -lncrypt10 -lnsgr10 -lnzjs10 -ln10 -lnnz10 -lnl10   -lsnls10 -lnls10  -lcore10 -lsnls10  -lnls10 -lcore10 -lsnls10 -lnls10 -lxml10  -lcore10 -lunls10 -lsnls10 -lnls10 -lcore10 -lnls10 `if /usr/ccs/bin/ar tv /oracle/app/oracle/product/10.2.0/db_1/rdbms/lib/libknlopt.a | grep "kxmnsd.o" > /dev/null 2>&1 ; then echo " " ; else echo "-lordsdo10"; fi` -lctxc10 -lctx10 -lzx10 -lgx10 -lctx10 -lzx10 -lgx10 -lordimt10  -lsnls10 -lnls10  -lcore10 -lsnls10  -lnls10 -lcore10 -lsnls10 -lnls10 -lxml10  -lcore10 -lunls10 -lsnls10 -lnls10 -lcore10 -lnls10 -lsnls10 -lunls10  -lsnls10 -lnls10  -lcore10 -lsnls10  -lnls10 -lcore10 -lsnls10 -lnls10 -lxml10  -lcore10 -lunls10 -lsnls10 -lnls10 -lcore10 -lnls10      `cat /oracle/app/oracle/product/10.2.0/db_1/lib/sysliblist`  -lm    `cat /oracle/app/oracle/product/10.2.0/db_1/lib/sysliblist`  -lm  -lpthread  -lpthread
ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
*** Error exit code 1
 
Stop.

$
$ mv $ORACLE_HOME/.patch_storage/6163771_Jun_19_2008_17_41_45 $ORACLE_HOME/.patch_storage/6163771_Jun_19_2008_17_41_45.orig

我们用lsinventory来查看回滚情况:

$  opatch lsinventory
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-09_09-27-27AM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
Lsinventory Output file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/lsinv/lsinventory2009-04-09_09-27-27AM.txt
 
--------------------------------------------------------------------------------
Installed Top-level Products (2):
 
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
There are 2 products installed in this Oracle Home.
 
 
Interim patches (16) :
 
Patch  7375644      : applied on Wed Apr 08 16:49:19 SGT 2009
   Created on 19 Sep 2008, 03:40:43 hrs PST8PDT
   Bugs fixed:
     7375644, 7150470
 
Patch  7375617      : applied on Wed Apr 08 16:49:14 SGT 2009
   Created on 19 Sep 2008, 03:40:41 hrs PST8PDT
   Bugs fixed:
     7375617
 
Patch  7375613      : applied on Wed Apr 08 16:49:10 SGT 2009
   Created on 19 Sep 2008, 03:40:40 hrs PST8PDT
   Bugs fixed:
     7375613
 
Patch  7375611      : applied on Wed Apr 08 16:49:05 SGT 2009
   Created on 19 Sep 2008, 03:40:37 hrs PST8PDT
   Bugs fixed:
     7375611
 
Patch  7197583      : applied on Wed Apr 08 16:48:51 SGT 2009
   Created on 2 Jul 2008, 05:50:52 hrs PST8PDT
   Bugs fixed:
     7197583
 
Patch  7155254      : applied on Wed Apr 08 16:48:41 SGT 2009
   Created on 2 Jul 2008, 05:55:42 hrs PST8PDT
   Bugs fixed:
     7155254
 
Patch  7155253      : applied on Wed Apr 08 16:46:48 SGT 2009
   Created on 2 Jul 2008, 05:55:29 hrs PST8PDT
   Bugs fixed:
     7155253
 
Patch  7155252      : applied on Wed Apr 08 16:45:15 SGT 2009
   Created on 2 Jul 2008, 04:38:30 hrs PST8PDT
   Bugs fixed:
     7155252
 
Patch  7155251      : applied on Wed Apr 08 16:45:09 SGT 2009
   Created on 2 Jul 2008, 04:37:07 hrs PST8PDT
   Bugs fixed:
     7155251
 
Patch  7155250      : applied on Wed Apr 08 16:44:58 SGT 2009
   Created on 2 Jul 2008, 04:36:18 hrs PST8PDT
   Bugs fixed:
     7155250
 
Patch  7155249      : applied on Wed Apr 08 16:44:48 SGT 2009
   Created on 2 Jul 2008, 04:34:23 hrs PST8PDT
   Bugs fixed:
     7155249
 
Patch  7155248      : applied on Wed Apr 08 16:44:43 SGT 2009
   Created on 2 Jul 2008, 04:35:32 hrs PST8PDT
   Bugs fixed:
     7155248
 
Patch  7278117      : applied on Wed Apr 08 16:25:38 SGT 2009
   Created on 13 Aug 2008, 23:13:23 hrs US/Pacific
   Bugs fixed:
     7155655, 6917874, 7278117
 
Patch  7123643      : applied on Wed Apr 08 16:25:31 SGT 2009
   Created on 16 Jul 2008, 23:55:13 hrs US/Pacific
   Bugs fixed:
     7123643
 
Patch  6327692      : applied on Wed Apr 08 16:24:49 SGT 2009
   Created on 9 Jun 2008, 02:23:15 hrs US/Pacific
   Bugs fixed:
     6327692
 
Patch  5868257      : applied on Wed Apr 08 16:24:42 SGT 2009
   Created on 21 Oct 2008, 11:41:00 hrs PST8PDT
   Bugs fixed:
     5868257
 
 
 
--------------------------------------------------------------------------------
 
OPatch succeeded.
$

发现确实已经清楚掉了6163771的安装信息!我们再次尝试安装opatch:

$ pwd
/arch/ora_patch/patch_ia/7409356/6163771
$ opatch apply
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-09_10-01-38AM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
ApplySession applying interim patch '6163771' to OH '/oracle/app/oracle/product/10.2.0/db_1'
 
Running prerequisite checks...
 
OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.
 
 
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/oracle/app/oracle/product/10.2.0/db_1')
 
 
Is the local system ready for patching? [y|n]
Y
User Responded with: Y
Backing up files and inventory (not for auto-rollback) for the Oracle Home
Backing up files affected by the patch '6163771' for restore. This might take a while...
Backing up files affected by the patch '6163771' for rollback. This might take a while...
 
Patching component oracle.rdbms, 10.2.0.4.0...
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfc.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcb.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfcl.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfr.o"
Updating archive file "/oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a"  with "lib/libserver10.a/kfrb.o"
 
The following actions have failed:
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
 
Do you want to proceed? [y|n]
Y
User Responded with: Y
Running make for target ioracle
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
 
The following make actions have failed :
 
Re-link fails on target "ioracle".
 
 
Do you want to proceed? [y|n]
Y
User Responded with: Y
ApplySession adding interim patch '6163771' to inventory
 
Verifying the update...
Inventory check OK: Patch ID 6163771 is registered in Oracle Home inventory with proper meta-data.
ApplySession failed: ApplySession failed in system modification phase... 'Verification of patch failed: Error verification failed: ar: kfc.o not found
'
OPatch will attempt to restore the system...
Restoring the Oracle Home...
Checking if OPatch needs to invoke 'make' to restore some binaries...
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
 
--------------------------------------------------------------------------------
Failed to run make commands. They are stored in file '/oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6163771_Jun_19_2008_17_41_45/make.txt'
Invoke these commands manually to restore the binaries in the Oracle Home.
OPatch failed to restore OH '/oracle/app/oracle/product/10.2.0/db_1'. Consult OPatch document to restore the home manually before proceeding.
--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1) OUI-67124:Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfc.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfcl.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfr.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
Archive not applied /arch/ora_patch/patch_ia/7409356/6163771/files/lib/libserver10.a/kfrb.o to /oracle/app/oracle/product/10.2.0/db_1/lib/libserver10.a... ''
 
2) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
3) OUI-67124:Re-link fails on target "ioracle".
 
4) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk ioracle ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1"....'ld: I/O error, file "/oracle/app/oracle/product/10.2.0/db_1/lib//libserver10.a":
Fatal error.
 
Stop.
'
--------------------------------------------------------------------------------
 
OPatch failed with error code 115
$

我们发现还是报错了!

难道是libserver10.a文件已经被破坏了?因为这个文件已经被破坏,所以在从这个文件读取备份文件信息的时候,会报错I/O error。也就是说,我是在opatch正在修改libserver10.a这个文件的时候,按下了ctrl+C,导致写文件到一半被中断,所以导致这个文件被破坏了!

用ar来测试一下:

$ cp $ORACLE_HOME/lib/libserver10.a /tmp/diags
$ cd /tmp/diags
$ ls
kcc.o          kcra.o         kct.o          krbo.o         krci.o         krh.o          ksc.o          ksp.o
kccr.o         kcrf.o         kcv.o          krbr.o         krcl.o         krpi.o         ksct.o         ksst.o
kcf.o          kcrfr.o        kiem.o         krbtdb.o       krcp.o         krsc.o         ksdc.o         kst.o
kck.o          kcrfw.o        krb.o          krbx.o         krcr.o         krsf.o         ksdf.o         ksucln.o
kckt.o         kcrlc.o        krbb.o         krby.o         krd.o          krsl.o         kse.o          ksuxs.o
kcm.o          kcrp.o         krbc.o         krbz.o         krf.o          krsm.o         ksf.o          libserver10.a
kco.o          kcrr.o         krbd.o         krc.o          krff.o         krsr.o         ksl.o
kcot.o         kcrrt.o        krbi.o         krc0.o         krfg.o         krt.o          kslt.o
kcp.o          kcrx.o         krbm.o         krcc.o         krfr.o         ksa.o          ksmst.o
kcq.o          kcs.o          krbn.o         krcg.o         krfw.o         ksbt.o         ksmuf.o
$ ar xv libserver10.a
x - kcrfr.o
x - kcrrt.o
x - kcrr.o
x - kcf.o
x - kckt.o
x - kcrfw.o
x - kcrf.o
x - kco.o
x - kcm.o
x - kck.o
x - kcot.o
x - kcra.o
x - kcrp.o
x - kcv.o
x - kct.o
x - kcc.o
x - krbi.o
x - krbd.o
x - krby.o
x - krbc.o
x - krbb.o
x - krbr.o
x - krb.o
x - krbm.o
x - krt.o
x - kccr.o
x - krpi.o
x - krh.o
x - kcs.o
x - kcp.o
x - krbx.o
x - krd.o
x - kcrlc.o
x - kcq.o
x - krsm.o
x - krsf.o
x - krsl.o
x - krsr.o
x - krsc.o
x - kcrx.o
x - krc.o
x - krc0.o
x - krci.o
x - krcl.o
x - krcg.o
x - krcc.o
x - krcp.o
x - krcr.o
x - krf.o
x - krff.o
x - krfr.o
x - krfg.o
x - krfw.o
x - krbn.o
x - krbtdb.o
x - krbz.o
x - krbo.o
x - ksst.o
x - kse.o
x - ksbt.o
x - kst.o
x - ksmuf.o
x - ksc.o
x - ksa.o
x - ksp.o
x - ksmst.o
x - ksdc.o
x - ksl.o
x - ksuxs.o
x - kiem.o
x - ksct.o
x - ksucln.o
x - ksdf.o
x - ksf.o
ar: read error
$

唉,果真如此啊!在这情况下,我们也有两种方式来处理:
情况1:如果libserver10.a之前没有被其他patch修改过,我们可以用当前这个patch包中的文件进行编译和替换。

1.进patch包的目录:
$ cd
<patch_path>
 
2.查找文件:
$ for f in `find . -type f -name '*\.jar'`; do unzip -l $f | grep -i "libserver10.a" && echo "was found in $f"; done
162678516 04-04-08 04:09 libserver10.a
%s_patchLocation%/lib/libserver10.a
was found in ./stage/Patches/oracle.rdbms/10.2.0.4.0/1/DataFiles/filegroup40.1.1.jar
 
3.解压覆盖:
$ rm -rf /tmp/diags/*
$ cp filegroup40.1.1.jar /tmp/diags
$ cd /tmp/diags
$ export PATH=$ORACLE_HOME/jdk/bin:$PATH
$ jar xvf filegroup40.1.1.jar
$ cd $ORACLE_HOME/lib
$ mv libserver10.a libserver10.a.bad
$ cp /tmp/diags/libserver10.a .

情况2,也是最坏的情况,libserver10.a文件已经之前被其他的patch所修改过,我们检查我也确实属于了这个情况:

$ opatch lsinventory -detail
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-09_10-30-43AM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
Lsinventory Output file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/lsinv/lsinventory2009-04-09_10-30-43AM.txt
 
--------------------------------------------------------------------------------
Installed Top-level Products (2):
 
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
There are 2 products installed in this Oracle Home.
 
 
Installed Products (188):
 
Agent Required Support Files                                         10.2.0.1.0
Agent Required Support Files Patch                                   10.2.0.4.0
Assistant Common Files                                               10.2.0.1.0
Assistant Common Files Patch                                         10.2.0.4.0
Bali Share                                                           1.1.18.0.0
Buildtools Common Files                                              10.2.0.1.0
Character Set Migration Utility                                      10.2.0.1.0
Character Set Migration Utility Patch                                10.2.0.4.0
Database Configuration and Upgrade Assistants                        10.2.0.1.0
Database Configuration and Upgrade Assistants Patch                  10.2.0.4.0
Database SQL Scripts                                                 10.2.0.1.0
Database SQL Scripts Patch                                           10.2.0.4.0
Database Workspace Manager                                           10.2.0.1.0
Database Workspace Manager                                           10.2.0.4.0
DBJAVA Required Support Files                                        10.2.0.1.0
DBJAVA Required Support Files Patch                                  10.2.0.4.0
Enterprise Edition Options                                           10.2.0.1.0
Enterprise Manager Agent Core                                        10.2.0.1.0
Enterprise Manager Agent Core Patch                                 10.2.0.4.0a
Enterprise Manager Agent DB                                          10.2.0.1.0
Enterprise Manager Agent DB                                          10.2.0.4.0
Enterprise Manager Baseline                                          10.2.0.1.0
Enterprise Manager Baseline                                          10.2.0.4.0
Enterprise Manager Common Core Patch                                10.2.0.4.0a
Enterprise Manager Common Files                                      10.2.0.1.0
Enterprise Manager Minimal Integration                               10.2.0.1.0
Enterprise Manager plugin Common Files                               10.2.0.1.0
Enterprise Manager plugin Common Files                               10.2.0.1.0
Enterprise Manager plugin Common Files Patch                         10.2.0.4.0
Enterprise Manager Repository Core                                   10.2.0.1.0
Enterprise Manager Repository Core patch                            10.2.0.4.0a
Enterprise Manager Repository DB                                     10.2.0.1.0
Enterprise Manager Repository DB                                     10.2.0.4.0
Generic Connectivity Common Files                                    10.2.0.1.0
Generic Connectivity Common Files Patch                              10.2.0.4.0
HAS Common Files                                                     10.2.0.1.0
HAS Common Files Patch                                               10.2.0.4.0
HAS Files for DB                                                     10.2.0.1.0
HAS Files for DB Patch                                               10.2.0.4.0
Installation Common Files                                            10.2.0.1.0
Installation Common Files Patch                                      10.2.0.4.0
Installer SDK Component                                              10.2.0.4.0
Java Runtime Environment                                             1.4.2.14.0
JDBC Common Files                                                    10.2.0.1.0
JDBC Common Files                                                    10.2.0.4.0
LDAP Required Support Files                                          10.2.0.1.0
LDAP Required Support Files Patch                                    10.2.0.4.0
OLAP SQL Scripts                                                     10.2.0.1.0
OLAP SQL Scripts Patch                                               10.2.0.4.0
Oracle Advanced Security                                             10.2.0.1.0
Oracle Advanced Security Patch                                       10.2.0.4.0
Oracle Call Interface (OCI)                                          10.2.0.1.0
Oracle Call Interface (OCI) Patch                                    10.2.0.4.0
Oracle Clusterware RDBMS Files                                       10.2.0.1.0
Oracle Clusterware RDBMS Files Patch                                 10.2.0.4.0
Oracle Code Editor                                                   1.2.1.0.0I
Oracle Configuration Manager                                         10.2.7.1.0
Oracle Containers for Java                                           10.2.0.1.0
Oracle Containers for Java                                           10.2.0.4.0
Oracle Core Required Support Files                                   10.2.0.1.0
Oracle Core Required Support Files Patch                             10.2.0.4.0
Oracle Data Mining RDBMS Files                                       10.2.0.1.0
Oracle Data Mining RDBMS Files Patch                                 10.2.0.4.0
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10G 32 bit                                           10.1.0.2.0
Oracle Database 10g interMedia Files                                 10.2.0.1.0
Oracle Database 10g interMedia Files Patch                           10.2.0.4.0
Oracle Database 10g Patch                                            10.2.0.4.0
Oracle Database 10g Patch                                            10.2.0.4.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
Oracle Database User Interface                                       2.2.13.0.0
Oracle Database Utilities                                            10.2.0.1.0
Oracle Database Utilities Patch                                      10.2.0.4.0
Oracle Display Fonts                                                  9.0.2.0.0
Oracle Enterprise Manager Console DB                                 10.2.0.1.0
Oracle Enterprise Manager Console DB                                 10.2.0.4.0
Oracle Extended Windowing Toolkit                                    3.4.38.0.0
Oracle Globalization Support                                         10.2.0.1.0
Oracle Globalization Support Patch                                   10.2.0.4.0
Oracle Help For Java                                                  4.2.6.1.0
Oracle Help for the  Web                                             1.1.10.0.0
Oracle Ice Browser                                                    5.2.3.6.0
Oracle interMedia                                                    10.2.0.1.0
Oracle interMedia Annotator                                          10.2.0.1.0
Oracle interMedia Client Option                                      10.2.0.1.0
Oracle interMedia Client Option Patch                                10.2.0.4.0
Oracle interMedia Java Advanced Imaging                              10.2.0.1.0
Oracle interMedia Java Advanced Imaging Patch                        10.2.0.4.0
Oracle interMedia Locator                                            10.2.0.1.0
Oracle interMedia Locator Patch                                      10.2.0.4.0
Oracle interMedia Locator RDBMS Files                                10.2.0.1.0
Oracle interMedia Locator RDBMS Files Patch                          10.2.0.4.0
Oracle interMedia Patch                                              10.2.0.4.0
Oracle Internet Directory Client                                     10.2.0.1.0
Oracle Internet Directory Client Patch                               10.2.0.4.0
Oracle Java Client                                                   10.2.0.1.0
Oracle Java Client Patch                                             10.2.0.4.0
Oracle JDBC Thin Driver for JDK 1.2                                  10.2.0.1.0
Oracle JDBC Thin Driver for JDK 1.2 Patch                            10.2.0.4.0
Oracle JDBC Thin Driver for JDK 1.4                                  10.2.0.1.0
Oracle JDBC Thin Driver for JDK 1.4 Patch                            10.2.0.4.0
Oracle JDBC/OCI Instant Client                                       10.2.0.1.0
Oracle JDBC/OCI Instant Client Patch                                 10.2.0.4.0
Oracle JFC Extended Windowing Toolkit                                4.2.33.0.0
Oracle JVM                                                           10.2.0.1.0
Oracle JVM Patch                                                     10.2.0.4.0
Oracle LDAP administration                                           10.2.0.1.0
Oracle LDAP administration patch                                     10.2.0.4.0
Oracle Locale Builder                                                10.2.0.1.0
Oracle Message Gateway Common Files                                  10.2.0.1.0
Oracle Message Gateway Common Files Patch                            10.2.0.4.0
Oracle Net                                                           10.2.0.1.0
Oracle Net Listener                                                  10.2.0.1.0
Oracle Net Listener Patch                                            10.2.0.4.0
Oracle Net Patch                                                     10.2.0.4.0
Oracle Net Required Support Files                                    10.2.0.1.0
Oracle Net Required Support Files Patch                              10.2.0.4.0
Oracle Net Services                                                  10.2.0.1.0
Oracle Notification Service                                           9.0.4.0.0
Oracle Notification Service Patch                                    10.2.0.4.0
Oracle OLAP                                                          10.2.0.1.0
Oracle OLAP API                                                      10.2.0.1.0
Oracle OLAP API Patch                                                10.2.0.4.0
Oracle OLAP Patch                                                    10.2.0.4.0
Oracle OLAP RDBMS Files                                              10.2.0.1.0
Oracle OLAP RDBMS Files Patch                                        10.2.0.4.0
Oracle One-Off Patch Installer                                       10.2.0.4.0
Oracle Partitioning                                                  10.2.0.1.0
Oracle Partitioning Patch                                            10.2.0.4.0
Oracle Programmer                                                    10.2.0.1.0
Oracle RAC Required Support Files-HAS                                10.2.0.1.0
Oracle RAC Required Support Files-HAS Patch                          10.2.0.4.0
Oracle Real Application Testing                                      10.2.0.4.0
Oracle Recovery Manager                                              10.2.0.1.0
Oracle Recovery Manager Patch                                        10.2.0.4.0
Oracle Required Support Files 32 bit                                 10.2.0.0.0
Oracle Required Support Files 32 bit Patch                           10.2.0.4.0
Oracle Spatial                                                       10.2.0.1.0
Oracle Starter Database                                              10.2.0.1.0
Oracle Starter Database Patch                                        10.2.0.4.0
Oracle Text                                                          10.2.0.1.0
Oracle Text Patch                                                    10.2.0.4.0
Oracle UIX                                                           2.1.22.0.0
Oracle Universal Installer                                           10.2.0.4.0
Oracle Wallet Manager                                                10.2.0.1.0
Oracle Wallet Manager Patch                                          10.2.0.4.0
Oracle XML Development Kit                                           10.2.0.1.0
Oracle XML Development Kit Patch                                     10.2.0.4.0
Parser Generator Required Support Files                              10.2.0.1.0
Perl Interpreter                                                      5.8.3.0.1
Perl Interpreter Patch                                               5.8.3.0.1a
PL/SQL                                                               10.2.0.1.0
PL/SQL                                                               10.2.0.4.0
PL/SQL Embedded Gateway                                              10.2.0.1.0
PL/SQL Embedded Gateway Patch                                        10.2.0.4.0
Platform Required Support Files                                      10.2.0.1.0
Platform Required Support Files                                      10.2.0.4.0
Precompiler Common Files                                             10.2.0.1.0
Precompiler Common Files Patch                                       10.2.0.4.0
Precompiler Required Support Files                                   10.2.0.1.0
Precompiler Required Support Files Patch                             10.2.0.4.0
RDBMS Required Support Files                                         10.2.0.1.0
RDBMS Required Support Files for Instant Client                      10.2.0.1.0
RDBMS Required Support Files for Instant Client Patch                10.2.0.4.0
RDBMS Required Support Files Patch                                   10.2.0.4.0
regexp                                                                2.1.9.0.0
Required Support Files                                               10.2.0.1.0
Sample Schema Data                                                   10.2.0.1.0
Sample Schema Data Patch                                             10.2.0.4.0
Secure Socket Layer                                                  10.2.0.1.0
Secure Socket Layer Patch                                            10.2.0.4.0
SQL*Plus                                                             10.2.0.1.0
SQL*Plus                                                             10.2.0.4.0
SQL*Plus Required Support Files                                      10.2.0.1.0
SQL*Plus Required Support Files Patch                                10.2.0.4.0
SQLJ Runtime                                                         10.2.0.1.0
SQLJ Runtime Patch                                                   10.2.0.4.0
SSL Required Support Files for InstantClient                         10.2.0.1.0
SSL Required Support Files for InstantClient Patch                   10.2.0.4.0
Sun JDK                                                              1.4.2.17.0
Sun JDK extensions                                                    9.2.0.1.0
XDK Required Support Files                                           10.2.0.1.0
XDK Required Support Files Patch                                     10.2.0.4.0
XML Parser for Java                                                  10.2.0.1.0
XML Parser for Java Patch                                            10.2.0.4.0
XML Parser for Oracle JVM                                            10.2.0.1.0
XML Parser for Oracle JVM Patch                                      10.2.0.4.0
There are 188 products installed in this Oracle Home.
 
 
Interim patches (16) :
 
Patch  7375644      : applied on Wed Apr 08 16:49:19 SGT 2009
   Created on 19 Sep 2008, 03:40:43 hrs PST8PDT
   Bugs fixed:
     7375644, 7150470
   Files Touched:
     catcpu.sql --> ORACLE_HOME/cpu/CPUOct2008/catcpu.sql
     catcpu_rollback.sql --> ORACLE_HOME/cpu/CPUOct2008/catcpu_rollback.sql
     rollback_all.lst --> ORACLE_HOME/cpu/CPUOct2008/rollback_all.lst
     rollback_new.lst --> ORACLE_HOME/cpu/CPUOct2008/rollback_new.lst
     bundledata_CPU.xml --> ORACLE_HOME/rdbms/admin/bundledata_CPU.xml
     catbundle.sql --> ORACLE_HOME/rdbms/admin/catbundle.sql
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375644
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375644_Sep_19_2008_03_40_43
 
Patch  7375617      : applied on Wed Apr 08 16:49:14 SGT 2009
   Created on 19 Sep 2008, 03:40:41 hrs PST8PDT
   Bugs fixed:
     7375617
   Files Touched:
     prvtbstr.plb --> ORACLE_HOME/rdbms/admin/prvtbstr.plb
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375617
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375617_Sep_19_2008_03_40_41
 
Patch  7375613      : applied on Wed Apr 08 16:49:10 SGT 2009
   Created on 19 Sep 2008, 03:40:40 hrs PST8PDT
   Bugs fixed:
     7375613
   Files Touched:
     prvtdmsu.plb --> ORACLE_HOME/rdbms/admin/prvtdmsu.plb
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375613
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375613_Sep_19_2008_03_40_40
 
Patch  7375611      : applied on Wed Apr 08 16:49:05 SGT 2009
   Created on 19 Sep 2008, 03:40:37 hrs PST8PDT
   Bugs fixed:
     7375611
   Files Touched:
     /qccpub.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375611
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375611_Sep_19_2008_03_40_37
 
Patch  7197583      : applied on Wed Apr 08 16:48:51 SGT 2009
   Created on 2 Jul 2008, 05:50:52 hrs PST8PDT
   Bugs fixed:
     7197583
   Files Touched:
     recompile_precheck_jan2008cpu.sql --> ORACLE_HOME/cpu/view_recompile/recompile_precheck_jan2008cpu.sql
     view_recompile_jan2008cpu.sql --> ORACLE_HOME/cpu/view_recompile/view_recompile_jan2008cpu.sql
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7197583
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7197583_Jul_2_2008_05_50_52
 
Patch  7155254      : applied on Wed Apr 08 16:48:41 SGT 2009
   Created on 2 Jul 2008, 05:55:42 hrs PST8PDT
   Bugs fixed:
     7155254
   Files Touched:
     /oracle/sysman/db/adm/inst/MemoryController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/adm/inst/SessionDetailsController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/adm/inst/SitemapController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/emo/perf/bean/sesn/SessionDetails.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /_database/_instance/_sitemap/_health.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
     /_database/_instance/_sitemap/_health$__jsp_StaticText.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155254
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155254_Jul_2_2008_05_55_42
 
Patch  7155253      : applied on Wed Apr 08 16:46:48 SGT 2009
   Created on 2 Jul 2008, 05:55:29 hrs PST8PDT
   Bugs fixed:
     7155253
   Files Touched:
     /oracle/sysman/db/rsc/inst/RsrcMonitorMsg.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/rsc/inst/RsrcMonitorMsgID.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/adm/inst/rsrcmgr/RsrcmgrMonController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /_database/_instance/_sitemap/_healthgif.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
     /_database/_instance/_sitemap/_healthgif$__jsp_StaticText.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155253
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155253_Jul_2_2008_05_55_29
 
Patch  7155252      : applied on Wed Apr 08 16:45:15 SGT 2009
   Created on 2 Jul 2008, 04:38:30 hrs PST8PDT
   Bugs fixed:
     7155252
   Files Touched:
     /ctc.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155252
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155252_Jul_2_2008_04_38_30
 
Patch  7155251      : applied on Wed Apr 08 16:45:09 SGT 2009
   Created on 2 Jul 2008, 04:37:07 hrs PST8PDT
   Bugs fixed:
     7155251
   Files Touched:
     /kwqn.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155251
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155251_Jul_2_2008_04_37_07
 
Patch  7155250      : applied on Wed Apr 08 16:44:58 SGT 2009
   Created on 2 Jul 2008, 04:36:18 hrs PST8PDT
   Bugs fixed:
     7155250
   Files Touched:
     /kupp.o --> ORACLE_HOME/lib/libserver10.a
     prvtbpp.plb --> ORACLE_HOME/rdbms/admin/prvtbpp.plb
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155250
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155250_Jul_2_2008_04_36_18
 
Patch  7155249      : applied on Wed Apr 08 16:44:48 SGT 2009
   Created on 2 Jul 2008, 04:34:23 hrs PST8PDT
   Bugs fixed:
     7155249
   Files Touched:
     prvtdefr.plb --> ORACLE_HOME/rdbms/admin/prvtdefr.plb
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155249
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155249_Jul_2_2008_04_34_23
 
Patch  7155248      : applied on Wed Apr 08 16:44:43 SGT 2009
   Created on 2 Jul 2008, 04:35:32 hrs PST8PDT
   Bugs fixed:
     7155248
   Files Touched:
     env_rdbms.mk --> ORACLE_HOME/rdbms/lib/env_rdbms.mk
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/iextjob
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/iextjobo
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155248
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155248_Jul_2_2008_04_35_32
 
Patch  7278117      : applied on Wed Apr 08 16:25:38 SGT 2009
   Created on 13 Aug 2008, 23:13:23 hrs US/Pacific
   Bugs fixed:
     7155655, 6917874, 7278117
   Files Touched:
     /vop.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7278117
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7278117_Aug_13_2008_23_13_23
 
Patch  7123643      : applied on Wed Apr 08 16:25:31 SGT 2009
   Created on 16 Jul 2008, 23:55:13 hrs US/Pacific
   Bugs fixed:
     7123643
   Files Touched:
     /kaf.o --> ORACLE_HOME/lib/libserver10.a
     /kaf9ir2.o --> ORACLE_HOME/lib/libserver10.a
     /kd.o --> ORACLE_HOME/lib/libserver10.a
     /kd9ir2c.o --> ORACLE_HOME/lib/libserver10.a
     /kd9ir2t.o --> ORACLE_HOME/lib/libserver10.a
     /kdb.o --> ORACLE_HOME/lib/libserver10.a
     /kdb9ir2o.o --> ORACLE_HOME/lib/libserver10.a
     /kdblc.o --> ORACLE_HOME/lib/libserver10.a
     /kdr.o --> ORACLE_HOME/lib/libserver10.a
     /kds.o --> ORACLE_HOME/lib/libserver10.a
     /kdst.o --> ORACLE_HOME/lib/libserver10.a
     /kdst00.o --> ORACLE_HOME/lib/libserver10.a
     /kdst01.o --> ORACLE_HOME/lib/libserver10.a
     /kdst10.o --> ORACLE_HOME/lib/libserver10.a
     /kdst11.o --> ORACLE_HOME/lib/libserver10.a
     /qertb.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
     /kd4.o --> ORACLE_HOME/lib/libcommon10.a
     /kdb4.o --> ORACLE_HOME/lib/libcommon10.a
     /kdr4.o --> ORACLE_HOME/lib/libcommon10.a
     /kdr9ir24.o --> ORACLE_HOME/lib/libcommon10.a
     /kd4.o --> ORACLE_HOME/lib32/libcommon10.a
     /kdb4.o --> ORACLE_HOME/lib32/libcommon10.a
     /kdr4.o --> ORACLE_HOME/lib32/libcommon10.a
     /kdr9ir24.o --> ORACLE_HOME/lib32/libcommon10.a
     ins_net_client.mk --> ORACLE_HOME/network/lib/client_sharedlib
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7123643
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7123643_Jul_16_2008_23_55_13
 
Patch  6327692      : applied on Wed Apr 08 16:24:49 SGT 2009
   Created on 9 Jun 2008, 02:23:15 hrs US/Pacific
   Bugs fixed:
     6327692
   Files Touched:
     /qkexr.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/6327692
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6327692_Jun_9_2008_02_23_15
 
Patch  5868257      : applied on Wed Apr 08 16:24:42 SGT 2009
   Created on 21 Oct 2008, 11:41:00 hrs PST8PDT
   Bugs fixed:
     5868257
   Files Touched:
     /updexe.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/5868257
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/5868257_Oct_21_2008_11_41_00
 
 
 
--------------------------------------------------------------------------------
 
OPatch succeeded.

$
$ $ opatch lsinventory -detail
Invoking OPatch 10.2.0.4.6
 
Oracle Interim Patch Installer version 10.2.0.4.6
Copyright (c) 2009, Oracle Corporation.  All rights reserved.
 
 
Oracle Home       : /oracle/app/oracle/product/10.2.0/db_1
Central Inventory : /oracle/app/oracle/oraInventory
   from           : /var/opt/oracle/oraInst.loc
OPatch version    : 10.2.0.4.6
OUI version       : 10.2.0.4.0
OUI location      : /oracle/app/oracle/product/10.2.0/db_1/oui
Log file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch2009-04-09_10-30-43AM.log
 
Patch history file: /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/opatch_history.txt
 
Lsinventory Output file location : /oracle/app/oracle/product/10.2.0/db_1/cfgtoollogs/opatch/lsinv/lsinventory2009-04-09_10-30-43AM.txt
 
--------------------------------------------------------------------------------
Installed Top-level Products (2):
 
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
There are 2 products installed in this Oracle Home.
 
 
Installed Products (188):
 
Agent Required Support Files                                         10.2.0.1.0
Agent Required Support Files Patch                                   10.2.0.4.0
Assistant Common Files                                               10.2.0.1.0
Assistant Common Files Patch                                         10.2.0.4.0
Bali Share                                                           1.1.18.0.0
Buildtools Common Files                                              10.2.0.1.0
Character Set Migration Utility                                      10.2.0.1.0
Character Set Migration Utility Patch                                10.2.0.4.0
Database Configuration and Upgrade Assistants                        10.2.0.1.0
Database Configuration and Upgrade Assistants Patch                  10.2.0.4.0
Database SQL Scripts                                                 10.2.0.1.0
Database SQL Scripts Patch                                           10.2.0.4.0
Database Workspace Manager                                           10.2.0.1.0
Database Workspace Manager                                           10.2.0.4.0
DBJAVA Required Support Files                                        10.2.0.1.0
DBJAVA Required Support Files Patch                                  10.2.0.4.0
Enterprise Edition Options                                           10.2.0.1.0
Enterprise Manager Agent Core                                        10.2.0.1.0
Enterprise Manager Agent Core Patch                                 10.2.0.4.0a
Enterprise Manager Agent DB                                          10.2.0.1.0
Enterprise Manager Agent DB                                          10.2.0.4.0
Enterprise Manager Baseline                                          10.2.0.1.0
Enterprise Manager Baseline                                          10.2.0.4.0
Enterprise Manager Common Core Patch                                10.2.0.4.0a
Enterprise Manager Common Files                                      10.2.0.1.0
Enterprise Manager Minimal Integration                               10.2.0.1.0
Enterprise Manager plugin Common Files                               10.2.0.1.0
Enterprise Manager plugin Common Files                               10.2.0.1.0
Enterprise Manager plugin Common Files Patch                         10.2.0.4.0
Enterprise Manager Repository Core                                   10.2.0.1.0
Enterprise Manager Repository Core patch                            10.2.0.4.0a
Enterprise Manager Repository DB                                     10.2.0.1.0
Enterprise Manager Repository DB                                     10.2.0.4.0
Generic Connectivity Common Files                                    10.2.0.1.0
Generic Connectivity Common Files Patch                              10.2.0.4.0
HAS Common Files                                                     10.2.0.1.0
HAS Common Files Patch                                               10.2.0.4.0
HAS Files for DB                                                     10.2.0.1.0
HAS Files for DB Patch                                               10.2.0.4.0
Installation Common Files                                            10.2.0.1.0
Installation Common Files Patch                                      10.2.0.4.0
Installer SDK Component                                              10.2.0.4.0
Java Runtime Environment                                             1.4.2.14.0
JDBC Common Files                                                    10.2.0.1.0
JDBC Common Files                                                    10.2.0.4.0
LDAP Required Support Files                                          10.2.0.1.0
LDAP Required Support Files Patch                                    10.2.0.4.0
OLAP SQL Scripts                                                     10.2.0.1.0
OLAP SQL Scripts Patch                                               10.2.0.4.0
Oracle Advanced Security                                             10.2.0.1.0
Oracle Advanced Security Patch                                       10.2.0.4.0
Oracle Call Interface (OCI)                                          10.2.0.1.0
Oracle Call Interface (OCI) Patch                                    10.2.0.4.0
Oracle Clusterware RDBMS Files                                       10.2.0.1.0
Oracle Clusterware RDBMS Files Patch                                 10.2.0.4.0
Oracle Code Editor                                                   1.2.1.0.0I
Oracle Configuration Manager                                         10.2.7.1.0
Oracle Containers for Java                                           10.2.0.1.0
Oracle Containers for Java                                           10.2.0.4.0
Oracle Core Required Support Files                                   10.2.0.1.0
Oracle Core Required Support Files Patch                             10.2.0.4.0
Oracle Data Mining RDBMS Files                                       10.2.0.1.0
Oracle Data Mining RDBMS Files Patch                                 10.2.0.4.0
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10G 32 bit                                           10.1.0.2.0
Oracle Database 10g interMedia Files                                 10.2.0.1.0
Oracle Database 10g interMedia Files Patch                           10.2.0.4.0
Oracle Database 10g Patch                                            10.2.0.4.0
Oracle Database 10g Patch                                            10.2.0.4.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
Oracle Database User Interface                                       2.2.13.0.0
Oracle Database Utilities                                            10.2.0.1.0
Oracle Database Utilities Patch                                      10.2.0.4.0
Oracle Display Fonts                                                  9.0.2.0.0
Oracle Enterprise Manager Console DB                                 10.2.0.1.0
Oracle Enterprise Manager Console DB                                 10.2.0.4.0
Oracle Extended Windowing Toolkit                                    3.4.38.0.0
Oracle Globalization Support                                         10.2.0.1.0
Oracle Globalization Support Patch                                   10.2.0.4.0
Oracle Help For Java                                                  4.2.6.1.0
Oracle Help for the  Web                                             1.1.10.0.0
Oracle Ice Browser                                                    5.2.3.6.0
Oracle interMedia                                                    10.2.0.1.0
Oracle interMedia Annotator                                          10.2.0.1.0
Oracle interMedia Client Option                                      10.2.0.1.0
Oracle interMedia Client Option Patch                                10.2.0.4.0
Oracle interMedia Java Advanced Imaging                              10.2.0.1.0
Oracle interMedia Java Advanced Imaging Patch                        10.2.0.4.0
Oracle interMedia Locator                                            10.2.0.1.0
Oracle interMedia Locator Patch                                      10.2.0.4.0
Oracle interMedia Locator RDBMS Files                                10.2.0.1.0
Oracle interMedia Locator RDBMS Files Patch                          10.2.0.4.0
Oracle interMedia Patch                                              10.2.0.4.0
Oracle Internet Directory Client                                     10.2.0.1.0
Oracle Internet Directory Client Patch                               10.2.0.4.0
Oracle Java Client                                                   10.2.0.1.0
Oracle Java Client Patch                                             10.2.0.4.0
Oracle JDBC Thin Driver for JDK 1.2                                  10.2.0.1.0
Oracle JDBC Thin Driver for JDK 1.2 Patch                            10.2.0.4.0
Oracle JDBC Thin Driver for JDK 1.4                                  10.2.0.1.0
Oracle JDBC Thin Driver for JDK 1.4 Patch                            10.2.0.4.0
Oracle JDBC/OCI Instant Client                                       10.2.0.1.0
Oracle JDBC/OCI Instant Client Patch                                 10.2.0.4.0
Oracle JFC Extended Windowing Toolkit                                4.2.33.0.0
Oracle JVM                                                           10.2.0.1.0
Oracle JVM Patch                                                     10.2.0.4.0
Oracle LDAP administration                                           10.2.0.1.0
Oracle LDAP administration patch                                     10.2.0.4.0
Oracle Locale Builder                                                10.2.0.1.0
Oracle Message Gateway Common Files                                  10.2.0.1.0
Oracle Message Gateway Common Files Patch                            10.2.0.4.0
Oracle Net                                                           10.2.0.1.0
Oracle Net Listener                                                  10.2.0.1.0
Oracle Net Listener Patch                                            10.2.0.4.0
Oracle Net Patch                                                     10.2.0.4.0
Oracle Net Required Support Files                                    10.2.0.1.0
Oracle Net Required Support Files Patch                              10.2.0.4.0
Oracle Net Services                                                  10.2.0.1.0
Oracle Notification Service                                           9.0.4.0.0
Oracle Notification Service Patch                                    10.2.0.4.0
Oracle OLAP                                                          10.2.0.1.0
Oracle OLAP API                                                      10.2.0.1.0
Oracle OLAP API Patch                                                10.2.0.4.0
Oracle OLAP Patch                                                    10.2.0.4.0
Oracle OLAP RDBMS Files                                              10.2.0.1.0
Oracle OLAP RDBMS Files Patch                                        10.2.0.4.0
Oracle One-Off Patch Installer                                       10.2.0.4.0
Oracle Partitioning                                                  10.2.0.1.0
Oracle Partitioning Patch                                            10.2.0.4.0
Oracle Programmer                                                    10.2.0.1.0
Oracle RAC Required Support Files-HAS                                10.2.0.1.0
Oracle RAC Required Support Files-HAS Patch                          10.2.0.4.0
Oracle Real Application Testing                                      10.2.0.4.0
Oracle Recovery Manager                                              10.2.0.1.0
Oracle Recovery Manager Patch                                        10.2.0.4.0
Oracle Required Support Files 32 bit                                 10.2.0.0.0
Oracle Required Support Files 32 bit Patch                           10.2.0.4.0
Oracle Spatial                                                       10.2.0.1.0
Oracle Starter Database                                              10.2.0.1.0
Oracle Starter Database Patch                                        10.2.0.4.0
Oracle Text                                                          10.2.0.1.0
Oracle Text Patch                                                    10.2.0.4.0
Oracle UIX                                                           2.1.22.0.0
Oracle Universal Installer                                           10.2.0.4.0
Oracle Wallet Manager                                                10.2.0.1.0
Oracle Wallet Manager Patch                                          10.2.0.4.0
Oracle XML Development Kit                                           10.2.0.1.0
Oracle XML Development Kit Patch                                     10.2.0.4.0
Parser Generator Required Support Files                              10.2.0.1.0
Perl Interpreter                                                      5.8.3.0.1
Perl Interpreter Patch                                               5.8.3.0.1a
PL/SQL                                                               10.2.0.1.0
PL/SQL                                                               10.2.0.4.0
PL/SQL Embedded Gateway                                              10.2.0.1.0
PL/SQL Embedded Gateway Patch                                        10.2.0.4.0
Platform Required Support Files                                      10.2.0.1.0
Platform Required Support Files                                      10.2.0.4.0
Precompiler Common Files                                             10.2.0.1.0
Precompiler Common Files Patch                                       10.2.0.4.0
Precompiler Required Support Files                                   10.2.0.1.0
Precompiler Required Support Files Patch                             10.2.0.4.0
RDBMS Required Support Files                                         10.2.0.1.0
RDBMS Required Support Files for Instant Client                      10.2.0.1.0
RDBMS Required Support Files for Instant Client Patch                10.2.0.4.0
RDBMS Required Support Files Patch                                   10.2.0.4.0
regexp                                                                2.1.9.0.0
Required Support Files                                               10.2.0.1.0
Sample Schema Data                                                   10.2.0.1.0
Sample Schema Data Patch                                             10.2.0.4.0
Secure Socket Layer                                                  10.2.0.1.0
Secure Socket Layer Patch                                            10.2.0.4.0
SQL*Plus                                                             10.2.0.1.0
SQL*Plus                                                             10.2.0.4.0
SQL*Plus Required Support Files                                      10.2.0.1.0
SQL*Plus Required Support Files Patch                                10.2.0.4.0
SQLJ Runtime                                                         10.2.0.1.0
SQLJ Runtime Patch                                                   10.2.0.4.0
SSL Required Support Files for InstantClient                         10.2.0.1.0
SSL Required Support Files for InstantClient Patch                   10.2.0.4.0
Sun JDK                                                              1.4.2.17.0
Sun JDK extensions                                                    9.2.0.1.0
XDK Required Support Files                                           10.2.0.1.0
XDK Required Support Files Patch                                     10.2.0.4.0
XML Parser for Java                                                  10.2.0.1.0
XML Parser for Java Patch                                            10.2.0.4.0
XML Parser for Oracle JVM                                            10.2.0.1.0
XML Parser for Oracle JVM Patch                                      10.2.0.4.0
There are 188 products installed in this Oracle Home.
 
 
Interim patches (16) :
 
Patch  7375644      : applied on Wed Apr 08 16:49:19 SGT 2009
   Created on 19 Sep 2008, 03:40:43 hrs PST8PDT
   Bugs fixed:
     7375644, 7150470
   Files Touched:
     catcpu.sql --> ORACLE_HOME/cpu/CPUOct2008/catcpu.sql
     catcpu_rollback.sql --> ORACLE_HOME/cpu/CPUOct2008/catcpu_rollback.sql
     rollback_all.lst --> ORACLE_HOME/cpu/CPUOct2008/rollback_all.lst
     rollback_new.lst --> ORACLE_HOME/cpu/CPUOct2008/rollback_new.lst
     bundledata_CPU.xml --> ORACLE_HOME/rdbms/admin/bundledata_CPU.xml
     catbundle.sql --> ORACLE_HOME/rdbms/admin/catbundle.sql
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375644
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375644_Sep_19_2008_03_40_43
 
Patch  7375617      : applied on Wed Apr 08 16:49:14 SGT 2009
   Created on 19 Sep 2008, 03:40:41 hrs PST8PDT
   Bugs fixed:
     7375617
   Files Touched:
     prvtbstr.plb --> ORACLE_HOME/rdbms/admin/prvtbstr.plb
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375617
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375617_Sep_19_2008_03_40_41
 
Patch  7375613      : applied on Wed Apr 08 16:49:10 SGT 2009
   Created on 19 Sep 2008, 03:40:40 hrs PST8PDT
   Bugs fixed:
     7375613
   Files Touched:
     prvtdmsu.plb --> ORACLE_HOME/rdbms/admin/prvtdmsu.plb
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375613
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375613_Sep_19_2008_03_40_40
 
Patch  7375611      : applied on Wed Apr 08 16:49:05 SGT 2009
   Created on 19 Sep 2008, 03:40:37 hrs PST8PDT
   Bugs fixed:
     7375611
   Files Touched:
     /qccpub.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7375611
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7375611_Sep_19_2008_03_40_37
 
Patch  7197583      : applied on Wed Apr 08 16:48:51 SGT 2009
   Created on 2 Jul 2008, 05:50:52 hrs PST8PDT
   Bugs fixed:
     7197583
   Files Touched:
     recompile_precheck_jan2008cpu.sql --> ORACLE_HOME/cpu/view_recompile/recompile_precheck_jan2008cpu.sql
     view_recompile_jan2008cpu.sql --> ORACLE_HOME/cpu/view_recompile/view_recompile_jan2008cpu.sql
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7197583
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7197583_Jul_2_2008_05_50_52
 
Patch  7155254      : applied on Wed Apr 08 16:48:41 SGT 2009
   Created on 2 Jul 2008, 05:55:42 hrs PST8PDT
   Bugs fixed:
     7155254
   Files Touched:
     /oracle/sysman/db/adm/inst/MemoryController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/adm/inst/SessionDetailsController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/adm/inst/SitemapController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/emo/perf/bean/sesn/SessionDetails.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /_database/_instance/_sitemap/_health.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
     /_database/_instance/_sitemap/_health$__jsp_StaticText.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155254
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155254_Jul_2_2008_05_55_42
 
Patch  7155253      : applied on Wed Apr 08 16:46:48 SGT 2009
   Created on 2 Jul 2008, 05:55:29 hrs PST8PDT
   Bugs fixed:
     7155253
   Files Touched:
     /oracle/sysman/db/rsc/inst/RsrcMonitorMsg.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/rsc/inst/RsrcMonitorMsgID.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /oracle/sysman/db/adm/inst/rsrcmgr/RsrcmgrMonController.class --> ORACLE_HOME/sysman/jlib/emDB.jar
     /_database/_instance/_sitemap/_healthgif.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
     /_database/_instance/_sitemap/_healthgif$__jsp_StaticText.class --> ORACLE_HOME/sysman/jlib/emjsp.jar
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155253
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155253_Jul_2_2008_05_55_29
 
Patch  7155252      : applied on Wed Apr 08 16:45:15 SGT 2009
   Created on 2 Jul 2008, 04:38:30 hrs PST8PDT
   Bugs fixed:
     7155252
   Files Touched:
     /ctc.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155252
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155252_Jul_2_2008_04_38_30
 
Patch  7155251      : applied on Wed Apr 08 16:45:09 SGT 2009
   Created on 2 Jul 2008, 04:37:07 hrs PST8PDT
   Bugs fixed:
     7155251
   Files Touched:
     /kwqn.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155251
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155251_Jul_2_2008_04_37_07
 
Patch  7155250      : applied on Wed Apr 08 16:44:58 SGT 2009
   Created on 2 Jul 2008, 04:36:18 hrs PST8PDT
   Bugs fixed:
     7155250
   Files Touched:
     /kupp.o --> ORACLE_HOME/lib/libserver10.a
     prvtbpp.plb --> ORACLE_HOME/rdbms/admin/prvtbpp.plb
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155250
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155250_Jul_2_2008_04_36_18
 
Patch  7155249      : applied on Wed Apr 08 16:44:48 SGT 2009
   Created on 2 Jul 2008, 04:34:23 hrs PST8PDT
   Bugs fixed:
     7155249
   Files Touched:
     prvtdefr.plb --> ORACLE_HOME/rdbms/admin/prvtdefr.plb
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155249
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155249_Jul_2_2008_04_34_23
 
Patch  7155248      : applied on Wed Apr 08 16:44:43 SGT 2009
   Created on 2 Jul 2008, 04:35:32 hrs PST8PDT
   Bugs fixed:
     7155248
   Files Touched:
     env_rdbms.mk --> ORACLE_HOME/rdbms/lib/env_rdbms.mk
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/iextjob
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/iextjobo
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7155248
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7155248_Jul_2_2008_04_35_32
 
Patch  7278117      : applied on Wed Apr 08 16:25:38 SGT 2009
   Created on 13 Aug 2008, 23:13:23 hrs US/Pacific
   Bugs fixed:
     7155655, 6917874, 7278117
   Files Touched:
     /vop.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7278117
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7278117_Aug_13_2008_23_13_23
 
Patch  7123643      : applied on Wed Apr 08 16:25:31 SGT 2009
   Created on 16 Jul 2008, 23:55:13 hrs US/Pacific
   Bugs fixed:
     7123643
   Files Touched:
     /kaf.o --> ORACLE_HOME/lib/libserver10.a
     /kaf9ir2.o --> ORACLE_HOME/lib/libserver10.a
     /kd.o --> ORACLE_HOME/lib/libserver10.a
     /kd9ir2c.o --> ORACLE_HOME/lib/libserver10.a
     /kd9ir2t.o --> ORACLE_HOME/lib/libserver10.a
     /kdb.o --> ORACLE_HOME/lib/libserver10.a
     /kdb9ir2o.o --> ORACLE_HOME/lib/libserver10.a
     /kdblc.o --> ORACLE_HOME/lib/libserver10.a
     /kdr.o --> ORACLE_HOME/lib/libserver10.a
     /kds.o --> ORACLE_HOME/lib/libserver10.a
     /kdst.o --> ORACLE_HOME/lib/libserver10.a
     /kdst00.o --> ORACLE_HOME/lib/libserver10.a
     /kdst01.o --> ORACLE_HOME/lib/libserver10.a
     /kdst10.o --> ORACLE_HOME/lib/libserver10.a
     /kdst11.o --> ORACLE_HOME/lib/libserver10.a
     /qertb.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
     /kd4.o --> ORACLE_HOME/lib/libcommon10.a
     /kdb4.o --> ORACLE_HOME/lib/libcommon10.a
     /kdr4.o --> ORACLE_HOME/lib/libcommon10.a
     /kdr9ir24.o --> ORACLE_HOME/lib/libcommon10.a
     /kd4.o --> ORACLE_HOME/lib32/libcommon10.a
     /kdb4.o --> ORACLE_HOME/lib32/libcommon10.a
     /kdr4.o --> ORACLE_HOME/lib32/libcommon10.a
     /kdr9ir24.o --> ORACLE_HOME/lib32/libcommon10.a
     ins_net_client.mk --> ORACLE_HOME/network/lib/client_sharedlib
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/7123643
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/7123643_Jul_16_2008_23_55_13
 
Patch  6327692      : applied on Wed Apr 08 16:24:49 SGT 2009
   Created on 9 Jun 2008, 02:23:15 hrs US/Pacific
   Bugs fixed:
     6327692
   Files Touched:
     /qkexr.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/6327692
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/6327692_Jun_9_2008_02_23_15
 
Patch  5868257      : applied on Wed Apr 08 16:24:42 SGT 2009
   Created on 21 Oct 2008, 11:41:00 hrs PST8PDT
   Bugs fixed:
     5868257
   Files Touched:
     /updexe.o --> ORACLE_HOME/lib/libserver10.a
     ins_rdbms.mk --> ORACLE_HOME/rdbms/lib/ioracle
   Patch Location in Inventory:
     /oracle/app/oracle/product/10.2.0/db_1/inventory/oneoffs/5868257
   Patch Location in Storage area:
     /oracle/app/oracle/product/10.2.0/db_1/.patch_storage/5868257_Oct_21_2008_11_41_00
 
 
 
--------------------------------------------------------------------------------
 
OPatch succeeded.

$
$

libserver10.a文件被之前好几个patch修改过,在这种情况下,我们只能重新安装oracle软件到一个新的ORACLE_HOME,在这个新的ORACLE_HOME下重新安装之前所有的patch,然把这个新的ORACLE_HOME下的libserver10.a文件拷贝到原来失败的ORACLE_HOME下,然后重新继续安装我们剩余的opatch。

幸好这台机器是做了双机热备,我们还有备机。我把存储挂到备机后,重新运行10204的patchset,重新安装所有小patch,再rcp到主机。

终于完成了这个工作!不过,这样的修复,已经离重装数据库很近了。-_-!

打opatch的时候,千万不能手欠,千万要保佑不要被中断!

· 【文章发布信息】发表于: 2009-04-13 @ 23:04:39 · ||分类: ..experience, Working case

1 条评论 »

  1. ochef 于 2009-04-14 @ 09:13:36 留言

    非常好的文章,经验分享,我琢磨着是RAC环境遇到这样的情况就复杂了

RSS 为此帖反馈评论 · 反向跟踪 网站

留条评论