Patching OEM 13c Cloud Control

Some quick notes on patching OEM. Any errors please let me know, I had to install these updates very quickly as they covered a critical security vulnerability.

We need the latest OMSPatcher, OPatch (the right one for OEM Cloud Control) and the correct EM patch.

13.2.0.0.190416 Enterprise Manager Base Platform Patch Set Update (PSU) Readme for Oracle Management Server (OMS) (Doc ID 2528034.1)


29433916 EMBP Patch Set Update 13.2.0.0.190416 System Patch


EM 13.2 How to Upgrade the Enterprise Manager 13.2 & 13.3 Cloud Control OMSPatcher to the Latest Version (Doc ID 2203007.1)

Additional notes here :

https://dbakevlar.com/2016/05/em13c-applying-system-patches-with-the-oms-patcher/

-- ---------------------------------------------------
-- patching the OEM server
-- ---------------------------------------------------
-- read me https://updates.oracle.com/Orion/Services/download?type=readme&aru=22826464
-- https://dbakevlar.com/2016/05/em13c-applying-system-patches-with-the-oms-patcher/
--
--
-- ---------------------------------------------------
-- patch OMSPATCHER
-- ---------------------------------------------------
-- https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=291979085412865&id=2203007.1&_afrWindowMode=0&_adf.ctrl-state=crcydkj0u_53
-- /u99/media/oracle/OMSPATCHER/p19999993_133000_Generic.zip
export OMS_HOME=/u01/app/oracle/oms13c
mv $OMS_HOME/OMSPatcher $OMS_HOME/OMSPatcherOLD_GS
unzip /u99/media/oracle/OMSPATCHER/p19999993_133000_Generic.zip -d $OMS_HOME
export ORACLE_HOME=$OMS_HOME
cd $OMS_HOME/OMSPatcher
./omspatcher version
-- ---------------------------------------------------
-- patch OPATCH
-- ---------------------------------------------------
-- https://updates.oracle.com/download/6880880.html
-- OPatch for OEM is completely different to installing opatch to the databases
export OMS_HOME=/u01/app/oracle/oms13c
export ORACLE_HOME=$OMS_HOME
export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OMSPatcher:$PATH:
emctl stop oms
emctl status oms


 -- if the path doesn't reference a java run time then add one to the path
find /u01 -name java
 -- add found path to the PATH
 -- for example PATH=$PATH:/u01/app/oracle/grid/jdk/jre/bin
-- unzip the OPatch to the media area
cd /u99/media/oracle/OPATCH
unzip p6880880_139000_Generic.zip
-- install the OPatch

java -jar ./6880880/opatch_generic.jar -silent oracle_home=$ORACLE_HOME


If you hit memory problems with java you can use the -XX option:

java -jar -XX:MaxDirectMemorySize=55m ./opatch_generic.jar -silent oracle_home=$ORACLE_HOME

-- check version
cd $ORACLE_HOME/OPatch
./opatch version
./opatch lspatches

emctl start oms
emctl status oms

-- ---------------------------------------------------
-- Applying the actual OMS patch
-- ---------------------------------------------------
-- https://updates.oracle.com/Orion/Services/download?type=readme&aru=22826464
-- check listener is up and database is up.

lsnrctl status
export ORACLE_SID=oemnyqa

sqlplus / as sysdba
select instance_name,status from v$instance;
exit

-- set oms home
export ORACLE_HOME=/u01/app/oracle/oms13c
export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OMSPatcher:$PATH

-- check oms is up emctl status oms
emctl status oms

-- (go into oem from web page and check can login)
-- check oms version is 13.9....

cd $ORACLE_HOME/OPatch

[oracle@oem01 OPatch]$ ./opatch version

OPatch Version: 13.9.3.3.0
OPatch succeeded.


-- check omspatcher version is 13.8.0.0.3

cd $ORACLE_HOME/OMSPatcher

-- check ORACLE_HOME is oms home /u01/app/oracle/oms13c

[oracle@oem01 OMSPatcher]$ ./omspatcher version
OMSPatcher Version: 13.8.0.0.3
OPlan Version: 12.2.0.1.6
OsysModel build: Tue Sep 04 18:15:05 PDT 2018
OMSPatcher succeeded.



echo $ORACLE_HOME
-- check PATH points to OMS bin and OMSPatcher
-- eg /u01/app/oracle/oms13c/bin:/u01/app/oracle/oms13c/OMSPatcher:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/oracle/.local/bin:/home/oracle/bin:/u01/app/oracle/product/12.2.0/dbhome/bin
echo $PATH

-- unzip the patch to the media folder
cd /u99/media/oracle/EMBP
unzip p29433916_132000_Generic.zip

-- test OMS PATCHER patch
-- if you want to you can create a properties file, so just answer the prompts
omspatcher apply /u99/media/oracle/EMBP/29433916 -analyze
-- press return to "Please enter OMS weblogic admin server URL(t3s://ussanqnycoem01:7102):>"
-- the username and password are in keepass QA->OEM weblogic admin server console
-- check the result is "success"
-- stop oms

emctl stop oms

unzip
omspatcher apply /u99/media/oracle/EMBP/29433916

-- start oms

emcli login -username=sysman -password=XXXXXX
Login successful
Synchronize emcli with the OMS

$ emcli sync
Synchronized successfully
Logout EM

$ emcli logout
Logout successful


-------------------------------------------------------------------------------------------
-- NOW PATCH DATABASE
-------------------------------------------------------------------------------------------
-- https://updates.oracle.com/Orion/Services/download?type=readme&aru=22821655
su - oracle
-- check oracle home
echo $PATH
--
-- check opatch version > 12.2.0.1.14
cd $ORACLE_HOME/OPatch
./opatch version
-- check path contains certain programs
which make
which ar
which ld
which nm
-- unzip patch
cd /u99/media/oracle/DB
unzip p29314339_122010_Linux-x86-64.zip
cd 29314339
$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
-- stop oms
/u01/app/oracle/oms13c/emctl stop oms

export ORACLE_SID=oemnyqa
sqlplus / as sysdba
shutdown immediate;

lsnrctl stop

cd /u99/media/oracle/DB/29314339

$ORACLE_HOME/OPatch/opatch apply

sqlplus /nolog
connect / as sysdba
startup
quit

-- apply the data changes

cd $ORACLE_HOME/OPatch
./datapatch -verbose

-- recompile any invalis objects
cd $ORACLE_HOME/rdbms/admin

sqlplus / as sysdba
@utlrp.sql

/u01/app/oracle/oms13c/emctl start oms




+++++++++++++++++++++++++++

On checking the patch recommendation in OEM we are still missing 

Patch 29204657: WLS PATCH SET UPDATE 12.1.3.0.190416

Hit a problem with the patch, basically :

Prereq "checkConflictAgainstOHWithDetail" failed.

Summary of Conflict Analysis:

There are no patches that can be applied now.

Following patches have conflicts. Please contact Oracle Support and get the merged patch of the patches :
18974665, 29204657


Logged an SR with Oracle who came back with :

18974665 fix is already in the WLS PSU 29204657.

Please rollback patch 18974665, and apply WLS PSU 29204657.

1) Rollback WLS one-off patch (patch 18974665): $ORACLE_HOME/OPatch/opatch rollback -id 18974665

2) Apply the WLS Patch (patch 29204657) according to the instructions in the patch README file.

Refer:

Please rollback Conflict With Patch 18974665 When Applying WebLogic Server 12.1.3 PSU ( Doc ID 2295478.1 )  


Rollback the patch and applied the 29204657 successfully. Happy Days ✔


+++++++++++++++++++++++++++

When checking the OEM patch - check you server architecture and java version match I.e. in this case 64bit otherwise you will see lots of errors re the java version.



Either put java home in the $PATH or use the "-jdk" option on opatch

[oracle@usnyssmtaoem01 OPatch]$ arch
x86_64


[oracle@usnyssmtaoem01 OPatch]$ /u01/app/oracle/middleware/oracle_common/jdk/bin/java -version
java version "1.7.0_111"
Java(TM) SE Runtime Environment (build 1.7.0_111-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.111-b13, mixed mode)

[oracle@usnyssmtaoem01 OPatch]$ ./opatch lsinventory -jdk /u01/app/oracle/middleware/oracle_common/jdk/

Oracle Interim Patch Installer version 13.9.3.3.0
Copyright (c) 2019, Oracle Corporation. All rights reserved.

Oracle Home : /u01/app/oracle/middleware
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/middleware/oraInst.loc
OPatch version : 13.9.3.3.0
OUI version : 13.9.1.0.0
Log file location : /u01/app/oracle/middleware/cfgtoollogs/opatch/opatch2019-06-13_04-21-31AM_1.log

OPatch detects the Middleware Home as "/u01/app/oracle/middleware"

Lsinventory Output file location : /u01/app/oracle/middleware/cfgtoollogs/opatch/lsinv/lsinventory2019-06-13_04-21-31AM.txt

--------------------------------------------------------------------------------
Local Machine Information::
Hostname: usnyssmtaoem01
ARU platform id: 226
ARU platform description:: Linux_AMD64


Interim patches (22) :

Patch 29433916 : applied on Fri May 31 06:36:00 EDT 2019
Unique Patch ID: 22826464
Patch description: "EMBP Patch Set Update 13.2.0.0.190416"
Created on 8 Apr 2019, 03:43:13 hrs PST8PDT
Bugs fixed:
28634622, 26224920, 29427226, 29295784, 28536777, 28524707, 28919063
29049300, 29132445, 27810593, 28749611, 27810608, 26142955, 28818634
28459757, 27156728, 26477226, 28126885, 28247894, 25925447, 28695777
27549803, 27136340, 26823968, 27551630, 27244426, 27804466, 24691913
25784796, 25221636, 25202643, 28202885, 28703948, 27829797, 27721767
.....

No comments:

Post a Comment