OGG-01416 OGG-01668 Process Abending


After a test box filesystem had filled up.

Cleared down and checked Golden Gate for any issues.

One of the extracts had abended.

EXTRACT     ABENDED     OAM_X       00:00:00      00:30:03

Checked ggserr.log file :

020-07-06T10:26:37.295-0400 ERROR OGG-01416 Oracle GoldenGate Capture for Oracle, oam_x.prm: File ./dirdat/oam/et000003576, with format RELEASE 9.0/9.5, does not match current format specification of RELEASE 12.3. Modify the parameter file to specify format RELEASE 9.0/9.5 or issue ETROLLOVER prior to restart.
2020-07-06T10:26:37.360-0400 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, oam_x.prm: PROCESS ABENDING.


Quick search on the web and followed the instructions here :

OGG-01411 – Cannot convert input file ./dirdat/xx with format RELEASE 9.0/9.5 to output file ./dirdat/zz


[oracle@usze2qmbtora02 gghome_app]$ ./ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 12.3.0.1.2 OGGCORE_12.3.0.1.0_PLATFORMS_171208.0005_FBO
Linux, x64, 64bit (optimized), Oracle 12c on Dec 9 2017 00:51:03
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.

GGSCI (usze2qmbtora02) 1> info OAM_X

EXTRACT OAM_X Last Started 2020-07-06 10:51 Status ABENDED
Checkpoint Lag 00:00:00 (updated 00:43:51 ago)
Log Read Checkpoint Oracle Redo Logs
2020-07-06 10:13:28 Seqno 1909, RBA 236535824
SCN 0.209622245 (209622245)

GGSCI (usze2qmbtora02) 2> stop OAM_X
EXTRACT OAM_X is already stopped.

GGSCI (usze2qmbtora02) 3> alter OAM_X etrollover

2020-07-06 10:58:28 INFO OGG-01520 Rollover performed. For each affected output trail of Version 10 or higher format, after starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file; it will not happen automatically.
EXTRACT altered.

GGSCI (usze2qmbtora02) 4> alter OAM_X begin 2020-07-06 10:13:28
EXTRACT altered.


GGSCI (usze2qmbtora02) 5> start OAM_X

Sending START request to MANAGER ...
EXTRACT OAM_X starting

GGSCI (usze2qmbtora02) 6> info all

Program Status Group Lag at Chkpt Time Since Chkpt

MANAGER RUNNING
EXTRACT RUNNING OAM_X 00:45:17 00:00:14

GGSCI (usze2qmbtora02) 7> info all

Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING OAM_X 00:00:01 00:00:00

Strange why only the one extract failed - will investigate further.



ACL resource



Colleague had an issue with ASM not starting and I think this was due to groups / users being changed during install. Asked to check this and came across this :

[grid@ORA01 ~]$ crsctl stat res ora.asm -f | grep -i acl

ACL=owner:grid:rwx,pgrp:asmdba:r-x,other::r--

should have been (comparing with a working server)

ACL=owner:grid:rwx,pgrp:oinstall:r-x,other::r--

After a lot of digging the command to change this is (why it is necessary to have something unsupported) 

[root@uszw2q2c2ods01 lib]# crsctl setperm resource ora.asm -g 'oinstall' -unsupported

[root@uszw2q2c2ods01 lib]# crsctl stat res ora.asm -f | grep -i acl

ACL=owner:grid:rwx,pgrp:oinstall:r-x,other::r--

DESCRIPTION=Oracle ASM resource

Still have an issue with ASM but made a note of this for future reference