Troubleshooting Oracle 19c RAC db crash with ORA-00600 [kcbbxsv_nwp]
db alert log
2020-06-12T05:01:44.048197+08:00 PDB(3):minact-scn: useg scan erroring out with error e:12751 2020-06-12T05:01:58.302414+08:00 Errors in file /u02/app/oracle/diag/rdbms/anbob/wgdb11/trace/wgdb11_dbwb_59726.trc (incident=1280745) (PDBNAME=CDB$ROOT): ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], [] Incident details in: /u02/app/oracle/diag/rdbms/wgdb1/wgdb11/incident/incdir_1280745/wgdb11_dbwb_59726_i1280745.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details. 2020-06-12T05:02:00.124461+08:00 Errors in file /u02/app/oracle/diag/rdbms/anbob/wgdb11/trace/wgdb11_dbwb_59726.trc: ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], [] Errors in file /u02/app/oracle/diag/rdbms/wgdb1/wgdb11/trace/wgdb11_dbwb_59726.trc (incident=1280746) (PDBNAME=CDB$ROOT): ORA-471 [] [] [] [] [] [] [] [] [] [] [] [] <<<<<<<< Incident details in: /u02/app/oracle/diag/rdbms/wgdb1/wgdb11/incident/incdir_1280746/wgdb11_dbwb_59726_i1280746.trc 2020-06-12T05:02:00.269879+08:00 Dumping diagnostic data in directory=[cdmp_20200612050200], requested by (instance=1, osid=59726 (DBWB)), summary=[incident=1280745]. 2020-06-12T05:02:01.998825+08:00 USER (ospid: 59726): terminating the instance due to ORA error 471 <<<<<<<< 2020-06-12T05:02:09.324604+08:00 Instance terminated by USER(prelim), pid = 201552
trace file
*** 2020-06-12T05:01:58.303334+08:00 2020-06-12T05:01:58.303319+08:00 Incident 1280745 created, dump file: /u02/app/oracle/diag/rdbms/anbob/anbob1/incident/incdir_1280745/anbob1_dbwb_59726_i1280745.trc ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], [] kge_experr : Found error ORA-600 not in expected list. kge_experr: Dumping error frames [top = 1 : barrier top = 0] kge_experr : [0] : Error = ORA-600 : Call stack = ksedsts()+426<-kge_snap_callstack()+77<-kgeadse()+557<-kgerinv_internal()+44 <-kgerinv()+40<-kserin()+180<-kcbbxsv()+17478<-kcbb_coalesce_int()+326<-kcbb_coalesce()+438< -kcbbwthc()+817<-kcbbdrv()+8765<-ksb_act_run_int()+117<-ksb_act_run()+130<-ksbcti()+18 kge_experr: Dumping error frames - done error 471 detected in background process ORA-00600: internal error code, arguments: [kcbbxsv_nwp], [], [], [], [], [], [], [], [], [], [], [] 2020-06-12T05:02:00.137498+08:00 Incident 1280746 created, dump file: /u02/app/oracle/diag/rdbms/anbob/anbob1/incident/incdir_1280746/anbob1_dbwb_59726_i1280746.trc ORA-471 [] [] [] [] [] [] [] [] [] [] [] [] 2020-06-12 05:02:01.983 :kjzduptcctx(): Notifying DIAG for crash event PROCESS STATE ------------- Process global information: process: 0xee1ac44f0, call: 0xab52da458, xact: (nil), curses: 0xf6257d6e0, usrses: 0xf6257d6e0 <<<<<<<<<<< in_exception_handler: no ---------------------------------------- SO: 0xf7fef76f8, type: process (2), map: 0xee1ac44f0 state: LIVE (0x4532), flags: 0x1 owner: (nil), proc: 0xf7fef76f8 link: 0xf7fef7718[0xf7fef7718, 0xf7fef7718] child list count: 15, link: 0xf7fef7768[0xdbff094a8, 0xdbff098a8] conid: 1, conuid: 1, SGA version=(1,0), pg: 0 SOC: 0xee1ac44f0, type: process (2), map: 0xf7fef76f8 state: LIVE (0x99fc), flags: INIT (0x1) (process) Oracle pid:93, ser:1, calls cur/top: 0xab52da458/0xab52da458 flags : (0x6) SYSTEM icon_uid:0 logon_pdbid=0 flags2: (0x800), flags3: (0x10) call error: 0, sess error: 0, txn error 0 intr queue: empty (post info) last post received: 0 0 33 last post received-location: ksa2.h LINE:298 ID:ksasnd last process to post me: 0xf21a5c338 1 6 last post sent: 0 0 193 last post sent-location: kjc.h LINE:2511 ID:KJCS Post snd proxy to flush msg last process posted by me: 0xf01a5e388 1 6 waiter on post event: 0 (latch info) hold_bits=0x0 ud_influx=0x19a7 (osp latch info) hold_bits=0x0 ud_influx=0x0 Process Group: DEFAULT, pseudo proc: 0xee1e6cf58 O/S info: user: oracle, term: UNKNOWN, ospid: 59726 OSD pid info: PDB SWITCH DEPTH : 0 ---------------------------------------- SO: 0xf7fe1ef90, type: session (4), map: 0xf6257d6e0 state: LIVE (0x4532), flags: 0x1 owner: 0xf7fef76f8, proc: 0xf7fef76f8 link: 0xf7fe1efb0[0xf7f21de90, 0xf7f21de10] child list count: 2, link: 0xf7fe1f000[0xdbff87fa8, 0xe7fd12340] conid: 1, conuid: 1, SGA version=(1,0), pg: 0 SOC: 0xf6257d6e0, type: session (4), map: 0xf7fe1ef90 <<<<<<<<<<< state: LIVE (0x99fc), flags: INIT (0x1) (session) sid: 4465 ser: 57003 trans: (nil), creator: 0xee1ac44f0 flags: (0x51) USR/- flags2: (0x409) -/-/INC flags_idl: (0x1) status: BSY/-/-/- kill: -/-/-/- DID: 0001-005D-000000020000-0000-00000000, short-term DID: txn branch: (nil) con_id/con_uid/con_name: 1/1/CDB$ROOT con_logonuid: 1 con_logonid: 1 con_scuid: 1 con_scid: 1 edition#: 0 user#/name: 0/SYS oct: 0, prv: 0, sql: (nil), psql: (nil) stats: 0xb1ffe1be0, PX stats: 0x12a0df44 service name: SYS$BACKGROUND Current Wait Stack: Not in wait; last wait ended 2.446949 sec ago <<<<<<<<<<< Wait State: fixed_waits=0 flags=0x21 boundary=(nil)/-1
kgerinv()+40 kernel generic error record internal named error with va_list
kserin()+180 kernel service error [partial hit for: kse ]
kcbbxsv()+17478 kernel cache buffers databasewriter take single buffer and check if we have to return to LRU
kcbb_coalesce_int()+326 kernel cache buffers databasewriter [partial hit for: kcbb ]
kcbb_coalesce()+438 kernel cache buffers databasewriter [partial hit for: kcbb ]
kcbbwthc()+817 kernel cache buffers databasewriter [partial hit for: kcbb ]
kcbbdrv()+8765 kernel cache buffers databasewriter central write driver
ksb_act_run_int()+117 kernel service background processes [partial hit for: ksb ]
ksb_act_run()+130 kernel service background processes [partial hit for: ksb ]
ksbcti() kernel service background processes call timeout/interrupts
MOS search callstack matched BUG 30486436.
INTERNAL PROBLEM DESCRIPTION:
A weak lock may be blocked due to a refuse bast was dropped for incorrect DRM check when refuse bast was issued right after DRM lock replay.
INTERNAL FIX DESCRIPTION:
Add check in refuse bast to handle DRM just replayed the lock. The refuse bast would be valid and should be honored.
对不起,这篇文章暂时关闭评论。