linux6.5+oracle12.2.0.1 rac两节点环境:节点1不断报错如下,节点2正常。此时数据库open状态,未宕机。
[oracle@rac1 trace]$ tail -f alert_cisdb1.log
Recovery of Online Redo Log: Thread 1 Group 1 Seq 441 Reading mem 0
Mem# 0: +DATA/CISDB/ONLINELOG/group_1.262.1017069397
Block recovery completed at rba 0.0.0, scn 0x0000000004848681
Doing block recovery for file 4 block 296
Resuming block recovery (PMON) for file 4 block 296
Block recovery from logseq 441, block 30777 to scn 0x00000000048b3fac
2019-10-31T14:20:05.570342+08:00
Recovery of Online Redo Log: Thread 1 Group 1 Seq 441 Reading mem 0
Mem# 0: +DATA/CISDB/ONLINELOG/group_1.262.1017069397
Block recovery completed at rba 441.30941.16, scn 0x00000000048b3fb3
2019-10-31T14:21:43.435017+08:00
Errors in file /oracle/app/oracle/diag/rdbms/cisdb/cisdb1/trace/cisdb1_ora_2628.trc (incident=761305):
ORA-00600: , : [4194], [4], [3], [], [], [], [], [], [], [], [], []
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
2019-10-31T14:21:43.439318+08:00
*****************************************************************
An internal routine has requested a dump of selected redo.
This usually happens following a specific internal error, when
analysis of the redo logs will help Oracle Support with the
diagnosis.
It is recommended that you retain all the redo logs generated (by
all the instances) during the past 12 hours, in case additional
redo dumps are required to help with the diagnosis.
*****************************************************************
2019-10-31T14:21:47.664140+08:00
*****************************************************************
An internal routine has requested a dump of selected redo.
This usually happens following a specific internal error, when
analysis of the redo logs will help Oracle Support with the
diagnosis.
It is recommended that you retain all the redo logs generated (by
all the instances) during the past 12 hours, in case additional
redo dumps are required to help with the diagnosis.
*****************************************************************
2019-10-31T14:21:51.631652+08:00
Doing block recovery for file 4 block 7243
Resuming block recovery (PMON) for file 4 block 7243
Block recovery from logseq 441, block 30777 to scn 0x000000000482fd7f
2019-10-31T14:21:51.651620+08:00
Recovery of Online Redo Log: Thread 1 Group 1 Seq 441 Reading mem 0
Mem# 0: +DATA/CISDB/ONLINELOG/group_1.262.1017069397
Block recovery completed at rba 0.0.0, scn 0x0000000004848681
Doing block recovery for file 4 block 296
Resuming block recovery (PMON) for file 4 block 296
Block recovery from logseq 441, block 30777 to scn 0x00000000048b4808
2019-10-31T14:21:51.669697+08:00
Recovery of Online Redo Log: Thread 1 Group 1 Seq 441 Reading mem 0
Mem# 0: +DATA/CISDB/ONLINELOG/group_1.262.1017069397
Block recovery completed at rba 441.31003.16, scn 0x00000000048b4838
Errors in file /oracle/app/oracle/diag/rdbms/cisdb/cisdb1/trace/cisdb1_ora_2628.trc (incident=761306):
ORA-00600: , : [4194], [4], [3], [], [], [], [], [], [], [], [], []
Incident details in: /oracle/app/oracle/diag/rdbms/cisdb/cisdb1/incident/incdir_761306/cisdb1_ora_2628_i761306.trc
2019-10-31T14:21:52.709744+08:00
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
more /oracle/app/oracle/diag/rdbms/cisdb/cisdb1/incident/incdir_761306/cisdb1_ora_2628_i761306.trc
Dump file /oracle/app/oracle/diag/rdbms/cisdb/cisdb1/incident/incdir_761306/cisdb1_ora_2628_i761306.trc
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
Build label: RDBMS_12.2.0.1.0_LINUX.X64_170125
ORACLE_HOME: /oracle/app/oracle/product/12.2.0/dbhome_1
System name: Linux
Node name: rac1
Release: 2.6.32-431.56.1.el6.x86_64
Version: #1 SMP Thu Jan 21 16:15:10 CST 2016
Machine: x86_64
Instance name: cisdb1
Redo thread mounted by this instance: 1
Oracle process number: 163
Unix process pid: 2628, image: oracle@rac1
*** 2019-10-31T14:21:51.717485+08:00
*** SESSION ID:(6190.60530) 2019-10-31T14:21:51.717502+08:00
*** CLIENT ID:() 2019-10-31T14:21:51.717509+08:00
*** SERVICE NAME:(cisdb) 2019-10-31T14:21:51.717517+08:00
*** MODULE NAME:(oracle@rac1) 2019-10-31T14:21:51.717524+08:00
*** ACTION NAME:() 2019-10-31T14:21:51.717532+08:00
*** CLIENT DRIVER:() 2019-10-31T14:21:51.717539+08:00
[TOC00000]
Jump to table of contents
Dump continued from file: /oracle/app/oracle/diag/rdbms/cisdb/cisdb1/trace/cisdb1_ora_2628.trc
[TOC00001]
ORA-00600: , : [4194], [4], [3], [], [], [], [], [], [], [], [], []
[TOC00001-END]
[TOC00002]
========= Dump for incident 761306 (ORA 600 [ORA-00600: , : [4194], [4], [3], [], [], [], [], [], [], [], [], []
]) ========
*** 2019-10-31T14:21:51.718122+08:00
dbkedDefDump(): Starting incident default dumps (flags=0x2, level=3, mask=0x0)
[TOC00003]
----- SQL Statement (None) -----
Current SQL information unavailable - no cursor.
[TOC00003-END]
[oracle@rac1 ~]$ sqlplus /nolog
SQL*Plus: Release 12.2.0.1.0 Production on Thu Oct 31 15:57:59 2019
Copyright (c) 1982, 2016, Oracle. All rights reserved.
SQL> conn /as sysdba
Connected.
SQL> create pfile='/home/oracle/cisdb20191031.ora' from spfile;
create pfile='/home/oracle/cisdb20191031.ora' from spfile
*
ERROR at line 1:
ORA-00600: internal error code, arguments: [4194], [4], [3], [], [], [], [],
[], [], [], [], []
SQL> select status from v$instance;
STATUS
------------
OPEN
SQL> show parameter undo;
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
temp_undo_enabled boolean FALSE
undo_management string AUTO
undo_retention integer 900
undo_tablespace string UNDOTBS1
16:02:15 SQL> create undo tablespace undotbs01 datafile '+DATA' size 4096M autoextend on;
Tablespace created.
Elapsed: 00:00:53.16
16:03:20 SQL> select name from v$tablespace;
NAME
------------------------------
SYSAUX
SYSTEM
UNDOTBS1
USERS
TEMP
UNDOTBS2
CISTSINDEX
CISTSDATA
CISTSDATA_TEMP
UNDOTBS01
10 rows selected.
Elapsed: 00:00:00.03
16:04:35 SQL> !more /home/oracle/cisdb20191031.ora –备份pfile参数文件
*.audit_file_dest='/oracle/app/oracle/admin/cisdb/adump'
*.audit_trail='none'
*.cluster_database=true
*.compatible='12.2.0'
*.control_files='+DATA/CISDB/CONTROLFILE/current.261.1017069391'
*.db_block_size=8192
*.db_create_file_dest='+DATA'
*.db_name='cisdb'
*.diagnostic_dest='/oracle/app/oracle'
*.dispatchers='(PROTOCOL=TCP) (SERVICE=cisdbXDB)'
family:dw_helper.instance_mode='read-only'
cisdb1.instance_number=1
cisdb2.instance_number=2
*.local_listener='-oraagent-dummy-'
*.nls_language='AMERICAN'
*.nls_territory='AMERICA'
*.open_cursors=300
*.pga_aggregate_target=20480m
*.processes=5000
*.remote_login_passwordfile='exclusive'
*.sga_target=40960m
cisdb2.thread=2
cisdb1.thread=1
cisdb1.undo_tablespace='UNDOTBS1'
cisdb2.undo_tablespace='UNDOTBS2'
16:04:56 SQL> alter system set undo_tablespace='UNDOTBS01' scope=both sid='cisdb1';
System altered.
[oracle@rac2 dmp]$ srvctl stop database -d cisdb -o immediate
[oracle@rac2 dmp]$ srvctl start database -d cisdb
[oracle@rac1 trace]$ sqlplus /nolog
SQL*Plus: Release 12.2.0.1.0 Production on Thu Oct 31 22:49:20 2019
Copyright (c) 1982, 2016, Oracle. All rights reserved.
SQL> conn /as sysdba
Connected.
SQL> show parameter undo;
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
temp_undo_enabled boolean FALSE
undo_management string AUTO
undo_retention integer 900
undo_tablespace string UNDOTBS01
SQL> select name from v$tablespace;
NAME
------------------------------
SYSAUX
SYSTEM
UNDOTBS1
USERS
TEMP
UNDOTBS2
CISTSINDEX
CISTSDATA
CISTSDATA_TEMP
UNDOTBS01
10 rows selected.
SQL> drop tablespace UNDOTBS1 including contents and datafiles;
Tablespace dropped.
SQL> select name from v$tablespace;
NAME
------------------------------
SYSAUX
SYSTEM
USERS
TEMP
UNDOTBS2
CISTSINDEX
CISTSDATA
CISTSDATA_TEMP
UNDOTBS01
9 rows selected.
SQL> select name from v$datafile;
NAME
--------------------------------------------------------------------------------
+DATA/CISDB/DATAFILE/system.257.1017069215
+DATA/CISDB/DATAFILE/cistsindex.269.1017073627
+DATA/CISDB/DATAFILE/sysaux.258.1017069287
+DATA/CISDB/DATAFILE/undotbs2.265.1017069455
+DATA/CISDB/DATAFILE/users.260.1017069323
+DATA/CISDB/DATAFILE/cistsdata.270.1017073831
+DATA/CISDB/DATAFILE/sysaux.276.1022360053
+DATA/CISDB/DATAFILE/undotbs01.277.1023120147
8 rows selected.
SQL> @/home/oracle/tbs.sql
TABLESPACE_NAME SUM_SPACE(M) SUM_BLOCKS USED_SPACE(M) USED_RATE(%) FREE_SPACE(M)
------------------------------ ------------ ---------- ------------- ------------ -------------
SYSAUX 12828 1641984 8273.37 64.49 4554.63
CISTSDATA 10240 1310720 5159.37 50.38 5080.63
SYSTEM 2048 262144 886.06 43.26 1161.94
USERS 100 12800 4.94 4.94 95.06
UNDOTBS2 4096 524288 110 2.69 3986
TEMP 2652 339456 5 .19 2647
UNDOTBS01 4096 524288 7.81 .19 4088.19
CISTSINDEX 10240 1310720 1 .01 10239
CISTSDATA_TEMP 2048 262144 0
9 rows selected.
附:如果报错宕机的情况下,一般处理步骤参考:
1、修改参数undo_management= MANUALundo_tablespace= SYSTEM2、打开数据库,重建新undo空间,删除当前undo空间3、修改参数undo_management= AUTOundo_tablespace= UNDOTBSNEW4、重新启动数据库