Oracle 12.2 Flex ASM安装RU后ASM、GIMR等资源未启动, 手动启动提示CRS-2549“it is not a valid candidate as per the placement policy”

首页 » Cloud » Oracle 12.2 Flex ASM安装RU后ASM、GIMR等资源未启动, 手动启动提示CRS-2549“it is not a valid candidate as per the placement policy”

Oracle 12.2 Flex ASM安装RU后ASM、GIMR等资源未启动, 手动启动提示CRS-2549“it is not a valid candidate as per the placement policy”

2018/11/12
Cloud
1,456 views
2 条评论

今天遇到的一个案例，一套ORACLE 12.2 FLEX CLUSTER，在安装了RU(20180417)后节点2的CRS启动正常，但是其它如ASM、DB、GIMR 等资源都未启动， GI alert log并未发现错误，手动使用srvctl启动ASM资源提示:

CRS-2549: Resource ‘ora.asm’ cannot be placed on ‘anbob02’ as it is not a valid candidate as per the placement policy

使用SQLPLUS启动ASM实例提示:

SQL> startup
ORA-39510: CRS error performing start on instance ‘+ASM2’ on ‘+ASM’
CRS-2549: Resource ‘ora.asm’ cannot be placed on ‘anbob02’ as it is not a valid candidate as per the placement policy
CRS-0223: Resource ‘ora.asm’ has placement error.
clsr_start_resource:260 status:223
clsrapi_start_asm:start_asmdbs status:223

查看CRS状态

grid@anbob02:/home/grid> crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCHDG.dg
               ONLINE  ONLINE       anbob01                STABLE
               OFFLINE OFFLINE      anbob02                STABLE
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  OFFLINE      anbob02                STABLE
ora.DATADG.dg
               ONLINE  ONLINE       anbob01                STABLE
               OFFLINE OFFLINE      anbob02                STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  OFFLINE      anbob02                STABLE
ora.MGMTDG.dg
               ONLINE  ONLINE       anbob01                STABLE
               OFFLINE OFFLINE      anbob02                STABLE
ora.OCRDG.dg
               ONLINE  ONLINE       anbob01                STABLE
               OFFLINE OFFLINE      anbob02                STABLE
ora.chad
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  OFFLINE      anbob02                STABLE
ora.net1.network
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.ons
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  OFFLINE      anbob02                STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       anbob01                STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       anbob01                169.254.53.162 192.1
                                                             68.60.35,STABLE
ora.asm
      1        ONLINE  ONLINE       anbob01                Started,STABLE
      2        ONLINE  OFFLINE                               Instance Shutdown,ST
                                                             ABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       anbob01                STABLE
ora.iboss.db
      1        ONLINE  ONLINE       anbob01                Open,HOME=/oracle/ap
                                                             p/oracle/product/12.
                                                             2.0/db_1,STABLE
      2        ONLINE  OFFLINE                               STABLE
ora.anbob01.vip
      1        ONLINE  ONLINE       anbob01                STABLE
ora.anbob02.vip
      1        ONLINE  INTERMEDIATE anbob01                FAILED OVER,STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       anbob01                Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       anbob01                STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       anbob01                STABLE
--------------------------------------------------------------------------------

grid@anbob02:/home/grid> crsctl stat res -t -init
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       anbob02                STABLE
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       anbob02                STABLE
ora.crf
      1        ONLINE  ONLINE       anbob02                STABLE
ora.crsd
      1        ONLINE  ONLINE       anbob02                STABLE
ora.cssd
      1        ONLINE  ONLINE       anbob02                STABLE
ora.cssdmonitor
      1        ONLINE  ONLINE       anbob02                STABLE
ora.ctssd
      1        ONLINE  ONLINE       anbob02                OBSERVER,STABLE
ora.diskmon
      1        OFFLINE OFFLINE                               STABLE
ora.drivers.acfs
      1        ONLINE  ONLINE       anbob02                STABLE
ora.evmd
      1        ONLINE  ONLINE       anbob02                STABLE
ora.gipcd
      1        ONLINE  ONLINE       anbob02                STABLE
ora.gpnpd
      1        ONLINE  ONLINE       anbob02                STABLE
ora.mdnsd
      1        ONLINE  ONLINE       anbob02                STABLE
ora.storage
      1        ONLINE  ONLINE       anbob02                STABLE
--------------------------------------------------------------------------------

Note: 节点2上CRS 服务正常，只是MGMT, ASM, DB instance都未启动。

查看CLUSTER & ASM mode

grid@anbob01:/home/grid> asmcmd showclustermode
ASM cluster : Flex mode enabled

grid@anbob01:/home/grid> crsctl get cluster mode status
Cluster is running in "flex" mode


grid@anbob01:/home/grid> srvctl config asm
ASM home: 
Password file: +OCRDG/orapwASM
Backup of Password file: 
ASM listener: LISTENER
ASM instance count: 3
Cluster ASM listener: ASMNET1LSNR_ASM

Note: 当使用集群是FLEX Cluster和FLEX ASM 架构。关于FLEX不在本篇范围，这是一种新型RAC架构。

查看资源

grid@anbob01:/home/grid> srvctl start asm -n anbob02
PRCR-1013 : Failed to start resource ora.asm
PRCR-1064 : Failed to start resource ora.asm on node anbob02
CRS-2549: Resource 'ora.asm' cannot be placed on 'anbob02' as it is not a valid candidate as per the placement policy

 
grid@anbob01:/oracle/app/grid/crsdata> ps -ef|grep lsnr
grid     11141     1  0 15:04 ?        00:00:02 /oracle/app/12.2.0/grid/bin/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit
grid     11791     1  0 15:04 ?        00:00:00 /oracle/app/12.2.0/grid/bin/tnslsnr LISTENER_SCAN1 -no_crs_notify -inherit
grid     11855     1  0 15:04 ?        00:00:00 /oracle/app/12.2.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid     11860     1  0 15:04 ?        00:00:00 /oracle/app/12.2.0/grid/bin/tnslsnr MGMTLSNR -no_crs_notify -inherit


SQL>  SELECT s.inst_id, s.osuser, s.username, s.program, i.network_service_banner
  2  FROM gv$session s, gv$session_connect_info i
  3  WHERE s.sid = i.sid
  4  AND   s.inst_id = i.inst_id
  5  AND   s.program like 'crsd.bin%'
  6  AND   i.network_service_banner like '%Protocol%'
  7* ORDER BY 1

   INST_ID OSUSER               USERNAME             PROGRAM                                          NETWORK_SERVICE_BANNER
---------- -------------------- -------------------- ------------------------------------------------ ----------------------------------------
         1 root                 SYS                  crsd.bin@anbob01 (TNS V1-V3)                   Oracle Bequeath NT Protocol Adapter for
                                                                                                      Linux: Version 12.2.0.1.0 - Production

         1 root                 SYS                  crsd.bin@anbob02 (TNS V1-V3)                   TCP/IP NT Protocol Adapter for Linux: Ve
                                                                                                      rsion 12.2.0.1.0 - Production
 
SQL>select * from v$pwfile_users

USERNAME             SYSDB SYSOP SYSAS SYSBA SYSDG SYSKM ACCOUNT_STATUS                 PASSWORD_PROFILE     LAST_LOGIN           LOCK_DATE EXPIRY_DA EXTERNAL_NAME        AUTHENTI COM     CON_ID
-------------------- ----- ----- ----- ----- ----- ----- ------------------------------ -------------------- -------------------- --------- --------- -------------------- -------- --- ----------
SYS                  TRUE  TRUE  TRUE  FALSE FALSE FALSE OPEN                                                                                                              PASSWORD NO           0
CRSUSER__ASM_001     TRUE  FALSE TRUE  FALSE FALSE FALSE OPEN                                                                                                              PASSWORD NO           0
ASMSNMP              TRUE  FALSE FALSE FALSE FALSE FALSE OPEN                                                                                                              PASSWORD NO           0
ORACLE_001           TRUE  FALSE FALSE FALSE FALSE FALSE OPEN           


grid@anbob02:/home/grid> crsctl stat server -f
NAME=anbob02
MEMORY_SIZE=515676
CPU_COUNT=80
CPU_CLOCK_RATE=1899
CPU_HYPERTHREADING=1
CPU_EQUIVALENCY=1000
DEPLOYMENT=other
CONFIGURED_CSS_ROLE=hub
RESOURCE_USE_ENABLED=0    <<<<<<<
SERVER_LABEL=
PHYSICAL_HOSTNAME=
CSS_CRITICAL=no
CSS_CRITICAL_TOTAL=0
RESOURCE_TOTAL=0
SITE_NAME=anbob-cluster
STATE=ONLINE
ACTIVE_POOLS=Generic ora.iboss
STATE_DETAILS=
ACTIVE_CSS_ROLE=hub

Note: 手动启动报错，当前的RESOURCE_USE_ENABLED=0，表示禁用，该参数是一个server pool的资源管理参数。

解决方案

root@anbob02:/root> crsctl set resource use 1
CRS-4416: Server attribute 'RESOURCE_USE_ENABLED' successfully changed. Restart Oracle High Availability Services for new value to take effect.    

root@anbob02:/root> crsctl stop crs

root@anbob02:/root> crsctl start crs
CRS-4123: Oracle High Availability Services has been started.


root@anbob02:/root> crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCHDG.dg
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.DATADG.dg
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.MGMTDG.dg
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.OCRDG.dg
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.chad
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.net1.network
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
ora.ons
               ONLINE  ONLINE       anbob01                STABLE
               ONLINE  ONLINE       anbob02                STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       anbob01                STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       anbob01                169.254.53.162 192.1
                                                             68.60.35,STABLE
ora.asm
      1        ONLINE  ONLINE       anbob01                Started,STABLE
      2        ONLINE  ONLINE       anbob02                Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       anbob01                STABLE
ora.iboss.db
      1        ONLINE  ONLINE       anbob01                Open,HOME=/oracle/ap
                                                             p/oracle/product/12.
                                                             2.0/db_1,STABLE
      2        ONLINE  OFFLINE      anbob02                STARTING
ora.anbob01.vip
      1        ONLINE  ONLINE       anbob01                STABLE
ora.anbob02.vip
      1        ONLINE  ONLINE       anbob02                STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       anbob01                Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       anbob01                STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       anbob01                STABLE
--------------------------------------------------------------------------------       


grid@anbob02:/home/grid> crsctl stat server -f
...

NAME=anbob02
MEMORY_SIZE=515676
CPU_COUNT=80
CPU_CLOCK_RATE=1899
CPU_HYPERTHREADING=1
CPU_EQUIVALENCY=1000
DEPLOYMENT=other
CONFIGURED_CSS_ROLE=hub
RESOURCE_USE_ENABLED=1    
SERVER_LABEL=
PHYSICAL_HOSTNAME=
CSS_CRITICAL=no
CSS_CRITICAL_TOTAL=0
RESOURCE_TOTAL=0
SITE_NAME=anbob-cluster
STATE=ONLINE
ACTIVE_POOLS=Generic ora.iboss
STATE_DETAILS=
ACTIVE_CSS_ROLE=hub

NOTE:
修改参数 RESOURCE_USE_ENABLED=1，启用资源后，重启CRS恢复。该问题应该是安装PU 相关的BUG, 目前未知BUG ID, 稍后会更新。

打赏

clsr_start_resource:260 status:223, CRS-2549

目前这篇文章有2条评论(Rss)评论关闭。

SannyMit | #1
2018-12-07 at 14:40

Make a more new posts please 🙂
___
Sanny
nadian | #2
2018-11-16 at 17:14

FLEX Cluster和FLEX ASM 架构等待大神出介绍文章

上一篇： Troubleshooting ORA-21780 during SMON to clean transient type

下一篇：浅谈ORACLE免费数据库Oracle Database XE版

ANBOB™