1. Get rid of all advertisements and get unlimited access to documents by upgrading to Premium Membership. Upgrade to Premium Now and also get a Premium Badge!

RAC - Oracle Grid Infrastructure Configure failed

Discussion in 'Installation - Unix and Unix Like' started by nazeemodba, Feb 15, 2011.

  1. nazeemodba

    nazeemodba Guest

    Hi, am trying to install 2 node RAC on Oracle VMs. Before the installation during the -preinst check there were few issues which were resolved (ex user equivalence). After that during the installation process of the Grid it failed at step "Configure Oracle Grid Infrastructure for a cluster". After it failed at this step, subsequent steps too failed which I asked OUI to ignore and then I ran both the post installation scripts. And then ran post crsinst which failed. Pasting below the output of the root.sh script, post crsinst and other checks.

    *************************************

    [root@bsfrac01 grid]# sh root.sh
    Running Oracle 11g root.sh script...

    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2/grid

    Enter the full pathname of the local bin directory: [/usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...


    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2011-02-13 00:11:55: Parsing the host name
    2011-02-13 00:11:55: Checking for super user privileges
    2011-02-13 00:11:55: User has super user privileges
    Using configuration parameter file: /u01/app/11.2/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-2672: Attempting to start 'ora.gipcd' on 'bsfrac01'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'bsfrac01'
    CRS-2676: Start of 'ora.mdnsd' on 'bsfrac01' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'bsfrac01'
    CRS-2676: Start of 'ora.gpnpd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'bsfrac01'
    CRS-2676: Start of 'ora.cssdmonitor' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'bsfrac01'
    CRS-2672: Attempting to start 'ora.diskmon' on 'bsfrac01'
    CRS-2676: Start of 'ora.diskmon' on 'bsfrac01' succeeded
    CRS-2676: Start of 'ora.cssd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'bsfrac01'
    CRS-2676: Start of 'ora.ctssd' on 'bsfrac01' succeeded

    ASM created and started successfully.

    DiskGroup DATA1 created successfully.

    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    CRS-2672: Attempting to start 'ora.crsd' on 'bsfrac01'
    CRS-2676: Start of 'ora.crsd' on 'bsfrac01' succeeded
    CRS-4256: Updating the profile
    Successful addition of voting disk 0ea2052d8a714fd7bf46d9d5c785483e.
    Successfully replaced voting disk group with +DATA1.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    --


    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------
    ---------
    1. ONLINE 0ea2052d8a714fd7bf46d9d5c785483e (ORCL:DISK1) [DATA1]
    Located 1 voting disk(s).
    Failed to rmtcopy "/tmp/filekRIMbG" to "/u01/app/11.2/grid/gpnp/manifest.txt" for nodes {bsfrac01,bsfrac02}, rc=256
    Failed to rmtcopy "/u01/app/11.2/grid/gpnp/bsfrac01/profiles/peer/profile.xml" to "/u01/app/11.2/grid/gpnp/profiles/peer/profile.xml" for nodes {bsfrac01,bsfrac02}, rc=256
    rmtcopy aborted
    Failed to promote local gpnp setup to other cluster nodes
    CRS-2673: Attempting to stop 'ora.crsd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.crsd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'bsfrac01'
    CRS-2677: Stop of 'ora.asm' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.ctssd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'bsfrac01'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.cssd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.gpnpd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.gipcd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.mdnsd' on 'bsfrac01' succeeded
    Initial cluster configuration failed. See /u01/app/11.2/grid/cfgtoollogs/crsconfig/rootcrs_bsfrac01.log for details
    [root@bsfrac01 grid]#

    ***************************************
    [oracle@bsfrac01 bin]$ ./cluvfy stage -post crsinst -n bsfrac01,bsfrac02 -verbose

    Performing post-checks for cluster services setup

    Checking node reachability...

    Check: Node reachability from node "bsfrac01"
    Destination Node Reachable?


    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------
    bsfrac01 yes
    bsfrac02 yes
    Result: Node reachability check passed from node "bsfrac01"

    Checking user equivalence...

    Check: User equivalence for user "oracle"
    Node Name Comment


    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------
    bsfrac01 passed
    bsfrac02 passed
    Result: User equivalence check passed for user "oracle"

    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    Checking time zone consistency...
    Time zone consistency check passed.

    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}

    ERROR:
    Cluster manager integrity check failed
    PRVF-5434 : Cannot identify the current CRS software version

    UDev attributes check for OCR locations started...
    Result: UDev attributes check passed for OCR locations

    UDev attributes check for Voting Disk locations started...

    ERROR:
    PRVF-5197 : Failed to retrieve voting disk locationsPRKC-1092 : Failed to retrieve the location of votedisks: java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found

    Result: UDev attributes check failed for Voting Disk locations


    Check default user file creation mask
    Node Name Available Required Comment


    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------
    bsfrac01 0022 0022 passed
    bsfrac02 0022 0022 passed
    Result: Default user file creation mask check passed

    Checking cluster integrity...

    Node Name
    --------------------------------------------------------------------------------
    bsfrac01

    Cluster integrity check failed This check did not run on the following node(s):
    bsfrac02

    Checking OCR integrity...

    Checking the absence of a non-clustered configuration...
    All nodes free of non-clustered, local-only configurations


    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}

    ERROR:
    PRVF-5300 : Failed to retrieve active version for CRS on this node

    OCR integrity check failed

    Checking CRS integrity...

    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}

    ERROR:
    PRVF-5300 : Failed to retrieve active version for CRS on this node

    CRS integrity check failed
    OCR detected on ASM. Running ACFS Integrity checks...

    Starting check to see if ASM is running on all cluster nodes...
    PRVF-5137 : Failure while checking ASM status on node "bsfrac01"
    PRVF-5137 : Failure while checking ASM status on node "bsfrac02"

    Starting Disk Groups check to see if at least one Disk Group configured...
    PRVF-5112 : An Exception occurred while checking for Disk Groups
    PRVF-5114 : Disk Group check failed. No Disk Groups configured

    Task ACFS Integrity check failed

    Checking Oracle Cluster Voting Disk configuration...

    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}

    ERROR:
    PRVF-5434 : Cannot identify the current CRS software version

    PRVF-5431 : Oracle Cluster Voting Disk configuration check failed

    Checking to make sure user "oracle" is not in "root" group
    Node Name Status Comment


    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------

    --------------------------------------------------------------------------------
    bsfrac01 does not exist passed
    bsfrac02 does not exist passed
    Result: User "oracle" is not part of "root" group. Check passed

    Post-check for cluster services setup was unsuccessful on all the nodes.

    *******************
    [oracle@bsfrac01 bin]$ /u01/app/11.2/grid/bin/ocrcheck
    Status of Oracle Cluster Registry is as follows :
    Version : 3
    Total space (kbytes) : 262120
    Used space (kbytes) : 408
    Available space (kbytes) : 261712
    ID : 1671840043
    Device/File Name : +DATA1
    Device/File integrity check succeeded

    Device/File not configured

    Device/File not configured

    Device/File not configured

    Device/File not configured

    Cluster registry integrity check succeeded

    Logical corruption check bypassed due to non-privileged user

    *******************************
    ASM looks to be up and running..

    [oracle@bsfrac01 bin]$ /usr/sbin/oracleasm listdisks
    DISK1
    DISK2
    DISK3
    DISK4
    DISK5
    DISK6
    [oracle@bsfrac01 bin]$ /usr/sbin/oracleasm status
    Checking if ASM is loaded: yes
    Checking if /dev/oracleasm is mounted: yes

    ******************************

    Please help.
     
  2. zargon

    zargon Community Moderator Forum Guru

    Messages:
    2,347
    Likes Received:
    348
    Trophy Points:
    1,430
    Location:
    Aurora, CO
    Your installation failed to configure Grid for the cluster and you ignored this and other pertintent errors yet expect the installation to work? Note the following errors:

    Checking Oracle Cluster Voting Disk configuration...

    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}

    ERROR:
    PRVF-5434 : Cannot identify the current CRS software version

    PRVF-5431 : Oracle Cluster Voting Disk configuration check failed

    These are fatal errors for a RAC installation, most likely tied to the errors you told the OUI to ignore. You will need to fix what is wrong (we don't know what that is because you did not post the errors you ignored during installation) then re-install the software ensuring that the errors you ignored do not come up again.