1. Get rid of all advertisements and get unlimited access to documents by upgrading to Premium Membership. Upgrade to Premium Now and also get a Premium Badge!

OC4J: Cannot start OC4J Instance

Discussion in 'Application Server (Weblogic Server, OC4J etc) & I' started by mzainal, May 12, 2010.

  1. mzainal

    mzainal Forum Advisor

    Messages:
    72
    Likes Received:
    0
    Trophy Points:
    130
    Hi,

    My development server have 8 OC4J instance. All can run except one call IIAS. Here is log from opmn.log:
    Code (Text):
    Operation: request (time out while waiting for a managed process to stop)
      ErrFile: /u01/app/oracle/product/10.1.3/oc4j_1/opmn/logs//External~LSMS_E~External~1.log

    10/05/12 11:37:25 [libopmnoc4j] Forcefully Terminating Process: External~LSMS_E~External~1 (717441049:13691)
    10/05/12 11:37:27 [pm-process] Process Stopped: Internal~LSMS~Internal~1 (717441043:13685)
    10/05/12 11:37:27 [pm-process] Process Stopped: External~LSMS_E~External~1 (717441049:13691)
    10/05/12 11:37:30 [internal] Logging disabled
    10/05/12 11:38:34 [ons-internal] ONS server initiated
    10/05/12 11:38:34 [pm-internal] PM state directory exists: /u01/app/oracle/product/10.1.3/oc4j_1/opmn/logs/states
    10/05/12 11:38:34 [pm-internal] OPMN server ready.  Request handling enabled.
    10/05/12 11:38:44 [pm-requests] Request 3 Started.  Command: /start?process-type=IIAS
    10/05/12 11:38:44 [pm-process] Starting Process: Internal~IIAS~Internal~1 (717441052:0)
    10/05/12 11:38:59 [libopmnoc4j] Host and Port information for port type default-web-site not sent by the OC4J process
    10/05/12 11:38:59 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: default-web-site
    10/05/12 11:38:59 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 717441052. Some of the reasons for the failure are:
     1. ajp, rmi and jms ports could not be bound by the process.
     2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
    10/05/12 11:38:59 [libopmnoc4j] Process Start Error: Internal~IIAS~Internal~1 (717441052:17670)
    10/05/12 11:38:59 [pm-process] Stopping Process: Internal~IIAS~Internal~1 (717441052:17670)
    10/05/12 11:38:59 [libopmnoc4j] Process Stop Error: Internal~IIAS~Internal~1 (717441052:17670)
    10/05/12 11:38:59 [libopmnoc4j] Failed to construct stop command for proc: 717441052
    10/05/12 11:38:59 [libopmnoc4j] Forcefully Terminating Process: Internal~IIAS~Internal~1 (717441052:17670)
    10/05/12 11:39:01 [pm-requests] Request 3 Completed. Command: /start?process-type=IIAS
    10/05/12 11:39:44 [pm-requests] Request 6 Started.  Command: /start?process-type=IIAS
    10/05/12 11:39:44 [pm-process] Starting Process: Internal~IIAS~Internal~1 (717441053:0)
    10/05/12 11:39:58 [libopmnoc4j] Host and Port information for port type default-web-site not sent by the OC4J process
    10/05/12 11:39:58 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: default-web-site
    10/05/12 11:39:58 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 717441053. Some of the reasons for the failure are:
     1. ajp, rmi and jms ports could not be bound by the process.
     2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
    10/05/12 11:39:58 [libopmnoc4j] Process Start Error: Internal~IIAS~Internal~1 (717441053:18007)
    10/05/12 11:39:59 [pm-process] Stopping Process: Internal~IIAS~Internal~1 (717441053:18007)
    10/05/12 11:39:59 [libopmnoc4j] Process Stop Error: Internal~IIAS~Internal~1 (717441053:18007)
    10/05/12 11:39:59 [libopmnoc4j] Failed to construct stop command for proc: 717441053
    10/05/12 11:39:59 [libopmnoc4j] Forcefully Terminating Process: Internal~IIAS~Internal~1 (717441053:18007)
    10/05/12 11:40:01 [pm-requests] Request 6 Completed. Command: /start?process-type=IIAS
    10/05/12 11:44:50 [pm-internal] OPMN server stopped.  Request handling disabled.
    10/05/12 11:44:50 [pm-requests] Request 8 Started.  Command: /reload
    10/05/12 11:44:51 [internal] Logging disabled
    10/05/12 11:44:51 [ons-internal] ONS server initiated
    10/05/12 11:44:51 [pm-internal] PM state directory exists: /u01/app/oracle/product/10.1.3/oc4j_1/opmn/logs/states
    10/05/12 11:44:51 [pm-internal] OPMN server ready.  Request handling enabled.
    10/05/12 11:45:14 [pm-requests] Request 3 Started.  Command: /start?process-type=IIAS
    10/05/12 11:45:14 [pm-process] Starting Process: Internal~IIAS~Internal~1 (717441054:0)
    10/05/12 11:45:30 [libopmnoc4j] Host and Port information for port type default-web-site not sent by the OC4J process
    10/05/12 11:45:30 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: default-web-site
    10/05/12 11:45:30 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 717441054. Some of the reasons for the failure are:
     1. ajp, rmi and jms ports could not be bound by the process.
     2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
    10/05/12 11:45:30 [libopmnoc4j] Process Start Error: Internal~IIAS~Internal~1 (717441054:18971)
    10/05/12 11:45:30 [pm-process] Stopping Process: Internal~IIAS~Internal~1 (717441054:18971)
    10/05/12 11:45:30 [libopmnoc4j] Process Stop Error: Internal~IIAS~Internal~1 (717441054:18971)
    10/05/12 11:45:30 [libopmnoc4j] Failed to construct stop command for proc: 717441054
    10/05/12 11:45:30 [libopmnoc4j] Forcefully Terminating Process: Internal~IIAS~Internal~1 (717441054:18971)
    10/05/12 11:45:32 [pm-requests] Request 3 Completed. Command: /start?process-type=IIAS
    10/05/12 11:49:50 [pm-requests] Request 5 Started.  Command: /start?process-type=IIAS
    10/05/12 11:49:50 [pm-process] Starting Process: Internal~IIAS~Internal~1 (717441055:0)
    10/05/12 11:50:05 [libopmnoc4j] Host and Port information for port type default-web-site not sent by the OC4J process
    10/05/12 11:50:05 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: default-web-site
    10/05/12 11:50:05 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 717441055. Some of the reasons for the failure are:
     1. ajp, rmi and jms ports could not be bound by the process.
     2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
    10/05/12 11:50:05 [libopmnoc4j] Process Start Error: Internal~IIAS~Internal~1 (717441055:19799)
    10/05/12 11:50:06 [pm-process] Stopping Process: Internal~IIAS~Internal~1 (717441055:19799)
    10/05/12 11:50:06 [libopmnoc4j] Process Stop Error: Internal~IIAS~Internal~1 (717441055:19799)
    10/05/12 11:50:06 [libopmnoc4j] Failed to construct stop command for proc: 717441055
    10/05/12 11:50:06 [libopmnoc4j] Forcefully Terminating Process: Internal~IIAS~Internal~1 (717441055:19799)
    10/05/12 11:50:08 [pm-requests] Request 5 Completed. Command: /start?process-type=IIAS
    10/05/12 11:55:08 [pm-requests] Request 7 Started.  Command: /start?process-type=IIAS
    10/05/12 11:55:08 [pm-process] Starting Process: Internal~IIAS~Internal~1 (717441056:0)
    10/05/12 11:55:23 [libopmnoc4j] Host and Port information for port type default-web-site not sent by the OC4J process
    10/05/12 11:55:23 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: default-web-site
    10/05/12 11:55:23 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 717441056. Some of the reasons for the failure are:
     1. ajp, rmi and jms ports could not be bound by the process.
     2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
    10/05/12 11:55:23 [libopmnoc4j] Process Start Error: Internal~IIAS~Internal~1 (717441056:21013)
    10/05/12 11:55:23 [pm-process] Stopping Process: Internal~IIAS~Internal~1 (717441056:21013)
    10/05/12 11:55:23 [libopmnoc4j] Process Stop Error: Internal~IIAS~Internal~1 (717441056:21013)
    10/05/12 11:55:23 [libopmnoc4j] Failed to construct stop command for proc: 717441056
    10/05/12 11:55:23 [libopmnoc4j] Forcefully Terminating Process: Internal~IIAS~Internal~1 (717441056:21013)
    10/05/12 11:55:25 [pm-requests] Request 7 Completed. Command: /start?process-type=IIAS
    10/05/12 11:57:24 [pm-internal] OPMN server stopped.  Request handling disabled.
    10/05/12 11:57:24 [pm-requests] Request 9 Started.  Command: /reload
    10/05/12 11:57:25 [internal] Logging disabled
    10/05/12 11:57:26 [ons-internal] ONS server initiated
    10/05/12 11:57:26 [pm-internal] PM state directory exists: /u01/app/oracle/product/10.1.3/oc4j_1/opmn/logs/states
    10/05/12 11:57:26 [pm-internal] OPMN server ready.  Request handling enabled.
    10/05/12 11:57:28 [pm-requests] Request 3 Started.  Command: /start?process-type=IIAS
    10/05/12 11:57:28 [pm-process] Starting Process: Internal~IIAS~Internal~1 (717441057:0)
    10/05/12 11:57:43 [libopmnoc4j] Host and Port information for port type default-web-site not sent by the OC4J process
    10/05/12 11:57:43 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: default-web-site
    10/05/12 11:57:43 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 717441057. Some of the reasons for the failure are:
     1. ajp, rmi and jms ports could not be bound by the process.
     2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
    10/05/12 11:57:43 [libopmnoc4j] Process Start Error: Internal~IIAS~Internal~1 (717441057:21823)
    10/05/12 11:57:43 [pm-process] Stopping Process: Internal~IIAS~Internal~1 (717441057:21823)
    10/05/12 11:57:43 [libopmnoc4j] Process Stop Error: Internal~IIAS~Internal~1 (717441057:21823)
    10/05/12 11:57:43 [libopmnoc4j] Failed to construct stop command for proc: 717441057
    10/05/12 11:57:43 [libopmnoc4j] Forcefully Terminating Process: Internal~IIAS~Internal~1 (717441057:21823)
    10/05/12 11:57:45 [pm-requests] Request 3 Completed. Command: /start?process-type=IIAS
     
    This is from debug mode:
    Code (Text):
    10/05/12 11:57:28 [libopmnoc4j] cmd[30]: oc4j.jar
    10/05/12 11:57:28 [libopmnoc4j] cmd[31]: -config
    10/05/12 11:57:28 [libopmnoc4j] cmd[32]: /u01/app/oracle/product/10.1.3/oc4j_1/j2ee/IIAS/config/server.xml
    10/05/12 11:57:28 [libopmnoc4j] cmd[33]: -properties
    10/05/12 11:57:28 [libopmnoc4j] cmd[34]: -ports
    10/05/12 11:57:28 [libopmnoc4j] cmd[35]: default-web-site:ajp:12510,rmi:12410,rmis:12701,jms:12610
    10/05/12 11:57:28 [libopmnoc4j] env[0]: TMP=/tmp
    10/05/12 11:57:28 [libopmnoc4j] env[1]: ORACLE_HOME=/u01/app/oracle/product/10.1.3/oc4j_1
    10/05/12 11:57:28 [libopmnoc4j] env[2]: ORACLE_CONFIG_HOME=/u01/app/oracle/product/10.1.3/oc4j_1
    10/05/12 11:57:28 [libopmnoc4j] env[3]: ORA_NLS33=/u01/app/oracle/product/10.1.3/oc4j_1/ocommon/nls/admin/data
    10/05/12 11:57:28 [libopmnoc4j] env[4]: LANG=en_US.UTF-8
    10/05/12 11:57:28 [libopmnoc4j] env[5]: NLS_LANG=AMERICAN_AMERICA.WE8MSWIN1252
    10/05/12 11:57:28 [libopmnoc4j] env[6]: SHELL=/bin/bash
    10/05/12 11:57:28 [libopmnoc4j] env[7]: LD_LIBRARY_PATH=/u01/app/oracle/product/10.1.3/oc4j_1/opmn/lib:/u01/app/oracle/product/10.1.3/oc4j_1/lib
    10/05/12 11:57:28 [libopmnoc4j] env[8]: X_LD_LIBRARY_PATH_64=/u01/app/oracle/product/10.1.3/oc4j_1/lib
    10/05/12 11:57:28 [libopmnoc4j] Start executed successfully for proc: 717441057
    10/05/12 11:57:28 [pm-scheduler] job completed Proc 717441057:21823 Job 3:1 (start)
    10/05/12 11:57:28 [pm-scheduler] job done Proc 717441057:21823 [start/Init] Job 3:1 (start)
    10/05/12 11:57:28 [pm-workers] Worker ddbba0 waiting
    10/05/12 11:57:28 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:28 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:28 [pm-process] Proc 717441057:21823 saved
    10/05/12 11:57:28 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:28 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:29 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:29 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:29 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:29 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:31 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:31 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:31 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:31 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:33 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:33 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:33 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:33 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:35 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:35 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:35 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:35 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:37 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:37 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:37 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:37 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:39 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:39 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:39 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:39 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:41 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:41 [pm-monitor] Proc 717441057:21823 Start status: Init
    10/05/12 11:57:41 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:41 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:43 [pm-scheduler] Proc 717441057:21823 notify scheduled (827aa08)
    10/05/12 11:57:43 [pm-workers] Worker 1b5ba0 process Job 0:0 (notify) for Module libopmnoc4j
    10/05/12 11:57:43 [libopmnoc4j] Received notification from proc: 717441057
    10/05/12 11:57:43 [pm-scheduler] job completed Job 0:0 (notify)
    10/05/12 11:57:43 [pm-scheduler] Proc 717441057:21823 notify completed (827aa08)
    10/05/12 11:57:43 [pm-workers] Worker 1b5ba0 waiting
    10/05/12 11:57:43 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:43 [pm-monitor] Proc 717441057:21823 Start->InitFail->Stop
    10/05/12 11:57:43 [pm-scheduler] job new Proc 717441057:21823 (stop)
    10/05/12 11:57:43 [pm-process] Proc 717441057:21823 saved
    10/05/12 11:57:43 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:43 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:43 [pm-scheduler] job worker Proc 717441057:21823 Job 3:2 (stop)
    10/05/12 11:57:43 [pm-workers] Worker ddbba0 process Job 3:2 (stop) for Module libopmnoc4j
    10/05/12 11:57:43 [libopmnoc4j] Stop command has been issued for proc: 717441057
    10/05/12 11:57:43 [libopmnoc4j] Stopping proc: 717441057 using the OC4J stop command
    10/05/12 11:57:43 [pm-scheduler] job completed Proc 717441057:21823 Job 3:2 (stop)
    10/05/12 11:57:43 [pm-scheduler] job done Proc 717441057:21823 [start/Stop] Job 3:2 (stop)
    10/05/12 11:57:43 [pm-workers] Worker ddbba0 waiting
    10/05/12 11:57:43 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:43 [pm-monitor] Proc 717441057:21823 Start status: Stop
    10/05/12 11:57:43 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:43 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:45 [pm-scheduler] set monitor Proc 717441057:21823
    10/05/12 11:57:45 [pm-scheduler] request completed Proc 717441057:21823 Http 3
    10/05/12 11:57:45 [pm-scheduler] Http 3 for Proc 717441057:21823 request completed
    10/05/12 11:57:45 [pm-scheduler] Http 3 request completed
    10/05/12 11:57:45 [pm-scheduler] releasedHttp 3
    10/05/12 11:57:45 [pm-requests] Http 3 sync request sending response
    10/05/12 11:57:45 [pm-monitor] Proc 717441057:21823 Start->Dead: maxretry
    10/05/12 11:57:45 [pm-requests] Http 3 sent response: HTTP/1.1 204 No Content
    Content-Length: 739
    Content-Type: text/html
    Response: 0 of 1 processes started.


    10/05/12 11:57:45 [pm-requests] Http 3 request freed
    10/05/12 11:57:45 [pm-process] Unlinked proc file: /u01/app/oracle/product/10.1.3/oc4j_1/opmn/logs/states/p717441057
    10/05/12 11:57:45 [pm-scheduler] clear monitor Proc 717441057:21823
    10/05/12 11:57:45 [pm-scheduler] check pending jobs Proc 717441057:21823
    10/05/12 11:57:45 [pm-scheduler] job worker Proc 717441057:21823 Job 0:21d03be (comp)
    10/05/12 11:57:45 [pm-workers] Worker 1b5ba0 process Job 0:21d03be (comp) for Module libopmnoc4j
    10/05/12 11:57:45 [libopmnoc4j] Private resources are being released for proc: 717441057 as it has completed
    10/05/12 11:57:45 [pm-scheduler] job completed Proc 717441057:21823 Job 0:21d03be (comp)
    10/05/12 11:57:45 [pm-scheduler] job done Proc 717441057:21823 [start/Stopped] Job 0:21d03be (comp)
    10/05/12 11:57:45 [pm-workers] Worker 1b5ba0 waiting
    10/05/12 11:57:45 [pm-monitor] sched COMPPROC for Proc 717441057:21823
    10/05/12 11:57:45 [pm-process] Proc 717441057:21823 freed
     
    Please assist me. Do anyone have issue like me?

    Regards,
    MzarM.
     
  2. mzainal

    mzainal Forum Advisor

    Messages:
    72
    Likes Received:
    0
    Trophy Points:
    130
    Solutio:

    Delete all file in directory $ORACLE_HOME/j2ee/<instance name>/persistance/*