Hello Gurus,
the disp+work process starts and then stops after a database restore from the production server to the DR server. I have checked every parameter i.e environmental variable, Registry, Host file and even ran the schema4sap schema repair tool specified in note 1294762. see the developer trace for the disp+work process below:-
---------------------------------------------------
trc file: "dev_disp", trc level: 1, release: "701"
---------------------------------------------------
sysno 00
sid SWP
systemid 562 (PC with Windows NT)
relno 7010
patchlevel 0
patchno 32
intno 20020600
make: multithreaded, Unicode, 64 bit, optimized
pid 4184
Mon Nov 02 10:32:40 2015
kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)
length of sys_adm_ext is 576 bytes
*** SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (00 4184) [dpxxdisp.c 1286]
shared lib "dw_xml.dll" version 32 successfully loaded
shared lib "dw_xtc.dll" version 32 successfully loaded
shared lib "dw_stl.dll" version 32 successfully loaded
shared lib "dw_gui.dll" version 32 successfully loaded
shared lib "dw_mdm.dll" version 32 successfully loaded
rdisp/softcancel_sequence : -> 0,5,-1
use internal message server connection to port 3900
Mon Nov 02 10:32:47 2015
*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 6 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5529]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: start server >SWPSAP_SWP_00 <
DpShMCreate: sizeof(wp_adm) 29792 (1752)
DpShMCreate: sizeof(tm_adm) 5912704 (29416)
DpShMCreate: sizeof(wp_ca_adm) 24064 (80)
DpShMCreate: sizeof(appc_ca_adm) 8000 (80)
DpCommTableSize: max/headSize/ftSize/tableSize=500/16/552064/552080
DpShMCreate: sizeof(comm_adm) 552080 (1088)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm) 0 (104)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm) 0 (72)
DpShMCreate: sizeof(vmc_adm) 0 (1864)
DpShMCreate: sizeof(wall_adm) (41664/36752/64/192)
DpShMCreate: sizeof(gw_adm) 48
DpShMCreate: SHM_DP_ADM_KEY (addr: 0000000007E10050, size: 6614144)
DpShMCreate: allocated sys_adm at 0000000007E10050
DpShMCreate: allocated wp_adm at 0000000007E12270
DpShMCreate: allocated tm_adm_list at 0000000007E196D0
DpShMCreate: allocated tm_adm at 0000000007E19730
DpShMCreate: allocated wp_ca_adm at 00000000083BCFB0
DpShMCreate: allocated appc_ca_adm at 00000000083C2DB0
DpShMCreate: allocated comm_adm at 00000000083C4CF0
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 000000000844B980
DpShMCreate: allocated gw_adm at 000000000844BA00
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 000000000844BA30
DpShMCreate: allocated wall_adm at 000000000844BA40
MBUF state OFF
DpCommInitTable: init table for 500 entries
Mon Nov 02 10:32:48 2015
rdisp/queue_size_check_value : -> off
ThTaskStatus: rdisp/reset_online_during_debug 0
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 4096 kByte.
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 4092 blocks reserved for free list.
ES initialized.
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1681]
***LOG Q0K=> DpMsAttach, mscon ( SWPSAP) [dpxxdisp.c 12483]
DpStartStopMsg: send start message (myname is >SWPSAP_SWP_00 <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 7010, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1048]
DpMsgAdmin: Set patchno for this platform to 32
Release check o.K.
Mon Nov 02 10:33:28 2015
my types changed after wp death/restart 0xbf --> 0xbe
my types changed after wp death/restart 0xbe --> 0xbc
my types changed after wp death/restart 0xbc --> 0xb8
my types changed after wp death/restart 0xb8 --> 0xb0
my types changed after wp death/restart 0xb0 --> 0xa0
my types changed after wp death/restart 0xa0 --> 0x80
*** DP_FATAL_ERROR => DpWPCheck: no more work processes
*** DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:38 2015
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long) Mon Nov 02 09:33:38 2015
========================
No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table
-------------------------------------------------------------------------------------------------------------------------------
0 DIA 6972 Ended no 1 0 0
1 DIA 6168 Ended no 1 0 0
2 DIA 7144 Ended no 1 0 0
3 DIA 6708 Ended no 1 0 0
4 DIA 6924 Ended no 1 0 0
5 DIA 5896 Ended no 1 0 0
6 DIA 6932 Ended no 1 0 0
7 DIA 824 Ended no 1 0 0
8 DIA 7048 Ended no 1 0 0
9 DIA 6156 Ended no 1 0 0
10 UPD 7072 Ended no 1 0 0
11 ENQ 4592 Ended no 1 0 0
12 BTC 5588 Ended no 1 0 0
13 BTC 6688 Ended no 1 0 0
14 BTC 7132 Ended no 1 0 0
15 SPO 4740 Ended no 1 0 0
16 UP2 6260 Ended no 1 0 0
Dispatcher Queue Statistics Mon Nov 02 09:33:38 2015
===========================
+------+--------+--------+--------+--------+--------+
| Typ | now | high | max | writes | reads |
+------+--------+--------+--------+--------+--------+
| NOWP | 0 | 2 | 2000 | 5 | 5 |
+------+--------+--------+--------+--------+--------+
| DIA | 5 | 5 | 2000 | 5 | 0 |
+------+--------+--------+--------+--------+--------+
| UPD | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| ENQ | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| BTC | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| SPO | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| UP2 | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
max_rq_id 12
wake_evt_udp_now 0
wake events total 8, udp 6 ( 75%), shm 2 ( 25%)
since last update total 8, udp 6 ( 75%), shm 2 ( 25%)
Dump of tm_adm structure: Mon Nov 02 09:33:38 2015
=========================
Term uid man user term lastop mod wp ta a/i (modes)
Workprocess Comm. Area Blocks Mon Nov 02 09:33:38 2015
=============================
Slots: 300, Used: 1, Max: 0
+------+--------------+----------+-------------+
| id | owner | pid | eyecatcher |
+------+--------------+----------+-------------+
| 0 | DISPATCHER | -1 | *WPCAAD000* |
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:43 2015
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >SWPSAP_SWP_00 < (normal)
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (6936) (SOFT_KILL)
Stop icman
killing process (7140) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives (PID:6936 HANDLE:936)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:44 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:6936 HANDLE:936)
wait for end of icman
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:45 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:46 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:47 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:48 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:49 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:50 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:51 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:52 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:53 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:54 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:7140 HANDLE:944)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1057
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Nov 02 10:33:55 2015
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:7140 HANDLE:944)
DpStartStopMsg: send stop message (myname is >SWPSAP_SWP_00 <)
DpStartStopMsg: Write AD_STARTSTOP message with type= 0, name=SWPSAP_SWP_00 , sapsysnr= 0, hostname=SWPSAP
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name -, type 4, key -
DpStartStopMsg: stop msg sent
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIRead: read for hdl 2 timed out (0ms)
DpHalt: no more messages from the message server
DpHalt: send keepalive to synchronize with the message server
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)
MsINiWrite: sent 114 bytes
send msg (len 110+4) to name MSG_SERVER, type 0, key -
MsSndName: MS_NOOP ok
Send 4 bytes to MSG_SERVER
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIPeek: peek successful for hdl 2 (r)
NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
Received 4 bytes from MSG_SERVER
Received opcode MS_NOOP from msg_server, reply MSOP_OK
MsOpReceive: ok
MsSendKeepalive : keepalive sent to message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
Mon Nov 02 10:33:56 2015
NiIPeek: peek for hdl 2 timed out (r; 1000ms)
NiIRead: read for hdl 2 timed out (1000ms)
DpHalt: no more messages from the message server
DpHalt: sync with message server o.k.
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12829]
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0
SiSelNSet: set events of sock 932 to: ---
NiBufISelRemove: remove hdl 2 from set0
SiSelNRemove: removed sock 932 (pos=2)
SiSelNRemove: removed sock 932
NiSelIRemove: removed hdl 2
MBUF state OFF
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/17
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 2 / sock 932
NiBufIClose: clear extension for hdl 2
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Es2Cleanup: Cleanup ES2
***LOG Q05=> DpHalt, DPStop ( 4184) [dpxxdisp.c 11045]
Good Bye .....
Thanks
Adeyinka