Thread 19 has used more CPU time than any other thread (19 minutes), but is
currently idle. The fact that it is a .Net thread implies that your problem
is likely a bug on an ASP.Net page (or a problem w/some .Net code, etc.).
You will need to run IISState while the problem is happening to get a good
log of the issue.
Pat
"Joe Callaghan" <joecallaghan DeleteThis @lavache.com> wrote in message
news:fd122be4.0408060709.3b51c277@posting.google.com...
> We have recently experienced very poor performance on our Windows 2003
> Web Server. On investigation, we found that the w3wp process was
> running at around 90% of cpu. I downloaded and ran the iisstate
> utility as suggested, but I cannot make any sense of the output. I
> would be grateful if someone could comment. See below for iisstate
> output.
>
> Thanks in advance.
>
> Opened log file 'C:\iisstate\output\IISState-3684.log'
>
> ***********************
> Starting new log output
> IISState version 3.3.1
>
> Fri Aug 06 15:51:59 2004
>
> OS = Windows 2003 Server
> Executable: w3wp.exe
> PID = 3684
>
> Note: Thread times are formatted as HH:MM:SS.ms
>
> ***********************
>
>
>
>
> Thread ID: 0
> System Thread ID: e68
> Kernel Time: 0:0:0.46
> User Time: 0:0:0.31
> Thread Type: HTTP Compression Thread
> # ChildEBP RetAddr
> 00 0006fe58 77f43741 SharedUserData!SystemCallStub+0x4
> 01 0006fe5c 77e41817 ntdll!ZwWaitForSingleObject+0xc
> 02 0006fecc 77e4168f kernel32!WaitForSingleObjectEx+0xac
> 03 0006fedc 5a3635ae kernel32!WaitForSingleObject+0xf
> 04 0006feec 5a364d7d w3dt!WP_CONTEXT::RunMainThreadLoop+0xe
> 05 0006fef4 5a3a1d98 w3dt!UlAtqStartListen+0x2d
> 06 0006ff00 5a3a5d54 w3core!W3_SERVER::StartListen+0x8e
> 07 0006ff0c 010017af w3core!UlW3Start+0xea
> 08 0006ff44 0100195e w3wp!wmain+0x236
> 09 0006ffc0 77e4f38c w3wp!wmainCRTStartup+0x12f
> 0a 0006fff0 00000000 kernel32!BaseProcessStart+0x23
>
>
>
>
> Thread ID: 1
> System Thread ID: e70
> Kernel Time: 0:0:0.62
> User Time: 0:0:0.15
> Thread Type: Other
> # ChildEBP RetAddr
> 00 009bff9c 77f4262b SharedUserData!SystemCallStub+0x4
> 01 009bffa0 77f6b5b2 ntdll!NtDelayExecution+0xc
> 02 009bffb8 77e4a990 ntdll!RtlpTimerThread+0x45
> 03 009bffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 2
> System Thread ID: e80
> Kernel Time: 0:0:0.78
> User Time: 0:0:0.93
> Thread Type: HTTP Listener
> # ChildEBP RetAddr
> 00 00c6ff28 77f430c7 SharedUserData!SystemCallStub+0x4
> 01 00c6ff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
> 02 00c6ff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
> 03 00c6ff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
> 04 00c6ffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
> 05 00c6ffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
> 06 00c6ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 3
> System Thread ID: e84
> Kernel Time: 0:0:0.46
> User Time: 0:0:0.15
> Thread Type: HTTP Listener
> # ChildEBP RetAddr
> 00 00caff28 77f430c7 SharedUserData!SystemCallStub+0x4
> 01 00caff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
> 02 00caff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
> 03 00caff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
> 04 00caffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
> 05 00caffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
> 06 00caffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 4
> System Thread ID: e88
> Kernel Time: 0:0:0.93
> User Time: 0:0:0.109
> Thread Type: HTTP Listener
> # ChildEBP RetAddr
> 00 00ceff28 77f430c7 SharedUserData!SystemCallStub+0x4
> 01 00ceff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
> 02 00ceff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
> 03 00ceff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
> 04 00ceffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
> 05 00ceffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
> 06 00ceffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 5
> System Thread ID: e8c
> Kernel Time: 0:0:0.218
> User Time: 0:0:0.234
> Thread Type: HTTP Listener
> # ChildEBP RetAddr
> 00 00d2ff28 77f430c7 SharedUserData!SystemCallStub+0x4
> 01 00d2ff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
> 02 00d2ff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
> 03 00d2ff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
> 04 00d2ffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
> 05 00d2ffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
> 06 00d2ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 6
> System Thread ID: e90
> Kernel Time: 0:0:0.31
> User Time: 0:0:0.0
> Thread Status: Thread is in a WAIT state.
> Thread Type: Other
> # ChildEBP RetAddr
> 00 00defcec 77f4372d SharedUserData!SystemCallStub+0x4
> 01 00defcf0 77f75297 ntdll!NtWaitForMultipleObjects+0xc
> 02 00deffb8 77e4a990 ntdll!RtlpWaitThread+0x158
> 03 00deffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 7
> System Thread ID: e94
> Kernel Time: 0:0:0.0
> User Time: 0:0:0.0
> Thread Type: HTTP Compression Thread
> # ChildEBP RetAddr
> 00 016aff14 77f43741 SharedUserData!SystemCallStub+0x4
> 01 016aff18 77e41817 ntdll!ZwWaitForSingleObject+0xc
> 02 016aff88 77e4168f kernel32!WaitForSingleObjectEx+0xac
> 03 016aff98 5a3a51f7 kernel32!WaitForSingleObject+0xf
> 04 016affb8 77e4a990 w3core!HTTP_COMPRESSION::CompressionThread+0x85
> 05 016affc4 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 8
> System Thread ID: e9c
> Kernel Time: 0:0:0.0
> User Time: 0:0:0.0
> Thread Type: Other
> # ChildEBP RetAddr
> 00 0172ff8c 77f4262b SharedUserData!SystemCallStub+0x4
> 01 0172ff90 77f6f0fc ntdll!NtDelayExecution+0xc
> 02 0172ffb8 77e4a990 ntdll!RtlpIOWorkerThread+0x3d
> 03 0172ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 9
> System Thread ID: eb0
> Kernel Time: 0:0:0.62
> User Time: 0:0:0.31
> Thread Type: Managed Thread. Possible ASP.Net page or other .Net
> worker
>
>
> Unable to locate .Net Framework 1.1
>
> # ChildEBP RetAddr
> 00 0182fee4 77f4262b SharedUserData!SystemCallStub+0x4
> 01 0182fee8 77e418ea ntdll!NtDelayExecution+0xc
> 02 0182ff50 77e416ee kernel32!SleepEx+0x68
> 03 0182ff5c 792e9ebe kernel32!Sleep+0xb
> 04 0182ffb8 77e4a990 mscorwks!ThreadpoolMgr::GateThreadStart+0x54
> 05 0182ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 10
> System Thread ID: eb4
> Kernel Time: 0:4:38.218
> User Time: 0:20:36.234
> Thread Type: Other
> # ChildEBP RetAddr
> 00 0186f71c 77f43741 SharedUserData!SystemCallStub+0x4
> 01 0186f720 71b23988 ntdll!ZwWaitForSingleObject+0xc
> 02 0186f75c 71b2b13e mswsock!SockWaitForSingleObject+0x38
> 03 0186f7d4 71c0fdf1 mswsock!WSPRecv+0x1f0
> 04 0186f81c 018fb077 WS2_32!recv+0x81
> WARNING: Frame IP not in any known module. Following frames may be
> wrong.
> 05 00002000 00000000 0x18fb077
>
>
>
>
> Thread ID: 11
> System Thread ID: eb8
> Kernel Time: 0:0:0.0
> User Time: 0:0:0.0
> Thread Status: Thread is in a WAIT state.
> Thread Type: Managed Thread. Possible ASP.Net page or other .Net
> worker
>
>
> Unable to locate .Net Framework 1.1
>
> # ChildEBP RetAddr
> 00 0196fe74 77f4372d SharedUserData!SystemCallStub+0x4
> 01 0196fe78 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
> 02 0196ff20 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
> 03 0196ff38 791d25d5 kernel32!WaitForMultipleObjects+0x17
> 04 0196ffa0 791d254c mscorwks!DebuggerRCThread::MainLoop+0x90
> 05 0196ffb0 791d4d50 mscorwks!DebuggerRCThread::ThreadProc+0x68
> 06 0196ffb8 77e4a990 mscorwks!DebuggerRCThread::ThreadProcStatic+0xb
> 07 0196ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 12
> System Thread ID: ebc
> Kernel Time: 0:0:0.453
> User Time: 0:0:1.937
> Thread Type: Managed Thread. Possible ASP.Net page or other .Net
> worker
>
>
> Unable to locate .Net Framework 1.1
>
> # ChildEBP RetAddr
> 00 01a4fedc 77f43741 SharedUserData!SystemCallStub+0x4
> 01 01a4fee0 77e41817 ntdll!ZwWaitForSingleObject+0xc
> 02 01a4ff50 77e4168f kernel32!WaitForSingleObjectEx+0xac
> 03 01a4ff60 79262a32 kernel32!WaitForSingleObject+0xf
> 04 01a4ff74 791bbea4 mscorwks!WaitForFinalizerEvent+0x2d
> 05 01a4ffb8 77e4a990 mscorwks!GCHeap::FinalizerThreadStart+0x96
> 06 01a4ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 13
> System Thread ID: ec4
> Kernel Time: 0:0:0.31
> User Time: 0:0:0.109
> Thread Type: Managed Thread. Possible ASP.Net page or other .Net
> worker
>
>
> Unable to locate .Net Framework 1.1
>
> # ChildEBP RetAddr
> 00 01dcff38 77f4262b SharedUserData!SystemCallStub+0x4
> 01 01dcff3c 77e418ea ntdll!NtDelayExecution+0xc
> 02 01dcffa4 792ea483 kernel32!SleepEx+0x68
> 03 01dcffb8 77e4a990 mscorwks!ThreadpoolMgr::TimerThreadStart+0x30
> 04 01dcffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 14
> System Thread ID: f04
> Kernel Time: 0:4:12.250
> User Time: 0:19:25.203
> Thread Type: Managed Thread. Possible ASP.Net page or other .Net
> worker
>
>
> Unable to locate .Net Framework 1.1
>
> # ChildEBP RetAddr
> 00 088bff10 77f43741 SharedUserData!SystemCallStub+0x4
> 01 088bff14 77e41817 ntdll!ZwWaitForSingleObject+0xc
> 02 088bff84 77e4168f kernel32!WaitForSingleObjectEx+0xac
> 03 088bff94 792e91e0 kernel32!WaitForSingleObject+0xf
> 04 088bffb8 77e4a990 mscorwks!ThreadpoolMgr::WorkerThreadStart+0x3a
> 05 088bffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 15
> System Thread ID: ffc
> Kernel Time: 0:3:10.140
> User Time: 0:13:33.15
> Thread Type: Other
> # ChildEBP RetAddr
> 00 08d9f71c 77f43741 SharedUserData!SystemCallStub+0x4
> 01 08d9f720 71b23988 ntdll!ZwWaitForSingleObject+0xc
> 02 08d9f75c 71b2b13e mswsock!SockWaitForSingleObject+0x38
> 03 08d9f7d4 71c0fdf1 mswsock!WSPRecv+0x1f0
> 04 08d9f81c 018fb077 WS2_32!recv+0x81
> WARNING: Frame IP not in any known module. Following frames may be
> wrong.
> 05 00002000 00000000 0x18fb077
>
>
>
>
> Thread ID: 16
> System Thread ID: d78
> Kernel Time: 0:0:0.0
> User Time: 0:0:0.0
> Thread Type: Possible ASP page. Possible DCOM activity
> Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
> Continuing with other analysis.
>
> No remote call being made
>
> # ChildEBP RetAddr
> 00 08effe20 77f4313f SharedUserData!SystemCallStub+0x4
> 01 08effe24 77c52555 ntdll!NtReplyWaitReceivePortEx+0xc
> 02 08efff8c 77c65159 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
> 03 08efff90 77c650a1 RPCRT4!RecvLotsaCallsWrapper+0x9
> 04 08efffb0 77c65187 RPCRT4!BaseCachedThreadRoutine+0x9c
> 05 08efffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
> 06 08efffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 17
> System Thread ID: a64
> Kernel Time: 0:1:12.187
> User Time: 0:5:40.593
> Thread Type: Other
> # ChildEBP RetAddr
> 00 00a6f71c 77f43741 SharedUserData!SystemCallStub+0x4
> 01 00a6f720 71b23988 ntdll!ZwWaitForSingleObject+0xc
> 02 00a6f75c 71b2b13e mswsock!SockWaitForSingleObject+0x38
> 03 00a6f7d4 71c0fdf1 mswsock!WSPRecv+0x1f0
> 04 00a6f81c 018fb077 WS2_32!recv+0x81
> WARNING: Frame IP not in any known module. Following frames may be
> wrong.
> 05 00002000 00000000 0x18fb077
>
>
>
>
> Thread ID: 18
> System Thread ID: bc8
> Kernel Time: 0:0:0.0
> User Time: 0:0:0.0
> Thread Type: Other
> # ChildEBP RetAddr
> 00 08f9ff70 77f430c7 SharedUserData!SystemCallStub+0x4
> 01 08f9ff74 77f7e6ae ntdll!ZwRemoveIoCompletion+0xc
> 02 08f9ffb8 77e4a990 ntdll!RtlpWorkerThread+0x3b
> 03 08f9ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 19
> System Thread ID: 878
> Kernel Time: 0:0:37.453
> User Time: 0:3:9.62
> Thread Type: Managed Thread. Possible ASP.Net page or other .Net
> worker
>
>
> Unable to locate .Net Framework 1.1
>
> # ChildEBP RetAddr
> 00 08e5ff10 77f43741 SharedUserData!SystemCallStub+0x4
> 01 08e5ff14 77e41817 ntdll!ZwWaitForSingleObject+0xc
> 02 08e5ff84 77e4168f kernel32!WaitForSingleObjectEx+0xac
> 03 08e5ff94 792e91e0 kernel32!WaitForSingleObject+0xf
> 04 08e5ffb8 77e4a990 mscorwks!ThreadpoolMgr::WorkerThreadStart+0x3a
> 05 08e5ffec 00000000 kernel32!BaseThreadStart+0x34
>
>
>
>
> Thread ID: 20
> System Thread ID: 3a0
> Kernel Time: 0:0:0.0
> User Time: 0:0:0.0
> Thread Type: Other
> # ChildEBP RetAddr
> 00 019dff70 77f430c7 SharedUserData!SystemCallStub+0x4
> 01 019dff74 77f7e6ae ntdll!ZwRemoveIoCompletion+0xc
> 02 019dffb8 77e4a990 ntdll!RtlpWorkerThread+0x3b
> 03 019dffec 00000000 kernel32!BaseThreadStart+0x34
>
> Closing open log file C:\iisstate\output\IISState-3684.log<!-- ~MESSAGE_AFTER~ -->
>> Stay informed about: iisstate log file intrepretation