Sunday, 22 December 2019

Stuck Thread in WebLogic Error and solution

Hi DBA-Mates, Stuck Thread in WebLogic Error and solution
Hope you all are doing your best!!!

We would like to share Stuck Thread in WebLogic Error and work-around one of the important task and frequently getting such below error in WebLogic.

It is very danger also because if it occurs then it will slow down the performance also.

And also we can't do anything that time if it occurs in PROD in middle of Business hours except to wait it to clear.

Another option is to bounce the clear the Thread. So, it is very critical as well as very difficult situation also.

Error details from log:

####<Dec 6, 2019 1:29:51 PM IST> <Info> <WebLogicServer> <ora-data> <SKU_Managed_Server> <[STUCK] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <a7480fd28a732992:-912e7549:f33b68edc18:-7fec-0000000000000530> <1575656991618> <BEA-000339> <[STUCK] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>

####<Dec 6, 2019 1:29:51 PM IST> <Info> <WebLogicServer> <ora-data> <SKU_Managed_Server> <[STUCK] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <a7480fd28a732992:-912e7549:f33b68edc18:-7fec-0000000000000531> <1575656991619> <BEA-000339> <[STUCK] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>

####<Dec 6, 2019 1:30:11 PM IST> <Info> <WebLogicServer> <ora-data> <SKU_Managed_Server> <[STUCK] ExecuteThread: '17' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <a7480fd28a732992:-912e7549:f33b68edc18:-7fec-0000000000000532> <1575657011586> <BEA-000339> <[STUCK] ExecuteThread: '17' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>

####<Dec 6, 2019 1:30:15 PM IST> <Info> <WebLogicServer> <ora-data> <SKU_Managed_Server> <[STUCK] ExecuteThread: '16' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <a7480fd28a732992:-912e7549:f33b68edc18:-7fec-0000000000000533> <1575657015170> <BEA-000339> <[STUCK] ExecuteThread: '16' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>

Work-around:

If any stuck thread comes then we can check the below things:

1. First check the Managed Server log file for which got alert.
ex: /ora-data/fmw/spl/SID/splapp/servers/Managed_Server/logs/Managed_Server.log

Here, sometimes stuck thread automatically will get clear.

2. Second, check for the status of the Managed Server.

3. Third, Check the Performance and Thread of the Managed Server.

i.e. Click on Environment --> Servers --> Managed Server --> Monitoring --> Performance.

Here check for “Heap Free Percent” (It should be more percentage free)

Also, check for count of the “Hogging Thread Count” which should be either 0 or very less.

i.e. Click on Environment --> Servers --> Managed Server --> Monitoring --> Threads.

If all above looks all fine and still Stuck Thread is not clearing then last option is to bounce the Managed Servers.
 
Some more useful links:
Regards,