Support #12869

[SCP ID :##6203##] : IBAM - Keep loading

Added by Zahir Abd Latif over 2 years ago. Updated over 2 years ago.

Status:Work Completed-End life cycleStart date:March 16, 2022
Priority:NormalDue date:
Assignee:Zahir Abd Latif% Done:

100%

Category:BIBSpent time:-
Target version:-

Description

Hi,
Kindly attend below request:-

today we received complaint from contact center IBAM keep loading. Please help to check.

log file can be found here:

\\172.16.49.2\prod_logs\VPIBKA01\IBAM\16032022
\\172.16.49.2\prod_logs\VPIBKA02\IBAM

History

#1 Updated by Siti Balqis Othman over 2 years ago

  • Status changed from New - Begin Life Cycle to Development / Work In Progress
  • % Done changed from 0 to 50

#2 Updated by Siti Balqis Othman over 2 years ago

  • Status changed from Development / Work In Progress to Work Completed-End life cycle
  • Assignee changed from Siti Balqis Othman to Zahir Abd Latif
  • % Done changed from 50 to 100

Finding: We found JDBC connection error as below

[3/16/22 12:41:58:008 SGT] 0000015b SystemOut O [16/03/2022] [12:41:58:008] [ERROR] [IBSSBusinessException]:141 - [0000] Service is currently unavailable.
[3/16/22 12:44:01:134 SGT] 000000bf WebContainer E com.ibm.ws.webcontainer.internal.WebContainer handleRequest SRVE0255E: A WebGroup/Virtual Host to handle /favicon.ico has not been defined.
[3/16/22 12:44:42:774 SGT] 000000e1 FreePool E J2CA0045E: Connection not available while invoking method createOrWaitForConnection for resource jdbc/ProdAgroIBAMNew.
[3/16/22 12:44:42:774 SGT] 000000e1 SystemOut O [16/03/2022] [12:44:42:774] [ERROR] [JDBCExceptionReporter]:101 - J2CA1010E: Connection not available; timed out waiting for 180 seconds.
[3/16/22 12:44:42:774 SGT] 000000e1 SystemOut O [16/03/2022] [12:44:42:774] [ERROR] [JDBCExceptionReporter]:101 - J2CA1010E: Connection not available; timed out waiting for 180 seconds.
[3/16/22 12:44:42:774 SGT] 000000e1 SystemOut O [16/03/2022] [12:44:42:774] [ERROR] [IBSSLoggerBase]:242 - Transaction not successfully started
org.hibernate.TransactionException: Transaction not successfully started
at org.hibernate.transaction.JDBCTransaction.rollback(JDBCTransaction.java:183)

Action:
1) Penril suggested increasing the connection pool from 10 to 15.
This action was done on 16/03/2022 at 7.55 pm by ITD (kak Ilah) and CF.
2) Penril to check on the module that might have causing this issue, for instance welcome pack module - pending
3) 17/03/2022 close monitoring has been conducted using IBM PMI tools. Results showed that request is heavy feeding to VPIBKA02 IBAM where connection pool usage reached 100% although has been increased to 15. Note: Please see the attached screenshot.
4) Upon discussion among kak Ilah and CF, CF suggested that IBAM deploy to IBM HTTP Server to achieve software load balancing and at the same time restrict access using IP addresses. Similar to current setup for BIB & RIB

Patch deploy to production for action 2 on 21/03/2022 under ticket Id "6206". No report on the slowness after deployed the patch.

Also available in: Atom PDF