Support #13343
[SCP ID :##6532##] : CPU Memory High Utilization
Status: | Closed - End of life cycle | Start date: | December 01, 2022 | |
---|---|---|---|---|
Priority: | High | Due date: | December 23, 2022 | |
Assignee: | Bramantyo Pujo Wiyono | % Done: | 100% | |
Category: | - | Spent time: | - | |
Target version: | - |
Description
Hi,
Kindly attend below request:-
Based on Monitoring BIFAST server utilization, there is high utilization in the CPU as below :
- CPU utilization dc1fastportdb01 100% reached (critical)
- CPU utilization dc1fastportdb02 100% reached (critical)
History
#1 Updated by Tan Lee Yong almost 2 years ago
- Due date set to December 23, 2022
- Status changed from New - Begin Life Cycle to Development / Work In Progress
We will perform enhancement on the below items to tackle for this problem>-
Fee Calculation batch job enhancement:-
1) Will enhance the Fee Calculation batch job to include the "Completed Date" as the search criteria
Dashboard module enhancement:-
1) To develop the new pre-calculation batch job on every hour
2) To enhance Dashboard module to use the new table and also the latest hour data
3) To add column name to the count('column name')
4) To add table clean up for the new table to the archive program
Reports Modules enhancement:
1) To enhance the Daily Report batch job to store the daily calculated data to a new table (7 new tables)
2) To enhance the Weekly and Monthly Reort batch job to query from the new table for the report generation (24 reports impacted)
3) To add table clean up for the new table to the archive program
#2 Updated by Tan Lee Yong over 1 year ago
- Status changed from Development / Work In Progress to Pending SIT Deployment
- % Done changed from 0 to 100
Issue 1:
After implemented the DB partition, certain search query facing slowness and high CPU issue due to db scan
Suspect:
After implemented the table partition for the transaction table, suspect due to the query does not specify to which partition to get the data that cause Oracle DB to use more CPU on the query
Solution:
Add the "Completed Date", the Partition Key, as part of the search criteria. Oracle DB will have the specific partition date range to search from.
Action:
1) Will enhance the Fee Calculation batch job to include the "Completed Date" as the search criteria
Release Patch: TrnxDataChargesCalculatorMain-2.0.32-ga.jar
Issue 2: Suspect of high CPU contribution from Dashboard
Suspect:
Dashboard is one of the heavy query module that will enquire for today's transaction data during every user login. Due to getting more participants and more transaction data, during day time, this might contribute to heavy Transaction table query that resulted on higher CPU.
Solution:
Create a new batch job to perform pre-calculation on every hour per participant and save the result to a new table. When a participant login, the Dashboard will calculate based on the precalculated data from the new table. This will greatly lighten on the DB query on the fly. Of cause, we spread the DB usage into every hour and also reduce to by participant, not by user.
Action:
1) To develop the new pre-calculation batch job on every hour
2) To enhance Dashboard module to use the new table and also the latest hour data
3) To add column name to the count('column name')
4) To add table clean up for the new table to the archive program
Release Patch: ???
Issue 3:
Suspect of high CPU contribution from Daily report batch job
Suspect:
Monthly report is one of the heavy query at every month end, which will lead to higher CPU usage at DB at every month end.
Solution:
To enhance all the daily report module to store the daily calculated data to a separate table. Weekly and Monthly Report batch job will get the data from the new daily report table, which will greatly reduce the query volume to DB at month end.
All query will add the "Completed Date" as search criteria to comply with the table Partition Key
Action:
1) To enhance the Daily Report batch job to store the daily calculated data to a new table
2) To enhance the Weekly and Monthly Reort batch job to query from the new table for the report generation
3) To add table clean up for the new table to the archive program
Release Patch: ???
Development done on Dec 23th
#3 Updated by Bramantyo Pujo Wiyono over 1 year ago
Release patch for Enhance Dashboard:
Release [20230119_01] - Enhance Transaction Dashboard
https://drive.google.com/drive/folders/1FDyYXo6_N-cpGk1Qbcz6jbr5HsuMCAef?usp=share_link
This patch already release to PTAP 20230119
Note:
this patch include
- [SCP id: 6392, 6393] Fix Trnx history search field & Dispute start date
- [SCP id: 6452] Resend Email for unlocked user
#4 Updated by Bramantyo Pujo Wiyono over 1 year ago
Release patch for Issue 3 Enhance Monthly Report:
Release [20230203_01] - [SCP-6532] Enhance Monthly Reports
https://drive.google.com/drive/folders/1p5aT2SnDQmnP1EHp_cnaRhG4kOn0bpbb?usp=share_link
This patch already release to PTAP 20230203
#5 Updated by Tan Lee Yong about 1 year ago
- Status changed from Pending SIT Deployment to Closed - End of life cycle
Already went life in July 2023