Support #13715
[SCP ID :##6846##] : Monthly E-Statement Cron Job (SCPID 6802) bug
| Status: | System Integration Test | Start date: | November 06, 2023 | ||
|---|---|---|---|---|---|
| Priority: | Normal | Due date: | |||
| Assignee: |  Nurul Athira Abdul Rahim | % Done: | 90% | ||
| Category: | Bug | Spent time: | - | ||
| Target version: | - |
Description
Hi,
Kindly attend below request:-
eStatement still processing one data file instead of two data files at one time.
Improving monthly EStatement file processing. Previously took 13 hours to completed.
History
#1
Updated by Binti Marobi Athirah Umairah 11 months ago
- Category set to Bug
- Assignee changed from Nurul Athira Abdul Rahim to Najmi Pasarudin
#2
Updated by Najmi Pasarudin 10 months ago
- Status changed from New - Begin Life Cycle to Development / Work In Progress
- % Done changed from 0 to 90
#3
Updated by Najmi Pasarudin 10 months ago
- Status changed from Development / Work In Progress to Pending SIT Deployment
- Assignee changed from Najmi Pasarudin to Nurul Hasnieza Bt Mohd Zamri
Salam Hasnieza,
Please help to deploy to SIT and UAT.
Issue:
Previous Support #13688 to separate Monthly and other eStatement does not work concurrently.
Finding:
The eStatement program created a temporary account list file. This file is prevents Monthly and other eStatement from working concurrently.
Additionally, the Monthly eStatement is too slow because it creates new file reader at every account number.
Causing performance issue when processing large data file, like > 800MB.
- Separate temporary account list files between Monthly and other eStatement so that it can work concurrently
- Fix the Monthly eStatement logic. Minimizing new file reader instead of one for every account number.
- Prepare eStatement data file, Daily and Monthly
- Copy to /batch/BSN/BatchFilesSIT/eStatement/RawFile/
- Execute EStatementProgramMonthly.sh and EStatementProgram.sh in order
- This will creates accountListMonthly.txt and accountList.txt
- Execute EStatementProgramMonthly.sh and EStatementProgram.sh in order again
- This will creates eStatement files
- Execute EStatementProgramMonthly.sh and EStatementProgram.sh in order again
- This will deletes accountListMonthly.txt and accountList.txt
- Expected result, both Daily and Monthly eStatement files are created and able to download from IBAM.
#4
Updated by Nurul Hasnieza Bt Mohd Zamri 10 months ago
- Status changed from Pending SIT Deployment to Finished Development
#5
Updated by Nurul Hasnieza Bt Mohd Zamri 10 months ago
- Status changed from Finished Development to Internal Testing
- Assignee changed from Nurul Hasnieza Bt Mohd Zamri to Binti Marobi Athirah Umairah
SIT deploy on 22/11/2023
#6
Updated by Binti Marobi Athirah Umairah 10 months ago
- Status changed from Internal Testing to System Integration Test
#7
Updated by Nurul Athira Abdul Rahim 2 months ago
- Status changed from System Integration Test to Development / Work In Progress
- Assignee changed from Binti Marobi Athirah Umairah to Najmi Pasarudin
Tested and failed at SIRT due to : accountListMonthly.txt not deleted and raw file statement not archived
#8
Updated by Najmi Pasarudin about 1 month ago
- Status changed from Development / Work In Progress to System Integration Test
Emailed to Asrul to test using the following steps.
daily
1. run(3), generate accountList.txt
2. run(3), generate estatement.txt
3. run(3), delete accountList.txt and archive data file
4. run(3b), generate estatement.pdf
monthly
1. run(3d), generate accountListMonthly.txt
2. run(3d), generate estatement.txt for small data
3. run(3d), generate estatement.txt for large data (may need multiple run)
4. run(3d), delete accountListMonthly.txt and archive data file
5. run(3e), generate estatement.pdf
#9
Updated by Najmi Pasarudin about 1 month ago
- Assignee changed from Najmi Pasarudin to Nurul Athira Abdul Rahim
Salam Athira,
I have emailed to Asrul with the full testing steps.
Below is my SIT result.
- Daily/Weekly : Success until data file is archived
- Monthly: Success for small data. The last data failed to process due to limited CPU/Memory. Data file is not archived. Requires to archive manually.