Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Reduce batch CPU usage #1535

Open
purplesmoke05 opened this issue Jul 18, 2024 · 0 comments
Open

[FEATURE] Reduce batch CPU usage #1535

purplesmoke05 opened this issue Jul 18, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@purplesmoke05
Copy link
Member

Is your feature request related to a problem? Please describe.

  • Currently, the processor/indexer batch processes consume more CPU resources as the number of listing tokens increases.
  • It is necessary to reduce the CPU resource consumption.

Describe the solution you'd like

  • Reduce the CPU resource consumption of the processor/indexer batch processes.

Additional context

ps aux

$ ps aux
USER         PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
apl            1  0.0  0.0   5544  3456 ?        Ss   Jul17   0:00 /bin/bash /app/run.sh
apl           75  0.0  0.0   5544  3456 ?        S    Jul17   0:00 /bin/bash ./bin/run_indexer.sh
apl           76  0.0  0.0   5544  3456 ?        S    Jul17   0:00 /bin/bash ./bin/run_processor.sh
apl           77  0.0  0.0   3976  1920 ?        S    Jul17   0:01 tail -f /dev/null
apl          171 12.2  0.3 873920 255596 ?       Rl   Jul17 183:37 /home/apl/.pyenv/versions/3.12.2/bin/python batch/processor_Notifications_Token.py
apl          172  0.0  0.1 110872 83048 ?        S    Jul17   0:07 /home/apl/.pyenv/versions/3.12.2/bin/python batch/processor_Send_Mail.py
apl          173  0.2  0.1 124724 94368 ?        S    Jul17   3:25 /home/apl/.pyenv/versions/3.12.2/bin/python batch/processor_Block_Sync_Status.py
apl          174  0.0  0.0   3976  1920 ?        S    Jul17   0:01 tail -f /dev/null
apl          335  0.0  0.2 234400 134692 ?       Sl   Jul17   0:33 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_CompanyList.py
apl          336 39.3  0.4 482840 307372 ?       Rl   Jul17 590:21 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Transfer.py
apl          337  0.0  0.1 285640 109604 ?       Sl   Jul17   0:28 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Token_Holders.py
apl          338  0.3  0.1 284580 108340 ?       Sl   Jul17   4:46 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Token_List.py
apl          339 28.4  0.3 391152 215308 ?       Rl   Jul17 427:38 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Position_Share.py
apl          340 35.6  0.3 432112 255720 ?       Rl   Jul17 535:31 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_TransferApproval.py
apl          341 28.7  0.3 402152 226044 ?       Rl   Jul17 431:01 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Position_Bond.py
apl          342  0.2  0.1 448020 124624 ?       Sl   Jul17   3:12 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Token_Detail.py
apl          343 49.9  0.1 375584 126892 ?       Rl   Jul17 749:14 /home/apl/.pyenv/versions/3.12.2/bin/python batch/indexer_Token_Detail_ShortTerm.py
apl          344  0.0  0.0   3976  1920 ?        S    Jul17   0:01 tail -f /dev/null
apl       928345  0.0  0.0   7064  2816 pts/0    Rs+  01:57   0:00 ps aux

speedscope json
ibet-wallet-api-processor_Notifications_Token.json
ibet-wallet-api-indexer_Token_Detail_ShortTerm.json
ibet-wallet-api-indexer_Transfer.json
ibet-wallet-api-indexer_Position_Bond.json

@purplesmoke05 purplesmoke05 added the enhancement New feature or request label Jul 18, 2024
@purplesmoke05 purplesmoke05 self-assigned this Jul 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants