Skip to content

possible bug in post-processing of jobs #243

Description

@ilaflott
2026-06-11 13:14:21 WARNING: epmt.epmt_job:   copied 830 processes from staging in 0.49794 sec at 1666.86968 procs/sec
2026-06-11 13:14:21    INFO: epmt.epmt_job:   moving processes from staging complete
2026-06-11 13:14:21    INFO: epmt.epmt_job:   job contains 830 processes (862 threads)
2026-06-11 13:14:21    INFO: epmt.epmt_job:   job 55129671 has been post-processed
2026-06-11 13:14:21    INFO: epmt.epmt_job: Starting post-processing of job 55102032
2026-06-11 13:14:21    INFO: epmt.epmt_job:   moving job 55102032 processes from staging -> process table..
2026-06-11 13:14:21 WARNING: epmt.orm.sqlalchemy.general: Rolling back due to exception: list index out of range
Traceback (most recent call last):
  File "/home/Ian.Laflotte/conda/envs/epmt_main/bin/epmt", line 6, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/cli.py", line 481, in main
    retval = epmt_entrypoint(args)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/epmt_cmds.py", line 1878, in epmt_entrypoint
    epmt_dbcare( retire_jobs = args.retire_jobs ,
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/epmt_cmd_dbcare.py", line 155, in epmt_dbcare
    num_jobs_ppd=len(post_process_jobs(jobs=job_list))
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/epmt_query.py", line 3187, in post_process_jobs
    if post_process_job(jobid, force=not check):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/orm/sqlalchemy/general.py", line 50, in wrapper
    retval = func(*args, **kwargs)  # No need to pass session explicitly
             ^^^^^^^^^^^^^^^^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/epmtlib.py", line 263, in wrap
    result = f(*args, **kw)
             ^^^^^^^^^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/epmt_job.py", line 651, in post_process_job
    stage_copy_result = populate_process_table_from_staging(j)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/Ian.Laflotte/conda/envs/epmt_main/lib/python3.11/site-packages/epmt/epmt_job.py", line 959, in populate_process_table_from_staging
    threads_sums[metric_names[i]] += int(threads_df[t * len(metric_names) + i])
                                         ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
IndexError: list index out of range

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions