Improve performance of jobs aggregation.

[aaronweeden]

WORK IN PROGRESS

Description

TODO: Check if this slows down batch queries.
TODO: Verify that quarter and year are slower.
TODO: Test in Docker.

This PR improves the performance of the Jobs realm aggregation.

In testing ingestion of a day in October 2024 on xdmod-dev using the following commands,

sudo -u xdmod /data/www/xdmod/share/tools/etl/etl_overseer.php -v debug -a xsede.jobs-xdcdb.XdcdbJobRecordDayAggregator -s 2024-10-16 00:00:00 -e 2024-10-16 23:59:59 -f
sudo -u xdmod /data/www/xdmod/share/tools/etl/etl_overseer.php -v debug -a xsede.jobs-xdcdb.XdcdbJobRecordAggregator -s 2024-10-16 00:00:00 -e 2024-10-16 23:59:59 -f

the old and new queries took this time to run:

Aggregation unit	Before	After
Day (records = 6133)	456.82s	9.14s
Month (records = 55224)	44.66s	33.43s
Quarter (records = 55224)	46.12s	49.53s
Year (records = 364212)	412.72s	664.97s

Motivation and Context

Tests performed

Checklist:

• The pull request description is suitable for a Changelog entry
• The milestone is set correctly on the pull request
• The appropriate labels have been added to the pull request