Improve title resolution make it a background process

[Kirandawadi]

Features Added

• Moved title pattern resolution to Celery tasks for non-blocking operation
• Added /api/title-patterns/<pattern_id>/status/ endpoint to monitor resolution progress
• Implemented 5-minute polling mechanism to check resolution status every 2 seconds
• Added real-time status notifications showing progress and completion of title resolutions

[Kirandawadi]

Demo

• Background resolution of titles
• Can schedule resolution for multiple title patterns at once

Background_Title_Resolution.mov

[CarsonDavis]

take a look at this:

    # if you want call apply by itsef apply()
    # but if want to call it async, use apply_async()

    def apply_async(self):
        return self.apply.delay(self.id, *args, **kwargs)

    @shared_task(bind=True)
    def apply(self) -> None:

[Kirandawadi]

Tests failing

• Currently, the title resolution task is running as expected when ran from the COSMOS but tests are failing.
• Here's how apply() method is modified.

    def apply(self) -> None:

        # Inserting here to avoid circular import issue
        from ..tasks import process_title_resolutions

        def queue_task():
            process_title_resolutions.delay(self.id)

        # Queue the background task only after the transaction commits (i.e, after apply() method)
        transaction.on_commit(queue_task)

• During tests, my guess is that the celery workers are not working properly and handling the background tasks as they should.

Methods Tried

• Set CELERY_ALWAYS_EAGER = True and CELERY_TASK_ALWAYS_EAGER = True on config/test.py to make async workflow to synchronous.
• Inherit TransactionTestCase for TestDeltaTitlePattern because we are dealing with transaction-related tests.

@pytest.mark.django_db(transaction=True)
class TestDeltaTitlePattern(TransactionTestCase):

• Marking test functions with decorators (transaction=True)

    @pytest.mark.django_db(transaction=True)
    def test_apply_generates_delta_url_if_title_differs(self):

• This method is working but it would be troublesome to write this everytime just to apply the pattern

        # Call the `apply()` method and capture/execute `on_commit` callbacks
        with self.captureOnCommitCallbacks(execute=True):  # Ensure `on_commit` callbacks are executed
             pattern.apply()