fix(glue): restore notifyDelayAfter across different job types

[humanzz]

Issue # (if applicable)

Related to #33356
Closes #33839

Reason for this change

address the regression of "notifyDelayAfter got removed from PySparkEtlJob props"

Description of changes

• move notifyDelayAfter prop to JobProps
• refactor to reduce code duplication
  • move jobRunQueuingEnabled prop to JobProps
  • introduce Job.setupJobResource utility static method to handle setting up the CfnJob for all job types
  • refactor all job types to use Job.setupJobResource while passing the overrides/customizations relevant to each job type
  • move extraJars, extraJarsFirst, and extraFiles props from the different spark job props into SparkJobProps

Describe any new or updated permissions being added

N/A

Description of how you validated changes

unit and integ tests

Checklist

• My code adheres to the CONTRIBUTING GUIDE and DESIGN GUIDELINES

---

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

[aws-cdk-automation]

(This review is outdated)

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.38%. Comparing base (ae3fd67) to head (8bdd926).
Report is 12 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main   #33842   +/-   ##
=======================================
  Coverage   82.38%   82.38%           
=======================================
  Files         120      120           
  Lines        6937     6937           
  Branches     1170     1170           
=======================================
  Hits         5715     5715           
  Misses       1119     1119           
  Partials      103      103           

Flag	Coverage Δ
suite.unit	82.38% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Components	Coverage Δ
packages/aws-cdk	∅ <ø> (∅)
packages/aws-cdk-lib/core	82.38% <ø> (ø)

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

✅ Updated pull request passes all PRLinter validations. Dismissing previous PRLinter review.

[aws-cdk-automation]

AWS CodeBuild CI Report

• CodeBuild project: AutoBuildv2Project1C6BFA3F-wQm2hXv2jqQv
• Commit ID: 8bdd926
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository