Technical Debt: Update crawler dependencies to current versions

[elrayle]

Description

Many of the dependencies for this repo are out of date. A significant set of dependencies have reached EOL and are no longer supported. Update dependencies to current maintained versions.

NOTE: If code changes are required to update a dependency, consider whether a refactor from JavaScript to TypeScript would help with long term maintenance.

Related Work

• explore scancode.io as a replacement for including scancode-toolkit as a library #527
• Update ScanCode Toolkit version #502
• Technical Debt: Update service dependencies to current versions service#1007
• Technical Debt: Update website dependencies to current versions website#1024

[qtomlinson]

@clearlydefined/spdx has been upgraded and released. need to upgrade in crawler's package.json.

[elrayle]

@qtomlinson @lumaxis @yashkohli88 There have been updates to a lot of the dependencies. Are there additional dependencies needing updates for this to be complete?