Stop fetching when remaining calls are exhausted

[almereyda]

At the moment, we can observe how the remaining calls from the rate limiting response headers are declining constantly, until after reaching 0 no waiting happens. In this case for downloading README files. I don't know how this behaves with regards to exceeding the limit when pulling API responses.

Remaining calls: 10 til 2025-04-25T21:13:26.000Z
Getting readme for ngryman/reading-time
Remaining calls: 9 til 2025-04-25T21:13:26.000Z
Getting readme for elsaland/elsa
Remaining calls: 8 til 2025-04-25T21:13:26.000Z
Getting readme for surishortlink/suri
Remaining calls: 7 til 2025-04-25T21:13:26.000Z
Getting readme for sindresorhus/yocto-queue
Remaining calls: 6 til 2025-04-25T21:13:26.000Z
Getting readme for artilleryio/artillery
Remaining calls: 5 til 2025-04-25T21:13:26.000Z
Getting readme for devinrhode2/Navigator.sendBeacon
Remaining calls: 4 til 2025-04-25T21:13:26.000Z
Getting readme for lukejacksonn/oceanwind
Remaining calls: 3 til 2025-04-25T21:13:26.000Z
Getting readme for simonhaenisch/md-to-pdf
Remaining calls: 2 til 2025-04-25T21:13:26.000Z
Getting readme for evanw/esbuild
Remaining calls: 1 til 2025-04-25T21:13:26.000Z
Getting readme for offen/offen
Remaining calls: 0 til 2025-04-25T21:13:26.000Z
Getting readme for logux/logux
Error getting readme from github API: FetchError: [GET] "https://api.github.com/repos/evanw/esbuild/readme": 403 Forbidden
Attempting HTTP GET for evanw/esbuild/README.md
Error getting readme from github API: FetchError: [GET] "https://api.github.com/repos/offen/offen/readme": 403 Forbidden
Attempting HTTP GET for offen/offen/README.md
Error getting readme from github API: FetchError: [GET] "https://api.github.com/repos/logux/logux/readme": 403 Forbidden
Attempting HTTP GET for logux/logux/README.md
Error getting raw readme from github: FetchError: [GET] "https://raw.githubusercontent.com/evanw/esbuild/main/README": 404 Not Found
Error getting raw readme from github: FetchError: [GET] "https://raw.githubusercontent.com/offen/offen/development/README": 404 Not Found
Error getting raw readme from github: FetchError: [GET] "https://raw.githubusercontent.com/logux/logux/main/README": 404 Not Found
Error getting raw readme from github: FetchError: [GET] "https://raw.githubusercontent.com/offen/offen/development/readme": 404 Not Found

Note how the FetchErrors already appear for repositories that are listed below single-digit limits. Eventually it will be good to back off earlier, and then wait until the limit period is refilled.

[almereyda]

In other executions, this was respected. Note this was before I had changed do destruct GITHUB_USERNAME together with the _TOKEN from process.env in my fork.

[DavidWells]

Yeah I see what you mean. The initial runs usually exhaust the token. I had to seed my stars locally before actions would make it "just work"

I added delay based on the GH response 27e28c8

This will probably time out GH actions but will "fix" the problem locally

[almereyda]

I'm going to track your branch and will try to generalise my adjustments, in so this could work for many. Another step might be to separate the repository into three: The CLI, the action and the content. Should I file another issue about possible generalisations?

This observation was made locally when seeding a repository with some 16k stars.