-
Notifications
You must be signed in to change notification settings - Fork 55
Unable to cache most of bitmaps #76
Comments
This is a know problem. Was working on it these few last day. Can't tell you when it will be fixed tho, but next version 👍 . Basically we're hitting the rate-limit of beatsaver. |
@Alaanor I noticed this issue as well, it seems like some of the keys are not registered IE if you try to type |
Is this related to the problem that songs don't show up in the Beatlist tool (windows), even though they are inside beatsaber and are appearing ingame? Is beatlist maybe not displaying songs at all, where it is not able to retrieve meta-information about from beatsaver? |
I keep getting this: But all 262 songs are being read just fine within the game. |
Here I only have a couple of invalid maps, however, I do have 663 songs in my folder and BeatList only shows 486 |
I know that the UI I made isn't very intuitive concerning the recent change for rate-limiting. But basically this might be just that:
Where the UI is bad and I'll admit it. Is that I make it look like the scan has finished and all the rate-limited song goes in same category as those who were invalid. (But this list should go down over time as he will scan it later again) Can you guys confirm that it is only a UI/misunderstanding issue rather than an actual bug ? Also know that since 1.2.3 there's a mirror settings that you can use to change the source. This should make you avoid the rate-limit issue completely. |
I have waited for the scan to finish. It calls the invalid maps. I check into the beatmap tabs, and it only shows those limited songs that's DID validate. The rest wasn't showing up. And I waited 20-30 a couple times, in case it was just delayed. I have tried a couple directory changes where the source folder is, putting the veatnaps somewhere else. But yields the same result. |
Also: I have waited for the rate-limit countdown. But nothing changes. Even tried to "update" the beatmap validation, but it says "no changes made". |
@Alaanor About the rate-limit: Is beatlist sending one API-request for each song? That would be very bad. What should be done is, that it scannes all files in the folder, sends ONE single API-request with an array with those IDs/hashes, gets the response and maps the response to the files. |
There's no bulk as far as I know. This is indeed bad and I agree with. And I'm not sure the version of beatsaver really reflect the content of the beatsaver repo. I don't have a contact to these owner. |
Tbh I personally think the solution out of all of that is to me to rewrite the scanner to not fetch song and do all locally. This has the consequences of not having some column such as vote/like etc but at least everything would work just so much faster. |
@Alaanor I just created a feature-request for bulk-api nedpoints on the beatsaber repo, as the official documentation shows none. I also agree, that showing metadata from the beatsaver-DB should be optional. The files should be still displayed (author and songname are in thr local JSON-file, so showng those information should not be depending on the DB information.
I am more profound in Angular, but if you need help to change this, I would be available for discussing this and participating in coding. |
Thanks for effort, appreciate it. This kinda imply a massive change so I need to give some time to think about all of that. But this is definitely something I wish to do. |
Got a response, the bulk endpoints are already planned, but the repo owner doesn't know when he has time to finish them :) luludotdev/beatsaver-reloaded#106 (comment) So i would suggest to start on the beatlist-repo to make the online-metadata optional and while that rewrite is happening (or after it) switch to the bulk endpoints, when they are ready. |
I just wanna add, that for me, vr 1.2.3 solved the problem, before that i had the same bug happening but now after few scans all my beatmaps are loaded (500) |
@LanceFoudre @Alaanor Few short questions regarding this:
|
On the second topic, I've been thinking a little these few past day and I forgot the most important part for the reason I did not went for a full local scan: playlists. I can't know what song is what song without fetching that online if the user doesn't have the song locally. A hybrid solution would have been the best tho, I do agree. I am still thinking and I honestly don't know if I will put effort or not on this issue to be transparent. Got other personal projects to work on and this isn't a small issue that can be solved in less than a few weeks. |
I have about 500 bitmaps loaded but starting from several days ego beatlist has problems to cache most of them with the error "Request error while retrieving data on beatsaver" and it's showing me the only 74 map.
clear cache and update library and scan doesn't help
beatlist version 1.2.2
"
468 beatmaps loaded.
16 playlists loaded.
0 beatmaps are cached.
1 beatmaps are invalid.
708 beatmaps inside some playlists are invalid.
Last scan done the 08/12/2020, 20:02:34
"
The text was updated successfully, but these errors were encountered: