-
-
Notifications
You must be signed in to change notification settings - Fork 528
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
remove huge files from the sagemath_objects PyPI repo to fit into 10GB total #39500
Comments
@tornaria @tobiasdiez - can sagemath_objects be just dropped from being put on PyPI ? |
@kwankyu - do you perhaps know the purpose of this PyPI repo for sagemath_objects ? Is anyone using it ? |
Obviously, to distribute the package? I don't know who is using it, but the author of https://lists.debian.org/debian-science/2024/07/msg00023.html may be using it. |
As the release sizes aren't easily seen at PyPI web interface, here is how I got the numbers. 1st, got the complete project info as a JSON file curl -sG -H 'Host: pypi.org' -H 'Accept: application/json' https://pypi.org/pypi/sagemath_objects/json >j.json Then, opened it in Python and computed these numbers (each release has a bunch of sizes, one per platform. import json
with open('j.json') as j:
d=json.load(j)
rels=d['releases']
for y in sorted([(rel, sum(x['size'] for x in rels[rel])/1000000) for rel in rels.keys()], key=lambda t: t[1]):
print(y) |
No way Debian people would be using binary packages. |
I've manually removed most of these almost 0.5Gb files from https://pypi.org/manage/project/sagemath-objects/releases/, @vbraun, @tornaria - let's keep this open until the next beta is out, and we see that |
I'm not aware of it being used anywhere. That being said, it would be good to have a broader discussion what to do with the half-finished modularization efforts. As this issue shows they do consume developer attention; without giving any value for the project at their current state. But, perhaps, Dima and I are the wrong persons to start this discussion. |
FWIW, I only use For distro purposes, what is needed is a self-contained sdist that builds sagelib with dependencies coming from system. @tobiasdiez is the meson build good for this purpose? |
The automatic release (dist) GH Action uploads stuff in various sagemath* repos (of them probably only
sagemath-standard
is of any real use).It was reported by @tornaria that uploading to sagemath_standard failed for 10.6.beta6, see sage-release:
upon inspection of Action logs, it turned up that
sagemath_objects
PyPI repo has reached its 10GB limit.No wonder, because for the last 15 or so releases, including betas and rc's, these releases of sagemath_objects` reached almost 0.5GB in size each, see below. This madness stopped in 10.6.beta1, but it was too late, as it was already very close to the limit.
So we need to clean most of these huge files up. Or, perhaps, we can just stop putting this thing up completely.
The sizes below are in Mb, and I haven't listed anything smaller than 9.128 Mb.
The text was updated successfully, but these errors were encountered: