Skip to content

Change single file upload size to 5000 MiB#503

Merged
nithinb merged 2 commits intomasterfrom
nithin/ChangeUploadSizeLimit
Jan 27, 2026
Merged

Change single file upload size to 5000 MiB#503
nithinb merged 2 commits intomasterfrom
nithin/ChangeUploadSizeLimit

Conversation

@nithinb
Copy link
Contributor

@nithinb nithinb commented Jan 27, 2026

As per the docs the maximum size allowed for a single PUT operation is 5000 MiB and not 5 GiB.

This causes any file larger than 4.88 GiB and less than 5 GiB to fail with error:

httpx.HTTPStatusError: Client error '413 Payload Too Large' for url 'https://bluefield.cognitedata.com/api/v1/files/storage/cognite/5564302947473076%2F3982046575651919%2Fnithin_large_test_file_4.9GiB.log?sv=2026-02-06&se=2026-02-03T05%3A39%3A46Z&sr=b&sp=cw&sig=JXmBOq45Q%2FkRMnRXg44%2BAcgxAizMqs%2Fca00W7jymnEQ%3D&rsct=text%2Fplain'

Nithin Bodanapu added 2 commits January 27, 2026 14:41
…rest/api/storageservices/understanding-block-blobs--append-blobs--and-page-blobs#about-block-blobs, the maximum single blob size allowed is 5000 MiB and not 5 GiB. Due to this if a file of size above 4.9 GiB fails with the error: httpx.HTTPStatusError: Client error '413 Payload Too Large' for url '<upload_url_for_file>'
@nithinb nithinb self-assigned this Jan 27, 2026
@nithinb nithinb requested a review from a team as a code owner January 27, 2026 09:23
Copy link
Contributor

@einarmo einarmo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🦄

@codecov
Copy link

codecov bot commented Jan 27, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 81.07%. Comparing base (18c597b) to head (611ef51).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #503      +/-   ##
==========================================
+ Coverage   81.03%   81.07%   +0.04%     
==========================================
  Files          43       43              
  Lines        4212     4212              
==========================================
+ Hits         3413     3415       +2     
+ Misses        799      797       -2     
Files with missing lines Coverage Δ
cognite/extractorutils/__init__.py 100.00% <100.00%> (ø)
cognite/extractorutils/uploader/files.py 90.03% <100.00%> (ø)

... and 1 file with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@nithinb nithinb merged commit ac0840a into master Jan 27, 2026
6 checks passed
@nithinb nithinb deleted the nithin/ChangeUploadSizeLimit branch January 27, 2026 10:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants