Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAM usage with MTG LI data #429

Open
g8sqh opened this issue Sep 21, 2024 · 1 comment
Open

RAM usage with MTG LI data #429

g8sqh opened this issue Sep 21, 2024 · 1 comment

Comments

@g8sqh
Copy link

g8sqh commented Sep 21, 2024

I'm using SIFT_2.0.0b1 to view MTG LI data (via my EUMETCAST system)

ON a Linux system with 64G of RAM, I can only load around 30 timesteps of LI L2 netCDF data before SIFT crashes 'bus error' - as its RAM usage (RES in top) exceed 32G.

Upto the crash the data is rendering and animating fine - but this only allowed a few minutes to be loaded at once.

Have I done something stupid (I'm new to SIFT)?
Since I only want a small area of the globe - should I have filtered the files I loaded to only include my area?

Many thanks

@ameraner
Copy link
Collaborator

ameraner commented Oct 4, 2024

Hi @g8sqh , thank you for reporting this. I don't think you're doing anything wrong here, also filtering the files beforehand for regions is not really possible unfortunately.
Which specific product are you loading, point or accumulated? This might be realted to e.g. pytroll/satpy#2854 or similar issues - the LI reader is still at an early (load) testing stage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants