Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Warning about 10,000 entities limitation (CSV Export and Map View) #6582

Open
salvalacruz opened this issue Mar 11, 2024 · 3 comments
Open
Labels
Feature Brand new functionality to be added to UWAZI

Comments

@salvalacruz
Copy link

Is your feature request related to a problem? Please describe.
The related problem is about the limitation of managing until 10,000 entities in two situations: CSV Export and Map View.

Describe the solution you'd like
Meanwhile these limitations are fixed, it would be usseful tu add a warning to the user, in two scenaries:

  • CSV Export: if the selected filter to be exported overcomes 10,000 entities, before creating the CSV file, to show a message warning that the file will include only the first 10k entities.
  • Map View: if the selected filter overcomes mora than 10k entities with geolocation, to show a message warning that the map only show 10k point.

Have you considered an alternative?
Hopefully, the best way to fix this is to avoid limitations with data export and geolocation views.

@salvalacruz salvalacruz added the Feature Brand new functionality to be added to UWAZI label Mar 11, 2024
@RafaPolit
Copy link
Member

After some discussions, we are going to try to:
a. Strip the data sent by the "geolocation" endpoint to only geolocation properties
b. try to use the same "pagination" approach as we are developing for the CSV export
c. have the client attempt to deal with all the geolocation data

We will evaluate how much impact this has on the client's machine.

@RafaPolit
Copy link
Member

@fnocetti what is the status of the 10.000 limit pagination so we can look into channeling that into the geolocation endpoints?

@fnocetti
Copy link
Contributor

@RafaPolit it's at a working poc status. We haven't had the capacity to move it forward. Let's discuss on Monday how we should proceed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature Brand new functionality to be added to UWAZI
Projects
None yet
Development

No branches or pull requests

3 participants