Skip to content
This repository has been archived by the owner on Jul 31, 2019. It is now read-only.

Use Pandas #6

Open
garnaat opened this issue Oct 14, 2014 · 1 comment
Open

Use Pandas #6

garnaat opened this issue Oct 14, 2014 · 1 comment
Labels
enhancement

Comments

@garnaat
Copy link
Contributor

garnaat commented Oct 14, 2014

The Data Frame object from Pandas would be a much more efficient way to handle the large CSV data. Would it be better to switch to that? My only real issue is having it as a dependency but the benefits may far outweigh that downside.
@hrez
Copy link

hrez commented Aug 31, 2015

Did you ever get to implement Pandas?
How much memory does current implementation require?
I tried it on ~2Gb csv file and it went into ~10Gb memory before I killed it.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@garnaat @hrez