How to implement HDFS as an external storage #1157
Unanswered
tomasperezfe
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I am a student, new to DataFusion, and I am trying to use HDFS as an external storage system in such a way that it accesses a CSV file located on my localhost and, using DataFusion Ballista, transforms it and saves it back to another output path in HDFS.
So far, I have managed to launch the containers included in the DataFusion project, as well as a DataNode and a NameNode container, and they are connected to the same network.
I have created a project that tries to access the path to retrieve the CSV file, but I always encounter issues with the object_store.
Please, can someone help me? I need a guide or an example for this.
Thank you very much.
Beta Was this translation helpful? Give feedback.
All reactions