Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GlusterFS-Hadoop plugin seems to no longer be under active development #138

Open
charlienewey opened this issue May 1, 2018 · 3 comments

Comments

@charlienewey
Copy link

As above. There have been relatively few commits since 2015 (in both the source repo and the wiki), and there are several outstanding PRs and issues.

  • Is this project still actively developed or worked on?
  • Is there a considerable amount of work that this project requires?
  • If there is any work required, is it something that a single individual might be able to help with? (i.e., is there anything I can do?)

I'd ideally like to use GlusterFS as a drop-in replacement for HDFS, but I just want to make sure that this project is still receiving development attention (otherwise I can't justify it to the IT/Ops people in my organisation)

@vbellur
Copy link
Member

vbellur commented May 1, 2018

glusterfs-hadoop is not under active development as the focus of developers working previously on this project changed. Drop-in replacement for HDFS used to work at that point in time when activity ceased. I am not sure about the current status of the project.

If there is considerable interest, we can reach out to the community to check if someone is interested in maintaining this project.

@david-capstick
Copy link

Did the focus of the developers change as a result of issues arising in fulfilling or continuing to fulfil the brief of drop-in replacement (for HDFS) ? It seems a shame as having the same file system space available for standard POSIX style mounting as well as Mapreduce/Spark analytics would certainly be useful.

@rockeet
Copy link

rockeet commented Oct 11, 2018

We are eagerly need this project!!

  • RocksDB on glusterfs
    We are planing to using glusterfs for our MyRocks(MySQL + RocksDB) fork because glusterfs is fast for random read small chunk of data on large files.
  • Spark & hadoop on RocksDB
    Also we are planing to support Apache Spark by exposing MyRocks data to Spark, this work needs glusterfs-hadoop being stable & up to date.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants