Skip to content
This repository was archived by the owner on Dec 20, 2018. It is now read-only.
This repository was archived by the owner on Dec 20, 2018. It is now read-only.

Add support for reading Avro from RDD #211

@adamblev

Description

@adamblev

Currently it is only possible to parse avro from a file - spark.read.avro(filepath). We want to be able to parse avro from an RDD since our data is in a nested format. Currently this is supported with json format - spark.read.json(RDD[String]), we would want similar functionality for Avro but with binary.

If its possible to do this now with some other mechanism, would love to hear about it too :)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions