Examples

Examples

Local CSV to Delta (example config)

floe run -c example/config.yml --entities customer

Expected outputs (default example config paths):

• Accepted: example/out/accepted/customer_delta/ (Delta table with _delta_log and part files)
• Rejected: example/out/rejected/customer/part-*.csv
• Reports: example/report/run_<run_id>/...

JSON NDJSON input

source:
  format: "json"
  path: "/data/in/customer.ndjson"
  options:
    json_mode: "ndjson"

Parquet input

source:
  format: "parquet"
  path: "/data/in/customer"

Local CSV to Parquet (custom config)

If you want Parquet output, set sink.accepted.format: parquet in your config:

sink:
  accepted:
    format: "parquet"
    path: "./out/accepted/customer/"

Delta accepted output

sink:
  accepted:
    format: "delta"
    path: "s3://my-bucket/floe/accepted/customer"

See docs/config.md for full reference.