Skip to content

R7: Scheduled ingestion #23

@bstruong

Description

@bstruong

Today CSV ingestion is fully manual: `rails caster:run[path/to/export.csv]`.

Future: scheduled ingestion that picks up new CSV exports from a watched directory and runs the pipeline automatically.

Considerations:

  • Local-only constraint stays (MLS license forbids cloud sync of raw exports)
  • Could be a cron job, systemd timer, or `whenever` gem
  • Idempotency: ingester already preserves raw rows — schedule must not double-ingest

Metadata

Metadata

Assignees

No one assigned

    Labels

    roadmapFuture feature ideas

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions