ParentText Pipeline

Handles the process for producing RapidPro flows from data held in spreadsheets.

Setup

1. Install Python >= 3.10
2. Install Python dependencies: pip install -e .
3. Install Node and npm LTS versions
4. Install Node dependencies: npm install

Run

Two operations are currently available:

• pull_data: Read data from various sources and store them locally in json format.
• create_flows: Compile RapidPro flows from locally stored json files

To start the pipeline performing both operations in sequence:

python -m parenttext_pipeline.cli pull_data compile_flows

You will need to create a file called 'config.py', in the current working directory, and define a callable called 'create_config' that returns the pipeline settings as a dict. More details can be in the configuration page.

Documentation

• Configuration - details of configuration options for the pipeline
• RapidPro flow importer - to automatically import flow definitions into RapidPro
• Archive tool - to create snapshots of source Google Sheets to support repeatable pipeline runs
• Transcode tool - to prepare video and audio files that may be used by ParentText applications
• RapidPro API Tools - tools for managing and exporting data from RapidPro
• CKAN Tools - tools for uploading exported data to a CKAN server
• Automated RapidPro to CKAN Export - deployment guide for automating contact exports to CKAN via Google Cloud Run