Turn a long-form talk into short-form vertical reels — automatically.
Organized Cuts ingests a talk into TwelveLabs to find the
most shareable moments, then cuts captioned 9:16 reels from frame-synced ProRes
masters with ffmpeg. It reframes a presenter camera with a face-tracked crop,
splices in a screen-recording feed as a picture-in-picture during demos, and
burns in styled, word-accurate captions from a local Whisper transcript.
Everything runs locally; nothing is published without you asking.
| Project | What it is |
|---|---|
jordan-close/ |
First pipeline: the Jordan Close workshop talk (presenter ISO1 + screen-recording ISO2 → 15 reels) |
01 ingest Create a TwelveLabs index, upload a 720p proxy, poll to ready
02 analyze Generative highlights + embedding search → candidate clips
transcript Local Whisper (faster-whisper) → word-accurate transcript
03 cut 9:16 reels from the masters: face-tracked crop, demo picture-in-
picture over the screen feed, burned-in captions
04 contact QA contact sheet
05 loudnorm Normalize every reel to -14 LUFS
06 report INDEX.md + summary table
See jordan-close/README.md for the full run guide.
- Subject-aware reframing — detects the speaker's position per clip (OpenCV) and crops 16:9 → 9:16 around them instead of a naive center crop.
- Demo picture-in-picture — when the moment is a screen demo, the screen feed fills the frame with the presenter kept in a corner inset; audio stays on the presenter's mic.
- Word-accurate captions — a local Whisper pass gives correct text and
timing; captions are rendered as styled PNG overlays (works even with a
minimal
ffmpegbuild that lackslibass).
ffmpeg(withh264_videotoolboxon Apple Silicon)- Python 3.13 +
pip install -r jordan-close/requirements.txt - A TwelveLabs API key (see each project's
.env.example) - Caption font: Playfair Display Bold Italic — fetched at setup, e.g.
(SIL Open Font License. The caption renderer falls back to a system serif if absent.)
curl -fsSL -o jordan-close/assets/fonts/PlayfairDisplay-Italic-var.ttf \ "https://github.com/google/fonts/raw/main/ofl/playfairdisplay/PlayfairDisplay-Italic%5Bwght%5D.ttf"
Code: MIT (see LICENSE). Source video, transcripts, and rendered reels are not included in this repository.