Selection rules (proposed)
- Datasets:
washdev, ploswater, uncnewsletter. datapapers excluded (data papers publish their data by definition).
- A paper qualifies when
das_type contains "request" (case-insensitive) — catches the coded category on request plus the few rows carrying the verbatim statement.
- Contact email:
correspondence_author_email, falling back to first_author_email (the fallback matters: it recovers 26 of the 44 uncnewsletter papers).
- Link:
paper_url, falling back to https://doi.org/<doi>.
- One row per (email, paper); the send step groups rows by address so nobody gets more than one message.
Yields 173 papers → 170 contactable rows → 153 unique addresses, with 3 papers lacking any address (parked in a missing_email sheet for manual address hunting via ORCID/institutional pages).
Known data-quality problems the review must catch
- Scraped address typos: e.g.
a.aprker@cranfield.ac.uk alongside the correct a.parker@cranfield.ac.uk — same person (Alison Parker), two "unique" addresses. Also seen: @ncsu.ede-style TLD typos. Regex validation can't catch these; eyes can.
- Greeting heuristic limits: "Dear Dr {last name token}" (with Jr./Sr./III suffixes stripped) mishandles compound surnames (e.g. Spanish double surnames greet by the second surname) and assumes a doctoral title. The greeting column must be editable and used verbatim by the send step.
- Same person, multiple addresses across datasets/papers — dedupe by person, not just by string-equal email.
- Stale addresses: some papers are 10+ years old; expect bounces.
Follow-up tasks for @larnsce
A draft implementation (list builder + generated CSV) exists on branch claude/automated-author-email-outreach-amipwb.
Refs #41
Selection rules (proposed)
washdev,ploswater,uncnewsletter.datapapersexcluded (data papers publish their data by definition).das_typecontains "request" (case-insensitive) — catches the coded categoryon requestplus the few rows carrying the verbatim statement.correspondence_author_email, falling back tofirst_author_email(the fallback matters: it recovers 26 of the 44uncnewsletterpapers).paper_url, falling back tohttps://doi.org/<doi>.Yields 173 papers → 170 contactable rows → 153 unique addresses, with 3 papers lacking any address (parked in a
missing_emailsheet for manual address hunting via ORCID/institutional pages).Known data-quality problems the review must catch
a.aprker@cranfield.ac.ukalongside the correcta.parker@cranfield.ac.uk— same person (Alison Parker), two "unique" addresses. Also seen:@ncsu.ede-style TLD typos. Regex validation can't catch these; eyes can.Follow-up tasks for @larnsce
A draft implementation (list builder + generated CSV) exists on branch
claude/automated-author-email-outreach-amipwb.Refs #41