[Bug]: ReqLLM Livebooks

[andyl]

Provider (if applicable)

NA

Model (if applicable)

NA

Bug Description

I've found a handful of glitches with ReqLLM livebooks, both in this repo and in 3rd party blog posts. There are some livebooks in guides/*.livemd that aren't included in the ExDocs.

I could possibly contribute to this project by making livebook-related PRs.

Here are the basic steps I have in mind:

1. manually test all *.livemd files
2. update mix.exs to include the livebooks in docs under a LIVEBOOKS group.
3. make sure the run in livebook button works
4. write more livebooks, and possibly convert some guides/*.md to livebooks.

Beyond that, I could search for a method to run livebook tests in development and in CI/CD. The livebook tests would simply check for successful completion of the entire livebook, without checking any intermediate assertions. To make this work, the livebooks would be built with no UI interaction or user input, just text blocks and elixir blocks. Probably I would add a mix task mix test_livebooks which would loop over all guides/*.livemd, extract the elixir code blocks and concatenate into a script, execute the script and check the return code. I've never seen this done, but it seems like it ought to work.

@mikehostetler Plz let me know if you would be in favor of this, and if you have any suggestions or direction on how to proceed.

Reproduction Code

NA

Expected Behavior

NA

Actual Behavior

NA

Environment

NA

[mikehostetler]

Help here would be incredible @andyl !!!!