This repository has been archived by the owner on May 17, 2024. It is now read-only.

Better text formatting on thought generation #99

Open

yujonglee opened this issue Sep 10, 2023 · 0 comments

Owner

yujonglee commented Sep 10, 2023 •

edited

Loading

Current approach:

https://github.com/fastrepl/fastrepl/blob/f18c86dddef268f111bf4328c77e820eaa0499e1/fastrepl/eval/model/llm_head_cot.py#L27
https://github.com/fastrepl/fastrepl/blob/f18c86dddef268f111bf4328c77e820eaa0499e1/fastrepl/eval/model/llm_head_cot.py#L54

Maybe this approach is more reliable(ask model to wrap text):

https://platform.openai.com/docs/guides/gpt-best-practices/strategy-give-gpts-time-to-think
https://docs.anthropic.com/claude/docs/give-claude-room-to-think-before-responding

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.