Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gemini 1.5 Flash Supervised Fine Tuning Updates #528

Open
bgrove-s7 opened this issue Aug 26, 2024 · 4 comments
Open

Gemini 1.5 Flash Supervised Fine Tuning Updates #528

bgrove-s7 opened this issue Aug 26, 2024 · 4 comments
Assignees
Labels
component:python sdk Issue/PR related to Python SDK status:awaiting user response Awaiting a response from the author type:feature request New feature request/enhancement

Comments

@bgrove-s7
Copy link

Description of the feature request:

Increase character limitation in tuning jobs to take advantage of the Flash 1.5 1,000,000 token window.

What problem are you trying to solve with this feature?

Gemini 1.5 Flash has a very large token window, which potentially makes it ideal for extracting needles from haystacks of text. We would like to fine tune Gemini 1.5 to perform this task for us. Tuning is appropriate because the content we are typically examining is hundreds of thousands of tokens, leaving no room for multishot prompting techniques.

Any other information you'd like to share?

No response

@MarkDaoust
Copy link
Collaborator

What is the current limit?

@bgrove-s7
Copy link
Author

bgrove-s7 commented Aug 26, 2024

It appears to be 40,000 characters, per the following error:

CreateTunedModelRequest.tuned_model.tuning_task.training_data.examples.examples[9].text_input: text_input is too long. The maximum character count accepted is 40000.

@manojssmk manojssmk added type:feature request New feature request/enhancement status:awaiting review PR awaiting review from a maintainer component:python sdk Issue/PR related to Python SDK labels Aug 30, 2024
@Annhiluc
Copy link
Contributor

Thanks for raising this issue. Have there been updates since the last comment, and is this request still active?

@Annhiluc Annhiluc added status:awaiting user response Awaiting a response from the author and removed status:awaiting review PR awaiting review from a maintainer labels Mar 24, 2025
@bgrove-s7
Copy link
Author

We are no longer trying to train with Gemini 1.5 Flash, but thank you for following up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:python sdk Issue/PR related to Python SDK status:awaiting user response Awaiting a response from the author type:feature request New feature request/enhancement
Projects
None yet
Development

No branches or pull requests

5 participants
@MarkDaoust @Annhiluc @bgrove-s7 @manojssmk and others