Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rust_arroyo: transform_and_produce example panics #5031

Open
loewenheim opened this issue Nov 15, 2023 · 3 comments
Open

rust_arroyo: transform_and_produce example panics #5031

loewenheim opened this issue Nov 15, 2023 · 3 comments
Assignees

Comments

@loewenheim
Copy link
Contributor

Environment

Current master, i.e. fa3cf88.

Steps to Reproduce

 cargo run --example transform_and_produce

Expected Result

The example would run without panicking.

Actual Result

running processor. transforming from test_in to test_out
thread 'main' panicked at rust_arroyo/examples/transform_and_produce.rs:87:21:
called `Result::unwrap()` on an `Err` value: PollError
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
@untitaker
Copy link
Member

I think this might be because of something basic like either the topic not existing, or the consumer group not having a pre-existing offset.

@loewenheim
Copy link
Contributor Author

The base_processor example also produces errors, although they're not visible unless you add some logging:

2023-11-15T11:48:59.002530Z ERROR rdkafka::client: librdkafka: Global error: UnknownTopicOrPartition (Broker: Unknown topic or partition): Subscribed topic not available: test_static: Broker: Unknown topic or partition    
2023-11-15T11:48:59.002648Z ERROR rust_arroyo::processing: poll error error=Message consumption error: UnknownTopicOrPartition (Broker: Unknown topic or partition)

@untitaker
Copy link
Member

i guess we should mostly fix this to not throw away the inner error information:

Err(e) => {
log::error!("poll error: {}", e);
return Err(RunError::PollError);
}

and have perhaps some docs on how to create topics?

@mcannizz mcannizz self-assigned this Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants