Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dapr Kafka Bulk messaging enhancement #3472

Open
rahulpoddar-fyndna opened this issue Jul 2, 2024 · 2 comments
Open

Dapr Kafka Bulk messaging enhancement #3472

rahulpoddar-fyndna opened this issue Jul 2, 2024 · 2 comments
Labels
kind/enhancement New feature or request pinned Issue does not get stale

Comments

@rahulpoddar-fyndna
Copy link

Dapr bulk messaging requires producer of the message to bulk it and send to side car in the application as of now. I could not find parameter setting such as linger.ms/batch.size/compression in yaml configuration.
The pure java SDK based kafka client has a way to set the following properties

  1. linger.ms
  2. batch.size
  3. compression

We are requesting to add support for above parameters so that the application code does not have to bother about bulking within a given time limit and create bulk messages in a for loop. Compression will further help in improving the performance. This needs to be taken care by underlying SDK as is the case with java SDK for apache kafka.

@rahulpoddar-fyndna rahulpoddar-fyndna added the kind/bug Something isn't working label Jul 2, 2024
@berndverst berndverst added kind/enhancement New feature or request and removed kind/bug Something isn't working labels Jul 8, 2024
Copy link

github-actions bot commented Aug 7, 2024

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale label Aug 7, 2024
Copy link

This issue has been automatically closed because it has not had activity in the last 37 days. If this issue is still valid, please ping a maintainer and ask them to label it as pinned, good first issue, help wanted or triaged/resolved. Thank you for your contributions.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 14, 2024
@artursouza artursouza reopened this Sep 3, 2024
@artursouza artursouza added pinned Issue does not get stale and removed stale labels Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement New feature or request pinned Issue does not get stale
Projects
Status: Backlog
Development

No branches or pull requests

3 participants