Skip to content

Conversation

jiahuizz
Copy link

@jiahuizz jiahuizz commented Sep 16, 2025

Like the previous submission, deployment outside Alibaba Cloud is not supported. Performance verification therefore requires access to a Hologres instance on Alibaba Cloud. We apologize for this limitation. The testing methodology is documented in README.md, and we are happy to provide vouchers to assist with validation.
We are submitting updated results in this version due to the release of a new system iteration that includes several optimizations.

@TimothyDing
Copy link

@rschu1ze Could you help us to review it?

@rschu1ze
Copy link
Member

Sorry for the delay, I got a bit sidetracked.

This PR represents the first non-on-premise aka. the first cloud entry for JSONBench. Looking at the current dashboard, all entries run on the same hardware (i.e. there is no hardware dimension in the selector on top). This is different from the ClickBench dashboard which has a "machine" selector. So we either add a machine selector (I can do that) or another toggle "on-premise" vs. "cloud" to make clear that not all systems run on equally sized hardware.

@jiahuizz
Copy link
Author

Sorry for the confusion — I think there might have been a misunderstanding. This is actually a submission for ClickBench, and the JSONBench submissions are in a different repository. Would it be convenient for you to take a look at this ClickBench submission first?

@wangmj17
Copy link

Sorry for the delay, I got a bit sidetracked.

This PR represents the first non-on-premise aka. the first cloud entry for JSONBench. Looking at the current dashboard, all entries run on the same hardware (i.e. there is no hardware dimension in the selector on top). This is different from the ClickBench dashboard which has a "machine" selector. So we either add a machine selector (I can do that) or another toggle "on-premise" vs. "cloud" to make clear that not all systems run on equally sized hardware.

Hi, thank you for the reply! I am the committer for JSONBench result of Hologres. We think it is better to add a toggle "on-premise" vs. "cloud". If you think "machine selector" is better, it is also ok with us.

@jiahuizz
Copy link
Author

Would you be available to review this PR when you get a moment? Thanks so much in advance! @rschu1ze

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants