WIP: Custom runner for subdomain / independent workloads #415
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Subdomain running options:
- hosted: using `-$ITER` subdomain suffix
- local: using increasing port numbers
- Add measure prepare phase for "loading" style metric
- Move the warmup suite to the main config
- Display all top level metrics directly in the details view
The subdomain runner works by the outer default runner communicating
with the inner (embedded) runner via postMessage. There are 2 new
runners
- SubdomainBenchmarkRunner: the outer runner
- EmbeddedBenchmarkRunner: the inner runner
The main page switches over to the SubdomainBenchmarkRunner if the
corresponding param is set.
The EmbeddedBenchmarkRunner is then used by setting `?embedded` and
we end up with double wrapped workload (easy right...):
SubdomainBenchmarkRunner:
iframe:
EmbeddedBenchmarkRunner:
iframe:
Suite
This approach doesn't require changing the current workloads and we
can still easily measure framework setup time. Hopefully this can
be cleaned up in the future by refactoring the runner.
Change-Id: Ib813e8d83fd164fb2849b6889f187c1904b21965
Force run a gc() (expose with `--js-flags=--expose-gc`) before and after preparing a suite to limit potential ripple-effects from previous tests. Change-Id: Ia397b9e0aa8f5dabfb1dc4a69cfad9a7cf63ce60
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
WIP PR to demonstrate a hacky approach to run workloads independently from the main runnner.
hosted version: https://chromium-workloads.web.app/speedometer/v3.0-custom/?developerMode=&domainPerIteration=true