Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

query/store: memoize PromLabels() call #7767

Merged
merged 1 commit into from
Sep 20, 2024
Merged

query/store: memoize PromLabels() call #7767

merged 1 commit into from
Sep 20, 2024

Conversation

GiedriusS
Copy link
Member

We use the stringlabels call so some allocations are inevitable but we can be much smarter about it:

func (s *storeSeriesSet) At() (labels.Labels, []*storepb.AggrChunk) {
	return s.series[s.i].PromLabels(), s.series[s.i].Chunks <--- not memoized, new alloc on every At() call; need to memoize because of stringlabel. One alloc is inevitable.
}
lset, chks := s.SeriesSet.At()
if s.peek == nil {
	s.peek = &Series{Labels: labelpb.PromLabelsToLabelpbLabels(lset), Chunks: chks} <-- converting back to labelpb ?
	continue
}
if labels.Compare(lset, s.peek.PromLabels()) != 0 { <--- PromLabels() called; we can avoid this call
	s.lset, s.chunks = s.peek.PromLabels(), s.peek.Chunks <- PromLabels() called; we can avoid this
	s.peek = &Series{Labels: labelpb.PromLabelsToLabelpbLabels(lset), Chunks: chks} <--- converting back to labelpb; we can avoid this
	return true
}

We use the stringlabels call so some allocations are inevitable but we
can be much smarter about it:

```
func (s *storeSeriesSet) At() (labels.Labels, []*storepb.AggrChunk) {
	return s.series[s.i].PromLabels(), s.series[s.i].Chunks <--- not memoized, new alloc on every At() call; need to memoize because of stringlabel. One alloc is inevitable.
}
```

```
lset, chks := s.SeriesSet.At()
if s.peek == nil {
	s.peek = &Series{Labels: labelpb.PromLabelsToLabelpbLabels(lset), Chunks: chks} <-- converting back to labelpb ?
	continue
}
```

```
if labels.Compare(lset, s.peek.PromLabels()) != 0 { <--- PromLabels() called; we can avoid this call
	s.lset, s.chunks = s.peek.PromLabels(), s.peek.Chunks <- PromLabels() called; we can avoid this
	s.peek = &Series{Labels: labelpb.PromLabelsToLabelpbLabels(lset), Chunks: chks} <--- converting back to labelpb; we can avoid this
	return true
}
```

Signed-off-by: Giedrius Statkevičius <[email protected]>
Copy link
Contributor

@pedro-stanaka pedro-stanaka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lg

@GiedriusS GiedriusS merged commit 735db72 into main Sep 20, 2024
21 of 22 checks passed
@GiedriusS GiedriusS deleted the cache_promlabels branch September 20, 2024 10:00
GiedriusS added a commit that referenced this pull request Oct 1, 2024
GiedriusS added a commit that referenced this pull request Oct 1, 2024
This reverts commit 735db72.

Signed-off-by: Giedrius Statkevičius <[email protected]>
GiedriusS added a commit that referenced this pull request Oct 1, 2024
* Revert "store: add chunk pooling (#7771)"

This reverts commit a2113fd.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "query/store: memoize PromLabels() call (#7767)"

This reverts commit 735db72.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "store: compare labels directly (#7766)"

This reverts commit 30f453e.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "store: don't create intermediate labels (#7762)"

This reverts commit 8cd3fae.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: build with stringlabels (#7745)"

This reverts commit 883fade.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: enable gRPC pooling (#7742)"

This reverts commit ca8ab90.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: switch to vtprotobuf (#7721)"

This reverts commit a8e7109.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: removing gogoproto extensions (#7718)"

This reverts commit 97710f4.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: rm ZLabels (#7675)"

This reverts commit 8c8a88e.

Signed-off-by: Giedrius Statkevičius <[email protected]>

---------

Signed-off-by: Giedrius Statkevičius <[email protected]>
jnyi pushed a commit to jnyi/thanos that referenced this pull request Oct 17, 2024
We use the stringlabels call so some allocations are inevitable but we
can be much smarter about it:

```
func (s *storeSeriesSet) At() (labels.Labels, []*storepb.AggrChunk) {
	return s.series[s.i].PromLabels(), s.series[s.i].Chunks <--- not memoized, new alloc on every At() call; need to memoize because of stringlabel. One alloc is inevitable.
}
```

```
lset, chks := s.SeriesSet.At()
if s.peek == nil {
	s.peek = &Series{Labels: labelpb.PromLabelsToLabelpbLabels(lset), Chunks: chks} <-- converting back to labelpb ?
	continue
}
```

```
if labels.Compare(lset, s.peek.PromLabels()) != 0 { <--- PromLabels() called; we can avoid this call
	s.lset, s.chunks = s.peek.PromLabels(), s.peek.Chunks <- PromLabels() called; we can avoid this
	s.peek = &Series{Labels: labelpb.PromLabelsToLabelpbLabels(lset), Chunks: chks} <--- converting back to labelpb; we can avoid this
	return true
}
```

Signed-off-by: Giedrius Statkevičius <[email protected]>
jnyi pushed a commit to jnyi/thanos that referenced this pull request Oct 17, 2024
* Revert "store: add chunk pooling (thanos-io#7771)"

This reverts commit a2113fd.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "query/store: memoize PromLabels() call (thanos-io#7767)"

This reverts commit 735db72.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "store: compare labels directly (thanos-io#7766)"

This reverts commit 30f453e.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "store: don't create intermediate labels (thanos-io#7762)"

This reverts commit 8cd3fae.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: build with stringlabels (thanos-io#7745)"

This reverts commit 883fade.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: enable gRPC pooling (thanos-io#7742)"

This reverts commit ca8ab90.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: switch to vtprotobuf (thanos-io#7721)"

This reverts commit a8e7109.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: removing gogoproto extensions (thanos-io#7718)"

This reverts commit 97710f4.

Signed-off-by: Giedrius Statkevičius <[email protected]>

* Revert "*: rm ZLabels (thanos-io#7675)"

This reverts commit 8c8a88e.

Signed-off-by: Giedrius Statkevičius <[email protected]>

---------

Signed-off-by: Giedrius Statkevičius <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants