Skip to content

Conversation

@osalyk
Copy link
Contributor

@osalyk osalyk commented Jan 13, 2026

This change is Reviewable

@osalyk osalyk requested review from grom72 and janekmi January 13, 2026 11:26
@osalyk osalyk changed the base branch from master to stable-2.1 January 13, 2026 11:26
Copy link
Contributor

@janekmi janekmi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

@janekmi reviewed 49 files and all commit messages, and made 2 comments.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved (waiting on @grom72).


src/test/pmempool_sync/TEST32 line 38 at r1 (raw file):

expect_normal_exit "$OBJ_VERIFY$EXESUFFIX $POOLSET pmempool$SUFFIX c v &>> $LOG"

turn_on_checking_bad_blocks $POOLSET

This line should be removed from all tests which transitioned from require_fs_type non-pmem to require_real_pmem. Can we make sure it happens just after this PMDK release?

osalyk and others added 12 commits January 14, 2026 08:37
Signed-off-by: Oksana Salyk <[email protected]>
Signed-off-by: Oksana Salyk <[email protected]>
Signed-off-by: Oksana Salyk <[email protected]>
... chunk reinit

Issue

Huge memory blocks with the header chunk of type CHUNK_TYPE_FREE had not
reinitialized their footer chunk.

Context

- Allocator divides the available space into zones and zones into
  smaller chunks.
- All chunk headers belonging to a single zone are stored in an array.
- Chunk header describes its: type, size_idx and flags.
- Chunk can be of a few types. The types important for this patch are:
  CHUNK_TYPE_FOOTER, CHUNK_TYPE_FREE, and CHUNK_TYPE_USED.
- CHUNK_TYPE_FREE and _USED are chunk types marking the beginning of so
  called huge memory block. This means this chunk and a number of chunks
  following it (size_idx) constitues a single allocation or a free
  memory.
- The last chunk belonging to a huge memory block ought to be of type
  CHUNK_TYPE_FOOTER. Its size_idx allows to easily find the first chunk
  belonging to this huge memory block and determine the huge memory
  block type.
- Huge memory blocks' footers are written immediately but persited
  lazily. It is not a problem at runtime since the footers are there at
  runtime. But in case of a crash the footers may be not persisted
  properly and missing on open. So, when the allocator is booted up it
  recreates footers just in case any of them is missing.

Note: The huge memory block's first chunk header and the last chunk
header (footer) are not written nor persisted in any way
transactionally. The first chunk header occupies only 8 bytes so it is
written and persisted atomically. But its footer is written
independently and not explicitly persisted.

Note: The first chunk header contains all the required info to recreate
footer. The last chunk header is there only to make huge memory blocks
coalescing easier to compute. Reading the footer allows to immediately
find the memory block leaving just before the memory block which
neighbours one might want to find.

This patch makes sure the huge memory block's footer is recreated no
matter whather its type is CHUNK_TYPE_FREE or CHUNK_TYPE_USED.

The patch is inspired by work done for DAOS' DAV allocator (DAOS-18195)
which is heavily based on the PMEMOBJ allocator.

Signed-off-by: Jan Michalski <[email protected]>
Inspired-by: Sherin T George <[email protected]>
Signed-off-by: Oksana Salyk <[email protected]>
Signed-off-by: Oksana Salyk <[email protected]>
@osalyk
Copy link
Contributor Author

osalyk commented Jan 14, 2026

I can't fix this story.

@osalyk osalyk closed this Jan 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants