You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have an application that dynamically creates column families. One thing I've noticed while monitoring it is that column family creation slows down linearly with the number of column families that already exist in the DB. Having done some digging within RocksDB to understand why, it seems the reason here is that RocksDB rewrites and re-parses the OPTIONS file (which gets quite large over time) in its entirety with every new column family that is created.
Why does WrapUpColumnFamilyCreation re-write the entire OPTIONS file instead of append (or even copy + append) the new column family details?
Why does persisting the new options file require reading/verifying what was written?
Is it possible to make column family creation faster?
Are there any options I can configure that prevent column family creation from slowing down as more column families are added to a DB?
Thank you for your time.
The text was updated successfully, but these errors were encountered:
Hi folks,
I have an application that dynamically creates column families. One thing I've noticed while monitoring it is that column family creation slows down linearly with the number of column families that already exist in the DB. Having done some digging within RocksDB to understand why, it seems the reason here is that RocksDB rewrites and re-parses the OPTIONS file (which gets quite large over time) in its entirety with every new column family that is created.
Thank you for your time.
The text was updated successfully, but these errors were encountered: