Skip to content

Commit 116aa6f

Browse files
SelfeerSelfeer
committed
push new requirements
1 parent 71c49ce commit 116aa6f

File tree

2 files changed

+213
-135
lines changed

2 files changed

+213
-135
lines changed

‎parquet/requirements/requirements.md

Lines changed: 55 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -413,44 +413,47 @@
413413
* 19.5.8.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NotSuitedEngines](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenotsuitedengines)
414414
* 19.5.9 [Cache Invalidation](#cache-invalidation)
415415
* 19.5.9.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.Invalidation](#rqsrs-032clickhouseparquetmetadatacachingobjectstorageinvalidation)
416-
* 19.5.10 [Reading Metadata After Caching Is Completed](#reading-metadata-after-caching-is-completed)
417-
* 19.5.10.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.ReadMetadataAfterCaching](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragereadmetadataaftercaching)
418-
* 19.5.11 [Caching When Reading From Hive Partitioned Parquet Files in Object Storage](#caching-when-reading-from-hive-partitioned-parquet-files-in-object-storage)
419-
* 19.5.11.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.HivePartitioning](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragehivepartitioning)
420-
* 19.5.12 [Caching Settings](#caching-settings)
421-
* 19.5.12.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.Settings](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragesettings)
422-
* 19.5.13 [All Possible Settings That Can Be Used Along With Metadata Caching Settings](#all-possible-settings-that-can-be-used-along-with-metadata-caching-settings)
423-
* 19.5.13.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.AllSettings](#rqsrs-032clickhouseparquetmetadatacachingobjectstorageallsettings)
424-
* 19.5.14 [Cases When Metadata Cache Speeds Up Query Execution](#cases-when-metadata-cache-speeds-up-query-execution)
425-
* 19.5.14.1 [Count](#count)
426-
* 19.5.14.1.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.Count](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutioncount)
427-
* 19.5.14.2 [Min and Max](#min-and-max)
428-
* 19.5.14.2.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.MinMax](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutionminmax)
429-
* 19.5.14.3 [Bloom Filter Caching](#bloom-filter-caching)
430-
* 19.5.14.3.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.BloomFilter](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutionbloomfilter)
431-
* 19.5.14.4 [Distinct Count](#distinct-count)
432-
* 19.5.14.4.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.DistinctCount](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutiondistinctcount)
433-
* 19.5.14.5 [File Schema](#file-schema)
434-
* 19.5.14.5.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.FileSchema](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutionfileschema)
435-
* 19.5.15 [Maximum Size of Metadata Cache](#maximum-size-of-metadata-cache)
436-
* 19.5.15.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.MaxSize](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragemaxsize)
437-
* 19.5.16 [File With The Same Name But Different Location](#file-with-the-same-name-but-different-location)
438-
* 19.5.16.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SameNameDifferentLocation](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragesamenamedifferentlocation)
439-
* 19.5.17 [Hits and Misses Counter](#hits-and-misses-counter)
440-
* 19.5.17.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.HitsMissesCounter](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragehitsmissescounter)
441-
* 19.5.18 [Nested Queries With Metadata Caching](#nested-queries-with-metadata-caching)
442-
* 19.5.18.1 [Join Two Parquet Files From an Object Storage](#join-two-parquet-files-from-an-object-storage)
443-
* 19.5.18.1.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.Join](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesjoin)
444-
* 19.5.18.2 [Basic Nested Subquery](#basic-nested-subquery)
445-
* 19.5.18.2.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.Basic](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesbasic)
446-
* 19.5.18.3 [Union All with Nested Parquet Queries](#union-all-with-nested-parquet-queries)
447-
* 19.5.18.3.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.UnionAll](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesunionall)
448-
* 19.5.18.4 [Nested Subquery with an Additional Filter and Aggregation](#nested-subquery-with-an-additional-filter-and-aggregation)
449-
* 19.5.18.4.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.FilterAggregation](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesfilteraggregation)
450-
* 19.5.18.5 [Combining a UNION with a JOIN](#combining-a-union-with-a-join)
451-
* 19.5.18.5.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.UnionJoin](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesunionjoin)
452-
* 19.5.18.6 [Deeply Nested JOIN](#deeply-nested-join)
453-
* 19.5.18.6.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.DeeplyNestedJoin](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesdeeplynestedjoin)
416+
* 19.5.10 [Cache Clearing](#cache-clearing)
417+
* 19.5.10.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.CacheClearing](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragecacheclearing)
418+
* 19.5.10.2 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.CacheClearing,OnCluster](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragecacheclearingoncluster)
419+
* 19.5.11 [Reading Metadata After Caching Is Completed](#reading-metadata-after-caching-is-completed)
420+
* 19.5.11.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.ReadMetadataAfterCaching](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragereadmetadataaftercaching)
421+
* 19.5.12 [Caching When Reading From Hive Partitioned Parquet Files in Object Storage](#caching-when-reading-from-hive-partitioned-parquet-files-in-object-storage)
422+
* 19.5.12.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.HivePartitioning](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragehivepartitioning)
423+
* 19.5.13 [Caching Settings](#caching-settings)
424+
* 19.5.13.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.Settings](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragesettings)
425+
* 19.5.14 [All Possible Settings That Can Be Used Along With Metadata Caching Settings](#all-possible-settings-that-can-be-used-along-with-metadata-caching-settings)
426+
* 19.5.14.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.AllSettings](#rqsrs-032clickhouseparquetmetadatacachingobjectstorageallsettings)
427+
* 19.5.15 [Cases When Metadata Cache Speeds Up Query Execution](#cases-when-metadata-cache-speeds-up-query-execution)
428+
* 19.5.15.1 [Count](#count)
429+
* 19.5.15.1.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.Count](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutioncount)
430+
* 19.5.15.2 [Min and Max](#min-and-max)
431+
* 19.5.15.2.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.MinMax](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutionminmax)
432+
* 19.5.15.3 [Bloom Filter Caching](#bloom-filter-caching)
433+
* 19.5.15.3.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.BloomFilter](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutionbloomfilter)
434+
* 19.5.15.4 [Distinct Count](#distinct-count)
435+
* 19.5.15.4.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.DistinctCount](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutiondistinctcount)
436+
* 19.5.15.5 [File Schema](#file-schema)
437+
* 19.5.15.5.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SpeedUpQueryExecution.FileSchema](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragespeedupqueryexecutionfileschema)
438+
* 19.5.16 [Maximum Size of Metadata Cache](#maximum-size-of-metadata-cache)
439+
* 19.5.16.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.MaxSize](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragemaxsize)
440+
* 19.5.17 [File With The Same Name But Different Location](#file-with-the-same-name-but-different-location)
441+
* 19.5.17.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.SameNameDifferentLocation](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragesamenamedifferentlocation)
442+
* 19.5.18 [Hits and Misses Counter](#hits-and-misses-counter)
443+
* 19.5.18.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.HitsMissesCounter](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragehitsmissescounter)
444+
* 19.5.19 [Nested Queries With Metadata Caching](#nested-queries-with-metadata-caching)
445+
* 19.5.19.1 [Join Two Parquet Files From an Object Storage](#join-two-parquet-files-from-an-object-storage)
446+
* 19.5.19.1.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.Join](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesjoin)
447+
* 19.5.19.2 [Basic Nested Subquery](#basic-nested-subquery)
448+
* 19.5.19.2.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.Basic](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesbasic)
449+
* 19.5.19.3 [Union All with Nested Parquet Queries](#union-all-with-nested-parquet-queries)
450+
* 19.5.19.3.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.UnionAll](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesunionall)
451+
* 19.5.19.4 [Nested Subquery with an Additional Filter and Aggregation](#nested-subquery-with-an-additional-filter-and-aggregation)
452+
* 19.5.19.4.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.FilterAggregation](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesfilteraggregation)
453+
* 19.5.19.5 [Combining a UNION with a JOIN](#combining-a-union-with-a-join)
454+
* 19.5.19.5.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.UnionJoin](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesunionjoin)
455+
* 19.5.19.6 [Deeply Nested JOIN](#deeply-nested-join)
456+
* 19.5.19.6.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.NestedQueries.DeeplyNestedJoin](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragenestedqueriesdeeplynestedjoin)
454457
* 19.6 [Cachable Metadata Types](#cachable-metadata-types)
455458
* 19.6.1 [Metadata Generated by ClickHouse](#metadata-generated-by-clickhouse)
456459
* 19.6.1.1 [RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.MetadataTypes.ClickHouse](#rqsrs-032clickhouseparquetmetadatacachingobjectstoragemetadatatypesclickhouse)
@@ -3602,7 +3605,20 @@ version: 1.0
36023605
##### RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.Invalidation
36033606
version: 1.0
36043607
3605-
[ClickHouse] SHALL throw and error when the Parquet file is deleted from the object storage and we .
3608+
[ClickHouse] SHALL throw and error when the Parquet file is deleted from the object storage and we try to access the cache related to that file.
3609+
3610+
#### Cache Clearing
3611+
3612+
##### RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.CacheClearing
3613+
version: 1.0
3614+
3615+
[ClickHouse] SHALL support clearing the Parquet metadata cache on a single node using the `SYSTEM DROP PARQUET METADATA CACHE` command.
3616+
3617+
##### RQ.SRS-032.ClickHouse.Parquet.Metadata.Caching.ObjectStorage.CacheClearing,OnCluster
3618+
version: 1.0
3619+
3620+
[ClickHouse] SHALL support clearing the Parquet metadata cache on all nodes in a cluster using the `SYSTEM DROP PARQUET METADATA CACHE ON CLUSTER {cluster_name}` command.
3621+
36063622
36073623
#### Reading Metadata After Caching Is Completed
36083624

0 commit comments

Comments
 (0)