feat(connectors): BI-6585 Add column tables support for YDB

[catsona]

No description provided.

[Copilot]

Pull request overview

This PR adds support for YDB column tables to the connector implementation. Column tables are a specific YDB table type optimized for analytical workloads (OLAP).

• Enables column table features in the YDB Docker environment
• Adds test infrastructure for column table datasets
• Updates table discovery to include column tables and views

Reviewed changes

Copilot reviewed 7 out of 8 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
lib/dl_connector_ydb/pyproject.toml	Corrects path reference to dl-sqlalchemy-ydb dependency
lib/dl_connector_ydb/docker-compose/Dockerfile.db-ydb	Updates base image to official YDB platform image with pinned SHA
lib/dl_connector_ydb/docker-compose.yml	Enables column tables and OLAP schema operations via feature flags
lib/dl_connector_ydb/dl_connector_ydb_tests/db/config.py	Adds schema definitions and type mappings for column table testing
lib/dl_connector_ydb/dl_connector_ydb_tests/db/api/test_dataset.py	Adds test suite for column table dataset functionality
lib/dl_connector_ydb/dl_connector_ydb_tests/db/api/base.py	Implements column table test fixture with custom creation logic
lib/dl_connector_ydb/dl_connector_ydb/core/ydb/adapter.py	Updates table discovery to include column tables and views

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

The condition if key in COLUMN_TABLE_SCHEMA checks if the key exists in a tuple of tuples, which will always be False. This should check against the column names extracted from COLUMN_TABLE_SCHEMA. Consider: COLUMN_TABLE_DATA = [{key: value for key, value in row.items() if key in {col[0] for col in COLUMN_TABLE_SCHEMA}} for row in TABLE_DATA]

Suggested change

	COLUMN_TABLE_DATA = [{key: value for key, value in row.items() if key in COLUMN_TABLE_SCHEMA} for row in TABLE_DATA]
	COLUMN_TABLE_DATA = [{key: value for key, value in row.items() if key in {col[0] for col in COLUMN_TABLE_SCHEMA}} for row in TABLE_DATA]

[Copilot]

TABLE_DATA contains columns not present in COLUMN_TABLE_SCHEMA (e.g., 'some_bool', 'some_interval'). This will cause insertion to fail. Use COLUMN_TABLE_DATA instead of TABLE_DATA.

Suggested change

	db.insert_into_table(db_table.table, TABLE_DATA)
	db.insert_into_table(db_table.table, COLUMN_TABLE_DATA)