Skip to content

Commit 2910f63

Browse files
lqiu96lqiu96
authored
feat(datacatalog)!: remove java-datacatalog library (#14178)
Fixes #14110 ### Description Removes the `java-datacatalog` module and all references to Data Catalog across the repository, as the service has reached end-of-life and was shut down on 2026-06-01 (https://docs.cloud.google.com/data-catalog/docs) Users are suggested to move to dataplex: https://docs.cloud.google.com/dataplex/docs/reference/libraries ### Changes - Deleted `java-datacatalog/` module directory. - Removed `<module>java-datacatalog</module>` from root `pom.xml`. - Removed `google-cloud-datacatalog-bom` from `gapic-libraries-bom/pom.xml`. - Removed `Data Catalog` entry from root `README.md`. - Removed `google-cloud-datacatalog` entries from `versions.txt`. - Removed `datacatalog` configuration block from `librarian.yaml`. - Removed `google-cloud-datacatalog` from `java-cloud-bom/` metadata, README, and dependency-convergence tests. - Removed `datacatalog` test dependencies and obsolete policy tag integration test from `java-bigquery/google-cloud-bigquery`.
1 parent de926bd commit 2910f63

966 files changed

Lines changed: 0 additions & 397077 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎README.md‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,6 @@ Libraries are available on GitHub and Maven Central for developing Java applicat
5151
| [Container Analysis](https://github.com/googleapis/google-cloud-java/tree/main/java-containeranalysis) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-containeranalysis.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-containeranalysis&core=gav) |
5252
| [Controls Partner API](https://github.com/googleapis/google-cloud-java/tree/main/java-cloudcontrolspartner) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-cloudcontrolspartner.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-cloudcontrolspartner&core=gav) |
5353
| [DNS](https://github.com/googleapis/google-cloud-java/tree/main/java-dns) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-dns.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-dns&core=gav) |
54-
| [Data Catalog](https://github.com/googleapis/google-cloud-java/tree/main/java-datacatalog) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-datacatalog.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-datacatalog&core=gav) |
5554
| [Data Fusion](https://github.com/googleapis/google-cloud-java/tree/main/java-data-fusion) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-data-fusion.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-data-fusion&core=gav) |
5655
| [Data Lineage](https://github.com/googleapis/google-cloud-java/tree/main/java-datalineage) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-datalineage.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-datalineage&core=gav) |
5756
| [Data Loss Prevention](https://github.com/googleapis/google-cloud-java/tree/main/java-dlp) | [![stable][stable-stability]][stable-description] | [![Maven](https://img.shields.io/maven-central/v/com.google.cloud/google-cloud-dlp.svg)](https://search.maven.org/search?q=g:com.google.cloud%20AND%20a:google-cloud-dlp&core=gav) |

‎gapic-libraries-bom/pom.xml‎

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -512,13 +512,6 @@
512512
<type>pom</type>
513513
<scope>import</scope>
514514
</dependency>
515-
<dependency>
516-
<groupId>com.google.cloud</groupId>
517-
<artifactId>google-cloud-datacatalog-bom</artifactId>
518-
<version>1.102.0</version><!-- {x-version-update:google-cloud-datacatalog:current} -->
519-
<type>pom</type>
520-
<scope>import</scope>
521-
</dependency>
522515
<dependency>
523516
<groupId>com.google.cloud</groupId>
524517
<artifactId>google-cloud-dataflow-bom</artifactId>

‎java-bigquery/google-cloud-bigquery/pom.xml‎

Lines changed: 0 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -146,12 +146,6 @@
146146
<classifier>testlib</classifier>
147147
<scope>test</scope>
148148
</dependency>
149-
<dependency>
150-
<groupId>com.google.cloud</groupId>
151-
<artifactId>google-cloud-datacatalog</artifactId>
152-
<scope>test</scope>
153-
<version>1.102.0</version><!-- {x-version-update:google-cloud-datacatalog:current} -->
154-
</dependency>
155149
<dependency>
156150
<groupId>com.google.cloud</groupId>
157151
<artifactId>google-cloud-bigqueryconnection</artifactId>
@@ -194,18 +188,6 @@
194188
<artifactId>mockito-core</artifactId>
195189
<scope>test</scope>
196190
</dependency>
197-
<dependency>
198-
<groupId>com.google.cloud</groupId>
199-
<artifactId>google-cloud-datacatalog</artifactId>
200-
<scope>test</scope>
201-
<version>1.102.0</version><!-- {x-version-update:google-cloud-datacatalog:current} -->
202-
</dependency>
203-
<dependency>
204-
<groupId>com.google.api.grpc</groupId>
205-
<artifactId>proto-google-cloud-datacatalog-v1</artifactId>
206-
<scope>test</scope>
207-
<version>1.102.0</version><!-- {x-version-update:proto-google-cloud-datacatalog-v1:current} -->
208-
</dependency>
209191
<dependency>
210192
<groupId>org.jspecify</groupId>
211193
<artifactId>jspecify</artifactId>

‎java-bigquery/google-cloud-bigquery/src/test/java/com/google/cloud/bigquery/it/ITBigQueryTest.java‎

Lines changed: 0 additions & 100 deletions
Original file line numberDiff line numberDiff line change
@@ -113,7 +113,6 @@
113113
import com.google.cloud.bigquery.ModelInfo;
114114
import com.google.cloud.bigquery.Parameter;
115115
import com.google.cloud.bigquery.ParquetOptions;
116-
import com.google.cloud.bigquery.PolicyTags;
117116
import com.google.cloud.bigquery.PrimaryKey;
118117
import com.google.cloud.bigquery.QueryJobConfiguration;
119118
import com.google.cloud.bigquery.QueryJobConfiguration.JobCreationMode;
@@ -145,12 +144,6 @@
145144
import com.google.cloud.bigquery.ViewDefinition;
146145
import com.google.cloud.bigquery.WriteChannelConfiguration;
147146
import com.google.cloud.bigquery.testing.RemoteBigQueryHelper;
148-
import com.google.cloud.datacatalog.v1.CreatePolicyTagRequest;
149-
import com.google.cloud.datacatalog.v1.CreateTaxonomyRequest;
150-
import com.google.cloud.datacatalog.v1.PolicyTag;
151-
import com.google.cloud.datacatalog.v1.PolicyTagManagerClient;
152-
import com.google.cloud.datacatalog.v1.Taxonomy;
153-
import com.google.cloud.datacatalog.v1.Taxonomy.PolicyType;
154147
import com.google.cloud.storage.BlobInfo;
155148
import com.google.cloud.storage.BucketInfo;
156149
import com.google.cloud.storage.Storage;
@@ -2147,99 +2140,6 @@ void testCreateTableWithDefaultValueExpression() {
21472140
bigquery.delete(tableId);
21482141
}
21492142

2150-
@Test
2151-
void testCreateAndUpdateTableWithPolicyTags() throws IOException {
2152-
// Set up policy tags in the datacatalog service
2153-
try (PolicyTagManagerClient policyTagManagerClient = PolicyTagManagerClient.create()) {
2154-
CreateTaxonomyRequest createTaxonomyRequest =
2155-
CreateTaxonomyRequest.newBuilder()
2156-
.setParent(String.format("projects/%s/locations/%s", PROJECT_ID, "us"))
2157-
.setTaxonomy(
2158-
Taxonomy.newBuilder()
2159-
// DisplayName must be unique across org. Use UUID rather than time to ensure
2160-
// no collisions
2161-
// from parallel test invocations
2162-
.setDisplayName(
2163-
String.format(
2164-
"testing taxonomy %s", UUID.randomUUID().toString().substring(0, 8)))
2165-
.setDescription("taxonomy created for integration tests")
2166-
.addActivatedPolicyTypes(PolicyType.FINE_GRAINED_ACCESS_CONTROL)
2167-
.build())
2168-
.build();
2169-
Taxonomy taxonomyResponse = policyTagManagerClient.createTaxonomy(createTaxonomyRequest);
2170-
String taxonomyId = taxonomyResponse.getName();
2171-
2172-
CreatePolicyTagRequest createPolicyTagRequest =
2173-
CreatePolicyTagRequest.newBuilder()
2174-
.setParent(taxonomyId)
2175-
.setPolicyTag(PolicyTag.newBuilder().setDisplayName("ExamplePolicyTag").build())
2176-
.build();
2177-
PolicyTag policyTagResponse = policyTagManagerClient.createPolicyTag(createPolicyTagRequest);
2178-
String policyTagId = policyTagResponse.getName();
2179-
PolicyTags policyTags =
2180-
PolicyTags.newBuilder().setNames(ImmutableList.of(policyTagId)).build();
2181-
Field stringFieldWithPolicy =
2182-
Field.newBuilder("StringFieldWithPolicy", LegacySQLTypeName.STRING)
2183-
.setMode(Field.Mode.NULLABLE)
2184-
.setDescription("field has a policy")
2185-
.setPolicyTags(policyTags)
2186-
.build();
2187-
Schema policySchema =
2188-
Schema.of(STRING_FIELD_SCHEMA, stringFieldWithPolicy, INTEGER_FIELD_SCHEMA);
2189-
2190-
String policyDatasetName = "policyset_" + UUID.randomUUID().toString().replace("-", "_");
2191-
globalBigQuery.create(DatasetInfo.newBuilder(policyDatasetName).setLocation("US").build());
2192-
try {
2193-
// Test: Amend an existing schema with a policy tag.
2194-
String tableNameForUpdate = "test_update_table_policytags";
2195-
TableId tableIdForUpdate = TableId.of(policyDatasetName, tableNameForUpdate);
2196-
TableInfo tableInfo =
2197-
TableInfo.newBuilder(tableIdForUpdate, StandardTableDefinition.of(TABLE_SCHEMA))
2198-
.setDescription("policy tag update test table")
2199-
.build();
2200-
Table createdTableForUpdate = globalBigQuery.create(tableInfo);
2201-
assertNotNull(createdTableForUpdate);
2202-
Schema schema = createdTableForUpdate.getDefinition().getSchema();
2203-
FieldList fields = schema.getFields();
2204-
// Create a new schema adding the current fields, plus the new policy tag field
2205-
List<Field> fieldList = new ArrayList<>();
2206-
for (Field field : fields) {
2207-
fieldList.add(field);
2208-
}
2209-
fieldList.add(stringFieldWithPolicy);
2210-
Schema updatedSchemaWithPolicyTag = Schema.of(fieldList);
2211-
Table updatedTable =
2212-
createdTableForUpdate.toBuilder()
2213-
.setDefinition(StandardTableDefinition.of(updatedSchemaWithPolicyTag))
2214-
.build();
2215-
updatedTable.update();
2216-
Table remoteUpdatedTable = globalBigQuery.getTable(policyDatasetName, tableNameForUpdate);
2217-
assertEquals(
2218-
updatedSchemaWithPolicyTag,
2219-
remoteUpdatedTable.<StandardTableDefinition>getDefinition().getSchema());
2220-
globalBigQuery.delete(tableIdForUpdate);
2221-
2222-
// Test: Create a new table with a policy tag defined.
2223-
String tableName = "test_create_table_policytags";
2224-
TableId tableId = TableId.of(policyDatasetName, tableName);
2225-
StandardTableDefinition tableDefinition =
2226-
StandardTableDefinition.newBuilder().setSchema(policySchema).build();
2227-
Table createdTable = globalBigQuery.create(TableInfo.of(tableId, tableDefinition));
2228-
assertNotNull(createdTable);
2229-
Table remoteTable = globalBigQuery.getTable(policyDatasetName, tableName);
2230-
assertEquals(
2231-
policySchema, remoteTable.<StandardTableDefinition>getDefinition().getSchema());
2232-
globalBigQuery.delete(tableId);
2233-
} finally {
2234-
RemoteBigQueryHelper.forceDelete(globalBigQuery, policyDatasetName);
2235-
}
2236-
2237-
// Clean up policy tags
2238-
policyTagManagerClient.deletePolicyTag(policyTagId);
2239-
policyTagManagerClient.deleteTaxonomy(taxonomyId);
2240-
}
2241-
}
2242-
22432143
@Test
22442144
void testCreateAndGetTable() {
22452145
String tableName = "test_create_and_get_table";

‎java-cloud-bom/README.md‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -123,7 +123,6 @@ This is the table of modules included in the latest libraries-bom release:
123123
| google-cloud-core | Runtime | [2.73.0](https://cloud.google.com/java/docs/reference/google-cloud-core/latest/overview) | [Google Cloud Core](n/a) |
124124
| google-cloud-data-fusion | Product | [1.95.0](https://cloud.google.com/java/docs/reference/google-cloud-data-fusion/latest/overview) | [Cloud Data Fusion](https://cloud.google.com/data-fusion/docs) |
125125
| google-cloud-databasecenter | Product | [0.16.0](https://cloud.google.com/java/docs/reference/google-cloud-databasecenter/latest/overview) | N/A |
126-
| google-cloud-datacatalog | Product | [1.101.0](https://cloud.google.com/java/docs/reference/google-cloud-datacatalog/latest/overview) | [Data Catalog](https://cloud.google.com/data-catalog) |
127126
| google-cloud-dataflow | Product | [0.99.0](https://cloud.google.com/java/docs/reference/google-cloud-dataflow/latest/overview) | [Dataflow](https://cloud.google.com/dataflow/docs) |
128127
| google-cloud-dataform | Product | [0.94.0](https://cloud.google.com/java/docs/reference/google-cloud-dataform/latest/overview) | [Cloud Dataform](https://cloud.google.com/dataform/docs) |
129128
| google-cloud-datalabeling | Product | [0.215.0](https://cloud.google.com/java/docs/reference/google-cloud-datalabeling/latest/overview) | [Data Labeling](https://cloud.google.com/ai-platform/data-labeling/docs/) |

‎java-cloud-bom/libraries-bom-table-generation/javaModulesMetadata.yaml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,6 @@ google-cloud-contentwarehouse: https://cloud.google.com/document-warehouse/docs/
8080
Document AI Warehouse
8181
google-cloud-core: n/a, Google Cloud Core
8282
google-cloud-data-fusion: https://cloud.google.com/data-fusion/docs, Cloud Data Fusion
83-
google-cloud-datacatalog: https://cloud.google.com/data-catalog, Data Catalog
8483
google-cloud-dataflow: https://cloud.google.com/dataflow/docs, Dataflow
8584
google-cloud-dataform: https://cloud.google.com/dataform/docs, Cloud Dataform
8685
google-cloud-datalabeling: https://cloud.google.com/ai-platform/data-labeling/docs/,

‎java-cloud-bom/tests/dependency-convergence/pom.xml‎

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -136,10 +136,6 @@
136136
<artifactId>google-cloud-data-fusion</artifactId>
137137
<groupId>com.google.cloud</groupId>
138138
</dependency>
139-
<dependency>
140-
<artifactId>google-cloud-datacatalog</artifactId>
141-
<groupId>com.google.cloud</groupId>
142-
</dependency>
143139
<dependency>
144140
<artifactId>google-cloud-datalabeling</artifactId>
145141
<groupId>com.google.cloud</groupId>

‎java-datacatalog/.cloud/main.tf‎

Lines changed: 0 additions & 13 deletions
This file was deleted.

‎java-datacatalog/.cloud/variables.tf‎

Lines changed: 0 additions & 7 deletions
This file was deleted.

‎java-datacatalog/.repo-metadata.json‎

Lines changed: 0 additions & 15 deletions
This file was deleted.

0 commit comments

Comments
 (0)