Skip to content

Conversation

@123-komal
Copy link
Contributor

Added a new Submodule cdap-SpannerMetadata

@123-komal 123-komal added the java Pull requests that update Java code label Feb 20, 2025
@bhardwaj-priyanshu bhardwaj-priyanshu added the build Triggers github actions build label Feb 20, 2025
@123-komal 123-komal force-pushed the feature-permission branch from 204ba01 to ba142d6 Compare March 4, 2025 05:46
Komal Yadav added 6 commits March 7, 2025 14:46
Add permission

Add spanner

Add Spanner

Add changes

docker

Add packaging

Add plugins

Add plugins

Add Licenses

Add changes

Add changes

Add changes

Add changes

Add changes

Add changes

Add changes

Add changes

Add changes

Add changes

Add changes in dockerfile

Add changes in dockerfile

Add changes in dockerfile

Add changes in dockerfile

Add changes in dockerfile

Add changes in dockerfile

Add changes in dockerfile

did some changes in Dockerfile

Add

Changes

Changes

Add changes

changes

Added Submodule-cdapSpannerMetadata

Add Extension Loader

Extension-Loader Changes

Removed SpannerConfig

Version Changes
This reverts commit ba142d6.
This reverts commit 999aefe.
@123-komal 123-komal force-pushed the feature-permission branch from bfea793 to d3a1fee Compare March 10, 2025 04:06
@123-komal 123-komal force-pushed the feature-permission branch 2 times, most recently from c9f8d86 to 26dddf3 Compare May 27, 2025 03:12
Added SpannerMetadata Submodule and ExtensionLoader

Added SpannerMetadata Submodule and ExtensionLoader

changes

changes
@123-komal 123-komal force-pushed the feature-permission branch from 26dddf3 to a5c6795 Compare May 27, 2025 03:57
* using Google Cloud Spanner as the underlying storage.
* It provides methods for managing metadata within a Spanner database.
*/
public class SpannerMetadataStorage implements MetadataStorage {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

* A simple class to pass around a Spanner Mutation, along with the metadata
* change that it effects.
*/
public class RequestandChange {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See if we can make interface for ES and Cloud spanner and implement it in the ext.

Otherwise check if the class can be renamed (if used in just Cloud Spanner)

}

@Override
public String getName() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can also use - this.getClass().getSimpleName();

}

@Override
public void dropIndex() throws IOException {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can return for now - throw new IOException("NOT IMPLEMENTED");

<groupId>org.hamcrest</groupId>
<artifactId>hamcrest-core</artifactId>
</dependency>
<dependency>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please check if this is needed - Usually we add spi dependency only in pom.xml


//Metadata configs
public static final String Metadata_Storage_Enabled = "metadata.storage.enabled";
public static final String Metadata_Storage_EXT_DIR = "metadata.storage.extensions.dir";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please check if this property is needed.

this.extensionLoader = extensionLoader;
this.extensionLoader.getAll();

String providerName = "spanner";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should not be hardcoded here.


@Override
public void close() {
delegate.close();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

usually we use getDelegate() method in all the calls.


public class DefaultMetadataStorageProviderContext implements MetadataStorageContext {

public static final String METADATA_STORAGE_PREFIX = "data.storage.properties.gcp-spanner";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets keep this in separate metadata/ package

@123-komal 123-komal requested review from vsethi09 and removed request for vsethi09 June 4, 2025 07:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build Triggers github actions build java Pull requests that update Java code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants