Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Importing Data from the Same S3 Repo Should Be Blocked but Isn't #8735

Open
Annaseli opened this issue Feb 27, 2025 · 0 comments
Open
Assignees
Labels
bug Something isn't working

Comments

@Annaseli
Copy link
Contributor

What happened?

Description:

I was able to import data into a repository with S3 storage from the same repo namespace on S3, even though this should be blocked.

Steps to Reproduce:

  1. Run lakeFS OSS with S3 blockstore.
  2. Create a new repository.
  3. Upload data to that repository.
  4. Attempt to import the same data from the same namespace in the S3 blockstore.

Expected Behavior:

Importing data from the same S3 namespace into the same repository should be blocked.

Actual Behavior:

The data gets imported into the repository without restriction.

My Blockstore Configuration:

blockstore:
    type: s3
    s3:
      profile: cloud-dev

Storage Namespace & Import Source:

Storage namespace: s3://annaselibucket-us-east-1/repos/oss-s3-1-repo-1
Import source: s3://annaselibucket-us-east-1/repos/oss-s3-1-repo-1

Observed Behavior Based on Destination Used:

Importing to lakefs://oss-s3-1-repo-1/main/ → Overwrites the existing data within the repository in main.
Importing to lakefs://oss-s3-1-repo-1/main/import → Adds the imported data to the "import" folder within the repository in main.

Expected behavior

No response

lakeFS version

No response

How lakeFS is installed

No response

Affected clients

No response

Relevant log output

Contact details

No response

@Annaseli Annaseli added bug Something isn't working contributor and removed contributor labels Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants