Skip to content

feat: support scan from oss#217

Merged
luoyuxia merged 4 commits into
apache:mainfrom
luoyuxia:support-oss
Jan 30, 2026
Merged

feat: support scan from oss#217
luoyuxia merged 4 commits into
apache:mainfrom
luoyuxia:support-oss

Conversation

@luoyuxia
Copy link
Copy Markdown
Contributor

Purpose

Linked issue: close #215

Brief change log

Tests

API and Format

Documentation

Comment thread crates/fluss/Cargo.toml
[features]
default = ["storage-memory", "storage-fs", "storage-s3"]
storage-all = ["storage-memory", "storage-fs", "storage-s3"]
default = ["storage-memory", "storage-fs"]
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove storage-s3 from default which avoid oss users include it though they don't need.

Comment thread crates/fluss/Cargo.toml
default = ["storage-memory", "storage-fs", "storage-s3"]
storage-all = ["storage-memory", "storage-fs", "storage-s3"]
default = ["storage-memory", "storage-fs"]
storage-all = ["storage-memory", "storage-fs", "storage-s3", "storage-oss"]
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for s3 users:

fluss = { version = "x.x", features = ["storage-s3"] }

for oss users

fluss = { version = "x.x", features = ["storage-oss"] }

@luoyuxia
Copy link
Copy Markdown
Contributor Author

I'll verify it before ready to review.

@luoyuxia
Copy link
Copy Markdown
Contributor Author

Already verify oss access @fresh-borzoni @leekeiabstraction @zhaohaidao Could you please help review this?

Copy link
Copy Markdown
Contributor

@leekeiabstraction leekeiabstraction left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TY for the PR, added one small comment


assert!(convert_hadoop_key_to_opendal("fs.s3a.connection.ssl.enabled").is_none());

// OSS keys
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we also add an assertion for access_key_secret in build_remote_fs_props_includes_all_fields()?

@luoyuxia
Copy link
Copy Markdown
Contributor Author

@leekeiabstraction Thanks for your review. Commments are addressed.

Copy link
Copy Markdown
Contributor

@leekeiabstraction leekeiabstraction left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TY Added small comment

Comment thread crates/fluss/src/client/credentials.rs Outdated
Copy link
Copy Markdown
Member

@fresh-borzoni fresh-borzoni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@luoyuxia TY, LGTM.

Comment thread crates/fluss/src/client/credentials.rs Outdated
credentials.access_key_secret.clone(),
);

// OSS specific configurations, todo: consider refactor it
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@luoyuxia luoyuxia merged commit 00f4aca into apache:main Jan 30, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support read remote log segement in Aliyun OSS

3 participants