-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature-16396][storage-plugin] Add Tencent Cloud COS Storage Plugin #16565
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since we don't have any tencent cos support for integration testing. I will -1 on this until we can find a way to test against this in out UT, IT and E2E.
dolphinscheduler-storage-plugin/dolphinscheduler-storage-cos/src/test/resources/logback.xml
Show resolved
Hide resolved
...eduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/TaskConstants.java
Outdated
Show resolved
Hide resolved
...age-cos/src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageOperator.java
Fixed
Show fixed
Hide fixed
...age-cos/src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageOperator.java
Fixed
Show fixed
Hide fixed
ea644bc
to
40e5ff2
Compare
8a33b77
to
037a91b
Compare
...age-cos/src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageOperator.java
Outdated
Show resolved
Hide resolved
...age-cos/src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageOperator.java
Outdated
Show resolved
Hide resolved
...age-cos/src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageOperator.java
Outdated
Show resolved
Hide resolved
.../src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageOperatorFactory.java
Outdated
Show resolved
Hide resolved
037a91b
to
a1fdd4c
Compare
...ge-cos/src/main/java/org/apache/dolphinscheduler/plugin/storage/cos/CosStorageConstants.java
Outdated
Show resolved
Hide resolved
a1fdd4c
to
b4a834e
Compare
fc7abdd
to
2113175
Compare
dolphinscheduler-storage-plugin/dolphinscheduler-storage-cos/pom.xml
Outdated
Show resolved
Hide resolved
dolphinscheduler-storage-plugin/dolphinscheduler-storage-cos/pom.xml
Outdated
Show resolved
Hide resolved
ef4c495
to
71f8675
Compare
151fb99
to
07791a7
Compare
07791a7
to
e209cfe
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
* Fixed SonarCloud Quality Readability B (required >= A) * Added missing license files * YAML-ized Tencent COS configuration from common.properties * Added remote logger support with Tencent COS
* Removed redundant dependency: `bcprov-jdk15on-1.69.jar` * Relocated Tencent COS Constants, and reduced magic values in COS with constants * Isolated cloud storage configuration in `common.properties` -> `resource-center.yaml` * Fixed CodeQL: Uncontrolled data used in path expression
* Updated log statements in `CosRemoteLogHandler` * Updated `CosStorageOperator` * Added *maven-shade-plugin* in storage-plugin-cos/pom.xml
* Refactored `pom.xml`
e209cfe
to
2fd0793
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, Thanks for your contribution.
Quality Gate failedFailed conditions |
Awesome work, congrats on your first merged pull request! |
Purpose of the pull request
This pull request adds a Storage Plugin to the DS Resource Center to support Tencent Cloud COS and aims to close #16396 .
Brief change log
dolphinscheduler-storage-cos
indolphinscheduler-storage-plugin
CosRemoteLogHandler
indolphinscheduler-common
Verify this pull request
Pull Request Notice
Pull Request Notice
If your pull request contain incompatible change, you should also add it to
docs/docs/en/guide/upgrede/incompatible.md