Skip to content

Commit

Permalink
update outdated hyperlinks referencing provider package files (#45332)
Browse files Browse the repository at this point in the history
* udpated 404 hyperlink to gcstogcsoperator

* udpated 404 hyperlink to all provider code references
  • Loading branch information
rahul-madaan authored Jan 1, 2025
1 parent 53ec279 commit 3dd5b0c
Show file tree
Hide file tree
Showing 7 changed files with 11 additions and 11 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ Update the policy store schema
the policy store.
* You have an existing policy store used for Airflow and you made some modifications to its schema you want to revert.
* You have an existing policy store used for Airflow and you want to update its schema to the latest version.
This is only needed if your policy store schema and `the latest schema version <https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/auth_manager/avp/schema.json>`_
This is only needed if your policy store schema and `the latest schema version <https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/auth_manager/avp/schema.json>`_
are different. If so, there should be a warning message when Airflow is starting.

With CLI
Expand All @@ -100,7 +100,7 @@ Please follow the instructions below to update the Amazon Verified Permissions p
2. Choose the policy store used by Airflow (by default its description is ``Airflow``).
3. In the navigation pane on the left, choose **Schema**.
4. Choose **Edit schema** and then choose **JSON mode**.
5. Enter the content of `the latest schema version <https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/auth_manager/avp/schema.json>`_
5. Enter the content of `the latest schema version <https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/auth_manager/avp/schema.json>`_
in the **Contents** field.
6. Choose **Save changes**.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@
.. warning::
The Batch Executor is alpha/experimental at the moment and may be subject to change without warning.
.. |executorName| replace:: Batch
.. |dockerfileLink| replace:: `here <https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/executors/Dockerfile>`__
.. |dockerfileLink| replace:: `here <https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/executors/Dockerfile>`__
.. |configKwargs| replace:: SUBMIT_JOB_KWARGS

==================
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
.. |executorName| replace:: ECS
.. |dockerfileLink| replace:: `here <https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/executors/Dockerfile>`__
.. |dockerfileLink| replace:: `here <https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/executors/Dockerfile>`__
.. |configKwargs| replace:: SUBMIT_JOB_KWARGS

================
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -357,8 +357,8 @@ like extracting column level lineage and inputs/outputs from SQL query with SQL
return lineage_metadata
For more examples of OpenLineage Extractors, check out the source code of
`BashExtractor <https://github.com/apache/airflow/blob/main/airflow/providers/openlineage/extractors/bash.py>`_ or
`PythonExtractor <https://github.com/apache/airflow/blob/main/airflow/providers/openlineage/extractors/python.py>`_.
`BashExtractor <https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/openlineage/extractors/bash.py>`_ or
`PythonExtractor <https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/openlineage/extractors/python.py>`_.

.. _inlets_outlets:openlineage:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -436,7 +436,7 @@ def _check_avp_schema_version(self):
if not self.avp_facade.is_policy_store_schema_up_to_date():
self.log.warning(
"The Amazon Verified Permissions policy store schema is different from the latest version "
"(https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/auth_manager/avp/schema.json). "
"(https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/auth_manager/avp/schema.json). "
"Please update it to its latest version. "
"See doc: https://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/auth-manager/setup/amazon-verified-permissions.html#update-the-policy-store-schema."
)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,7 @@ Here, we are calling the `get_waiter` function defined in `base_aws.py` which ta
}
```

For more information about writing custom waiter, see the [README.md](https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/waiters/README.md) for custom waiters.
For more information about writing custom waiter, see the [README.md](https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/waiters/README.md) for custom waiters.

In some cases, a built-in or custom waiter may not be able to solve the problem. In such cases, the asynchronous method used to poll the boto3 API would need to be defined in the hook of the service being used. This method is essentially the same as the synchronous version of the method, except that it will use the aiobotocore client, and will be awaited. For the Redshift example, the async `describe_clusters` method would look as follows:

Expand Down
6 changes: 3 additions & 3 deletions providers/src/airflow/providers/apache/beam/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,8 +71,8 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| New Airflow 2.0 operators: `airflow.providers.apache.beam` package |
|:---------------------------------------------------------------------------------------------------------------------------------------------|
| [operators.beam.BeamRunJavaPipelineOperator](https://github.com/apache/airflow/blob/main/airflow/providers/apache/beam/operators/beam.py) |
| [operators.beam.BeamRunPythonPipelineOperator](https://github.com/apache/airflow/blob/main/airflow/providers/apache/beam/operators/beam.py) |
| [operators.beam.BeamRunJavaPipelineOperator](https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/apache/beam/operators/beam.py) |
| [operators.beam.BeamRunPythonPipelineOperator](https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/apache/beam/operators/beam.py) |


## Hooks
Expand All @@ -81,7 +81,7 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| New Airflow 2.0 hooks: `airflow.providers.apache.beam` package |
|:-----------------------------------------------------------------------------------------------------------------|
| [hooks.beam.BeamHook](https://github.com/apache/airflow/blob/main/airflow/providers/apache/beam/hooks/beam.py) |
| [hooks.beam.BeamHook](https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/apache/beam/hooks/beam.py) |


## Releases

0 comments on commit 3dd5b0c

Please sign in to comment.