Skip to content

Commit 468b809

Browse files
authored
[FSTORE-1619] Update Flink certificate management (#427)
1 parent 8487e95 commit 468b809

File tree

1 file changed

+1
-29
lines changed

1 file changed

+1
-29
lines changed

docs/user_guides/integrations/flink.md

+1-29
Original file line numberDiff line numberDiff line change
@@ -3,35 +3,7 @@ description: Documentation on how to configure an external Flink cluster to writ
33
---
44
# Flink Integration
55

6-
Connecting to the Feature Store from an external Flink cluster, such as AWS EMR and GCP DataProc requires configuring it with the Hopsworks certificates. This guide explains step by step how to connect to the Feature Store from an external Flink cluster.
7-
8-
## Download the Hopsworks Certificates
9-
In the *Project Settings*, select the *integration* tab and scroll to the *Configure Spark Integration* section. Click on *Download certificates*.
10-
11-
<p align="center">
12-
<figure>
13-
<img src="../../../assets/images/guides/integrations/spark_integration.png" alt="Spark integration tab">
14-
<figcaption>The Spark Integration gives access to Jars and configuration for an external Spark cluster</figcaption>
15-
</figure>
16-
</p>
17-
18-
Hopsworks uses X.509 certificates for authentication and authorization. If you are interested in the Hopsworks security model, you can read more about it in this [blog post](https://www.hopsworks.ai/post/how-we-secure-your-data-with-hopsworks).
19-
The certificates are composed of three different components: the `keyStore.jks` containing the private key and the certificate for your project user, the `trustStore.jks` containing the certificates for the Hopsworks certificates authority, and a password to unlock the private key in the `keyStore.jks`. The password is displayed in a pop-up when downloading the certificate and should be saved in a file named `material_passwd`.
20-
21-
!!! warning
22-
When you copy-paste the password to the `material_passwd` file, pay attention to not introduce additional empty spaces or new lines.
23-
24-
The three files (`keyStore.jks`, `trustStore.jks` and `material_passwd`) should be accessible by your Flink application.
25-
26-
## Configure your Flink cluster
27-
28-
Add the following configuration to the `flink-conf.yaml`:
29-
30-
```
31-
flink.hadoop.hops.ssl.keystore.name: replace_this_with_actual_path/keyStore.jks
32-
flink.hadoop.hops.ssl.truststore.name: replace_this_with_actual_path/trustStore.jks
33-
flink.hadoop.hops.ssl.keystores.passwd.name: replace_this_with_actual_path/material_passwd
34-
```
6+
Connecting to the Feature Store from an external Flink cluster, such as AWS EMR and GCP DataProc requires configuring it with the Hopsworks certificates, done automatically when using Hopsworks API. This guide explains how to connect to the Feature Store from an external Flink cluster.
357

368
## Generating an API Key
379

0 commit comments

Comments
 (0)