Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOC-806: adding revised Datadog integration doc #1961

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

dmitry-spectro
Copy link

Describe the Change

This PR pushes revised Datadog documentation

Review Changes

💻 Add Preview URL

🎫 Jira Ticket

Copy link

netlify bot commented Jan 3, 2024

Deploy Preview for docs-spectrocloud ready!

Name Link
🔨 Latest commit f7d0209
🔍 Latest deploy log https://app.netlify.com/sites/docs-spectrocloud/deploys/66edd628d2840a00080966cd
😎 Deploy Preview https://deploy-preview-1961--docs-spectrocloud.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

---


# Palette Datadog Integration
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


# Palette Datadog Integration

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters managed by Palette to Datadog. This guide will walk you through the steps to accomplish this through installing Datadog Helm chart and configuring it.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


# Palette Datadog Integration

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters managed by Palette to Datadog. This guide will walk you through the steps to accomplish this through installing Datadog Helm chart and configuring it.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


# Palette Datadog Integration

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters managed by Palette to Datadog. This guide will walk you through the steps to accomplish this through installing Datadog Helm chart and configuring it.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


2. Kubernetes Cluster with admin rights under Palette control

3. Datadog account with API key
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

|**Line**| **Modification**|
|---|---|
|2 | choose namespace for Datadog install, for example: namespace: "datadog"|
|36 | add your Datadog API key saved earlier |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

|---|---|
|2 | choose namespace for Datadog install, for example: namespace: "datadog"|
|36 | add your Datadog API key saved earlier |
|117 | choose your regional Datadog website, for example datadoghq.eu, please refer to [Datadog Documentation](https://docs.datadoghq.com/) for the full list
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

:::

:::caution
Make sure to save the profile after making these changes!
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Google.Exclamation] Don't use exclamation points in text.


![alt_text](/datadog/audit-logs_datadog-06_profile_confirm.png "Profile")

6. After some time, the Datadog agent should start reporting, click **Finish** to get to the Datadog Panel and verify that audit logs are indeed being transferred to it.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


## Validate

Open Datadog console by clicking **Logs** on the left hand side and make sure you're seeing Kubernetes audit logs flowing in
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

Copy link
Contributor

github-actions bot commented Jan 3, 2024

Images automagically compressed by Calibre's image-actions

Compression reduced images by 8.3%, saving 238.45 KB.

Filename Before After Improvement Visual comparison
static/assets/docs/images/datadog/audit-logs_datadog-01_datadog_signup.png 337.56 KB 332.31 KB -1.6% View diff
static/assets/docs/images/datadog/audit-logs_datadog-02_datadog_apikey.png 395.51 KB 388.24 KB -1.8% View diff
static/assets/docs/images/datadog/audit-logs_datadog-03_helm_repository.png 183.38 KB 179.73 KB -2.0% View diff
static/assets/docs/images/datadog/audit-logs_datadog-04_helm_chart.png 360.00 KB 189.73 KB -47.3% View diff
static/assets/docs/images/datadog/audit-logs_datadog-05_helm_modifications.png 514.55 KB 497.84 KB -3.2% View diff
static/assets/docs/images/datadog/audit-logs_datadog-06_profile_confirm.png 100.47 KB 97.73 KB -2.7% View diff
static/assets/docs/images/datadog/audit-logs_datadog-07_datadog_agent.png 395.96 KB 385.25 KB -2.7% View diff
static/assets/docs/images/datadog/audit-logs_datadog-08_datadog_example.png 578.79 KB 556.93 KB -3.8% View diff

560 images did not require optimisation.

@karl-cardenas-coding karl-cardenas-coding mentioned this pull request Jan 3, 2024
@karl-cardenas-coding karl-cardenas-coding removed the request for review from ritawatson January 3, 2024 17:44

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters managed by Palette to Datadog. This guide will walk you through the steps to accomplish this through installing Datadog Helm chart and configuring it.

## Prerequisites:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[spectrocloud-docs-internal.colon] Use colons only to introduce lists, unless in code blocks or inline code.


Datadog will provide you with an API key, record it for the future

![alt_text](/datadog/audit-logs_datadog-02_datadog_apikey.png "Datadog APIkey")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


:::

![alt_text](/datadog/audit-logs_datadog-03_helm_repository.png "Helm Repository")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


Then click on **Add new pack**, choose Pack Type **Helm Chart** and Registry **Datadog** Then pick the **Datadog** chart and its latest version.

![alt_text](/datadog/audit-logs_datadog-04_helm_chart.png "Helm Chart")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


4. This will open a Helm chart modification window, so that Datadog installation collects all the necessary data, you need to modify a number of parameters and to add two YAML stanzas to the Helm chart

![alt_text](/datadog/audit-logs_datadog-05_helm_modifications.png "Helm modifications")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


6. After some time, the Datadog agent should start reporting, click **Finish** to get to the Datadog Panel and verify that audit logs are indeed being transferred to it.

![alt_text](/datadog/audit-logs_datadog-07_datadog_agent.png "Datadog agent")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


![alt_text](/datadog/audit-logs_datadog-07_datadog_agent.png "Datadog agent")

7. Enable configmap for the cluster to collect data: create a `datadog-configmap.yaml` file with the following content:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[spectrocloud-docs-internal.colon] Use colons only to introduce lists, unless in code blocks or inline code.

and apply it with the kubeconfig file for the Kubernetes cluster from which you want to obtain audit logs:

```bash
kubectl -n datadog apply -f datadog-configmap.yaml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[spectrocloud-docs-internal.longform] Avoid using the short form of commands. Replace the short form flag in 'apply -f' with the corresponding long form flag.

```

:::tip
Make sure path for apiserver corresponds to what is in `kube-apiserver-arg` argument of the Kubernetes cluster, you can look it up in Kubernetes profile in Palette. In case of k3s it is `/var/log/apiserver`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Terms] Use 'K3s' instead of 'k3s'.


Open Datadog console by clicking **Logs** on the left hand side and make sure you're seeing Kubernetes audit logs flowing in

![alt_text](/datadog/audit-logs_datadog-08_datadog_example.png "Datadog Example")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?

Copy link

@kuberca kuberca left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please ingore. devsecops tests.


1. Ensure you have access to Datadog console, navigate to [https://app.datadoghq.eu/signup](https://app.datadoghq.eu/signup) to obtain a free trial. Pick appropriate region (for example, EU1), provide your name, email address and company name, and click **Sign up**

![alt_text](/datadog/audit-logs_datadog-01_datadog_signup.webp "Datadog Signup" )
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


Datadog will provide you with an API key, record it for the future

![alt_text](/datadog/audit-logs_datadog-02_datadog_apikey.webp "Datadog APIkey")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


:::

![alt_text](/datadog/audit-logs_datadog-03_helm_repository.webp "Helm Repository")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


Then click on **Add new pack**, choose Pack Type **Helm Chart** and Registry **Datadog** Then pick the **Datadog** chart and its latest version.

![alt_text](/datadog/audit-logs_datadog-04_helm_chart.webp "Helm Chart")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


4. This will open a Helm chart modification window, so that Datadog installation collects all the necessary data, you need to modify a number of parameters and to add two YAML stanzas to the Helm chart

![alt_text](/datadog/audit-logs_datadog-05_helm_modifications.webp "Helm modifications")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?

|**Line**| **Modification**|
|---|---|
|2 | choose namespace for Datadog install, for example: namespace: "datadog"|
|38 | add your Datadog API key saved earlier |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

|---|---|
|2 | choose namespace for Datadog install, for example: namespace: "datadog"|
|38 | add your Datadog API key saved earlier |
|119 | choose your regional Datadog website, for example datadoghq.eu, please refer to [Datadog Documentation](https://docs.datadoghq.com/) for the full list
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


5. Now apply new created profile to the cluster: go to **Profiles** of the cluster, click on blue **+** sign, choose `datadog` profile and click on **Confirm**

![alt_text](/datadog/audit-logs_datadog-06_profile_confirm.webp "Profile")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


6. After some time, the Datadog agent should start reporting, click **Finish** to get to the Datadog Panel and verify that audit logs are indeed being transferred to it.

![alt_text](/datadog/audit-logs_datadog-07_datadog_agent.webp "Datadog agent")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


Open Datadog console by clicking **Logs** on the left hand side and make sure you're seeing Kubernetes audit logs flowing in

![alt_text](/datadog/audit-logs_datadog-08_datadog_example.webp "Datadog Example")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?


# Palette Datadog Integration

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

# Palette Datadog Integration

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters
managed by Palette to Datadog. This guide will walk you through the steps to accomplish this through installing Datadog
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

# Palette Datadog Integration

Datadog is a monitoring and analytics tool. You can set up Palette to export audit logs from your Kubernetes clusters
managed by Palette to Datadog. This guide will walk you through the steps to accomplish this through installing Datadog
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?


### Datadog configuration

1. Ensure you have access to Datadog console, navigate to
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

[https://app.datadoghq.eu/signup](https://app.datadoghq.eu/signup) to obtain a free trial. Pick appropriate region
(for example, EU1), provide your name, email address and company name, and click **Sign up**

![alt_text](/datadog/audit-logs_datadog-01_datadog_signup.webp "Datadog Signup")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'alt_text'?

| -------- | ------------------------------------------------------------------------------------------------------------------------------------------------------ |
| 2 | choose namespace for Datadog install, for example: namespace: "datadog" |
| 38 | add your Datadog API key saved earlier |
| 119 | choose your regional Datadog website, for example datadoghq.eu, please refer to [Datadog Documentation](https://docs.datadoghq.com/) for the full list |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Datadog'?

```

:::tip Make sure `mountPath` and `path` for apiserver correspond to what is set up in `kube-apiserver-arg` argument of
your Kubernetes cluster, you can look it up in Kubernetes profile in Palette. In case of k3s it is `/var/log/apiserver`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Terms] Use 'K3s' instead of 'k3s'.

your Kubernetes cluster, you can look it up in Kubernetes profile in Palette. In case of k3s it is `/var/log/apiserver`
:::

:::caution Make sure to save the profile after making these changes! :::
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Google.Exclamation] Don't use exclamation points in text.

service: audit
```

and apply it with the kubeconfig file for the Kubernetes cluster from which you want to obtain audit logs:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[spectrocloud-docs-internal.colon] Use colons only to introduce lists, unless in code blocks or inline code.

```

:::tip Make sure path for apiserver corresponds to what is in `kube-apiserver-arg` argument of the Kubernetes cluster,
you can look it up in Kubernetes profile in Palette. In case of k3s it is `/var/log/apiserver` :::
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Terms] Use 'K3s' instead of 'k3s'.

@vault-token-factory-spectrocloud
Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 60.7%, saving 1.49 MB.

Filename Before After Improvement Visual comparison
static/assets/docs/images/datadog/audit-logs_datadog-01_datadog_signup.webp 88.52 KB 85.48 KB -3.4% View diff
static/assets/docs/images/datadog/audit-logs_datadog-02_datadog_apikey.webp 264.25 KB 51.58 KB -80.5% View diff
static/assets/docs/images/datadog/audit-logs_datadog-03_helm_repository.webp 565.43 KB 105.40 KB -81.4% View diff
static/assets/docs/images/datadog/audit-logs_datadog-04_helm_chart.webp 81.82 KB 79.48 KB -2.9% View diff
static/assets/docs/images/datadog/audit-logs_datadog-05_helm_modifications.webp 193.08 KB 188.13 KB -2.6% View diff
static/assets/docs/images/datadog/audit-logs_datadog-06_profile_confirm.webp 562.32 KB 76.27 KB -86.4% View diff
static/assets/docs/images/datadog/audit-logs_datadog-07_datadog_agent.webp 436.04 KB 103.12 KB -76.3% View diff
static/assets/docs/images/datadog/audit-logs_datadog-08_datadog_example.webp 313.75 KB 294.31 KB -6.2% View diff

719 images did not require optimisation.

@vault-token-factory-spectrocloud
Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 1.6%, saving 9.45 KB.

Filename Before After Improvement Visual comparison
static/assets/docs/images/datadog/audit-logs_datadog-02_datadog_apikey.webp 51.58 KB 50.62 KB -1.9% View diff
static/assets/docs/images/datadog/audit-logs_datadog-03_helm_repository.webp 105.40 KB 104.03 KB -1.3% View diff
static/assets/docs/images/datadog/audit-logs_datadog-04_helm_chart.webp 79.48 KB 78.36 KB -1.4% View diff
static/assets/docs/images/datadog/audit-logs_datadog-05_helm_modifications.webp 188.13 KB 185.40 KB -1.5% View diff
static/assets/docs/images/datadog/audit-logs_datadog-06_profile_confirm.webp 76.27 KB 75.24 KB -1.3% View diff
static/assets/docs/images/datadog/audit-logs_datadog-07_datadog_agent.webp 103.12 KB 100.88 KB -2.2% View diff

721 images did not require optimisation.

@vault-token-factory-spectrocloud
Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 1.3%, saving 1.31 KB.

Filename Before After Improvement Visual comparison
static/assets/docs/images/datadog/audit-logs_datadog-07_datadog_agent.webp 100.88 KB 99.57 KB -1.3% View diff

726 images did not require optimisation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants