Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Use block storage for Crunchy Postgres and RabbitMQ for AWS (PSKD-1282) #594

Merged
merged 4 commits into from
Feb 27, 2025

Conversation

dhoucgitter
Copy link
Member

@dhoucgitter dhoucgitter commented Feb 18, 2025

Changes

  • For AWS, create block storage classes for RabbitMQ and Crunchy Postgres use so that persistent volume claim requests in those applications create elastic block storage based persistent volumes instead of using NFS based persistent volumes for those applications.
  • For AWS, configure the two new io2 based storage classes with reasonable iopsPerGB and Throughput defaults based on volume sizes for satisfactory RabbitMQ and Crunchy Postgres performance. Allow for configuration variable overrides to choose different volume types or performance related parameters for the new storage classes if needed.

Development tests

Scenario Provider DAC deploy method K8s version Cadence RabbitMQ PVs RabbitMQ PV IOPS Crunchy Postgres PVs Crunchy Postgres PV IOPS Provisioner Notes
1 AWS deploy cmd 1.30.9 stable 2025.01 three 4Gi RWO io2-vol-mq based PVs three 4Gi PVs at 2000 IOPS four RWO io2-vol-pg based PVs, each 128 Gi PV 5120 IOPS ebs csi driver Successful Viya deployment, all pods including the RabbitMQ and Crunchy pods using block storage PVs are at Running
2 Azure deploy cmd 1.30.9 stable 2025.01 three 2Gi RWO sas storage class based PVs n/a four RWO sas storage class based PVs n/a nfs-subdir-external-provisioner For Azure, verified that existing nfs-based pg-storage and sas storage classes were created as needed, four 128Gi Crunchy persistent volumes were provisioned by the nfs-subdir-external-provisioner as expected, three 2Gi RabbitMQ persistent volumes were provisioned by the nfs-subdir-external-provisioner as expected, RabbitMQ and Crunchy pods are healthy and Running, stable:2025.01 Viya deployment was successful, all pods have reached Running and are stable
3 GCP deploy cmd * * three 2Gi RWO sas storage class based PVs n/a four RWO sas storage class based PVs n/a nfs-subdir-external-provisioner For GCP, verified existing nfs-based pg-storage and sas storage classes were created as needed, four 128Gi Crunchy persistent volumes were provisioned by the nfs-subdir-external-provisioner as expected, three 2Gi RabbitMQ persistent volumes were provisioned by the nfs-subdir-external-provisioner as expected, RabbitMQ and Crunchy pods are Running, Viya deployment was successful

@dhoucgitter dhoucgitter added the enhancement New feature or request label Feb 18, 2025
@dhoucgitter dhoucgitter self-assigned this Feb 18, 2025
@dhoucgitter dhoucgitter marked this pull request as ready for review February 21, 2025 16:25
Copy link
Contributor

@saschjmil saschjmil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

Copy link
Contributor

@joboon joboon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, just a question for my own understanding.

@dhoucgitter dhoucgitter merged commit 7503f29 into staging Feb 27, 2025
4 checks passed
@dhoucgitter dhoucgitter deleted the pr-pskd-1282 branch February 27, 2025 21:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants