Add dev environment setup for JavaBuilder Lambda deployment #406

anthony-jackson-code · 2025-07-17T17:10:57Z

Add comprehensive deployment scripts for dev environment
Include pre-deployment checks for prerequisites validation
Add CloudFormation template processing from ERB
Include deployment parameters configuration
Add detailed README for new engineers
Organize all files in dev-deployment folder for better structure

Features:

Automated CloudFormation template generation
AWS credential and prerequisite validation
S3 artifact bucket management
Stack creation/update with proper error handling
Post-deployment verification steps

Add alarm for high HTTP requests

…larms Improve performance alarms

…e-codepipeline

Add alert for high Lambda invocations

Set up unit tests for javabuilder-authorizer

Prevent duplicate authorizer warnings

Enable running individual integration tests

…e-codepipeline

Make composite alarm for high request counts

Move error handling logic to the handler level

Add authorizer alarms/alerts to cloudformation template

…e-codepipeline

…o-ci-cd SL-667: Add CICD config for Javabuilder demo env

* reduce concurrency for demo mode * PR feedback

…rency-to-1 Increase provisioned concurrency to 1

next: reduce reserved concurrency

Reduce demo concurrency - step 1

Reduce demo concurrency - step 2

* update daily blocking logic * add config for dev setup * updates * decrease dev limit * update constants * update string * update configs * update prod to have no daily limit * make no limit clearer * try out -1 as no limit

update cicd readme with ruby version fix

* update limit and change alert description * try using version 2.7.5 * try using version 2.7.8 * add dev config * update alarm config * add whitespace * commas * try parens * hard-code limits * add period * temporarily change config for testing * change back to demo config * increase provisioned executions * remove dev config * switch to parameters * fix linting errors * add quotes * revert dev config change

- Add dev-deployment/ directory with complete deployment tooling - Create no-SSL deployment option for dev environments without Route53 access - Add modular deployment scripts (base infrastructure, java builds, application) - Include cleanup and health check utilities - Update CloudFormation templates to use ruby3.2 runtime (from deprecated ruby2.7) - Add comprehensive README with deployment options and troubleshooting - Implement ERB template processing with SSL resource removal - Add proper artifact management and S3 packaging for large templates - Include development configuration files and parameter templates - Create runtime placeholder system for missing Java artifacts Key features: - No-SSL deployment: deploy-javabuilder-dev-no-ssl-fixed.sh - Modular deployment: 01-deploy-base-infrastructure.sh -> 02-build-java-components.sh -> 03-deploy-application.sh - Comprehensive documentation and troubleshooting guide - Idempotent deployments safe to rerun - Proper handling of large CloudFormation templates via S3 - Development-focused with codeorg-dev AWS profile support Successfully tested with complete stack deployment in us-east-1 region.

…Python artifacts blocks - Removed unused environment configuration script check for ../config/set_environment.sh - Removed Python placeholder artifact creation for Java-based Lambda project - Streamlined script flow for better maintainability

- Align dev deployment script with production buildspec.yml workflow - Use actual build.sh scripts instead of custom build logic - Remove unnecessary base infrastructure checks and discovery logic - Use ARTIFACT_STORE environment variable like production - Replace create-stack/update-stack with modern 'cloudformation deploy' - Use parameter-overrides syntax for cleaner parameter passing - Keep dev-specific SSL removal logic for non-SSL development environment - Reduce script complexity from 300+ to ~285 lines - Improve maintainability by following production patterns

- Remove timestamp from artifact bucket name to prevent creating new buckets on each deployment - Change from 'javabuilder-dev-artifacts-1753199542' to 'javabuilder-dev-artifacts' - Simplify deployment script to use consistent bucket name without discovery logic - This ensures all deployments use the same S3 bucket for artifacts - Reduces S3 costs and prevents bucket proliferation

- Remove unused symlinks (api-gateway-routes, javabuilder-authorizer, org-code-javabuilder) - Remove obsolete deployment scripts and config files - Keep only the working deployment script (deploy-javabuilder-dev-no-ssl-fixed.sh) - Streamline directory structure for cleaner PR review

- Remove 150+ lines of complex SSL removal Python script - Rename to deploy-javabuilder-dev-with-ssl.sh (reflects SSL support) - Copy built artifacts to deployment directory for packaging - Use original SSL-enabled CloudFormation template - Clean up copied artifacts after deployment - Ready for SSL certificate configuration

- Add WildcardCertificateArn parameter to CloudFormation template - Add conditions to use existing wildcard certificate when provided - Update deployment script to check for artifact bucket existence - Switch from cp to rsync for artifact copying to avoid permission issues - Include wildcard certificate ARN in deployment parameters - Update processed template with latest artifact URIs

- Revert rsync back to cp commands to avoid directory creation issues - Add cleanup at end of script to remove temporary copied artifacts - Keep deployment directory clean after successful deployment

- Remove api-gateway-routes, javabuilder-authorizer, and org-code-javabuilder directories - These are temporary copies created during deployment and should not be tracked - Deployment script now properly cleans up these directories after packaging

sureshc · 2025-07-23T18:08:47Z

Do we really want to make a copy of the Javabuilder CloudFormation template (cicd/3-app/javabuilder/template.yml.erb) and place it in a new /dev-deployment directory (dev-deployment/app-template.yml)? Any time someone implements a change to the Javabuilder infrastructure, they would need to commit it in both files to keep Javabuilder development environments in sync with the Javabuilder web service provisioned by our CICD pipeline.

I think we need to update and document a way for an engineer to provision a development Javabuilder Stack (typically in our AWS Dev account) using the template cicd/3-app/javabuilder/template.yml.erb.

…cket policy - Replace public bucket policy (Principal: '*') with secure CloudFront OAC - Add ContentOAC resource for proper CloudFront to S3 access control - Update ContentCDN to use OriginAccessControlId instead of empty S3OriginConfig - This fixes deployment failures due to S3 Block Public Access settings

Since app-template.yml is auto-generated from the ERB template on each deployment, it shouldn't be tracked in version control.

anthony-jackson-code · 2025-07-23T19:15:57Z

@sureshc dev-deployment/app-template.yml this is always regenerated by my shell script using erb template file, i just need to add it to gitignore so it doesn't show up in my branch. Having said that, it means code will work as you are saying where no extra maintenance is required..

see in dev-deployment/deploy-javabuilder-dev-with-ssl.sh
erb -T - "$TEMPLATE_PATH/template.yml.erb" > "$APP_TEMPLATE"

bencodeorg and others added 30 commits May 26, 2022 15:05

Merge pull request #320 from code-dot-org/ben/high-http-requests-alert

ef46500

Add alarm for high HTTP requests

Add authorizer alarms/alerts to cloudformation template

2aeb523

improve alarms

1b5c2fa

lookup account ID in buildspec

8fa74c0

Merge pull request #322 from code-dot-org/molly/improve-performance-a…

40438cb

…larms Improve performance alarms

Add alert for high Lambda invocations

452bec6

Set actions enabled false

ce4d228

parameterize integration test target

648f9ca

add additional test runner env vars

30c58be

Move error handling logic to the handler level

64d7d1b

Merge branch 'main' of github.com:code-dot-org/javabuilder into creat…

badaf6e

…e-codepipeline

Set up unit tests for javabuilder-authorizer

2f02101

minor cleanup

6ec505a

Merge pull request #323 from code-dot-org/sanchit/lambda-alarms

b2ebd2e

Add alert for high Lambda invocations

Merge pull request #325 from code-dot-org/sanchit/authorizer-test

babd7df

Set up unit tests for javabuilder-authorizer

Prevent duplicate authorizer warnings

c6c4f25

Move duplicated output adapter code to util

3b2f79b

Enable running individual integration tests

86597c1

Merge pull request #326 from code-dot-org/sanchit/authorizer-warning

7fe9f27

Prevent duplicate authorizer warnings

Merge pull request #327 from code-dot-org/sanchit/integration-script

d0eae05

Enable running individual integration tests

Make composite alarm for high request counts

44a3932

Merge branch 'main' of github.com:code-dot-org/javabuilder into creat…

eece0b1

…e-codepipeline

bump limits in test

a60760e

Merge pull request #328 from code-dot-org/sanchit/composite-alarm

b789f82

Make composite alarm for high request counts

Merge pull request #324 from code-dot-org/sanchit/error-refactor

a56a0a2

Move error handling logic to the handler level

Merge pull request #321 from code-dot-org/ben/throttling-alarms

87fdb20

Add authorizer alarms/alerts to cloudformation template

add show hide buckets

53b5470

Merge branch 'main' of github.com:code-dot-org/javabuilder into creat…

d87d303

…e-codepipeline

try pinning ruby to match .ruby-version

98c6a95

try being less specific in ruby-version

a1975ba

cat5inthecradle and others added 15 commits April 11, 2023 14:11

Merge pull request #385 from code-dot-org/task/sl-667/javabuilder-dem…

01bbd21

…o-ci-cd SL-667: Add CICD config for Javabuilder demo env

update cicd readme with ruby version fix

14fbf25

quote strings to prevent conversion to boolean

0cfaad8

Merge pull request #387 from code-dot-org/quote-booleanish-strings

e0f4965

Reduce concurrency for demo mode (#388)

125bdcf

* reduce concurrency for demo mode * PR feedback

increase provisioned concurrency to 1

507fcf9

Merge pull request #389 from code-dot-org/chore/up-provisioned-concur…

cebb4dc

…rency-to-1 Increase provisioned concurrency to 1

Reduce demo provisioned concurrency

117d73b

next: reduce reserved concurrency

reduce demo reserved concurrency

6e3fd0b

Merge pull request #390 from code-dot-org/cat5inthecradle-patch-1

20b1237

Reduce demo concurrency - step 1

Merge pull request #391 from code-dot-org/cat5inthecradle-patch-2

2be46a5

Reduce demo concurrency - step 2

Add temporary per-day user throttling (#392)

82b6fe2

* update daily blocking logic * add config for dev setup * updates * decrease dev limit * update constants * update string * update configs * update prod to have no daily limit * make no limit clearer * try out -1 as no limit

Merge pull request #386 from code-dot-org/update-readme

d260afa

update cicd readme with ruby version fix

anthony-jackson-code force-pushed the feature/dev-environment-setup branch from 2d2f71d to 4e08a43 Compare July 22, 2025 13:15

anthony-jackson-code added 8 commits July 22, 2025 08:06

Fix deployment script to avoid creating project directories

78cc521

- Revert rsync back to cp commands to avoid directory creation issues - Add cleanup at end of script to remove temporary copied artifacts - Keep deployment directory clean after successful deployment

anthony-jackson-code added 2 commits July 23, 2025 11:53

Remove app-template.yml from git tracking and add to gitignore

b22b906

Since app-template.yml is auto-generated from the ERB template on each deployment, it shouldn't be tracked in version control.

anthony-jackson-code closed this Jul 23, 2025

anthony-jackson-code force-pushed the feature/dev-environment-setup branch from 17f5808 to b22b906 Compare July 23, 2025 19:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add dev environment setup for JavaBuilder Lambda deployment #406

Add dev environment setup for JavaBuilder Lambda deployment #406

anthony-jackson-code commented Jul 17, 2025

Uh oh!

sureshc commented Jul 23, 2025

Uh oh!

anthony-jackson-code commented Jul 23, 2025

Uh oh!

Uh oh!

Add dev environment setup for JavaBuilder Lambda deployment #406

Add dev environment setup for JavaBuilder Lambda deployment #406

Conversation

anthony-jackson-code commented Jul 17, 2025

Uh oh!

sureshc commented Jul 23, 2025

Uh oh!

anthony-jackson-code commented Jul 23, 2025

Uh oh!

Uh oh!