Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI/CD] decouple regular commits from nightly releases #691

Open
JulienPeloton opened this issue Apr 6, 2023 · 0 comments
Open

[CI/CD] decouple regular commits from nightly releases #691

JulienPeloton opened this issue Apr 6, 2023 · 0 comments
Assignees
Labels
Milestone

Comments

@JulienPeloton
Copy link
Member

JulienPeloton commented Apr 6, 2023

Rationale

The current CI pipeline has many disadvantages:

  1. We have a single Docker image for everything
  2. This image is huge due to scientific dependencies
  3. integration tests take forever as we check everything at every commit

Proposal

The main problems come from raw2science which imports fink_broker.science, which in turns import fink_science modules, which in turns needs the whole Earth dependencies... It would be interesting to isolate this script, and have conditional imports depending on the commit strategy (regular vs nightly). In turns, this means we can define two images:

  1. light image, with only core dependencies to test the skeleton
  2. complete image for nightly releases
@JulienPeloton JulienPeloton added this to the 3.0 milestone Apr 6, 2023
@JulienPeloton JulienPeloton self-assigned this Apr 6, 2023
@JulienPeloton JulienPeloton modified the milestones: 3.0, 3.1, 3.2 Sep 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant