-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
jaxdecomp proto #21
Open
ASKabalan
wants to merge
114
commits into
main
Choose a base branch
from
ASKabalan/jaxdecomp_proto
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
jaxdecomp proto #21
Changes from all commits
Commits
Show all changes
114 commits
Select commit
Hold shift + click to select a range
a742065
adding example of distributed solution
EiffL 6408aff
put back old functgion
EiffL 319942a
update formatting
EiffL ac86468
add halo exchange and slice pad
ASKabalan e62cd84
apply formatting
ASKabalan 5775a37
implement distributed optimized cic_paint
ASKabalan 7501b5b
Use new cic_paint with halo
ASKabalan 7f48cfa
Fix seed for distributed normal
ASKabalan c81d4d2
Wrap interpolation function to avoid all gather
ASKabalan abde543
Return normal order frequencies for single GPU
ASKabalan 82be568
add example
ASKabalan 4f508b7
format
ASKabalan 5f6d42e
add optimised bench script
ASKabalan 1f6b9c3
times in ms
ASKabalan ed8cf8e
add lpt2
ASKabalan 0216837
update benchmark and add slurm
ASKabalan 5b7f595
Visualize only final field
ASKabalan 1f20351
Update scripts/distributed_pm.py
ASKabalan f25eb7d
Adjust pencil type for frequencies
ASKabalan 8c5bd76
fix painting issue with slabs
ASKabalan 75604d2
Shared operation in fourrier space now take inverted sharding axis for
ASKabalan ccbfee3
add assert to make pyright happy
ASKabalan aebc3e7
adjust test for hpc-plotter
ASKabalan 9af4659
add PMWD test
ASKabalan 831291c
bench
ece8c93
format
ASKabalan 783a974
Merge remote-tracking branch 'upstream/main' into ASKabalan/jaxdecomp…
ASKabalan 02754cf
added github workflow
ASKabalan 8da3149
fix formatting from main
ASKabalan 2ea05a1
Update for jaxDecomp pure JAX
ab86699
merge with JZ
ASKabalan afecb13
revert single halo extent change
ASKabalan 01b9527
update for latest jaxDecomp
ASKabalan ff1c5e8
remove fourrier_space in autoshmap
ASKabalan 0ce7219
make normal_field work with single controller
ASKabalan 9c94f99
format
ASKabalan 375f204
make distributed pm work in single controller
ASKabalan 5a587fd
merge bench_pm
ASKabalan a160a3f
update to leapfrog
ASKabalan 38714cf
add a strict dependency on jaxdecomp
ASKabalan 591ee32
global mesh no longer needed
ASKabalan a5b267b
kernels.py no longer uses global mesh
ASKabalan 56ffd26
quick fix in distributed
ASKabalan 80c56dc
pm.py no longer uses global mesh
ASKabalan 105568e
painting.py no longer uses global mesh
ASKabalan 4d944f0
update demo script
ASKabalan a8b194f
quick fix in kernels
ASKabalan 0433c61
quick fix in distributed
ASKabalan 2f50993
update demo
ASKabalan 8623308
merge hugos LPT2 code
ASKabalan 82b8f56
format
ASKabalan 85cca44
Merge remote-tracking branch 'upstream/main' into ASKabalan/jaxdecomp…
ASKabalan d28982e
Small fix
ASKabalan 82f2987
format
ASKabalan 31ca41b
remove duplicate get_ode_fn
ASKabalan cf799b6
update visualizer
ASKabalan 0bb992f
update compensate CIC
ASKabalan 45b2c7f
By default check_rep is false for shard_map
ASKabalan 505f2ec
remove experimental distributed code
ASKabalan 5d4f438
update PGDCorrection and neural ode to use new fft3d
ASKabalan 8e8e896
jaxDecomp pfft3d promotes to complex automatically
ASKabalan 69c35d1
Merge remote-tracking branch 'upstream/main' into ASKabalan/jaxdecomp…
ASKabalan 0f833f0
remove deprecated stuff
EiffL d2f1eb2
fix painting issue with read_cic
ASKabalan ff8856d
use jnp interp instead of jc interp
ASKabalan 0c96a4d
delete old slurms
ASKabalan 49dd18a
add notebook examples
ASKabalan 11f7e90
Merge remote-tracking branch 'upstream/ASKabalan/jaxdecomp_proto' int…
ASKabalan 4342279
apply formatting
ASKabalan cc4f310
add distributed zeros
ASKabalan d62c38f
fix code in LPT2
ASKabalan b4fdb74
jit cic_paint
ASKabalan c93894f
update notebooks
ASKabalan 19011d0
apply formating
ASKabalan a757b62
get local shape and zeros can be used by users
ASKabalan f3b431a
add a user facing function to create uniform particle grid
ASKabalan 2ad035a
use jax interp instead of jax_cosmo
ASKabalan b3a264a
use float64 for enmeshing
ASKabalan b09580d
Allow applying weights with relative cic paint
ASKabalan e9529d3
Weights can be traced
ASKabalan 4da4c66
remove script folder
ASKabalan 72457d6
update example notebooks
ASKabalan a030ec4
delete outdated design file
ASKabalan f0c43f8
add readme for tutorials
ASKabalan a067954
update readme
ASKabalan 42d8e89
fix small error
ASKabalan 6256fba
forgot particles in multi host
ASKabalan 2472a5d
clarifying why cic_paint_dx is slower
ASKabalan ad45666
clarifying the halo size dependence on the box size
ASKabalan 12c74e2
ability to choose snapshots number with MultiHost script
ASKabalan 0946842
Adding animation notebook
ASKabalan 435c7c8
Put plotting in package
ASKabalan b32014b
Add finite difference laplace kernel + powerspec functions from Hugo
ASKabalan c1b276d
Put plotting utils in package
ASKabalan e0c118a
By default use absoulute painting with
ASKabalan 21373b8
update code
ASKabalan 36ef18e
update notebooks
ASKabalan f70583b
add tests
ASKabalan 7823fda
Upgrade setup.py to pyproject
ASKabalan af29c40
Format
ASKabalan 97f39bd
format tests
ASKabalan ac4ef9e
update test dependencies
ASKabalan 5d34d3c
add test workflow
ASKabalan adaf7d2
fix deprecated FftType in jaxpm.kernels
ASKabalan d8c68ac
Add aboucaud comments
ASKabalan b264da5
JAX version is 0.4.35 until Diffrax new release
ASKabalan 47c69c6
add numpy explicitly as dependency for tests
ASKabalan 8951f5c
fix install order for tests
ASKabalan 3ce0be6
add numpy to be installed
ASKabalan ae684c9
enforce no build isolation for fastpm
ASKabalan 7384343
pip install jaxpm test without build isolation
ASKabalan 3be5dae
bump jaxdecomp version
ASKabalan 158478c
revert test workflow
ASKabalan f91aa93
remove outdated tests
ASKabalan File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,21 @@ | ||
name: Code Formatting | ||
|
||
on: | ||
push: | ||
branches: [ "main" ] | ||
pull_request: | ||
branches: [ "main" ] | ||
|
||
jobs: | ||
build: | ||
runs-on: ubuntu-latest | ||
steps: | ||
- uses: actions/checkout@v4 | ||
- name: Set up Python ${{ matrix.python-version }} | ||
uses: actions/setup-python@v3 | ||
- name: Install dependencies | ||
run: | | ||
python -m pip install --upgrade pip isort | ||
python -m pip install pre-commit | ||
- name: Run pre-commit | ||
run: python -m pre_commit run --all-files |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,45 @@ | ||
name: Tests | ||
|
||
on: | ||
push: | ||
branches: | ||
- main | ||
pull_request: | ||
branches: | ||
- main | ||
|
||
jobs: | ||
run_tests: | ||
|
||
runs-on: ubuntu-latest | ||
strategy: | ||
matrix: | ||
python-version: ["3.10" , "3.11" , "3.12"] | ||
|
||
steps: | ||
- name: Checkout Source | ||
uses: actions/[email protected] | ||
|
||
- name: Set up Python ${{ matrix.python-version }} | ||
uses: actions/setup-python@v2 | ||
with: | ||
python-version: ${{ matrix.python-version }} | ||
|
||
- name: Install dependencies | ||
run: | | ||
sudo apt-get install -y libopenmpi-dev | ||
python -m pip install --upgrade pip | ||
pip install jax==0.4.35 | ||
pip install numpy setuptools cython wheel | ||
pip install git+https://github.com/MP-Gadget/pfft-python | ||
pip install git+https://github.com/MP-Gadget/pmesh | ||
pip install git+https://github.com/ASKabalan/fastpm-python --no-build-isolation | ||
pip install .[test] | ||
|
||
- name: Run Single Device Tests | ||
run: | | ||
cd tests | ||
pytest -v -m "not distributed" | ||
- name: Run Distributed tests | ||
run: | | ||
pytest -v -m distributed |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -14,4 +14,4 @@ repos: | |
rev: 5.13.2 | ||
hooks: | ||
- id: isort | ||
name: isort (python) | ||
name: isort (python) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would put the link to the README around
notebook section
.