Skip to content

Commit 0e070c8

Browse files
committed
Update instructions
1 parent 422a707 commit 0e070c8

File tree

5 files changed

+27
-16
lines changed

5 files changed

+27
-16
lines changed

README.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,22 @@
88

99
Data repository for Project Pythia examples/notebooks
1010

11+
## Sample data sets
12+
13+
These files are used as sample data in Pythia Project examples/notebooks and are downloaded by `pythia_datasets` package:
14+
15+
- `NARR_19930313_0000.nc`
16+
- `enso_data.csv`
17+
- `jan-17-co-asos.txt.xz`
18+
19+
### Adding new datasets
20+
21+
To add a new dataset file, please follow these steps:
22+
23+
1. Add the dataset file to the `data/` directory
24+
2. From the command line, run `python make_registry.py` script to update the registry file residing in `pythia_datasets/registry.txt`
25+
3. Commit and push your changes to GitHub
26+
1127
[github-ci-badge]: https://img.shields.io/github/workflow/status/ProjectPythia/pythia-datasets/CI?label=CI&logo=github&style=for-the-badge
1228
[github-lint-badge]: https://img.shields.io/github/workflow/status/ProjectPythia/pythia-datasets/linting?label=linting&logo=github&style=for-the-badge
1329
[github-ci-link]: https://github.com/ProjectPythia/pythia-datasets/actions?query=workflow%3ACI

data/README.md

Lines changed: 0 additions & 6 deletions
This file was deleted.

data/make_registry.py

Lines changed: 0 additions & 9 deletions
This file was deleted.

make_registry.py

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
import os
2+
import pathlib
3+
4+
import pooch
5+
6+
if __name__ == '__main__':
7+
here = pathlib.Path(os.path.dirname(__file__))
8+
data_dir = here / 'data'
9+
10+
pooch.make_registry(data_dir, here / 'pythia_datasets/registry.txt')

pythia_datasets/registry.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
1-
jan-17-co-asos.txt.xz c3b55b9ed67b3a3fa92636b139778e36240a09f8b6fc4d72526381b7673cc710
21
NARR_19930313_0000.nc 65a23aba0e32dc3dfa56e58fab68ad9028646e57547b246a42a8c16ed9152df4
32
enso_data.csv d81cafe5ad5cf3ee4b69c94f3401230badeb6429b85f916d62df6d74b553c371
3+
jan-17-co-asos.txt.xz c3b55b9ed67b3a3fa92636b139778e36240a09f8b6fc4d72526381b7673cc710

0 commit comments

Comments
 (0)