Skip to content

Update SPARCL notebooks to use SDSS/BOSS DR17 instead of DR16 #291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

Update SPARCL notebooks to use SDSS/BOSS DR17 instead of DR16 #291

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
464b948
Update to use SDSS/BOSS DR17 instead of DR16
jacquesalice Nov 5, 2025
352e6e7
Update to use SDSS/BOSS DR17 instead of DR16
jacquesalice Nov 5, 2025
d2cdbfa
Update to use SDSS/BOSS DR17 instead of DR16
jacquesalice Nov 5, 2025
f790c15
Update to use SDSS/BOSS DR17 instead of DR16
jacquesalice Nov 5, 2025
7a6a173
Update to use SDSS/BOSS DR17 instead of DR16
jacquesalice Nov 5, 2025
6b2e3cc
Automated commit for HTML files
invalid-email-address Nov 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
162 changes: 79 additions & 83 deletions 03_ScienceExamples/DESI/02_DESI_SDSS_Comparison.html
View file
Open in desktop

Large diffs are not rendered by default.

509 changes: 114 additions & 395 deletions 03_ScienceExamples/DESI/02_DESI_SDSS_Comparison.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

164 changes: 86 additions & 78 deletions 03_ScienceExamples/EmLineGalaxies/01_EmLineGalaxies_SpectraStack.html
View file
Open in desktop

Large diffs are not rendered by default.

436 changes: 108 additions & 328 deletions 03_ScienceExamples/EmLineGalaxies/01_EmLineGalaxies_SpectraStack.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

85 changes: 48 additions & 37 deletions 03_ScienceExamples/EmLineGalaxies/02_EmLineGalaxies_Outliers.html
View file
Open in desktop

Large diffs are not rendered by default.

258 changes: 131 additions & 127 deletions 03_ScienceExamples/EmLineGalaxies/02_EmLineGalaxies_Outliers.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

132 changes: 70 additions & 62 deletions 03_ScienceExamples/LargeScaleStructure/LargeScaleStructureSdssCosmicSlime.html
View file
Open in desktop

Large diffs are not rendered by default.

449 changes: 224 additions & 225 deletions 03_ScienceExamples/LargeScaleStructure/LargeScaleStructureSdssCosmicSlime.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

683 changes: 429 additions & 254 deletions 04_HowTos/SPARCL/How_to_use_SPARCL.html
View file
Open in desktop

Large diffs are not rendered by default.

1,109 changes: 639 additions & 470 deletions 04_HowTos/SPARCL/How_to_use_SPARCL.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

61 changes: 46 additions & 15 deletions 04_HowTos/SPARCL/Plot_SPARCL_Spectra_with_Prospect.html
View file
Open in desktop

Large diffs are not rendered by default.

52 changes: 37 additions & 15 deletions 04_HowTos/SPARCL/Plot_SPARCL_Spectra_with_Prospect.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,8 @@
"source": [
"__nbid__ = '0053'\n",
"__author__ = 'Eric Armengaud, Benjamin Weaver <[email protected]>, Alice Jacques <[email protected]>'\n",
"__version__ = '20251007' # yyyymmdd\n",
"__datasets__ = ['sdss_dr16', 'boss_dr16', 'desi_dr1']\n",
"__version__ = '20251105' # yyyymmdd\n",
"__datasets__ = ['boss_dr17', 'desi_dr1', 'sdss_dr17']\n",
"__keywords__ = ['sparcl', 'spectroscopy', 'sdss spectra', 'desi spectra', 'tutorial', 'prospect', 'specutils']"
]
},
Expand Down Expand Up @@ -45,7 +45,7 @@
"\n",
"[prospect](https://github.com/desihub/prospect/) is an interactive spectrum visualization tool created by the [DESI collaboration](https://www.desi.lbl.gov) to view and characterize DESI spectra. It has also been adapted to display data from other projects, specifically the [Sloan Digital Sky Survey (SDSS)](https://www.sdss.org).\n",
"\n",
"*Project*: Obtain DESI DR1, SDSS DR16, and (e)BOSS DR16 spectra using the [NOIRLab SPARCL spectrum service](https://astrosparcl.datalab.noirlab.edu), convert data to [specutils objects](https://specutils.readthedocs.io/en/stable/) as needed, and use [prospect](https://github.com/desihub/prospect/) to display the data.\n",
"*Project*: Obtain DESI DR1, SDSS DR17, and (e)BOSS DR17 spectra using the [NOIRLab SPARCL spectrum service](https://astrosparcl.datalab.noirlab.edu), convert data to [specutils objects](https://specutils.readthedocs.io/en/stable/) as needed, and use [prospect](https://github.com/desihub/prospect/) to display the data.\n",
"\n",
"*Takeaway*: At no point in this notebook will any data files be opened, except for an \"Aside\" section.\n",
"\n",
Expand All @@ -65,7 +65,7 @@
"\n",
"### Disclaimers\n",
"\n",
"Note that using the Astro Data Lab constitutes your agreement with our minimal [Disclaimers](https://datalab.noirlab.edu/disclaimers.php).\n",
"Note that using the Astro Data Lab constitutes your agreement with our minimal [Disclaimers](https://datalab.noirlab.edu/about/disclaimers).\n",
"\n",
"### Acknowledgments\n",
"\n",
Expand Down Expand Up @@ -190,6 +190,27 @@
"client"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"##### TEMPORARY\n",
"\n",
"from getpass import getpass\n",
"client.login(input(\"Enter SSO user name: (+ENTER) \"),getpass(\"Enter password: (+ENTER) \"))"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"client.authorized"
]
},
{
"cell_type": "markdown",
"metadata": {},
Expand Down Expand Up @@ -224,7 +245,7 @@
"source": [
"### Find DESI spectra\n",
"\n",
"SPARCL provides access to DESI spectra that have been coadded by HEALPixel. This corresponds to entries in the `desi_dr1.zpix` table at Astro Data Lab (see column information [here](https://datalab.noirlab.edu/query.php?name=desi_dr1.zpix))."
"SPARCL provides access to DESI spectra that have been coadded by HEALPixel. This corresponds to entries in the `desi_dr1.zpix` table at Astro Data Lab (see column information [here](https://datalab.noirlab.edu/data-explorer?showTable=desi_dr1.zpix))."
]
},
{
Expand Down Expand Up @@ -931,7 +952,7 @@
"q = \"\"\"\n",
"SELECT z.specobjid, z.bestobjid, z.z, z.zerr, z.zwarning, z.class, z.subclass,\n",
" z.rchi2diff, z.primtarget, z.sectarget\n",
"FROM sdss_dr16.specobj AS z\n",
"FROM sdss_dr17.specobj AS z\n",
"WHERE z.bestobjid > 0\n",
" AND z.run2d = '26'\n",
" AND z.plate = 2955\n",
Expand Down Expand Up @@ -980,10 +1001,10 @@
},
"outputs": [],
"source": [
"include = client.get_all_fields(dataset_list=['SDSS-DR16'])\n",
"include = client.get_all_fields(dataset_list=['SDSS-DR17'])\n",
"sdss_spectra = client.retrieve_by_specid(specid_list=sdss_ids['specobjid'].value.tolist(),\n",
" include=include,\n",
" dataset_list=['SDSS-DR16'])\n",
" dataset_list=['SDSS-DR17'])\n",
"sdss_spectra.info"
]
},
Expand Down Expand Up @@ -1071,6 +1092,7 @@
"cell_type": "code",
"execution_count": null,
"metadata": {
"scrolled": true,
"tags": []
},
"outputs": [],
Expand Down Expand Up @@ -1142,8 +1164,8 @@
"columns = ('z.specobjid', 'p.objid', 'p.ra', 'p.dec', 'p.u', 'p.g', 'p.r', 'p.i', 'p.z')\n",
"q = \"\"\"\n",
"SELECT {0}\n",
"FROM sdss_dr16.specobj AS z\n",
"JOIN sdss_dr16.photoplate AS p\n",
"FROM sdss_dr17.specobj AS z\n",
"JOIN sdss_dr17.photoplate AS p\n",
"ON z.bestobjid = p.objid\n",
"WHERE p.objid IN ({1})\n",
"ORDER BY z.specobjid\n",
Expand Down Expand Up @@ -1319,7 +1341,7 @@
"SELECT z.specobjid, z.bestobjid, z.z, z.zerr, z.zwarning, z.class, z.subclass,\n",
" z.rchi2diff, z.boss_target1, z.eboss_target0, z.eboss_target1,\n",
" z.eboss_target2\n",
"FROM sdss_dr16.specobj AS z\n",
"FROM sdss_dr17.specobj AS z\n",
"WHERE z.bestobjid > 0\n",
" AND z.run2d = 'v5_13_0'\n",
" AND z.plate = 9599\n",
Expand Down Expand Up @@ -1366,10 +1388,10 @@
},
"outputs": [],
"source": [
"include = client.get_all_fields(dataset_list=['BOSS-DR16'])\n",
"include = client.get_all_fields(dataset_list=['BOSS-DR17'])\n",
"boss_spectra = client.retrieve_by_specid(specid_list=boss_ids['specobjid'].value.tolist(),\n",
" include=include,\n",
" dataset_list=['BOSS-DR16'])\n",
" dataset_list=['BOSS-DR17'])\n",
"boss_spectra.info"
]
},
Expand Down Expand Up @@ -1525,8 +1547,8 @@
"columns = ('z.specobjid', 'p.objid', 'p.ra', 'p.dec', 'p.u', 'p.g', 'p.r', 'p.i', 'p.z')\n",
"q = \"\"\"\n",
"SELECT {0}\n",
"FROM sdss_dr16.specobj AS z\n",
"JOIN sdss_dr16.photoplate AS p\n",
"FROM sdss_dr17.specobj AS z\n",
"JOIN sdss_dr17.photoplate AS p\n",
"ON z.bestobjid = p.objid\n",
"WHERE p.objid IN ({1})\n",
"ORDER BY z.specobjid\n",
Expand Down