Create a Harvesting Guide

[karenmajewicz]

Include topics such as:

• what harvesting means
• why we have to re-harvest some sites on a regular basis and how we do that.
• an overview of the scripts we use (Python, Notebooks, BeautifulSoup)
• links to script examples
  ...

[karenmajewicz]

Test out all the forms of harvesting we have listed so far:

structured APIs

• DCAT JSONs
• CKAN API
• OAI-PMH
• other???

individual metadata standards files

• ISO 19139
• FGDC
• ArcGIS 1.0 metadata
• MODS
• MARC
• other???

web scraping

• HTML
• XML standards files (like above heading)

[karenmajewicz]

read about OAI-PMH

[karenmajewicz]

read about CSW: http://opengeospatial.github.io/e-learning/cat/text/main.html