Commit 2af9c64
committed
Cache code mappings to disk
This ensures that names can reliably be converted to codes in the post-processing stage after scraping.
For example, there has been a case of a course referencing a prerequisite subject name that existed in a previous semester but not the current one.
Thus, caching these code mappings that contain data from all semesters will prevent cases like these.1 parent ad5ab90 commit 2af9c64
File tree
5 files changed
+1021
-4
lines changed- app/scrapers
- code_mappings
5 files changed
+1021
-4
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
0 commit comments