Automated evaluation of predicted mappings

[cthoyt]

Given a set of mappings, they can be stratified on three axes:

1. mapping justification (semapv:ManualMappingCuration and maybe semapv:UnspecifiedMatching vs. others like semapv:LexicalMatching, semapv:BackgroundKnowledgeBasedMatching, semapv:MappingInversion, and semapv:MappingChaining)
2. mapping set
3. source-target prefix pair

Some ideas on making a comparison in order of increasing complexity

1. Compare mapping overlap to get a simple precision, recall, and $F_1$
2. Penalize incorrect 1-many, many-1, and many-to-many mappings
3. Incorporate ontology hierarchy