DH-benchmark-multiling/index.html at main · FelixFrizzy/DH-benchmark-multiling · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
<html>
<head>
<title>Ontology Alignment Evaluation Initiative::Digital Humanities (DH)</title>
<link rel="stylesheet" type="text/css" href="http://oaei.ontologymatching.org/2009/style.css" />
</head>
<body>

<div class="header">
<a style="color: grey; line-height: 5mm;" href="http://oaei.ontologymatching.org/2024/">Ontology
  Alignment Evaluation Initiative - OAEI-2024
  Campaign</a><a href="http://oaei.ontologymatching.org/"><img src="http://oaei.ontologymatching.org/oaeismall.jpg" alt="OAEI"
		   style="float:right; margin-left: 5pt; border-style:none;"/></a>
</div>

<h1>Multilingual Archaeology</h1>

<h2>General description</h2>

<p>
  The multilingual archaeology track is newly established for OAEI 2024. It aims at the alignment of multilingual domain specific vocabularies. The high quality reference is compiled manually, ensuring semantic, lexical and part-of-speech similarity. It offers different test cases from the archaeology domain. Each source and target ontology is monolingual in one of the following languages: English, German, French, Italian. The goal is to evaluate the matching system perfomance when dealing with small datasets in different languages and specialist terms.  </p>

<h2>Dataset description</h2>

<p>The resources and a comprehensive description is available in the <a href="https://github.com/FelixFrizzy/DH-benchmark-multiling">Multilingual archaeology benchmark github repo</a>. Each test case consists of a source and a target ontology and a manual reference alignment. For data provenance, see github description for more details.</p>

<h3>Archaeology</h3>
There are ten different test cases available. All of them use <a href="https://vocabs.dariah.eu/defc_thesaurus/en/">DEFC</a> as source and <a href="https://isl.ics.forth.gr/bbt-federated-thesaurus/PACTOLS/en/">PACTOLS</a> as target.
<p>
  <ul>
    <li>de-de</li>
    <li>de-en</li>
    <li>de-fr</li>
    <li>de-it</li>
    <li>en-en</li>
    <li>en-fr</li>
    <li>en-it</li>
    <li>fr-fr</li>
    <li>fr-it</li>
    <li>it-it</li>
  </ul>
</p>


<h2>Modalities</h2>

<p>
  MELT will be used and the output of the correspondences will automatically be evaluated against the manually complied reference by MELT. The evaluation will be based on precision, recall and F-measure. There will be additional criteria such as max. memory consumption and runtime.

</p>

<h2>Schedule</h2>

<p>The schedule is available at the <a href="https://oaei.ontologymatching.org/2023/index.html#schedule">OAEI 2024 main page</a>.</p>


<!-- <h2>Acknowledgements</h2>

<p>Acknowledge people who have helped you as well as resource
  providers in the terms they want.</p> -->

<h2>Organizers</h2>
<p>The DH track is organised by Felix Kraus <a href="https://www.scc.kit.edu/en/staff/14032.php">(https://www.scc.kit.edu/en/staff/14032.php)</a>.</p>
<p>For any kind of help or suggestions you are very welcome to contact the organizer using the following email (subsitute accordingly): firstname.lastname (at) kit (dot) edu


<h2>References</h2>
<p></p>

<div class="address">
<div class="footer">http://oaei.ontologymatching.org/2024/</div>
<!--$Id$-->
</div>
</body>
</html>