Synonyms: Exact match against WordNet synonym relations

This metric aims to evaluate whether a generated label is a recognised synonym of a gold-standard label, using WordNet's synset relations. It returns 1 when the two labels appear in the same synset and 0 otherwise. The method was considered but excluded from the final pipeline because WordNet poorly covers domain-specific ontology vocabulary.

Example:

Generate_Label_1: automobile

Generate_Label_2: hound

Generate_Label_3: Wine

Gold_Standard_Label_1: car

Gold_Standard_Label_2: dog

Gold_Standard_Label_3: Liquor

Result:

  1. Synonyms(Generate_Label_1, Gold_Standard_Label_1) = 1
  2. Synonyms(Generate_Label_2, Gold_Standard_Label_2) = 1
  3. Synonyms(Generate_Label_3, Gold_Standard_Label_3) = 0

What is being measured?

This metric captures lexicographic synonymy as encoded in WordNet. It is useful as a complementary signal in general-domain text but insufficient for technical labels typical in evaluated ontologies, which is why it is retained here only for transparency and reproducibility.

Metric information

RDF Resource Description Framework Flyer Icon
Title
Exact match against WordNet synonym relations
Identifier
Keywords
Ontology Concept Matching, Metric, Classes, Properties, WordNet
Contact Point
Publisher
Version
0.1.0
License
Category
Ontology Concept Matching
Dimension
Task
Applicable for
Benchmark
CQ2OE Benchmark: Competency Questions for Ontology Engineering. A benchmark for evaluating LLM-assisted ontology generation from competency questions.
Status
Inactive
Active Proposed Inactive Deprecated
Ontology Engineering Group https://oeg.fi.upm.es