MeanCoverage: Average per-CQ coverage rate across all retained CQs

This metric aims to evaluate the average depth of CQ coverage by averaging the individual CQ coverage rates across all CQs: MeanCoverage = (1 / N) × Σ cov_i, where cov_i is the fraction of required elements correctly generated for CQ i.

Example:

N = 4 CQs

Per-CQ coverage rates cov: [1.0, 0.5, 0.0, 0.7]

Sum = 2.2

Result:

MeanCoverage = 2.2 / 4 = 0.55

What is being measured?

This metric refelcts how much of each CQ's required content the generation includes.

Metric information

RDF Resource Description Framework Flyer Icon
Title
Average per-CQ coverage rate across all retained CQs
Identifier
Keywords
Ontology Engineering, Metric, Competency Questions, Coverage
Contact Point
Publisher
Version
0.1.0
License
Category
Competency Question Coverage
Dimension
Task
Applicable for
Benchmark
CQ2OE Benchmark: Competency Questions for Ontology Engineering. A benchmark for evaluating LLM-assisted ontology generation from competency questions.
Status
Active
Active Proposed Inactive Deprecated
Ontology Engineering Group https://oeg.fi.upm.es