FullCoverage: Fraction of CQs whose required elements are fully generated

This metric aims to evaluate the completeness of CQ coverage by computing the fraction of CQs that are answered in full: FullCoverage = |{ i : cov_i = 1 }| / N. A CQ counts only when every required element appears in the generation and is correctly attributed to that CQ.

Example:

N = 4 CQs

Per-CQ coverage rates cov: [1.0, 0.5, 0.0, 0.7]

CQs with cov = 1: {1} → count = 1

Result:

FullCoverage = 1 / 4 = 0.25

What is being measured?

This metric reports completeness, capturing whether each CQ is genuinely satisfied.

Metric information

RDF Resource Description Framework Flyer Icon
Title
Fraction of CQs whose required elements are fully generated
Identifier
Keywords
Ontology Engineering, Metric, Competency Questions, Completeness, Coverage
Contact Point
Publisher
Version
0.1.0
License
Category
Competency Question Coverage
Dimension
Task
Applicable for
Benchmark
CQ2OE Benchmark: Competency Questions for Ontology Engineering. A benchmark for evaluating LLM-assisted ontology generation from competency questions.
Status
Active
Active Proposed Inactive Deprecated
Ontology Engineering Group https://oeg.fi.upm.es