This metric aims to evaluate the average depth of CQ coverage by averaging the individual CQ coverage rates across all CQs: MeanCoverage = (1 / N) × Σ cov_i, where cov_i is the fraction of required elements correctly generated for CQ i.
Example:
N = 4 CQs
Per-CQ coverage rates cov: [1.0, 0.5, 0.0, 0.7]
Sum = 2.2
Result:
MeanCoverage = 2.2 / 4 = 0.55
What is being measured?
This metric refelcts how much of each CQ's required content the generation includes.