Benchmarks, quality, and observability#

These APIs describe reproducible benchmark suites, generator-quality reports, and optional production metrics.

Benchmarks#

`fraudtwin.benchmark.run_benchmark`	Generate and evaluate one or every standard benchmark suite.
`fraudtwin.benchmark.run_public_benchmark`	Run one immutable bundled M21 pack and verify its frozen outputs.
`fraudtwin.benchmark.build_suite_config`	Build and validate one standard suite without mutating global config.
`fraudtwin.list_public_packs`	Return all bundled public packs in stable identity order.
`fraudtwin.load_public_pack`	Resolve an exact or unambiguous major/minor public-pack reference.
`fraudtwin.PublicBenchmarkPack`	Immutable, distributable M21 benchmark definition.

`fraudtwin.run_quality_benchmark`	Run the native or external M22 quality protocol.
`fraudtwin.report_run`	Create an invariant report for one existing native generated run.
`fraudtwin.load_quality_profile`	Load one bundled immutable M22 profile or a YAML profile path.
`fraudtwin.QualityAdapterMetadata`	Identity and capabilities advertised by an external generator.
`fraudtwin.QualityAdapterRequest`	Read-only public workload delivered to an external adapter.
`fraudtwin.QualityArtifactBundle`	Normalized external output consumed by the quality scorer.
`fraudtwin.QualityBenchmarkProfile`	Immutable public workload and protocol selection.
`fraudtwin.QualityBenchmarkRequest`	Programmatic equivalent of the quality-benchmark CLI command.
`fraudtwin.QualityBenchmarkResult`	Immutable result and artifact location for a quality benchmark run.
`fraudtwin.QualityCandidateReport`	Normalized quality dimensions for one generator candidate.
`fraudtwin.QualityCapability`	Declared dimensions supplied by a native or external candidate.
`fraudtwin.QualityGeneratorAdapter`	Protocol implemented by an external generator benchmark adapter.
`fraudtwin.QualityMetric`	One independently interpretable quality result.

`fraudtwin.observability.MetricsSession`	Expose the stable M27 metric surface for one CLI invocation.
`fraudtwin.observability.ObservabilityDependencyError`	Raised when metrics are requested without the optional dependency.