Tech Meridian ← LIVE FEED
PROMY MERIDIAN RU

RESEARCH · RESEARCH · #1782

Explainable header-centric framework for metadata-only column type annotation and data quality assessment

This paper (arXiv:2610.10541v1) presents an explainable, header-centric framework for metadata-only Column Type Annotation (CTA) and Data Quality Assessment (DQA) that maps column headers to 39 interpretable FinalFormat types using curated lexical resources and token-level traceability (SourceKeywords). Each type triggers rule-based detections of Data Quality Issues (DQIs) which are aggregated into HeadersIQ, a lightweight data source-level quality metric; the approach was evaluated on ~120,000 header columns across heterogeneous benchmarks (UCI, Prague, Kaggle, VizNet/Sato, SOTAB, T2Dv2, SemTab 2024), with modest official SemTab GT-strict results but a blinded diagnostic audit attributing many mismatches to benchmark granularity, aliasing, and ontology-selection effects.

KEY POINTS

  1. This paper (arXiv:2610.10541v1) presents an explainable, header-centric framework for metadata-only Column Type Annotation (CTA) and Data Quality Assessment (DQA) that maps column headers to 39 interpretable FinalFormat types using curated lexical resources and token-level traceability (SourceKeywords).
  2. Each type triggers rule-based detections of Data Quality Issues (DQIs) which are aggregated into HeadersIQ, a lightweight data source-level quality metric; the approach was evaluated on ~120,000 header columns across heterogeneous benchmarks (UCI, Prague, Kaggle, VizNet/Sato, SOTAB, T2Dv2, SemTab 2024), with modest official SemTab GT-strict results but a blinded diagnostic audit attributing many mismatches to benchmark granularity, aliasing, and ontology-selection effects.
  3. Provides a reusable, explainable workflow and a lightweight HeadersIQ metric for metadata-driven semantic annotation and source-level quality monitoring prior to KG integration.

WHY IT MATTERS

Provides a reusable, explainable workflow and a lightweight HeadersIQ metric for metadata-driven semantic annotation and source-level quality monitoring prior to KG integration.

SOURCES & TIMELINE

1