Thermography data fusion and nonnegative matrix factorization for the evaluation of cultural heritage objects and buildings

Bardia Yousefi, Stefano Sfarra, Clemente Ibarra-Castanedo, Nicolas P. Avdelidis, Xavier P.V. Maldague

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

The application of the thermal and infrared technology in different areas of research is considerably increasing. These applications involve nondestructive testing, medical analysis (computer aid diagnosis/detection—CAD), and arts and archeology, among many others. In the arts and archeology field, infrared technology provides significant contributions in terms of finding defects of possible impaired regions. This has been done through a wide range of different thermographic experiments and infrared methods. The proposed approach here focuses on application of some known factor analysis methods such as standard nonnegative matrix factorization (NMF) optimized by gradient-descent-based multiplicative rules (SNMF1) and standard NMF optimized by nonnegative least squares active-set algorithm (SNMF2) and eigen-decomposition approaches such as principal component analysis (PCA) in thermography, and candid covariance-free incremental principal component analysis in thermography to obtain the thermal features. On the one hand, these methods are usually applied as preprocessing before clustering for the purpose of segmentation of possible defects. On the other hand, a wavelet-based data fusion combines the data of each method with PCA to increase the accuracy of the algorithm. The quantitative assessment of these approaches indicates considerable segmentation along with the reasonable computational complexity. It shows the promising performance and demonstrated a confirmation for the outlined properties. In particular, a polychromatic wooden statue, a fresco, a painting on canvas, and a building were analyzed using the above-mentioned methods, and the accuracy of defect (or targeted) region segmentation up to 71.98%, 57.10%, 49.27%, and 68.53% was obtained, respectively.

Original languageEnglish
Pages (from-to)943-955
Number of pages13
JournalJournal of Thermal Analysis and Calorimetry
Volume136
Issue number2
DOIs
Publication statusPublished - 30 Apr 2019

Keywords

  • Clustering
  • Gradient-descent-based multiplicative rules
  • Negative matrix factorization analysis
  • Nonnegative least squares (NNLS) active-set algorithm
  • Thermal image segmentation
  • Wavelet data fusion

ASJC Scopus subject areas

  • Condensed Matter Physics
  • Physical and Theoretical Chemistry

Fingerprint Dive into the research topics of 'Thermography data fusion and nonnegative matrix factorization for the evaluation of cultural heritage objects and buildings'. Together they form a unique fingerprint.

  • Cite this