Acquisition of High Spectral Resolution Diffuse Reflectance Image Cubes (350-2500 nm) from Archaeological Wall Paintings and Other Immovable Heritage Using a Field-Deployable Spatial Scanning Reflectance Spectrometry Hyperspectral System.

There is growing interest in bringing non-invasive laboratory-based analytical imaging tools to field sites to study wall paintings in order to collect molecular information on the macroscale. Analytical imaging tools, such as reflectance imaging spectrometry, have provided a wealth of information about artist materials and working methods, as well as painting conditions. Currently, scientific analyses of wall paintings have been limited to point-measurement techniques such as reflectance spectroscopy (near-ultraviolet, visible, near-infrared, and mid-infrared), X-ray fluorescence, and Raman spectroscopy. Macroscale data collection methods have been limited to multispectral imaging in reflectance and luminescence modes, which lacks sufficient spectral bands to allow for the mapping and identification of artist materials of interest. The development of laboratory-based reflectance and elemental imaging spectrometers and scanning systems has sparked interest in developing truly portable versions, which can be brought to field sites to study wall paintings where there is insufficient space or electrical power for laboratory instruments. This paper presents the design and testing of a simple hyperspectral system consisting of a 2D spatial spot scanning spectrometer, which provides high spectral resolution diffuse reflectance spectra from 350 to 2500 nm with high signal to noise and moderate spatial resolution (few mm). This spectral range at high spectral resolution was found to provide robust chemical specificity sufficient to identify and map many artists' materials, as well as the byproducts of weathering and conservation coatings across the surface of ancient and Byzantine Cypriot wall paintings. Here, we present a detailed description of the hyperspectral system, its performance, and examples of its use to study wall paintings from Roman tombs in Cyprus. The spectral/spatial image processing workflow to make maps of pigments and constituent painting materials is also discussed. This type of configurable hyperspectral system and the imaging processing workflow offer a new tool for the field study of wall paintings and other immovable heritage.

Low-Cost Multispectral System Design for Pigment Analysis in Works of Art.

To better understand and preserve works of art, knowledge is needed about the pigments used to create the artwork. Various noninvasive techniques have been used previously to create pigment maps, such as combining X-ray fluorescence and hyperspectral imaging data. Unfortunately, most museums have limited funding for the expense of specialized research equipment, such as hyperspectral reflectance imaging systems. However, many museums have hand-held point X-ray fluorescence systems attached to motorized easels for scanning artwork. To assist museums in acquiring data that can produce similar results to that of HSI systems, while minimizing equipment costs, this study designed and modeled a prototype system to demonstrate the expected performance of a low-cost multispectral system that can be attached to existing motorized easels. We show that multispectral systems with a well-chosen set of spectral bands can often produce classification maps with value on par with hyperspectral systems. This study analyzed the potential for capturing data with a point scanning system through predefined filters. By applying the system and noise modeling parameters to HSI data captured from a 14th-Century illumination, the study reveals that the proposed multispectral imaging system is a viable option for this need.

Reflectance Imaging Spectroscopy (RIS) for Operation Night Watch: Challenges and Achievements of Imaging Rembrandt's Masterpiece in the Glass Chamber at the Rijksmuseum.

Visible and infrared reflectance imaging spectroscopy is one of the several non-invasive techniques used during Operation Night Watch for the study of Rembrandt's iconic masterpiece The Night Watch (1642). The goals of this project include the identification and mapping of the artists' materials, providing information about the painting technique used as well as documenting the painting's current state and ultimately determining the possible conservation plan. The large size of the painting (3.78 m by 4.53 m) and the diversity of the technical investigations being performed make Operation Night Watch the largest research project ever undertaken at the Rijksmuseum. To construct a complete reflectance image cube at a high spatial resolution (168 µm2) and spectral resolution (2.54 to 6 nm), the painting was imaged with two high-sensitivity line scanning hyperspectral cameras (VNIR 400 to 1000 nm, 2.54 nm, and SWIR 900 to 2500 nm, 6 nm). Given the large size of the painting, a custom computer-controlled 3-D imaging frame was constructed to move each camera, along with lights, across the painting surface. A third axis, normal to the painting, was added along with a distance-sensing system which kept the cameras in focus during the scanning. A total of 200 hyperspectral image swaths were collected, mosaicked and registered to a high-resolution color image to sub-pixel accuracy using a novel registration algorithm. The preliminary analysis of the VNIR and SWIR reflectance images has identified many of the pigments used and their distribution across the painting. The SWIR, in particular, has provided an improved visualization of the preparatory sketches and changes in the painted composition. These data sets, when combined with the results from the other spectral imaging modalities and paint sample analyses, will provide the most complete understanding of the materials and painting techniques used by Rembrandt in The Night Watch.

Molecular Fluorescence Imaging Spectroscopy for Mapping Low Concentrations of Red Lake Pigments: Van†Gogh's Painting The Olive Orchard.

Vincent van Gogh used fugitive red lake pigments that have faded in some paintings. Mapping their distribution is key to understanding how his paintings have changed with time. While red lake pigments can be identified from microsamples, in situ identification and mapping remain challenging. This paper explores the ability of molecular fluorescence imaging spectroscopy to identify and, more importantly, map residual non-degraded red lakes. The high sensitivity of this method enabled identification of the emission spectra of eosin (tetrabromine fluorescein) lake mixed with lead or zinc white at lower concentrations than elemental X-ray fluorescence (XRF) spectroscopy used on account of bromine. The molecular fluorescence mapping of residual eosin and two carmine red lakes in van Gogh's The Olive Orchard is demonstrated and compared with XRF imaging spectroscopy. The red lakes are consistent with the composition of paint tubes known to have been used by van Gogh.

Standoff Mid-Infrared Emissive Imaging Spectroscopy for Identification and Mapping of Materials in Polychrome Objects.

Microscale mid-infrared (mid-IR) imaging spectroscopy is used for the mapping of chemical functional groups. The extension to macroscale imaging requires that either the mid-IR radiation reflected off or that emitted by the object be greater than the radiation from the thermal background. Reflectance spectra can be obtained using an active IR source to increase the amount of radiation reflected off the object, but rapid heating of greater than 4 °C can occur, which is a problem for paintings. Rather than using an active source, by placing a highly reflective tube between the painting and camera and introducing a low temperature source, thermal radiation from the room can be reduced, allowing the IR radiation emitted by the painting to dominate. Thus, emissivity spectra of the object can be recovered. Using this technique, mid-IR emissivity image cubes of paintings were collected at high collection rates with a low-noise, line-scanning imaging spectrometer, which allowed pigments and paint binders to be identified and mapped.

Reflectance Hyperspectral Imaging for Investigation of Works of Art: Old Master Paintings and Illuminated Manuscripts.

Diffuse reflectance hyperspectral imaging, or reflectance imaging spectroscopy, is a sophisticated technique that enables the capture of hundreds of images in contiguous narrow spectral bands (bandwidth < 10 nm), typically in the visible (Vis, 400-750 nm) and the near-infrared (NIR, 750-2500 nm) regions. This sequence of images provides a data set that is called an image-cube or file-cube. Two dimensions of the image-cube are the spatial dimensions of the scene, and the third dimension is the wavelength. In this way, each spatial pixel in the image has an associated reflectance spectrum. This "big data" image-cube allows for the mining of artists' materials and mapping their distribution across the surface of a work of art. Reflectance hyperspectral imaging, introduced in the 1980s by Goetz and co-workers, led to a revolution in the field of remote sensing of the earth and near planets ( Goetz, F. H.; Vane, G.; Solomon, B. N.; Rock, N. Imaging Spectrometry for Earth Remote Sensing . Science , 1985 , 228 , 1147 - 1152 ). In the subsequent decades, thanks to rapid advances in solid-state sensor technology, reflectance hyperspectral imaging, once only available to large government laboratories, was extended to new fields of application, such as monitoring agri-foods, pharmaceutical products, the environment, and cultural heritage. In the 2000s, the potential of this noninvasive technology for the study of artworks became evident and, consequently, the methodology is becoming more widely used in the art conservation science field. Typically hyperspectral reflectance image-cubes contain millions of spectra. Many of these spectra are similar, making the reduction of the data set size an important first step. Thus, image-processing tools based on multivariate techniques, such as principal component analysis (PCA), automated classification methods, or expert knowledge systems, that search for known spectral features are often applied. These algorithms seek to reduce the large number of high-quality spectra to a common subset, which allow identifying and mapping artists' materials and alteration products. Hence, reflectance hyperspectral imaging is finding its place as the starting point to find sites on polychrome surfaces for spot analytical techniques, such as X-ray fluorescence, Raman spectroscopy, and Fourier transform infrared spectroscopy. Reflectance hyperspectral imaging can also provide image products that are a mainstay in the art conservation field, such as color-accurate images, broadband near-infrared images, and false-color products. This Account reports on the research activity carried out by two research groups, one at the "Nello Carrara" Institute of Applied Physics of the Italian National Research Council (IFAC-CNR) in Florence and the other at the National Gallery of Art (NGA) in Washington, D.C. Both groups have conducted parallel research, with frequent interchanges, to develop multispectral and hyperspectral imaging systems to study works of art. In the past decade, they have designed and experimented with some of the earliest spectral imaging prototypes for museum applications. In this Account, a brief presentation of the hyperspectral sensor systems is given with case studies showing how reflectance hyperspectral imaging is answering key questions in cultural heritage.

Femtosecond pump-probe microscopy generates virtual cross-sections in historic artwork.

The layering structure of a painting contains a wealth of information about the artist's choice of materials and working methods, but currently, no 3D noninvasive method exists to replace the taking of small paint samples in the study of the stratigraphy. Here, we adapt femtosecond pump-probe imaging, previously shown in tissue, to the case of the color palette in paintings, where chromophores have much greater variety. We show that combining the contrasts of multispectral and multidelay pump-probe spectroscopy permits nondestructive 3D imaging of paintings with molecular and structural contrast, even for pigments with linear absorption spectra that are broad and relatively featureless. We show virtual cross-sectioning capabilities in mockup paintings, with pigment separation and nondestructive imaging on an intact 14th century painting (The crucifixion by Puccio Capanna). Our approach makes it possible to extract microscopic information for a broad range of applications to cultural heritage.

Experimental study on merits of virtual cleaning of paintings with aged varnish.

To assess the accuracy of virtual cleaning of Old Master paintings (i.e. digital removal of discolored varnishes), a physical model was developed and experimentally tested using reflectance imaging spectroscopy on three paintings undergoing conservation treatment. The model predicts the reflectance spectra of the painting without varnish or after application of a new varnish from the reflectances of the painting with the aged varnish, given the absorption of the aged varnish and the scattering terms. The resulting color differences between the painting actually and virtually cleaned can approach the perceivable limit. Residual discrepancies are ascribable to spatial variations in the characteristics of the aged varnish (scattering, optical thickness) and the exposed painting (surface roughness).

Complementary standoff chemical imaging to map and identify artist materials in an early Italian Renaissance panel painting.

Two imaging modalities based on molecular and elemental spectroscopy were used to characterize a painting by Cosimo Tura. Visible-to-near-infrared (400-1680 nm) reflectance imaging spectroscopy (RIS) and X-ray fluorescence (XRF) imaging spectroscopy were employed to identify pigments and determine their spatial distribution with higher confidence than from either technique alone. For example, Mary's red robe was modeled through the distribution of an insect-derived red lake (RIS map) and lead white (XRF lead map), rather than a layer of red lake on vermilion. The RIS image cube was also used to isolate the preparatory design by mapping the reflectance spectra associated with it. In conjunction with results from an earlier RIS study (1650-2500 nm) to map and identify the binding media, a more thorough understanding was gained of the materials and techniques used in the painting.

Mapping of egg yolk and animal skin glue paint binders in Early Renaissance paintings using near infrared reflectance imaging spectroscopy.

In situ chemical imaging techniques are being developed to provide information on the spatial distribution of artists' pigments used in polychrome works of art such as paintings. The new methods include reflectance imaging spectroscopy and X-ray fluorescence mapping. Results from these new methods have extended the knowledge obtained from site-specific chemical analyses widely in use. While these mapping methods have aided in determining the distribution of pigments, there is a growing interest to develop methods capable of identifying and mapping organic paint binders as well. Near infrared (NIR) reflectance spectroscopy has been extensively used in the remote sensing field as well as in the chemical industry to detect organic compounds. NIR spectroscopy provides a rapid method to assay organics by utilizing vibrational overtones and combination bands of fundamental absorptions that occur in the mid-IR. Here we explore the utility of NIR reflectance imaging spectroscopy to map organic binders in situ by examining a series of panel paintings known to have been painted using distemper (animal skin glue) and tempera (egg yolk) binders as determined by amino acid analysis of samples taken from multiple sites on the panels. In this report we demonstrate the success in identifying and mapping these binders by NIR reflectance imaging spectroscopy in situ. Three of the four panel paintings from Cosimo Tura's The Annunciation with Saint Francis and Saint Louis of Toulouse (ca. 1475) are imaged using a highly sensitive, line-scanning hyperspectral imaging camera. The results show an animal skin glue binder was used for the blue skies and blue robe of the Virgin Mary, and egg yolk tempera was used for the red robes and brown landscape. The mapping results show evidence for the use of both egg yolk and animal skin glue in the faces of the figures. The strongest absorption associated with lipidic egg yolk features visually correlates with areas that appear to have white highlights. The results are in agreement with prior site-specific amino acid analysis, underscoring the synergy of both methods. The work here demonstrates that NIR reflectance imaging spectroscopy is a useful technique that can identify and map paint binding media based on differences in chemical composition.

In Science Journals.

Highlights from the Science family of journals.

Dual mode standoff imaging spectroscopy documents the painting process of the Lamb of God in the Ghent Altarpiece by J. and H. Van Eyck.

The ongoing conservation treatment program of the Ghent Altarpiece by Hubert and Jan Van Eyck, one of the iconic paintings of the west, has revealed that the designs of the paintings were changed several times, first by the original artists, and then during later restorations. The central motif, The Lamb of God, representing Christ, plays an essential iconographic role, and its depiction is important. Because of the prevalence of lead white, it was not possible to visualize the Van Eycks' original underdrawing of the Lamb, their design changes, and the overpaint by later restorers with a single spectral imaging modality. However, by using elemental (x-ray fluorescence) and molecular (infrared reflectance) imaging spectroscopies, followed by analysis of the resulting data cubes, the necessary chemical contrast could be achieved. In this way, the two complementary modalities provided a more complete picture of the development and changes made to the Lamb.

Macroscale multimodal imaging reveals ancient painting production technology and the vogue in Greco-Roman Egypt.

Macroscale multimodal chemical imaging combining hyperspectral diffuse reflectance (400-2500 nm), luminescence (400-1000 nm), and X-ray fluorescence (XRF, 2 to 25 keV) data, is uniquely equipped for noninvasive characterization of heterogeneous complex systems such as paintings. Here we present the first application of multimodal chemical imaging to analyze the production technology of an 1,800-year-old painting and one of the oldest surviving encaustic ("burned in") paintings in the world. Co-registration of the data cubes from these three hyperspectral imaging modalities enabled the comparison of reflectance, luminescence, and XRF spectra at each pixel in the image for the entire painting. By comparing the molecular and elemental spectral signatures at each pixel, this fusion of the data allowed for a more thorough identification and mapping of the painting's constituent organic and inorganic materials, revealing key information on the selection of raw materials, production sequence and the fashion aesthetics and chemical arts practiced in Egypt in the second century AD.

Near-infrared luminescence of cadmium pigments: in situ identification and mapping in paintings.

A comprehensive study of the luminescence properties of cadmium pigments was undertaken to determine whether these properties could be used for in situ identification and mapping of the pigments in paintings. Cadmium pigments are semiconductors that show band edge luminescence in the visible range and deep trap luminescence in the red/infrared range. Emission maxima, quantum yields, and excitation spectra from the band edge and deep trap emissions were studied for sixty commercial cadmium pigments that span the color range from yellow to red (reflectance transition 470 to 660 nm). For paints containing cadmium pigments, luminescence from deep traps was more readily observable than that from the band edge, although the yield varied widely from zero to around 4.5%. Optimal excitation for emission is found to be in the visible for both pigments in powder form and mixed with a medium. The maxima of the deep trap emission shift with the band gap energy, providing a potentially useful way to assign pigment type even when used in pigment mixtures. The usefulness of the results of the study on mockups was demonstrated by the mapping of cadmium pigments of different hues with the aid of calibrated luminescence imaging spectroscopy in a painting by Edward Steichen, entitled Study for 'Le Tournesol' (1920). Analysis of the luminescence image cube reveals at least six unique spectral components, associated with emission from white pigments, paint binder, and cadmium red and yellow pigments. The results were compared with those from X-ray fluorescence spectrometry (XRF) and fiber-optic reflection spectroscopy (FORS) and the results obtained on paint samples containing cadmium pigments. These results show that, when present, the emission from traps can be used as an analytical tool to identify cadmium pigments, to distinguish among cadmium sulfide, cadmium zinc sulfide, and cadmium sulfoselenide, and to map cadmium pigments, even in mixtures.

Visible and infrared imaging spectroscopy of Picasso's Harlequin musician: mapping and identification of artist materials in situ.

Reflection imaging spectroscopy is a useful technique to remotely identify and map minerals and vegetation. Here we report on the mapping and identification of artists' materials in paintings using this method. Visible and infrared image cubes of Picasso's Harlequin Musician are collected using two hyperspectral cameras and combined into a single cube having 260 bands (441 to 1680 nm) and processed using convex geometry algorithms. The resulting 18 spectral end members are identified by comparison with library spectra, fitting by nonlinear mixing, and using results from luminescence imaging spectroscopy. The results are compared with those from X-ray fluorescence spectrometry, polarized light microscopy, and scanning electron microscopy-energy dispersive spectrometry (SEM/EDS). This work shows the potential of reflection imaging spectroscopy, in particular if the shortwave infrared region is included along with information from luminescence imaging spectroscopy.