The effect of following best practice reporting recommendations on legal and community evaluations of forensic examiners reports.

Commentators have recommended that forensic scientists' reports contain various disclosures to facilitate comprehension. However, little research has explored whether following best practice recommendations for disclosure impacts on receivers' impressions of the evidence. We examined whether forensic science reports that are more compliant with these best practice recommendations reduced overvaluing of the evidence and sensitized legal and community decision-makers to evidence quality. Across three experiments, 240 legal practitioners/trainees and 566 community decision-makers were presented with a fingerprint or footwear report that was either compliant or non-compliant with best practice recommendations. Participants were then asked to make evaluations and decisions based on the report. We found mixed effects of report compliance. Report compliance affected community participant's evaluations of the persuasiveness of the evidence but had limited impact on the judgments of legal practitioners/trainees. When presented with compliant reports, we found that community participants regarded unknown reliability evidence as less reliable and less persuasive than high reliability evidence, suggesting disclosures helped reduce overvaluing of the evidence and create sensitivity to differences in evidence quality. These results suggest compliance with reporting recommendations does affect community impressions, while only minimally influencing legal impressions of forensic science evidence. The costs and/or benefits of this outcome require further examination.

Innovative Solutions for Worn Fingerprints: A Comparative Analysis of Traditional Fingerprint Impression and 3D Printing.

Fingerprint recognition systems have achieved widespread integration into various technological devices, including cell phones, computers, door locks, and time attendance machines. Nevertheless, individuals with worn fingerprints encounter challenges when attempting to unlock original fingerprint systems, which results in disruptions to their daily activities. This study explores two distinct methods for fingerprint backup: traditional fingerprint impression and 3D printing technologies. Unlocking tests were conducted on commonly available optical fingerprint lock-equipped cell phones to assess the efficacy of these methods, particularly in unlocking with worn fingerprints. The research findings indicated that the traditional fingerprint impression method exhibited high fidelity in reproducing fingerprint patterns, achieving an impressive unlocking success rate of 97.8% for imprinting unworn fingerprints. However, when dealing with worn fingerprints, the traditional fingerprint impression technique showed a reduced unlocking success rate, progressively decreasing with increasing degrees of finger wear. In contrast, 3D-printed backup fingerprints, with image processing and optimization of ridge height, mitigated the impact of fingerprint wear on the unlocking capability, resulting in an unlocking success rate of 84.4% or higher. Thus, the utilization of 3D printing technology proves advantageous for individuals with severely worn or incomplete fingerprints, providing a viable solution for unforeseen circumstances.

Further research into alternative carrier solvents for the detection of latent fingermarks.

A number of solvents, (Solstice PF, Opteon SF33 and Amolea AS-300), are compared to the recommended carrier solvent of HFE7100 for the ninhydrin and 1,2-indandione formulations. As the supply of HFE7100 will cease by the end of 2025, suitable alternatives are required in the short-term to ensure the detection of latent fingermarks on porous surfaces is still effective. Although these solvents, with the exception of Amolea AS-300, are classified as per- and polyfluoroalkyl substances (PFAS); they are not classed as hazardous. The alternatives in this study have a low global warming potential and atmospheric lifetime and are volatile, non-flammable and non-ozone depleting, in addition to other desirable properties such as a high wetting-index. During Phase 2 trials with deposited fingermarks, HFE7100 provided the best performing results followed by Opteon SF33, Solstice PF and Amolea AS-300. A significant difference with a negligible effect size was observed for ninhydrin formulations (p-value 0.00179; ε2 0.00418) while a significant difference with a weak effect size was observed for 1,2-indanedione formulations (p-value 2.095 ×10-10; ε2 0.0167). Furthermore, HFE7100 provided the least ink diffusion and the brightest 1,2-indanedione luminosity (significant difference with a moderate effect size p-value 1.772 ×10-13; ε2 0.0434) but the HFE formulation turned cloudy more quickly and needed regular replacements. Phase 3 pseudo-operational trials of 100 porous items followed a similar trend whereby HFE7100 formulations detected the highest number of marks followed by Opteon SF33 and Solstice PF. Although HFE7100 is still the best performing carrier solvent, this study demonstrates that, in the short-term, Opteon SF33 and Solstice PF may have potential as non-flammable replacement carrier solvents while developing the long-term goal of solvent-less methods.

An investigation into the effect of surfactants on iron oxide powder suspension formulations for fingermark development.

Iron oxide powder suspension (FePS) is a fingermark development technique that can be used on adhesive and non-porous surfaces, the efficacy of which is known to be influenced by the surfactant used in the formulation. Despite previous work optimising surfactants for use in FePS, there is limited understanding of the interactions between surfactants, powders and fingermark residue which aid the successful development of fingermarks. To better understand the effect of surfactant on development quality produced by FePS, this research assessed a wide range of surfactants of different ionic natures and evaluated their ability to develop fingermarks based on the quality of ridge detail, contrast and background development produced. It was found that surfactants play a critical role in the selective deposition of powder on fingermark residue, as formulations made with only water (no surfactant) produced heavy background deposition. The efficacy of each surfactant depended on the quality parameter considered, and the addition of some surfactants hindered fingermark development. Effective surfactants such as T20, KP and TX100 prevented background development and produced well contrasted developed marks. Poor contrast was produced by LN, SP80/T80 and T80 due to indiscriminate powder deposition either across the entire sample or preventing any powder to deposit on the surface, demonstrating the role surfactants play in allowing powder deposition in this technique. The effectiveness of a surfactant in PS was not directly dependent on its ionic nature, and most surfactants were more effective when diluted from stock concentrations. This research has provided a robust base for future work improving fundamental understanding of FePS, which will greatly aid the efficacy of future optimisation efforts.

Sexual dimorphism and topological variability in fingerprint ridge density in a north-west Indian population.

The science of fingerprints is very crucial in criminal investigation as it helps identify perpetrators or victims of a crime. Fingerprint ridge density (FPRD), which refers to the number of ridges within a specific area on the epidermal skin layer of the distal phalanges in humans, has been found to differ between males and females. This study attempts to estimate the sex from FPRD and evaluates the diversity in FPRD across several topological areas. The study involves 208 participants (120 males, 88 females) between the ages 18 to 25 years from a North-west Indian population. Fingerprints were collected, and FPRD was accessed in radial, ulnar, and proximal areas as recommended by Gutierrez-Redomero et al. (Forensic Sci Int 180(1):17-22, 2008). FPRD has been quantified using the techniques described by Acree (Forensic Sci Int 102(1):35-44, 1999). When evaluating FPRD in the lateral pocket loops and twin loops, the proximal-side core was considered. The study reveals that males have a mean fingerprint ridge density of 12.82 ridges/25 mm2 while females have 13.01 ridges/25 mm2. Females have higher fingerprint ridge density solely in the proximal area; males have higher fingerprint ridge density in both radial and ulnar areas. In conclusion, this research underscores the potential of fingerprint ridge density as a parameter for investigating population variations and individual identification. Future studies on fingerprint ridge density in India's diverse population will help establish reference ranges, allowing for sex and likely population group estimation, making it a valuable tool for preliminary examinations and exclusion criteria for sex estimation in crime scene investigations.

Customizable Presentation Attack Detection for Improved Resilience of Biometric Applications Using Near-Infrared Skin Detection.

Due to their user-friendliness and reliability, biometric systems have taken a central role in everyday digital identity management for all kinds of private, financial and governmental applications with increasing security requirements. A central security aspect of unsupervised biometric authentication systems is the presentation attack detection (PAD) mechanism, which defines the robustness to fake or altered biometric features. Artifacts like photos, artificial fingers, face masks and fake iris contact lenses are a general security threat for all biometric modalities. The Biometric Evaluation Center of the Institute of Safety and Security Research (ISF) at the University of Applied Sciences Bonn-Rhein-Sieg has specialized in the development of a near-infrared (NIR)-based contact-less detection technology that can distinguish between human skin and most artifact materials. This technology is highly adaptable and has already been successfully integrated into fingerprint scanners, face recognition devices and hand vein scanners. In this work, we introduce a cutting-edge, miniaturized near-infrared presentation attack detection (NIR-PAD) device. It includes an innovative signal processing chain and an integrated distance measurement feature to boost both reliability and resilience. We detail the device's modular configuration and conceptual decisions, highlighting its suitability as a versatile platform for sensor fusion and seamless integration into future biometric systems. This paper elucidates the technological foundations and conceptual framework of the NIR-PAD reference platform, alongside an exploration of its potential applications and prospective enhancements.

Hierarchical Perceptual Noise Injection for Social Media Fingerprint Privacy Protection.

Billions of people share images from their daily lives on social media every day. However, their biometric information (e.g., fingerprints) could be easily stolen from these images. The threat of fingerprint leakage from social media has created a strong desire to anonymize shared images while maintaining image quality, since fingerprints act as a lifelong individual biometric password. To guard the fingerprint leakage, adversarial attack that involves adding imperceptible perturbations to fingerprint images have emerged as a feasible solution. However, existing works of this kind are either weak in black-box transferability or cause the images to have an unnatural appearance. Motivated by the visual perception hierarchy (i.e., high-level perception exploits model-shared semantics that transfer well across models while low-level perception extracts primitive stimuli that result in high visual sensitivity when a suspicious stimulus is provided), we propose FingerSafe, a hierarchical perceptual protective noise injection framework to address the above mentioned problems. For black-box transferability, we inject protective noises into the fingerprint orientation field to perturb the model-shared high-level semantics (i.e., fingerprint ridges). Considering visual naturalness, we suppress the low-level local contrast stimulus by regularizing the response of the Lateral Geniculate Nucleus. Our proposed FingerSafe is the first to provide feasible fingerprint protection in both digital (up to 94.12%) and realistic scenarios (Twitter and Facebook, up to 68.75%). Our code can be found at https://github.com/nlsde-safety-team/FingerSafe.

Development research of latent fingermarks based on aggregation-induced emission technique.

Fingerprints hold evidential value for individual identification; a sensitive, efficient, and convenient method for visualizing latent fingermarks (LFMs) is of great importance in the field of crime scene investigation. In this study, we proposed an aggregation-induced emission atomization technique (AIE-AT) to obtain high-quality fingermark images. Six volunteers made over 1566 fingerprint samples on 17 different objects. The quality of fingermark development was evaluated using grayscale analysis for quantitative assessment, combining the fluency of fingermark ridges and the degree of level 2 and level 3 features. Both qualitative and quantitative methods were employed to explore the effectiveness of AIE molecule C27H19N3SO in developing fingermarks, its applicability to objects, and its individual selectivity. Additionally, the stability of the AIE molecule was examined. Comparative experimental results demonstrated the high stability of the AIE molecule, making it suitable for long-term preservation. The grayscale ratio of the ridges and furrows was at least 2, with high brightness contrast, the level 2 and level 3 features were clearly observable. The AIE-AT proved to be effective for developing fingermarks on nonporous, porous, and semiporous objects. It exhibited low selectivity on suspects who leave fingermarks and showed better development effects on challenging objects, as well as efficient extraction capability for in situ fingermarks. In summary, AIE-AT can efficiently develop latent fingermarks on common objects and even challenging ones. It locates the latent fingermarks for further accurate extraction of touch exfoliated cells in situ, providing technical support for the visualization of fingermarks and the localization for extraction of touch DNA.

Study of the fingerprints of a Spanish sample for the determination of the hand and finger.

The individuality and permanence of fingerprints make of them a very useful feature in the identification of individuals. There are now automated computer programmes that allow a quick comparison between a fingermark and a database. However, in order to assess the strength of evidence in fingerprint identification, complementary information on the frequencies of the different morphological features of the dermopapillary ridges is required. This idea is used in this work as a starting point to evaluate the frequencies of the parameters used in the determination of the hand and finger in a large sample of 2600 fingerprints taken from 134 male and 127 female Spanish population. Based on these fingerprints, the frequencies of different categories of the following parameters were obtained: type of pattern, slope of the apex ridge, subtype of two-delta pattern, ridge tracing, major angle, major ridge count, bisector, rotation of the central ridge, assimilation to loops and slant. Moreover, the results have shown that these characters are useful for the determination of the hand in whorls (two-delta pattern) and loops (one-delta pattern), but not for the determination of the finger. The most useful and classificatory parameter when determining the hand of origin of a two-delta fingerprint is the slope of the apex ridge, and for the one-delta pattern, knowing the location of the delta allows the correct estimation of the hand of a fingerprint in more than 93% of the cases. The data presented in this paper are novel and can be used by latent print examiners to improve the statistical basis of their decisions in reaching conclusions.

The effect of fingerprint expertise on visual short-term memory.

Expert fingerprint examiners demonstrate impressive feats of memory that may support their accuracy when making high-stakes identification decisions. Understanding the interplay between expertise and memory is therefore critical. Across two experiments, we tested fingerprint examiners and novices on their visual short-term memory for fingerprints. In Experiment 1, experts showed substantially higher memory performance compared to novices for fingerprints from their domain of expertise. In Experiment 2, we manipulated print distinctiveness and found that while both groups benefited from distinctive prints, experts still outperformed novices. This indicates that beyond stimulus qualities, expertise itself enhances short-term memory, likely through more effective organisational processing and sensitivity to meaningful patterns. Taken together, these findings shed light on the cognitive mechanisms that may explain fingerprint examiners' superior memory performance within their domain of expertise. They further suggest that training to improve memory for diverse fingerprints could practically boost examiner performance. Given the high-stakes nature of forensic identification, characterising psychological processes like memory that potentially contribute to examiner accuracy has important theoretical and practical implications.

Cell counting to monitor swab efficiency.

Plastic bags, such as ziplock bags, have been used to transport illicit materials worldwide; however, very few studies have tried to optimize the recovery of DNA from these items. This study reports on the best combination of swabs and moistening solution for the greatest recovery of cellular material from ziplock bags. Five swabs, two different variations of Copan Diagnostics nylon 4N6FLOQSwabs, one Medical Wire rayon DRYSWAB, one IsoHelix rayon swab, and one Livingstone cotton swab, were evaluated with two moistening solutions, Triton X-100 in either distilled water or isopropanol. Fingermarks were deposited on ziplock bags and stained with Diamond™ Nucleic Acid Dye to allow visualization of the cells pre- and post-swabbing to determine the number of cells recovered. Based on cell counting data, swabs moistened with Triton X-100 in distilled water performed better than those moistened with isopropanol. Livingstone cotton swabs had the worst recovery of cellular material, while the other swabs tested had no significant difference in their respective solutions. A comparison of the best three swabs for cellular recovery yielded no differences in the DNA concentration extracted. A linear relationship was observed between the log number of cells recovered by swabbing and the DNA concentration following extraction and quantification. The process of monitoring cell collection using fluorescence microscopy on ziplock bags allowed evaluation of swabbing efficacy. Additionally, this study highlights the ability to evaluate cellular recovery independently of traditional extraction, quantification, or profiling techniques which may unequally affect samples.

DNA recovery after sequential processing of latent fingerprints on black polyethylene plastic.

Latent fingerprints on plastic substrates can be visualized by using sequential treatments to enhance the contrast between the fingerprint residues and underlying substrate; however, the extent to which these processes affect subsequent DNA analysis is mostly unknown. Latent fingerprints deposited on black plastic by one donor were visualized with single-process fingerprint powders (i.e., white powder, bichromatic powder, or bichromatic magnetic powder) or sequential treatments (i.e., laser → reflected ultraviolet imaging system (RUVIS) → CA fuming → RUVIS → Rhodamine 6G, Ardrox, and MBD (RAM) or CA fuming → RAM/laser → bichromatic magnetic powder). Samples were examined after the addition of each treatment. DNA was collected using cotton swabs, extracted, quantified, and amplified. DNA yields, peak heights, number of alleles obtained, and percentage of DNA profiles eligible for CODIS upload were examined. Latent fingerprints processed with the laser and up to three sequential treatments generated DNA profiles with significantly higher peaks heights than those of the untreated samples. Fingerprints processed with the laser and up to two sequential treatments generated DNA profiles with significantly more alleles. All methods beginning with laser enhancement generated more CODIS-eligible profiles. Additional research is needed to determine the extent to which initial laser enhancement impacts the success of downstream DNA profiling results. Although DNA profile development is not guaranteed due to the variable quantities of DNA contained within latent fingerprints, the selection of an appropriate latent fingerprint visualization method could maximize both fingerprint detection and the generation of CODIS-eligible DNA profiles.

Technical note: A preliminary assessment of UV-C imaging using the Full Spectrum Imaging System (FSIS-II) for the detection of latent fingermarks.

The Full Spectrum Imaging System (FSIS-II) was assessed for the detection of latent fingermarks on a variety of substrates, specifically focusing on UV-C imaging for untreated marks and those that have been treated with cyanoacrylate (CA). The use of UV-C was effective at the detection of latent fingermarks on a variety of substrates and UV-C imaging may be effective when UV-A does not provide any fingermark detections on thermal paper. A Phase 2 and a small Phase 3 trials on aluminium cans were carried out with a detection sequence of UV-C imaging, CA fuming, UV-C imaging, UV-A imaging and BY40. For Phase 2 laboratory trials, the use of initial UV-C reflection was effective at removing the background and was a useful tool for initial screening. The use of UV-C was superior to UV-A after CA fuming and provided the highest overall number of high-quality marks. For phase 3 trials, the results showed that BY40 fluorescence was marginally more effective than UV-C imaging of CA-treated marks. This preliminary study shows that the FSIS-II and UV-C imaging can complement other methods for the detection of latent fingermarks.

Toward multidimensional information: A derivatization-free UHPLC-QqQ MS/MS method for amino acid components of fingerprint.

The analysis of fingerprint chemical composition is a meaningful way to excavate the multidimensional information of fingerprint, including the donor profiling information and the age of a fingerprint, which broadens the evidential values of fingerprint, especially for the partial and distorted fingerprint. But the research remains still in the pilot phases or is ongoing. Amino acids are the dominant organic substances in latent sweat fingerprint and influenced by many donor factors. Hence, their content reflects personal information of donors. Forensic science will be revolutionized if suspects can be individualized by their amino acid content. The diverse nature, distinct physicochemical properties, and ultra-micro levels of amino acids present in fingerprints make it hard to detect. A high sensitivity method for detecting and quantifying multiple amino acid components is required. UHPLC-QqQ MS/MS offers high sensitivity, high separation, simultaneous multicomponents detection, and no derivatization, making it an ideal method for detecting and analyzing amino acids in fingerprints. Therefore, in this study, we propose and validate an efficient UHPLC-QqQ MS/MS method for the extraction and analysis of 13 amino acids from fingerprint. We compared the results of amino acids of 10 different substrates and found that the inherent amino acids in most porous substrates would have been extracted along with the fingerprint amino acids, making them unsuitable for quantitative amino acid analysis. Instead, plastic sheets are ideal substrates for laboratory studies. Then, extensive experiments were conducted among 30 donors for multidimensional information analysis. The type of samples analyzed were eccrine-rich fingerprints. A Binary Logistic Regression (BLR) model was developed, and the female and male donors were successfully differentiated by amino acids in fingerprints. Two other mathematical models were also developed to verify the accuracy, and all three different mathematical models were able to identify donors of different genders with over 90% accuracy. This demonstrates that amino acids have the potential to provide more information for donors as metabolic markers. In the future, we will conduct a series of experiments to analyze more multidimensional information for individual identification by amino acid content in the fingerprint.

Unveiling intra-person fingerprint similarity via deep contrastive learning.

Fingerprint biometrics are integral to digital authentication and forensic science. However, they are based on the unproven assumption that no two fingerprints, even from different fingers of the same person, are alike. This renders them useless in scenarios where the presented fingerprints are from different fingers than those on record. Contrary to this prevailing assumption, we show above 99.99% confidence that fingerprints from different fingers of the same person share very strong similarities. Using deep twin neural networks to extract fingerprint representation vectors, we find that these similarities hold across all pairs of fingers within the same person, even when controlling for spurious factors like sensor modality. We also find evidence that ridge orientation, especially near the fingerprint center, explains a substantial part of this similarity, whereas minutiae used in traditional methods are almost nonpredictive. Our experiments suggest that, in some situations, this relationship can increase forensic investigation efficiency by almost two orders of magnitude.

Harnessing fluorescent carbon quantum dots from natural resource for advancing sweat latent fingerprint recognition with machine learning algorithms for enhanced human identification.

Nowadays, it is fascinating to engineer waste biomass into functional valuable nanomaterials. We investigate the production of hetero-atom doped carbon quantum dots (N-S@MCDs) to address the adaptability constraint in green precursors concerning the contents of the green precursors i.e., Tagetes erecta (marigold extract). The successful formation of N-S@MCDs as described has been validated by distinct analytical characterizations. As synthesized N-S@MCDs successfully incorporated on corn-starch powder, providing a nano-carbogenic fingerprint powder composition (N-S@MCDs/corn-starch phosphors). N-S@MCDs imparts astounding color-tunability which enables highly fluorescent fingerprint pattern developed on different non-porous surfaces along with immediate visual enhancement under UV-light, revealing a bright sharp fingerprint, along with long-time preservation of developed fingerprints. The creation and comparison of latent fingerprints (LFPs) are two key research in the recognition and detection of LFPs, respectively. In this work, developed fingerprints are regulated with an artificial intelligence program. The optimum sample has a very high degree of similarity with the standard control, as shown by the program's good matching score (86.94%) for the optimal sample. Hence, our results far outperform the benchmark attained using the conventional method, making the N-S@MCDs/corn-starch phosphors and the digital processing program suitable for use in real-world scenarios.

Fingerprint Recognition in Forensic Scenarios.

Fingerprints are unique patterns used as biometric keys because they allow an individual to be unambiguously identified, making their application in the forensic field a common practice. The design of a system that can match the details of different images is still an open problem, especially when applied to large databases or, to real-time applications in forensic scenarios using mobile devices. Fingerprints collected at a crime scene are often manually processed to find those that are relevant to solving the crime. This work proposes an efficient methodology that can be applied in real time to reduce the manual work in crime scene investigations that consumes time and human resources. The proposed methodology includes four steps: (i) image pre-processing using oriented Gabor filters; (ii) the extraction of minutiae using a variant of the Crossing Numbers method which include a novel ROI definition through convex hull and erosion followed by replacing two or more very close minutiae with an average minutiae; (iii) the creation of a model that represents each minutia through the characteristics of a set of polygons including neighboring minutiae; (iv) the individual search of a match for each minutia in different images using metrics on the absolute and relative errors. While in the literature most methodologies look to validate the entire fingerprint model, connecting the minutiae or using minutiae triplets, we validate each minutia individually using n-vertex polygons whose vertices are neighbor minutiae that surround the reference. Our method also reveals robustness against false minutiae since several polygons are used to represent the same minutia, there is a possibility that even if there are false minutia, the true polygon is present and identified; in addition, our method is immune to rotations and translations. The results show that the proposed methodology can be applied in real time in standard hardware implementation, with images of arbitrary orientations.

Measuring the rarity of core-delta distances in fingerprint patterns in the Dutch population.

In latent print examination, a conclusion on an individualization is primarily based on the presence of corresponding minutiae. Depending on the level of correspondence between the minutiae on the fingermark and on the reference print, a match is concluded. However, a fingermark is analyzed on all three levels: general pattern combined with core-delta distance, minutiae, and third-level detail. In the opinion of the authors, next to the conclusion based on minutiae, all information should be included in the final assessment of the evidence if present. In this study, we present the results of frequency data on the combination of fingerprint patterns and their core-delta distances. The frequency data allow examiners to substantiate their subjective opinions on the strength of corresponding patterns and core-delta distances based on measurements. The frequencies of the core-delta distances in this study were obtained by encoding core-delta distances in a collection of more than 20,000 fingerprints containing either a loop or a whorl pattern. The frequencies for the core-delta distances of loop patterns were subsequently compared with data from the National Institute of Standards and Technology. This study will demonstrate that core-delta distances in loop and whorl patterns contribute significantly to the overall evidential strength of fingerprint evidence. By adding pattern and core-delta distance information to the evaluation of fingerprint evidence, more challenging fingermarks could be added to fingerprint case reports.

Reliability of ordinal outcomes in forensic black-box studies.

Forensic science disciplines such as latent print examination, bullet and cartridge case comparisons, and shoeprint analysis, involve subjective decisions by forensic experts throughout the examination process. Most of the decisions involve ordinal categories. Examples include a three-category outcome for latent print comparisons (exclusion, inconclusive, identification) and a seven-category outcome for footwear comparisons (exclusion, indications of non-association, inconclusive, limited association of class characteristics, association of class characteristics, high degree of association, identification). As the results of the forensic examinations of evidence can heavily influence the outcomes of court proceedings, it is important to assess the reliability and accuracy of the underlying decisions. "Black box" studies are the most common approach for assessing the reliability and accuracy of subjective decisions. In these studies, researchers produce evidence samples consisting of a sample of questioned source and a sample of known source where the ground truth (same source or different source) is known. Examiners provide assessments for selected samples using the same approach they would use in actual casework. These studies often have two phases; the first phase comprises of decisions on samples of varying complexities by different examiners, and the second phase involves repeated decisions by the same examiner on a (usually) small subset of samples that were encountered by examiners in the first phase. We provide a statistical method to analyze ordinal decisions from black-box trials with the objective of obtaining inferences for the reliability of these decisions and quantifying the variation in decisions attributable to the examiners, the samples, and statistical interaction effects between examiners and samples. We present simulation studies to judge the performance of the model on data with known parameter values and apply the model to data from a handwritten signature complexity study, a latent fingerprint examination black-box study, and a handwriting comparisons black-box study.