XrayVision: Brief history of X-ray security imaging in Computer Vision

---

💥 List of datasets and papers (not exhaustive)!

🦉 Our epochal mission: Time to gather all those papers and datasets about X-ray security imaging onto this page! Let's turn this into the one-stop-shop for the research community - no need to wander around - we've got you covered!

👾 This is constantly updated with the latest datasets, papers - check in regularly for updates!

🐲 Dataset

📈 [2D: 17] [3D: 2]

Name	Type	Year	Class	Prohibited - Negative	Annotations	Views	Open Source
DVXRAY	2D	2024	15	10,000 - 22,0000	bbox	2	✓ [Link]
LPIXray	2D	2023	18	60,950 - 0	bbox	1	✕ [Link]
FSOD	2D	2022	20	12,333 - 0	bbox	1	✓ [Link]
EDS	2D	2022	10	14,219 - 0	bbox	1	✓ [Link]
Xray-PI	2D	2022	12	2,409 - 0	bbox, segm	1	✓ [Link]
PIXray	2D	2022	12	5,046 - 0	bbox, segm	1	✓ [Link]
CLCXray	2D	2022	12	9,565 - 0	bbox	1	✓ [Link]
HiXray	2D	2021	8	45,364 - 0	bbox	1	✓ [Link]
deei6	2D	2021	6	7,022 - 0	bbox, segm	2	✕ [Link]
PIDray	2D	2021	12	47,677 - 0	bbox, segm	1	✓ [Link]
AB	2D	2021	--	417 - 6,608	--	2	✕ [Link]
dbf4	2D	2020	4	10,112 - 0	bbox, segm	4	✕ [Link]
OPIXray	2D	2020	5	8,885 - 0	bbox	1	✓ [Link]
SIXray	2D	2019	6	8,929 - 1,050,0302	bbox	1	✓ [Link]
COMPASS-XP	2D	2019	366	1928 - 0	--	1	✓ [Link]
dbf6	2D	2018	6	11,627 - 0	bbox, segm	4	✕ [Link]
GDXray	2D	2015	5	19,407 - 0	bbox	1	✓ [Link]
Dur_3D	3D	2020	5	774 - 0	bbox	--	✕ [Link]
Flitton_3D	3D	2015	2	810 - 2149	bbox	--	✕ [Link]

---

📜 Paper

📈 [2D: 158] [3D: 38]

🐜 [Dataset] [2024] [2023] [2022] [2021] [2020] [2019] [2018] [Earlier] [Reference]

2024

^[top]

2D

• Towards Dual-view X-ray Baggage Inspection: A Large-scale Benchmark and Adaptive Hierarchical Cross Refinement for Prohibited Item Discovery [Paper]
• X-ray image analysis for explosive circuit detection using deep learning algorithms [Paper]

2023

^[top]

2D

• Unaligned 2D to 3D Translation with Conditional Vector-Quantized Code Diffusion using Transformers [Paper]
• Illicit item detection in X-ray images for security applications [Paper]
• Enhancing baggage inspection through computer vision analysis of x-ray images [Paper]
• GADet: A Geometry-Aware X-ray Prohibited Items Detector [Paper]
• LPIXray: A Large-scale Logistics Prohibited Item X-ray Dataset for the Application of Deep Learning in Security Inspection [Paper]
• Electronic explosives inspection: a fine-grained X-ray benchmark and few-shot prohibited phone detection model [Paper]
• DETR Based Prohibited Item Detection in X-ray Security Checking Images [Paper]
• Feature-Aware Prohibited Items Detection for X-Ray Image [Paper]
• A literature review on deep learning algorithms for analysis of X-ray images [Paper]
• X-ray Detection of Prohibited Item Method Based on Dual Attention Mechanism [Paper]
• Inspection of cargo using dual-energy X-ray radiography: A review [Paper]
• Programmable broad learning system for baggage threat recognition [Paper]
• SLX: Similarity Learning for X-Ray Screening and Robust Automated Disassembled Object Detection [Paper]
• Attention Based Network with DA-Loss for X-ray Contraband Automatic Detection [Paper]
• AC-YOLOv4: an object detection model incorporating attention mechanism and atrous convolution for contraband detection in x-ray images [Paper]
• FSVM: A Few-Shot Threat Detection Method for X-ray Security Images [Paper]
• Incremental Instance Segmentation for Cluttered Baggage Threat Detection [Paper]
• Optimization and Research of Suspicious Object Detection Algorithm in X-ray Image [Paper]
• Object Detection and X-Ray Security Imaging: A Survey [Paper]
• RWSC-Fusion: Region-Wise Style-Controlled Fusion Network for the Prohibited X-Ray Security Image Synthesis [Paper]
• Transformers for Imbalanced Baggage Threat Recognition [Paper]
• CTA-FPN: Channel-Target Attention Feature Pyramid Network for Prohibited Object Detection in X-ray Images [Paper]
• Material-Aware Path Aggregation Network and Shape Decoupled SIoU for X-ray Contraband Detection [Paper]
• Seeing Through the Data: A Statistical Evaluation of Prohibited Item Detection Benchmark Datasets for X-ray Security Screening [Paper]
• X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detection [Paper]
• Cascaded structure tensor for robust baggage threat detection [Paper]
• Computer Vision on X-ray Data in Industrial Production and Security Applications: A Comprehensive Survey [Paper]

2022

^[top]

2D

• Learning-based Material Classification in X-ray Security Images [Paper]
• Few-shot X-ray Prohibited Item Detection: A Benchmark and Weak-feature Enhancement Network [Paper]
• Balanced Affinity Loss for Highly Imbalanced Baggage Threat Contour-Driven Instance Segmentation [Paper]
• Joint Sub-component Level Segmentation and Classification for Anomaly Detection within Dual-Energy X-Ray Security Imagery [Paper]
• Automatic Baggage Threat Detection Using Deep Attention Networks [Paper]
• A Multi-Task Semantic Segmentation Network for Threat Detection in X-Ray Security Images [Paper]
• Dualray: Dual-View X-ray Security Inspection Benchmark and Fusion Detection Framework [Paper]
• MFA-net: Object detection for complex X-ray cargo and baggage security imagery [Paper]
• Baggage Threat Recognition Using Deep Low-Rank Broad Learning Detector [Paper]
• Exploring Endogenous Shift for Cross-domain Detection: A Large-scale Benchmark and Perturbation Suppression Network [Paper]
• Improved YOLOX detection algorithm for contraband in X-ray images [Paper]
• LightRay: Lightweight network for prohibited items detection in X-ray images during security inspection [Paper]
• Benefits of Decision Support Systems in Relation to Task Difficulty in Airport Security X-Ray Screening [Paper]
• Recent Advances in Baggage Threat Detection: A Comprehensive and Systematic Survey [Paper]
• Automated Detection of Threat Materials in X -Ray Baggage Inspection System (XBIS) [Paper]
• Threat detection in x-ray baggage security imagery using convolutional neural networks [Paper]
• X-ray baggage screening and artificial intelligence (AI) [Paper]
• Material-aware Cross-channel Interaction Attention (MCIA) for occluded prohibited item detection [Paper]
• A Novel Incremental Learning Driven Instance Segmentation Framework to Recognize Highly Cluttered Instances of the Contraband Items [Paper]
• How Realistic Is Threat Image Projection for X-ray Baggage Screening? [Paper]
• Cross-modal Image Synthesis within Dual-Energy X-ray Security Imagery [Paper]
• Recursive CNN Model to Detect Anomaly Detection in X-Ray Security Image [Paper]
• Towards More Efficient Security Inspection via Deep Learning: A Task-Driven X-ray Image Cropping Scheme [Paper]
• DMA-Net: Dual multi-instance attention network for X-ray image classification [Paper]
• X-ray security check image recognition based on attention mechanism [Paper]
• A Data Augmentation Method for Prohibited Item X-Ray Pseudocolor Images in X-Ray Security Inspection Based on Wasserstein Generative Adversarial Network and Spatial-and-Channel Attention Block [Paper]
• Enhanced threat detection in three dimensions: An image-matched comparison of computed tomography and dual-view X-ray baggage screening [Paper]
• ETHSeg: An Amodel Instance Segmentation Network and a Real-world Dataset for X-Ray Waste Inspection [Paper]
• Anomaly object detection in x-ray images with Gabor convolution and bigger discriminative RoI pooling [Paper]
• Intelligent Detection of Dangerous Goods in Security Inspection Based on Cascade Cross Stage YOLOv3 Model [Paper]
• A Lightweight Dangerous Liquid Detection Method Based on Depthwise Separable Convolution for X-Ray Security Inspection [Paper]
• EAOD-Net: Effective anomaly object detection networks for X-ray images [Paper]
• American National Standard for Evaluating the Image Quality of X-ray Computed Tomography (CT) Security-Screening Systems [Paper]
• Automated Segmentation of Prohibited Items in X-ray Baggage Images Using Dense De-overlap Attention Snake [Paper]
• Programmable Broad Learning System to Detect Concealed and Imbalanced Baggage Threats [Paper]
• Few-Shot Segmentation for Prohibited Items Inspection with Patch-based Self-Supervised Learning and Prototype Reverse Validation [Paper]
• Augmenting data with GANs for firearms detection in cargo x-ray images [Paper]
• Weight-guided dual-direction-fusion feature pyramid network for prohibited item detection in x-ray images [Paper]
• Handling occlusion in prohibited item detection from X-ray images [Paper]
• Exploiting foreground and background separation for prohibited item detection in overlapping X-Ray images [Paper]
• PMix: a method to improve the classification of X-ray prohibited items based on probability mixing [Paper]
• Detecting prohibited objects with physical size constraint from cluttered X-ray baggage images [Paper]
• Synthetic threat injection using digital twin informed augmentation [Paper]
• Target Detection by Target Simulation in X-ray Testing [Paper]
• Abnormal object detection in x-ray images with self-normalizing channel attention and efficient data augmentation [Paper]
• Raw data processing techniques for material classification of objects in dual energy X-ray baggage inspection systems [Paper]

3D

• CTIMS: Automated Defect Detection Framework Using Computed Tomography [Paper]

2021

^[top]

2D

• Super-resolution network for x-ray security inspection [Paper]
• Information-exchange Enhanced Feature Pyramid Network (IEFPN) for Detecting Prohibited Items in X-ray Security Images [Paper]
• Learning-Based Image Synthesis for Hazardous Object Detection in X-Ray Security Applications [Paper]
• X-ray Security Inspection Image Detection Algorithm Based on Improved YOLOv4 [Paper]
• A YOLOv5s-SE model for object detection in X-ray security images [Paper]
• Prohibited Items Detection in X-ray Images in YOLO Network [Paper]
• Automatic and Robust Object Detection in X-Ray Baggage Inspection Using Deep Convolutional Neural Networks [Paper]
• Classify and Localize Threat Items in X-Ray Imagery With Multiple Attention Mechanism and High-Resolution and High-Semantic Features [Paper]
• Raw Data Processing Using Modern Hardware for Inspection of Objects in X-Ray Baggage Inspection Systems [Paper]
• Temporal Fusion Based Mutli-scale Semantic Segmentation for Detecting Concealed Baggage Threats [Paper]
• Automatic Threat Detection Using Deep Neural Networks [Paper]
• Towards Real-world X-ray Security Inspection: A High-Quality Benchmark And Lateral Inhibition Module For Prohibited Items Detection [Paper]
• A Novel Incremental Learning Driven Instance Segmentation Framework to Recognize Highly Cluttered Instances of the Contraband Items [Paper]
• Deep Fusion Driven Semantic Segmentation for the Automatic Recognition of Concealed Contraband Items [Paper]
• Brittle Features May Help Anomaly Detection [Paper]
• Deep Learning-Based X-Ray Baggage Hazardous Object Detection – An FPGA Implementation [Paper]
• Operationalizing Convolutional Neural Network Architectures for Prohibited Object Detection in X-Ray Imagery [Paper]
• Towards Automatic Threat Detection: A Survey of Advances of Deep Learning within X-ray Security Imaging [Paper]
• On the Impact of Using X-Ray Energy Response Imagery for Object Detection via Convolutional Neural Networks [Paper]
• Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmark [Paper]
• PANDA: Perceptually Aware Neural Detection of Anomalies [Paper]
• Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat Recognition [Paper]
• Unsupervised Anomaly Instance Segmentation for Baggage Threat Recognition [Paper]
• Symmetric Triangle Network for Object Detection Within X-ray Baggage Security Imagery [Paper]
• Anomaly Detection in X-ray Security Imaging: a Tensor-Based Learning Approach [Paper]
• Automated Threat Objects Detection with Synthetic Data for Real-Time X-ray Baggage Inspection [Paper]
• Evaluating GAN-Based Image Augmentation for Threat Detection in Large-Scale Xray Security Images [Paper]
• An X-ray Image Enhancement Algorithm for Dangerous Goods in Airport Security Inspection [Paper]
• Baggage Threat Detection Under Extreme Class Imbalance [Paper]
• Detecting Overlapped Objects in X-Ray Security Imagery by a Label-Aware Mechanism [Paper]

3D CT

• Contraband Materials Detection Within Volumetric 3D Computed Tomography Baggage Security Screening Imagery [Paper]
• On the Evaluation of Semi-Supervised 2D Segmentation for Volumetric 3D Computed Tomography Baggage Security Screening [Paper]
• SliceNets — A Scalable Approach for Object Detection in 3D CT Scans [Paper]
• DEBISim: A simulation pipeline for dual energy CT-based baggage inspection systems [Paper]

2020

^[top]

2D

• Learning-based Material Classification in X-ray Security Images [Paper]
• Multi-label X-ray Imagery Classification via Bottom-up Attention and Meta Fusion [Paper]
• Multi-view Object Detection Using Epipolar Constraints within Cluttered X-ray Security Imagery [Paper]
• Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Module [Paper]
• Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion [Paper]
• Cascaded Structure Tensor Framework for Robust Identification of Heavily Occluded Baggage Items from X-ray Scans [Paper]
• Automatic Threat Detection in Baggage Security Imagery using Deep Learning Models [Paper]
• Automatic Threat Detection in Single, Stereo (Two) and Multi View X-Ray Images [Paper]
• Detecting Prohibited Items in X-Ray Images: a Contour Proposal Learning Approach [Paper]
• Background Adaptive Faster R-CNN for Semi-Supervised Convolutional Object Detection of Threats in X-Ray Images [Paper]
• X-Ray Baggage Inspection With Computer Vision: A Survey [Paper]
• Data Augmentation of X-Ray Images in Baggage Inspection Based on Generative Adversarial Networks [Paper]

3D CT

• Multi-Class 3D Object Detection Within Volumetric 3D Computed Tomography Baggage Security Screening Imagery [Paper]
• On the Evaluation of Prohibited Item Classification and Detection in Volumetric 3D Computed Tomography Baggage Security Screening Imagery [Paper]
• A Reference Architecture for Plausible Threat Image Projection (TIP) Within 3D X-ray Computed Tomography Volumes [Paper]
• An Approach for Adaptive Automatic Threat Recognition Within 3D Computed Tomography Images for Baggage Security Screening [Paper]

2019

^[top]

2D

• Evaluating the Transferability and Adversarial Discrimination of Convolutional Neural Networks for Threat Object Detection and Classification within X-Ray Security Imagery [Paper]
• On the Impact of Object and Sub-Component Level Segmentation Strategies for Supervised Anomaly Detection within X-Ray Security Imagery [Paper]
• Using Deep Neural Networks to Address the Evolving Challenges of Concealed Threat Detection within Complex Electronic Items [Paper]
• On the Use of Deep Learning for the Detection of Firearms in X-ray Baggage Security Imagery [Paper]
• The Good, the Bad and the Ugly: Evaluating Convolutional Neural Networks for Prohibited Item Detection Using Real and Synthetically Composite X-ray Imagery [Paper]
• Evaluating a Dual Convolutional Neural Network Architecture for Object-wise Anomaly Detection in Cluttered X-ray Security Imagery [Paper]
• Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection [Paper]
• An evaluation of deep learning based object detection strategies for threat object detection in baggage security imagery [Paper]
• Deep Convolutional Neural Network Based Object Detector for X-Ray Baggage Security Imagery [Paper]
• Automated firearms detection in cargo x-ray images using RetinaNet [Paper]
• Toward Automatic Threat Recognition for Airport X-ray Baggage Screening with Deep Convolutional Object Detection [Paper]
• “Unexpected Item in the Bagging Area”: Anomaly Detection in X-Ray Security Images [Paper]
• Limits on transfer learning from photographic image data to X-ray threat detection [Paper]
• Data Augmentation for X-Ray Prohibited Item Images Using Generative Adversarial Networks [Paper]
• Modified Adaptive Implicit Shape Model for Object Detection [Paper]
• Graph clustering and variational image segmentation for automated firearm detection in X-ray images [Paper]
• Semantic Segmentation for Prohibited Items in Baggage Inspection [Paper]
• Application of Machine Learning Methods for Material Classification with Multi-energy X-Ray Transmission Images [Paper]
• Handgun Detection in Single-Spectrum Multiple X-ray Views Based on 3D Object Recognition [Paper]

3D CT

• On the Relevance of Denoising and Artefact Reduction in 3D Segmentation and Classification within Complex Computed Tomography Imagery [Paper]

2018

^[top]

2D

• On Using Deep Convolutional Neural Network Architectures for Automated Object Detection and Classification within X-ray Baggage Security Imagery [Paper]
• GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training [Paper]
• Multi-view X-ray R-CNN [Paper]
• A GAN-Based Image Generation Method for X-Ray Security Prohibited Items [Paper]
• Prohibited Item Detection in Airport X-Ray Security Images via Attention Mechanism Based CNN [Paper]
• Convolutional Neural Networks for Automatic Threat Detection in Security X-Ray Images [Paper]
• Automatic threat recognition of prohibited items at aviation checkpoint with x-ray imaging: a deep learning approach [Paper]

3D CT

• Consensus relaxation on materials of interest for adaptive ATR in CT images of baggage [Paper]
• Adaptive Target Recognition: A Case Study Involving Airport Baggage Screening [Paper]

Earlier

^[top]

2D

• An Evaluation Of Region Based Object Detection Strategies Within X-Ray Baggage Security Imagery [Paper]
• On using Feature Descriptors as Visual Words for Object Detection within X-ray Baggage Security Screening [Paper]
• Transfer Learning Using Convolutional Neural Networks For Object Classification Within X-Ray Baggage Security Imagery [Paper]
• Improving Feature-based Object Recognition for X-ray Baggage Security Screening using Primed Visual Words [Paper]
• A Combinational Approach to the Fusion, De-noising and Enhancement of Dual-Energy X-Ray Luggage Images [Paper]
• Improving Weapon Detection In Single Energy X-ray Images Through Pseudocoloring [Paper]
• A review of X-ray explosives detection techniques for checked baggage [Paper]
• A Logarithmic X-Ray Imaging Model for Baggage Inspection: Simulation and Object Detection [Paper]
• Automatic Defect Recognition in X-Ray Testing Using Computer Vision [Paper]
• Modern Computer Vision Techniques for X-Ray Testing in Baggage Inspection[Paper]
• Inspection of Complex Objects Using Multiple-X-Ray Views [Paper]
• Automated X-Ray Object Recognition Using an Efficient Search Algorithm in Multiple Views [Paper]
• X-Ray Testing by Computer Vision [Paper]
• Automated detection in complex objects using a tracking algorithm in multiple X-ray views [Paper]
• Threat Objects Detection in X-ray Images Using an Active Vision Approach [Paper]
• Object recognition in X-ray testing using an efficient search algorithm in multiple views [Paper]
• Modern Computer Vision Techniques for X-Ray Testing in Baggage Inspection [Paper]
• Automated Detection of Threat Objects Using Adapted Implicit Shape Model [Paper]
• A review of X-ray explosives detection techniques for checked baggage [Paper]
• Explosives detection systems (EDS) for aviation security [Paper]

3D CT

• Geometrical Approach for the Automatic Detection of Liquid Surfaces in 3D Computed Tomography Baggage Imagery [Paper]
• Materials-Based 3D Segmentation of Unknown Objects from Dual-Energy Computed Tomography Imagery in Baggage Security Screening [Paper]
• Object Classification in 3D Baggage Security Computed Tomography Imagery using Visual Codebooks [Paper]
• 3D Object Classification in Baggage Computed Tomography Imagery using Randomised Clustering Forests [Paper]
• Investigating Existing Medical CT Segmentation Techniques within Automated Baggage and Package Inspection [Paper]
• Radon Transform based Metal Artefacts Generation in 3D Threat Image Projection [Paper]
• A Comparison of 3D Interest Point Descriptors with Application to Airport Baggage Object Detection in Complex CT Imagery [Paper]
• A Distance Weighted Method for Metal Artefact Reduction in CT [Paper]
• An Experimental Survey of Metal Artefact Reduction in Computed Tomography [Paper]
• An Evaluation of CT Image Denoising Techniques Applied to Baggage Imagery Screening [Paper]
• Fully Automatic 3D Threat Image Projection: Application to Densely Cluttered 3D Computed Tomography Baggage Images [Paper]
• A Comparison of Classification Approaches for Threat Detection in CT based Baggage Screening [Paper]
• A Novel Intensity Limiting Approach to Metal Artefact Reduction in 3D CT Baggage Imagery [Paper]
• A 3D Extension to Cortex Like Mechanisms for 3D Object Class Recognition [Paper]
• Object Recognition using 3D SIFT in Complex CT Volumes [Paper]
• A Classifier based Approach for the Detection of Potential Threats in CT based Baggage Screening [Paper]
• A review of automated image understanding within 3D baggage computed tomography security screening [Paper]
• A volumetric object detection framework with dual-energy CT [Paper]
• Exact Reconstruction for Dual Energy Computed Tomography Using an H-L Curve Method [Paper]
• Automatic segmentation of CT scans of checked baggage [Paper]
• Automatic Segmentation of Unknown Objects, with Application to Baggage Security [Paper]
• ALERT Strategic Studies [Paper]
• Joint metal artifact reduction and segmentation of CT images using dictionary-based image prior and continuous-relaxed potts model [Paper]
• Using Threat Image Projection Data Forassessing Individual Screener Performance [Paper]
• 3D threat image projection [Paper]
• Learning-Based Object Identification and Segmentation Using Dual-Energy CT Images for Security [Paper]

🐸 Reference

If you use this repo and like it, use this to cite it:

@misc{xray-vision,
      title={Xray-Vision: Brief history of X-ray security imaging in Computer Vision},
      author={Neelanjan Bhowmik},
      year={2024},
      url={https://github.com/NeelBhowmik/xray}
    }

🚀 Contribute

Welcome to our lively repository - and you're invited to join the party! Feel free to contribute!

If you spot a missing paper/dataset - create an issue.

Together, we'll make this repo the coolest gathering spot for all things knowledge 📚