g

Leveraging Digital Twin Simulations to Pretrain Contrastive Encoders for Few-Shot Structural Damage Classification

Authors

  • Michael Anderson

    Department of Civil and Environmental Engineering, University of Nevada, Reno, United States
    Author
  • Natalie Fisher

    Department of Civil and Environmental Engineering, University of Nevada, Reno, United States
    Author
  • Thomas Wright

    Department of Civil and Environmental Engineering, University of Nevada, Reno, United States
    Author

DOI:

https://doi.org/10.71465/jgs59

Keywords:

digital twin, contrastive learning, few-shot learning, structural damage classification, structural health monitoring, self-supervised pretraining, synthetic data

Abstract

The classification of structural damage under severely limited labeled data conditions remains a persistent bottleneck in automated infrastructure inspection, where the cost and complexity of expert annotation constrain the scalability of conventional supervised learning pipelines. This paper proposes a framework that integrates digital twin (DT) simulation with contrastive self-supervised pretraining and prototypical few-shot classification to address this bottleneck. High-fidelity finite element models of reinforced concrete (RC) and steel frame structures are used to generate large-scale synthetic image datasets parameterized across a comprehensive range of damage types and severities. A SimCLR-inspired contrastive encoder is pretrained on this synthetic corpus without any human labels, learning transferable structural damage representations that bridge the simulation-to-reality gap. The pretrained encoder is subsequently adapted to real-world inspection imagery using prototypical networks operating in the five-shot and one-shot regimes. Experiments conducted on the PEER Hub ImageNet dataset and a collected bridge inspection corpus demonstrate that the proposed method achieves classification accuracy substantially exceeding ImageNet-pretrained baselines under equivalent few-shot conditions, validating the utility of DT-driven synthetic pretraining for structural health monitoring (SHM) applications.

References

Tang, C., Liu, Y. F., Li, B. L., Tang, L., & Fan, J. S. (2025). Automated subway tunnel lining crack classification and detection based on two-step sequential convolutional neural network. Journal of Civil Structural Health Monitoring, 15(5), 1493-1510.

Fan, C. L. (2024). Deep neural networks for automated damage classification in image-based visual data of reinforced concrete structures. Heliyon, 10(19).

Gao, Y., & Mosalam, K. M. (2020). PEER Hub ImageNet: A large-scale multiattribute benchmark data set of structural images. Journal of Structural Engineering, 146(10), 04020198.

Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2020). Generalizing from a few examples: A survey on few-shot learning. ACM computing surveys (csur), 53(3), 1-34.

Cao, C., & Zhang, Y. (2022). Learning to compare relation: Semantic alignment for few-shot learning. IEEE Transactions on Image Processing, 31, 1462-1474.

Zahedi, H., & Khanizad, R. Leveraging Digital Twins for Agent-Based Systems Thinking: An Integrated Framework for Modeling Complex System Dynamics.

Kapteyn, M. G., Knezevic, D. J., & Willcox, K. (2020). Toward predictive digital twins via component-based reduced-order models and interpretable machine learning. In AIAA scitech 2020 forum (p. 0418).

Zhang, S., Qiu, L., & Zeng, Z. (2026). Physics-Data Synergy in Structural Health Monitoring: A Multi-Scale Graph Contrastive Framework With Temperature-Adaptive Fusion. IEEE Access.

Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020, November). A simple framework for contrastive learning of visual representations. In International conference on machine learning (pp. 1597-1607). PmLR.

Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020). What makes for good views for contrastive learning?. Advances in neural information processing systems, 33, 6827-6839.

Li, S., Zhao, X., & Zhou, G. (2019). Automatic pixel‐level multiple damage detection of concrete structure using fully convolutional network. Computer‐Aided Civil and Infrastructure Engineering, 34(7), 616-634.

Xu, Y., Wei, S., Bao, Y., & Li, H. (2019). Automatic seismic damage identification of reinforced concrete columns from images by a region‐based deep convolutional neural network. Structural Control and Health Monitoring, 26(3), e2313.

Chen, Z., Wang, C., Wu, J., Deng, C., & Wang, Y. (2023). Deep convolutional transfer learning-based structural damage detection with domain adaptation: Deep convolutional transfer learning-based structural damage detection with domain adaptation. Applied intelligence, 53(5), 5085-5099.

Azimi, M., Eslamlou, A. D., & Pekcan, G. (2020). Data-driven structural health monitoring and damage detection through deep learning: State-of-the-art review. Sensors, 20(10), 2778.

Słoński, M. (2019). A comparison of deep convolutional neural networks for image-based detection of concrete surface cracks. Computer assisted methods in Engineering and Science, 26(2), 105-112.

Li, Z., Weng, S., Zhu, H., & Lei, A. (2025). Cross-domain damage detection through partial conditional adversarial domain adaptation. Mechanical Systems and Signal Processing, 225, 112263.

Melesse, T. Y., Di Pasquale, V., & Riemma, S. (2021). Digital Twin models in industrial operations: State‐of‐the‐art and future research directions. IET Collaborative Intelligent Manufacturing, 3(1), 37-47.

Huang, Z., Yin, X., & Liu, Y. (2022). Physics-guided deep neural network for structural damage identification. Ocean Engineering, 260, 112073.

Gulakala, R., Markert, B., & Stoffel, M. (2022). Generative adversarial network based data augmentation for CNN based detection of Covid-19. Scientific Reports, 12(1), 19186.

Ji, Z., Chai, X., Yu, Y., Pang, Y., & Zhang, Z. (2020). Improved prototypical networks for few-shot learning. Pattern Recognition Letters, 140, 81-87.

Wang, R., Xu, K., Liu, S., Chen, P. Y., Weng, T. W., Gan, C., & Wang, M. (2021). On fast adversarial robustness adaptation in model-agnostic meta-learning. arXiv preprint arXiv:2102.10454.

Gao, W., Xu, Z., & Akoudad, Y. (2025). Metric-based meta-learning relation network for cross-domain few-shot bearing fault diagnosis. IEEE Sensors Journal.

Liu, C. L., Tseng, C. J., Huang, T. H., Yang, J. S., & Huang, K. B. (2023). A multi-task learning model for building electrical load prediction. Energy and Buildings, 278, 112601.

Ding, G., Yang, S., Lin, H., Chen, Z., & Yang, J. S. (2026). LLM-driven adaptive cloud resource scheduling: Bridging reasoning intelligence with optimization guarantees. IEEE Open Journal of the Computer Society.

Chen, J., Liang, Y., Liu, J., & Zhou, M. (2026). Temporal Transformer with Conditional Tabular GAN for Credit Card Fraud Detection: A Sequential Deep Learning Approach. Mathematics, 14(7), 1183.

Ping, W., Jiao, Y., Fan, H., & Zhang, X. (2026). Multimodal Fraud Detection in Financial Statements: A Trimodal Attention Network with Contrastive Evidence Chain Construction. IEEE Access.

Wang, B., Wang, Z., Zhao, W., Zhang, F., & Shang, W. (2026). DRL-Adapt: Deep Reinforcement Learning for Adaptive Routing Convergence Optimization in Large-Scale Networks. IEEE Open Journal of the Computer Society.

Teng, D., Rhee, M., Qin, Y., Zi, B., & Liu, W. (2026). SW-SpeedDLM: Sliding-Window Speculative Decoding for Diffusion Language Models under Long-Context Constraints. Mathematics

Downloads

Published

2026-06-25