Identification of spacecraft at close range using depth maps

Intelligent Systems and Technologies, Artificial Intelligence
Authors:
Abstract:

The article addresses the problem of automatic detection, segmentation, and classification of spacecraft using depth maps. The study was based on synthesized semi-natural data, which made it possible to simulate various orbital imaging conditions and to provide accurate ground-truth annotations for the quantitative evaluation of algorithms. Due to the instability of texture and color features under real space conditions, the geometric structure of objects is proposed as a key invariant feature. To solve the detection problem, a multi-stage algorithm has been developed, which includes adaptive histogram equalization, local threshold segmentation, morphological processing, and filtering of false contours based on geometric criteria. To classify spacecraft, deep neural networks of the ResNet family were used in two configurations: based on optical images alone and based on combined data (image + depth map). Experiments on a synthetic dataset of 19 440 images showed that the proposed algorithm significantly outperforms the SAM 3 model in terms of detection accuracy (Precision 0.917 vs 0.171), ensuring a low level of false positives. The multimodal approach to classification achieved an accuracy of 99.9% (ResNet-152 model), confirming the effectiveness of using depth maps for reliable recognition of spacecraft under near-real space imaging conditions.

  • References

    1. Sagdullaev Iu.S., Smirnov A.I., Kovin S.D. Osnovy televizionnykh izmerenii parametrov sblizheniia kosmicheskikh apparatov [Fundamentals of Television-Based Measurement of Spacecraft Approach Parameters], monograph, Moscow: Sputnik+, 2014

    2. Keldysh M.V. Tvorcheskoe nasledie akademika Sergeia Pavlovicha Koroleva [Creative Legacy of Academician Sergei Pavlovich Korolev], Moscow: Izdatel'stvo “Nauka”, 1980.

    3. Devyatkin A.V., Gorshanov D.L., Tsytsulin A.K., Morozov A.V., Bobrovsky A.I., Pavlov V.A. Adaptation of frame frequency to observation stages at control of spacecraft convergence. Journal of Physics: Conference Series, 2019, Vol. 1236, Art. No. 012069. DOI: 10.1088/1742-6596/1236/1/012069

    4. Tsytsulin A.K., Bobrovskiy A.I., Morozov A.V. Synthesis of a space videoinformation system with a wide range of changes in the distance to the object. Voprosy radioelektroniki. Seriia: tekhnika televideniia [Issues of Radio Electronics. Series: Television Technology], 2020, Vol. 2, Pp. 19–37.

    5. Klyushnikov V.Yu. Construction of small spacecraft clusters. Izvestia vuzov. Priborostroenie, 2016, Vol. 59, No. 6, Pp. 423–428. DOI: 10.17586/0021-3454-2016-59-6-423-428

    6. Balukhto A.N., Romanov A.A. Artificial Intelligence in Space Technology: State, Development Prospects. Rocket-Space Device Engineering and Information Systems, 2019, Vol. 6, No. 1, Pp. 65–75. DOI: 10.30894/issn2409-0239.2019.6.1.65.75

    7. Bobrovskiy A. Video processing in adaptive control system of spacecraft rendezvous. Information and Space, 2018, Vol. 4, Pp. 149–153.

    8. Bachevskiy S.V. Tochnost' opredeleniia dal'nosti i orientatsii ob"ekta metodom proportsii v matrichnykh televizionnykh sistemakh [Accuracy of definition of range and orientation of object by the method of proportions in matrix television systems]. Voprosy radioelektroniki. Seriia: tekhnika televideniia [Issues of Radio Electronics. Series: Television Technology], 2010, No. 1, Pp. 57–66.

    9. Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao, Xiaogang Xu, Jiashi Feng, Hengshuang Zhao. Depth Anything V2. arXiv:2406.09414, 2024.

    10. Zuiderveld K. Contrast Limited Adaptive Histogram Equalization. In: Graphics Gems IV (ed. P.S. Heckbert), 1994, Pp. 474–485.

    11. Bradley D., Roth G. Adaptive thresholding using the integral image. Journal of Graphics Tools, 2007, Vol. 12, No. 2, Pp. 13–21. DOI: 10.1080/2151237X.2007.10129236

    12. Suzuki S., Abe K. Topological structural analysis of digitized binary images by border following. Com-puter Vision, Graphics, and Image Processing, 1985, Vol. 30, No. 1, Pp. 32–46. DOI: 10.1016/0734-189X(85)90016-7

    13. Everingham M., Van Gool L., Williams C.K.I., Winn J., Zisserman A. The PASCAL Visual Object Clas-ses (VOC) Challenge. International Journal of Computer Vision, 2010, Vol. 88, Pp. 303–338. DOI: 10.1007/s11263-009-0275-4

    14. Carion N., Gustafson L., Hu Y.-T. et al. SAM 3: Segment Anything with Concepts. arXiv:2511.16719, 2025. DOI: 10.48550/arXiv.2511.16719

    15. Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, Pp. 770–778. DOI: 10.1109/CVPR.2016.90

     

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Next article