TITLE:
The Fusion of Temporal Sequence with Scene Priori Information in Deep Learning Object Recognition
AUTHORS:
Yongkang Cao, Fengjun Liu, Xian Wang, Wenyun Wang, Zhaoxin Peng
KEYWORDS:
Computer Vison, Object Recognition, Deep Learning, Consecutive Scene, Information Fusion
JOURNAL NAME:
Open Journal of Applied Sciences,
Vol.14 No.9,
September
27,
2024
ABSTRACT: For some important object recognition applications such as intelligent robots and unmanned driving, images are collected on a consecutive basis and associated among themselves, besides, the scenes have steady prior features. Yet existing technologies do not take full advantage of this information. In order to take object recognition further than existing algorithms in the above application, an object recognition method that fuses temporal sequence with scene priori information is proposed. This method first employs YOLOv3 as the basic algorithm to recognize objects in single-frame images, then the DeepSort algorithm to establish association among potential objects recognized in images of different moments, and finally the confidence fusion method and temporal boundary processing method designed herein to fuse, at the decision level, temporal sequence information with scene priori information. Experiments using public datasets and self-built industrial scene datasets show that due to the expansion of information sources, the quality of single-frame images has less impact on the recognition results, whereby the object recognition is greatly improved. It is presented herein as a widely applicable framework for the fusion of information under multiple classes. All the object recognition algorithms that output object class, location information and recognition confidence at the same time can be integrated into this information fusion framework to improve performance.