您好,欢迎访问新疆农垦科学院 机构知识库!

An improved cascade R-CNN and RGB-D camera-based method for dynamic cotton top bud recognition and localization in the field

文献类型: 外文期刊

作者: Song, Peng 1 ; Chen, Keyi 1 ; Zhu, Longfu 1 ; Yang, Meng 1 ; Ji, Chao 2 ; Xiao, Ailing 3 ; Jia, Haoyang 1 ; Zhang, Jian 4 ; Yang, Wanneng 1 ;

作者机构: 1.Huazhong Agr Univ, Natl Ctr Plant Gene Res Wuhan, Natl Key Lab Crop Genet Improvement, Wuhan 430070, Peoples R China

2.Xinjiang Acad Agr & Reclamat Sci, Inst Mech Equipment, Shihezi 832003, Peoples R China

3.Tarim Univ, Coll Mech & Elect Engn, Alaer 843300, Xinjiang, Peoples R China

4.Huazhong Agr Univ, Coll Resources & Environm, Wuhan 430070, Peoples R China

关键词: RGB-D camera; Dynamic 3D localization; Cotton terminal bud recognition; Cascade

期刊名称:COMPUTERS AND ELECTRONICS IN AGRICULTURE ( 影响因子:6.757; 五年影响因子:6.817 )

ISSN: 0168-1699

年卷期: 2022 年 202 卷

页码:

收录情况: SCI

摘要: Cotton top cutting is an indispensable part of cotton planting. Cotton top bud detection and localization are highly challenging tasks because of tiny targets, dense growth and varying illumination. To achieve the auto-matic cutting of cotton buds in the field, a cotton top bud recognition and location algorithm adapted to a moving platform in the field based on images acquired by a red, green, blue and depth (RGB-D) camera was developed. In this study, an improved Cascade R-CNN network was proposed to detect cotton top bud regions on RGB images, and three-dimensional (3D) coordinates of targets were obtained by combining color images and depth images from RGB-D cameras. The 3D spatial position of the target in the world coordinate system was affected by the time of the cotton top bud recognition algorithm, the forward speed of the mobile platform and the time con-sumption of the manipulator moving to the target position. A dynamic compensation method of target co-ordinates in the moving direction was proposed to ensure the identification and positioning accuracy of cotton top buds in the moving process. To verify the effectiveness of the proposed algorithm, cotton top bud recognition and localization experiments were conducted in the field. The average precision with the proposed improved Cascade R-CNN model was 97.5 %, and the FPS was 13.3 frames per second, which was suitable for different period of a day. The average error of the positioning accuracy in the platform forwarding direction was 4.2 mm, 6.6 mm and 9.6 mm at speeds of 0.1 m/s, 0.2 m/s and 0.3 m/s, respectively. All the results demonstrate that the proposed method could be used for robotic cotton top cutting.

  • 相关文献
作者其他论文 更多>>