An improved cascade R-CNN and RGB-D camera-based method for dynamic cotton top bud recognition and localization in the field
文献类型: 外文期刊
作者: Song, Peng 1 ; Chen, Keyi 1 ; Zhu, Longfu 1 ; Yang, Meng 1 ; Ji, Chao 2 ; Xiao, Ailing 3 ; Jia, Haoyang 1 ; Zhang, Jian 4 ; Yang, Wanneng 1 ;
作者机构: 1.Huazhong Agr Univ, Natl Ctr Plant Gene Res Wuhan, Natl Key Lab Crop Genet Improvement, Wuhan 430070, Peoples R China
2.Xinjiang Acad Agr & Reclamat Sci, Inst Mech Equipment, Shihezi 832003, Peoples R China
3.Tarim Univ, Coll Mech & Elect Engn, Alaer 843300, Xinjiang, Peoples R China
4.Huazhong Agr Univ, Coll Resources & Environm, Wuhan 430070, Peoples R China
关键词: RGB-D camera; Dynamic 3D localization; Cotton terminal bud recognition; Cascade
期刊名称:COMPUTERS AND ELECTRONICS IN AGRICULTURE ( 影响因子:6.757; 五年影响因子:6.817 )
ISSN: 0168-1699
年卷期: 2022 年 202 卷
页码:
收录情况: SCI
摘要: Cotton top cutting is an indispensable part of cotton planting. Cotton top bud detection and localization are highly challenging tasks because of tiny targets, dense growth and varying illumination. To achieve the auto-matic cutting of cotton buds in the field, a cotton top bud recognition and location algorithm adapted to a moving platform in the field based on images acquired by a red, green, blue and depth (RGB-D) camera was developed. In this study, an improved Cascade R-CNN network was proposed to detect cotton top bud regions on RGB images, and three-dimensional (3D) coordinates of targets were obtained by combining color images and depth images from RGB-D cameras. The 3D spatial position of the target in the world coordinate system was affected by the time of the cotton top bud recognition algorithm, the forward speed of the mobile platform and the time con-sumption of the manipulator moving to the target position. A dynamic compensation method of target co-ordinates in the moving direction was proposed to ensure the identification and positioning accuracy of cotton top buds in the moving process. To verify the effectiveness of the proposed algorithm, cotton top bud recognition and localization experiments were conducted in the field. The average precision with the proposed improved Cascade R-CNN model was 97.5 %, and the FPS was 13.3 frames per second, which was suitable for different period of a day. The average error of the positioning accuracy in the platform forwarding direction was 4.2 mm, 6.6 mm and 9.6 mm at speeds of 0.1 m/s, 0.2 m/s and 0.3 m/s, respectively. All the results demonstrate that the proposed method could be used for robotic cotton top cutting.
- 相关文献
作者其他论文 更多>>
-
Attenuation of ethylene signaling increases cotton resistance to a defoliating strain of Verticillium dahliae
作者:Wang, Tianyi;Shaban, Muhammad;Shi, Junhui;Liu, Shiming;Zhang, Xianlong;Zhu, Longfu;Shaban, Muhammad;Wang, Weiran;Kong, Jie;Aierxi, Alifu;Nie, Xinhui;Yu, Yu;Klosterman, Steven J.
关键词:Cotton; Verticillium dahilae; Ethylene; Defoliation
-
GhWRKY41 forms a positive feedback regulation loop and increases cotton defence response against Verticillium dahliae by regulating phenylpropanoid metabolism
作者:Xiao, Shenghua;Ming, Yuqing;Hu, Qin;Ye, Zhengxiu;Si, Huan;Liu, Shiming;Zhang, Xiaojun;Zhang, Xianlong;Zhu, Longfu;Xiao, Shenghua;Hu, Qin;Ming, Yuqing;Liu, Shiming;Zhang, Xiaojun;Zhang, Xianlong;Zhu, Longfu;Wang, Weiran;Kong, Jie;Aierxi, Alifu;Yu, Yu;Klosterman, Steven J.;Lindsey, Keith
关键词:cotton; GhWRKY41; Verticillium dahliae; phenylpropanoid metabolism; Gh4CLGhC4H
-
Apple inflorescence recognition of phenology stage in complex background based on improved YOLOv7
作者:Chen, Jincheng;Ma, Benxue;Liu, Xin;Li, Yujie;Chen, Jincheng;Ji, Chao;Zhang, Jing;Ma, Benxue;Feng, Qingchun;Ma, Benxue
关键词:Phenology; Apple inflorescence; Deep learning; YOLOv7; Target recognition
-
Control System of a Motor-Driven Precision No-Tillage Maize Planter Based on the CANopen Protocol
作者:Chen, Jincheng;Zhang, Hui;Pan, Feng;Ji, Chao;Du, Mujun
关键词:precision planter; motor-driven; CANopen protocol; photoelectric sensor; no-tillage
-
Effects of oxidation on the physicochemical properties and degradation of mutton myofibrillar proteins
作者:Lei, Yongdong;Deng, Xiaorong;Zhang, Zhiwei;Guo, Xin;Zhang, Jian;Lei, Yongdong
关键词:mu-calpain; hydroxyl radical; myofibrillar protein; protein degradation; tan mutton
-
Intrinsic Calibration of Multi-Beam LiDARs for Agricultural Robots
作者:Sun, Na;Zhao, Chunjiang;Sun, Na;Fan, Zhengqiang;Li, Tao;Feng, Qingchun;Zhao, Chunjiang;Qiu, Quan;Fan, Zhengqiang;Ji, Chao
关键词:three-dimensional; LiDAR; intrinsic calibration; nonlinear optimization; agricultural robot
-
A Single-Nucleotide Mutation in a GLUTAMATE RECEPTOR-LIKE Gene Confers Resistance to Fusarium Wilt in Gossypium hirsutum
作者:Liu, Shiming;Zhang, Xiaojun;Xiao, Shenghua;Qin, Tao;Xu, Zheng;Wang, Tianyi;Wang, Yujing;Zhang, Zhennan;Li, Jianying;Zhang, Xianlong;Zhu, Longfu;Ma, Jun;Shi, Weijun;Kong, Jie;Aierxi, Alifu;Xi, Hui;Nie, Xinhui;You, Chunyuan;Yu, Yu;Lindsey, Keith;Klosterman, Steven J.
关键词:disease‐ resistant genes; Fusarium wilt; GLUTAMATE RECEPTOR‐ LIKE genes; Gossypium hirsutum