李小军,赵明炀,李淼
LI Xiaojun,ZHAO Mingyang,LI Miao

• 1:河南理工大学能源科学与工程学院
• 2:河南省煤矿岩层控制国际联合实验室
• 3:河南理工大学创新创业学院

摘要(Abstract)：

【目的】为解决人工统计钻孔冲煤量不准确以及效率低等问题，提出一种YOLOv8n、ResNet34和PP-OCRv4算法相结合的智能识别方法。【方法】该方法首先使用YOLOv8n算法完成一级检测，同时并行级联ResNet34算法与PP-OCRv4算法进行二级处理，并结合基于追踪帧数的分类状态判别方法，建立了冲煤量自动计算的算法框架。其次，在YOLOv8n的C2f模块中引入可变形卷积DCNv2模块，以削弱点状强光照对特征采集的影响，并将其默认的检测头替换为Dynamic Head检测头模块，以强化算法在尺度，空间和通道维度的特征提取能力，以及将CIoU损失函数替换为SIoU损失函数，以加速预测框与真实框的匹配，并利用自建的数据集对改进后的YOLOv8n算法进行验证。【结果和结论】结果表明：(1)与原算法相比，平均类别检测精度提高了7.6%，召回率提高了3.5%，精确率提高了6.4%，验证了改进策略对提升模型性能的有效性和稳定性。(2)对4个不同的瓦斯抽采水力冲孔钻场的实时视频进行测试，识别准确率分别为100.0%、93.3%、95.7%和93.1%，平均达到95.5%，满足了水力冲孔钻孔冲煤量自动识别的精度要求。(3)采用追踪帧数确定ResNet34分类状态的方法，解决了分类状态单次识别结果不可靠的问题。研究成果为YOLO系列算法与其他深度学习技术的融合和广泛应用提供了技术与实践基础，对促进瓦斯抽采钻场等煤矿井下复杂场景的智能化进步具有参考价值。
[Objective] Given the inaccurate and low-efficiency manual statistics of the quantity of coals flushed out during borehole hydraulic flushing, this study proposed an intelligent identification method that combines YOLOv8n, ResNet34, and PP-OCRv4 algorithms. [Methods] First, the first-level detection was completed using the YOLOv8n algorithm, which, combined with the ResNet34 and PP-OCRv4 algorithms via parallel cascade, was then employed to conduct second-level processing. Through the above processing and in combination with the method for classification status discrimination based on tracking frame numbers, the framework of an algorithm for automatically calculating the quantity of coals flushed out was established. Subsequently, the deformable convolution DCNv2 module was introduced into the C2f module of YOLOv8n to reduce the impacts of point-like strong illumination on feature extraction. Moreover, the default detection head of YOLOv8n was replaced with the Dynamic Head module to strengthen the feature extraction in scale, space, and channel dimensions. The CIoU loss function was replaced with the SIoU loss function to accelerate the matching between prediction and ground truth boxes. Finally, the improved YOLOv8n algorithm was validated using a self-built dataset. [Results and Conclusions] The results indicate that, compared to the original algorithm, the improved YOLOv8n algorithm increased the mean average classification accuracy, recall, and precision by 7.6%, 3.5%, and 6.4%,respectively. This verifies the effectiveness and stability of the improvement strategy for enhancing the model performance. The improved YOLOv8n algorithm was applied to the real-time videos from four drilling sites of borehole hydraulic flushing for gas drainage, yielding respective identification accuracies of 100.0%, 93.3%, 95.7%, and 93.1%,with an average of 95.5%, meeting the accuracy requirements for the automatic identification of coal quantity flushed out during borehole hydraulic flushing. The method for determining the ResNet34 classification status based on tracking frame numbers resolved the problem of unreliable single identification of the classification status. The results of this study provide a technical and practical foundation for the integration of the YOLO series of algorithms with other deep learning techniques and its wide applications. Besides, these results serve as a valuable reference for achieving intelligent advances in complex underground coal mine scenarios such as drilling sites for gas drainage.

关键词(KeyWords)： 瓦斯抽采;冲煤量;YOLOv8n;ResNet34;PaddleOCR;可变形卷积;动态检测头;智能识别;煤矿
gas drainage;quantity of coals flushed out;YOLOv8n;ResNet34;PaddleOCR;deformable convolution;Dynamic Head(DyHead);intelligent identification;coal mine

Abstract:

Keywords:

基金项目(Foundation): 国家自然科学基金面上项目(52374086);; 河南省高校科技创新团队支持计划项目(22IRTSTHN005)

作者(Author): 李小军,赵明炀,李淼
LI Xiaojun,ZHAO Mingyang,LI Miao

参考文献(References)：

• [1]刘晓，李勇，宣德全，等.软煤夹层水射流层状卸压增透抽采瓦斯数值模拟及试验[J].煤田地质与勘探，2021,49(2):54-61.LIU Xiao,LI Yong,XUAN Dequan,et al.Numerical simulation and test of gas drainage with water jet layered pressure relief and permeability enhancement in soft coal seam[J].Coal Geology&Exploration,2021,49(2):54-61.
• [2]卢义玉，黄杉，葛兆龙，等.我国煤矿水射流卸压增透技术进展与战略思考[J].煤炭学报，2022,47(9):3189-3211.LU Yiyu,HUANG Shan,GE Zhaolong,et al.Research progress and strategic thinking of coal mine water jet technology to enhance coal permeability in China[J].Journal of China Coal Society,2022,47(9):3189-3211.
• [3]谷保泽.五虎山煤矿水力造穴增透物理模拟及钻孔优化设计[J].煤矿安全，2024,55(7):15-21.GU Baoze.Physical simulation and drilling optimization design of hydraulic cavitation and permeability enhancement in Wuhushan Coal Mine[J].Safety in Coal Mines,2024,55(7):15-21.
• [4]任培良，刘彦伟，韩红凯，等.冲煤率对煤层卸压增透及瓦斯抽采的影响规律研究[J].煤炭科学技术，2022,50(10):102-109.REN Peiliang,LIU Yanwei,HAN Hongkai,et al.Study on influence laws of coal flushing rate on coal seam stress relief and gas extraction[J].Coal Science and Technology,2022,50(10):102-109.
• [5]刘厅，林柏泉，赵洋，等.瓦斯非均衡赋存煤层精准冲孔增透技术及应用[J].煤炭科学技术，2023,51(2):217-231.LIU Ting,LIN Baiquan,ZHAO Yang,et al.Precise permeability enhancement technique with hydraulic flushing for coal seams with non-uniformly distributed gas[J].Coal Science and Technology,2023,51(2):217-231.
• [6]张帅.松软低渗突出煤层水力冲孔卸压增透研究[J].煤矿安全，2024,55(3):66-72.ZHANG Shuai.Research of pressure relief and permeability improvement of hydraulic punching in soft and low permeability outburst coal seam[J].Safety in Coal Mines,2024,55(3):66-72.
• [7]曹佐勇，王恩元，何学秋，等.近距离突出煤层群水力冲孔卸压瓦斯抽采及效果评价研究[J].采矿与安全工程学报，2021,38(3):634-642.CAO Zuoyong,WANG Enyuan,HE Xueqiu,et al.Effect evaluation of pressure relief and gas drainage of hydraulic punching in short-distance coal seam group with the risk of outburst[J].Journal of Mining&Safety Engineering,2021,38(3):634-642.
• [8]王国法，庞义辉，任怀伟，等.智慧矿山系统工程及关键技术研究与实践[J].煤炭学报，2024,49(1):181-202.WANG Guofa,PANG Yihui,REN Huaiwei,et al.System engineering and key technologies research and practice of smart mine[J].Journal of China Coal Society,2024,49(1):181-202.
• [9]王国法，张良，李首滨，等.煤矿无人化智能开采系统理论与技术研发进展[J].煤炭学报，2023,48(1):34-53.WANG Guofa,ZHANG Liang,LI Shoubin,et al.Progresses in theory and technological development of unmanned smart mining system[J].Journal of China Coal Society,2023,48(1):34-53.
• [10]程德强，钱建生，郭星歌，等.煤矿安全生产视频AI识别关键技术研究综述[J].煤炭科学技术，2023,51(2):349-365.CHENG Deqiang,QIAN Jiansheng,GUO Xingge,et al.Review on key technologies of AI recognition for videos in coal mine[J].Coal Science and Technology,2023,51(2):349-365.
• [11]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,USA.IEEE,2016:779-788.
• [12]REDMON J,FARHADI A.YOLOv3:An incremental improvement[EB/OL].2018:1804.02767.https://arxiv.org/abs/1804.02767v1.
• [13]WANG C Y,BOCHKOVSKIY A,LIAO H Y M.YOLOv7:Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).Vancouver,BC,Canada.IEEE,2023:7464-7475.
• [14]郝帅，张旭，马旭，等.基于CBAM-YOLOv5的煤矿输送带异物检测[J].煤炭学报，2022,47(11):4147-4156.HAO Shuai,ZHANG Xu,MA Xu,et al.Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5[J].Journal of China Coal Society,2022,47(11):4147-4156.
• [15]姜媛媛，刘宋波.基于改进YOLOv8n的煤矿井下钻杆计数方法[J].工矿自动化，2024,50(8):112-119.JIANG Yuanyuan,LIU Songbo.A coal mine underground drill pipes counting method based on improved YOLOv8n[J].Journal of Mine Automation,2024,50(8):112-119.
• [16]王琦，夏鲁飞，陈天明，等.基于改进YOLOv8n的井下人员安全帽佩戴检测[J].工矿自动化，2024,50(9):124-129.WANG Qi,XIA Lufei,CHEN Tianming,et al.Detection of underground personnel safety helmet wearing based on improved YOLOv8n[J].Journal of Mine Automation,2024,50(9):124-129.
• [17]路晓亚，李海芳.低可见度环境下基于改进YOLOv3的井下人员定位方法[J].工矿自动化，2024,50(9):130-137.LU Xiaoya,LI Haifang.Personnel localization method for lowvisibility environments based on improved YOLOv3[J].Journal of Mine Automation,2024,50(9):130-137.
• [18]邵小强，李鑫，杨涛，等.改进YOLOv5s和DeepSORT的井下人员检测及跟踪算法[J].煤炭科学技术，2023,51(10):291-301.SHAO Xiaoqiang,LI Xin,YANG Tao,et al.Underground personnel detection and tracking based on improved YOLOv5s and DeepSORT[J].Coal Science and Technology,2023,51(10):291-301.
• [19]葛庆楠，程刚，赵东洋.基于KRB-YOLOv5s的煤矸识别方法[J].辽宁工程技术大学学报(自然科学版)，2024,43(4):385-392.GE Qingnan,CHENG Gang,ZHAO Dongyang.Recognition method for coal and gangue based on KRB-YOLOv5s[J].Journal of Liaoning Technical University (Natural Science),2024,43(4):385-392.
• [20]刘洺睿，车奔，董洪波，等.露天煤矿采场无人机遥感图像小目标检测[J].煤田地质与勘探，2023,51(11):132-140.LIU Mingrui,CHE Ben,DONG Hongbo,et al.Detection of small objects in open-pit coal mine stopes using UAV remote sensing images[J].Coal Geology&Exploration,2023,51(11):132-140.
• [21]孙传猛，王燕平，王冲，等.融合改进YOLOv3与三次样条插值的煤岩界面识别方法[J].采矿与岩层控制工程学报，2022,4(1):81-90.SUN Chuanmeng,WANG Yanping,WANG Chong,et al.Coalrock interface identification method based on improved YOLOv3and cubic spline interpolation[J].Journal of Mining and Strata Control Engineering,2022,4(1):81-90.
• [22]刘春霞，李超，潘理虎，等.改进YOLOv5s的煤矿烟火检测算法[J].计算机工程与应用，2023,59(17):286-294.LIU Chunxia,LI Chao,PAN Lihu,et al.Improved coal mine smoke and fire detection algorithm of YOLOv5s[J].Computer Engineering and Applications,2023,59(17):286-294.
• [23]王红尧，韩爽，李勤怡.改进YOLOv5的钢丝绳损伤图像识别实验方法研究[J].计算机工程与应用，2023,59(17):99-106.WANG Hongyao,HAN Shuang,LI Qinyi.Experimental research on image recognition of wire rope damage based on improved YOLOv5[J].Computer Engineering and Applications,2023,59(17):99-106.
• [24]ZHU Xizhou,HU Han,LIN S,et al.Deformable ConvNets V2:More deformable,better results[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).Long Beach,CA,USA.IEEE,2019:9300-9308.
• [25]DAI Xiyang,CHEN Yinpeng,XIAO Bin,et al.Dynamic head:Unifying object detection heads with attentions[C]//2021IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).Nashville,TN,USA.IEEE,2021:7369-7378.
• [26]GEVORGYAN Z.SIoU loss:More powerful learning for bounding box regression[EB/OL].2022:2205.12740.https://arxiv.org/abs/2205.12740v1
• [27]HE Kaiming,ZHANG Xiangyu,REN Shaoqing,et al.Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,USA.IEEE,2016:770-778.
• [28]LIAO Minghui,WAN Zhaoyi,YAO Cong,et al.Real-time scene text detection with differentiable binarization[J].Proceedings of the AAAI Conference on Artificial Intelligence,2020,34(7):11474-11481.
• [29]HOWARD A,SANDLER M,CHEN Bo,et al.Searching for MobileNetV3[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV).Seoul,Korea (South).IEEE,2019:1314-1324.
• [30]DU Yongkun,CHEN Zhineng,JIA Caiyan,et al.SVTR:Scene text recognition with a single visual model[EB/OL].2022:2205.00159.https://arxiv.org/abs/2205.00159v2.
• [31]WANG C Y,YEH I H,LIAO H Y M.YOLOv9:Learning what you want to learn using programmable gradient information[EB/OL].2024:2402.13616.https://arxiv.org/abs/2402.13616v2.
• [32]WANG Ao,CHEN Hui,LIU Lihao,et al.YOLOv10:Real-time end-to-end object detection[EB/OL].2024:2405.14458.https://arxiv.org/abs/2405.14458v2.

文章评论(Comment)：