手机端多模态低头族危险感知与预警
DOI:
CSTR:
作者:
作者单位:

南通大学交通与土木工程学院 南通 226019

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家自然科学基金面上项目(61872425)资助


Multimodal hazard sensing and warning for bowed-head tribe based on mobile terminals
Author:
Affiliation:

School of Transportation and Civil Engineering, Nantong University,Nantong 226019, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着智能手机产品的发展与畅销,不分场合随时玩手机的低头族大量涌现;针对低头族依赖手机导致道路交通事故频发问题,提出一种基于手机端多模态低头族危险感知与预警系统。首先,利用手机端的重力加速度基于模糊控制规则实时监测行为,包括:走路看手机、上下楼梯看手机、静止看手机、手持手机走路、手机揣兜走路;然后,使用手机后视摄像机图像基于分组快速空间金字塔池化的轻量化YOLO网络实时描述用户周围环境,包括:楼梯、斑马线、低照明环境、积水坑、正常路面。最后,面向安卓系统构建状态环境多模态低头族危险判定模型;并根据判定结果利用声音、画面、震动信号给予低头族听觉、视觉、触觉立体式预警信号;减少低头族跌伤、碰撞等潜在危险。在线实验表明,本文提出的手机端多模态低头族危险感知模型准确性高、鲁棒性强、实时性好,能够针对低头族常见的危险状态实现有效的主动预警。

    Abstract:

    With the development and popularity of smartphone products, a large number of bowed-head tribes have emerged who play mobile phones at any time regardless of the occasion; for the frequent occurrence of traffic accidents caused by bowed-head tribes′ dependence on mobile phones, a multimodal bowed-head tribes′ hazard perception and warning system based on mobile phones is proposed. First, gravity acceleration on the mobile phone side is used to monitor behaviors in real time based on fuzzy control rules, including Walking and looking at the mobile phone, Walking up and down stairs, Looking at the mobile phone at rest, Walking with the mobile phone in hand, Walking with the mobile phone in pocket; and then the user′s environment is described in real time using the mobile phone′s rear view camera images based on the grouping of fast spatial pyramids pooled in the lightweight YOLO network, including: stairs, crosswalks, low-light environments, puddles, and normal road surfaces. Finally, a state-environment-multimodal hazard detection model is constructed for the Android system; and based on the detection results, audible, visual, and tactile three-dimensional warning signals are given to the bowed tribe by using sound, image, and vibration signals to reduce the potential hazards of the bowed tribe such as fall injury and collision. Online experiments show that the proposed multimodal threat perception model for mobile phones is highly accurate, robust, and real-time, and is able to achieve effective proactive warning for the common threat states of bowed heads.

    参考文献
    相似文献
    引证文献
引用本文

金磊,吉翔,邓丽云,徐少杰,王晗.手机端多模态低头族危险感知与预警[J].电子测量技术,2024,47(9):172-183

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-09-04
  • 出版日期:
文章二维码