Abstract

A fusion method is proposed to keep a correct number of humans from all humans detected by the robot operating system based perception sensor network (PSN) which includes multiple partially overlapped field of view (FOV) Kinects. To this end, the fusion rules are based on the parallel and orthogonal configurations of Kinects in PSN system. For the parallel configuration, the system will decide whether the detected humans staying in FOV of single Kinect or in overlapped FOV of multiple Kinects by evaluating the angles formed between their locations and Kinect original point on top view (x, z plane) of 3D coordination. Then, basing on the angles, the PSN system will keep the person stay in only one FOV or keep the one with biggest ROI if they stay in overlapped FOV of Kinects. In the case of Kinects with orthogonal configuration, 3D Euclidian distances between detected humans are used to determine the group of humans supported to be same human but detected by different Kinects. Then the system, keep the human with a bigger region of interest (ROI) among this group. The experimental results demonstrate the outperforming of the proposed method in various scenarios. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Highlights

  • Detecting and tracking individual human in the cluster environments such as in the group of humans is an interesting area in recent years

  • Sensor fusion in computer vision is classied into several categories: scene segmentation, representation, 3-D shape estimation, sensor modeling, autonomous robots, and object detection and tracking

  • In [7] and [8], pedestrian tracking using the multiple sensors and optical follow are researched and these proved that cluster environments are the challenge problem of human detection and tracking

Read more

Summary

Introduction

Detecting and tracking individual human in the cluster environments such as in the group of humans is an interesting area in recent years. These fusion methods are proposed to tolerate the calibration errors of Kinects setting Specically, Kinect congurations are classied into parallel and orthogonal.

Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call