Skip to main navigation Skip to search Skip to main content

CAM-STITCH: Trajectory Cavity Stitching Method for Stereo Vision Cameras in a Public Building

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

Transforming the sensor data from building systems into meaningful information could be used to build data-driven reference models for occupant behavior and actions using Machine Learning (ML) and Deep Learning (DL) techniques. These models can also be implemented for different notable applications such as - controlling heating, ventilation and air conditioning (HVAC) parameters, automated lighting, safety and security, and efficient space utilization. In this paper, we deployed 3D Stereo Vision Cameras from Xovis in a public building to capture trajectory data for multiple occupants. If there are inconsistencies/a gap in the field of view (FoV) of the cameras, continuous tracking of multiple occupants becomes quite challenging. If the inconsistencies persist, a single occupant is assigned multiple occupant-ID's, which is misleading and inaccurate for both occupancy count and tracking measurements within the monitored area. To mitigate and overcome the inconsistencies in the FoV of the deployed cameras, we propose the CAM-STITCH algorithm, which would enable multi-sensor stitching of the occupant trajectories using a variant of Recurrent Neural Network known as Long Short-Term Memory (LSTM) model. The CAM-STITCH algorithm is evaluated by calculating the Root Mean Squared Error (RMSE) between the measured and predicted position coordinates (x, y), which resulted in an average RMSE of 9.53 centimeters on trajectory 1 and an average RMSE of 12.72 centimeters on trajectory 2 for multiple occupants. CAM-STITCH is also designed to overcome dynamic occlusions posed by the 3D Stereo Vision Cameras. The proposed algorithm CAM-STITCH can ensure that the gathered data from the building is reliable for accurate trajectory measurements and can further assist in performing intelligent building operations.
Original languageEnglish
Title of host publicationProceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things
Place of PublicationNew York
PublisherAssociation for Computing Machinery
Publication date10. Nov 2019
Pages8-14
ISBN (Print) 9781450370134
DOIs
Publication statusPublished - 10. Nov 2019
Event17th ACM Conference on Embedded Networked Sensor Systems - New York, United States
Duration: 10. Nov 2019 → 13. Nov 2019

Conference

Conference17th ACM Conference on Embedded Networked Sensor Systems
Country/TerritoryUnited States
CityNew York
Period10/11/2019 → 13/11/2019

Keywords

  • Occupancy Presence, Sensing Modalities, Pattern Recognition, Trajectory Cavity Stitching, Deep Learning, LSTM

Fingerprint

Dive into the research topics of 'CAM-STITCH: Trajectory Cavity Stitching Method for Stereo Vision Cameras in a Public Building'. Together they form a unique fingerprint.

Cite this