Comparison of Skeleton Models and Classification Accuracy forPosture-Based Threat Assessment Using Deep-Learning

Contributing USMA Research Unit(s)

Electrical Engineering and Computer Science, Robotics Research Center

Publication Date

Spring 4-21-2020

Publication Title

Prceedings SPIE 11413: SPIE Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications

Document Type

Conference Proceeding


This paper compares the effectiveness of two different skeletal pose models for a near real-time, multi-stage classifier. A cascaded neural-network (NN) classifier was previously developed to identify the level of threat posed by an armed person based on detected weapons and body posture. On an updated database of images containing armed individuals and groups, AlphaPose was used to calculate both MPII and COCO skeletons while OpenPose was used to calculate the COCO only. For comparison, we evaluated the importance of individual skeletal joints by systematically removing specific joints from the feature vector and retraining a reduced order network. On the database of images, the AlphaPose-COCO network was best able to correctly classify the threat presented by individuals, 83.7% on average, while AlphaPose-MPII registered 82.2% and 77.6% for OpenPose-COCO. As expected, the most important single joint in both skeleton models is the location of the pistol. As a guide for others deciding which skeleton to use for further studies, we conclude that neither skeleton significantly outperforms the other.

Record links to items hosted by external providers may require fee for full-text.