Human silhouettes verification technique

I have preprocessed my image and extract the human silheoutes from that (using connected components method) but there are some other objects present in the image as well like (car or some portion of wall)

I want an algorithem that will help me to verify that weather that particular connected region is human or non human (in short how i will verify that weather some connected region is a human or not).

in attached image i showed the connected components that i obtain i want some technique that will help me to verify that the connected region in green circle is a human silheoute and connected region in red circle is a non human object.

Anyone know plz help... your help is heighly appriciated.a quick response is expected plz