Cognitive Vision Systems have gained a lot of interest from industry and academia recently, due to their potential to revolutionize human life as they are designed to work under complex scenes, adapting to a range of unforeseen situations, changing accordingly to new scenarios and exhibiting prospective behavior. The combination of these properties aims to mimic the human capabilities and create more intelligent and efficient environments. Contextual information plays an important role when the objective is to reason such as humans do, as it can make the difference between achieving a weak, generalized set of outputs and a clear, target and confident understanding of a given situation. Nevertheless, dealing with contextual information still remains a challenge in cognitive systems applications due to the complexity of reasoning about it in real time in a flexible but yet efficient way. In this paper, we enrich a cognitive system with contextual information coming from different sensors and propose the use of stream reasoning to integrate/process all these data in real time, and provide a better understanding of the situation in analysis, therefore improving decision-making. The proposed approach has been applied to a Cognitive Vision System for Hazard Control (CVP-HC) which is based on Set of Experience Knowledge Structure (SOEKS) and Decisional DNA (DDNA) and has been designed to ensure that workers remain safe and compliant with Health and Safety policy for use of Personal Protective Equipment (PPE).