Introduction

Movicon.NExT has been designed to allow users to take the advantage of the most advanced Machine Learning technologies aimed at detecting and recognizing objects in the field to immediately visualize their dynamic real-time information for operator scrutiny.

This technology allows operators to use their mobile device’s integrated video camera or augmented reality devices to combine cognitive system information with the Movicon.NExT project by using any HTML5 browser with the WebHMI technology. This document describes the technologies on which the platform is based and how to use and configure them.

 

Cognitive Augmented Reality Applications with Movicon.NExT

The scope of this solution, which is integrated in Movicon.NExT, is to facilitate the creation of HMI systems with the capability to use the camera eye lens to recognize previously learned elements or components in the plant. When objects within the surrounding plant environment are recognized in realtime, operators will automatically receive the relative HMI realtime information on these objects through automatic pop-up screens which have been previously defined in the project in relation to the targeted context. These MI screens will then display dynamic project information which show variables in animated screen format with which the operator can interact to execute commands.

 

     

For example:

  1. Once the browser is opened, the video camera can be activated to allow the operator to frame their surrounding environment..
  2. A scroll slider has been provided for all desktop and Android devices with a Google Chrome browser to apply a zoom factor to the camera.  Other devices, such as Apple, or other browsers do not support this feature.
  3. The system will analyze the streamed video in order to recognize the objects it has been trained to identify.  Once identified, it will show them on screen enclosed within a boundary box.
  4. Once the target object has been recognized and tracked, a pop-up window will show with its corresponding information. This will give the operator direct access to all the information typical of an HMI, which include displayed digital data, alarms and historical information, along with the ability to execute operational commands.