A new generation of instructional material with augmented reality and featuring a mix of different multimedia, has been developed.

Augmented reality can be used to give intuitive instructions and guidance on-site and on demand. Using mobile devices or head-mounted displays, a number of options for training are available, including the use of three-dimensional models, animations, video, audio or written material in the form of Portable Document Format (pdf).

MAN CEON, which is MAN Energy Solutions’ umbrella brand for its digital products, has developed TechGuide to enable engineers to use a preferred learning style for on-the-job training and instruction.

To augment real-world content, CEON TechGuide employs spatial information and information about surroundings, such as table surfaces, workbenches and walls. Animations are not locked into a specific perspective, allowing the user to move their tablet or head-mounted display around to view components from different angles and obtain expanded views of spare parts, amongst other features.

The company believes TechGuide to be unique within interactive engine documentation in the industry. It explains that the rapid development of information technology has allowed it to facilitate an intuitive documentation solution aimed at the safe and fast execution of maintenance and troubleshooting, while also optimising the availability of its customers’ marine vessels.

The solution is currently being tested aboard a number of bulk carriers owned by Singapore-based Berge Bulk, an independent dry bulk owner. The app is connected to the owner's fleet maintenance and management system. When a maintenance job has been completed using the application (app), the information is automatically uploaded to the owner's system via WiFi in the engine room, simplifying administrative procedures.

Berge Bulk affirms that the app is transforming the way that maintenance and inspection operations are carried out on board and believes that it will reduce crews’ workloads and also enhance the quality and reliability of maintenance operations.

Central Components

The company’s goal is for the app to become an integrated part of marine engineers’ daily tasks and working routines. In the near future, the implementation of real-time augmented reality support will enable shore-based locations to offer expert guidance to on-site crew. The MAN CEON TechGuide application-programming interface (API) also supports different types of planned maintenance systems (PMSs).

The app’s central components are:

• Augmented reality view – whereby images and text are layered onto the engine components for an X-ray-like view of the components
• Automatic component recognition - displays documentation for the specific engine or component
• Two-way interface with planned maintenance systems – aims to facilitate seamless communication between the MAN CEON TechGuide and the PMS and to reduce engineers’ administrative workload
• Multimedia platform – allows maintenance descriptions to be read aloud, described by animations, seen on video and read as a pdf
• Audio input/output – instructions can be read aloud and the application can be used by means of voice control
• In-situ and table-study modes – include modes for in-situ work and pre-planning work with a maintenance team.