JN

OptiworX

Pharma AR Enterprise Platform

  1. The Product

OptiworX is an Augmented Reality software platform designed to optimize manufacturing operations. It helps Pharma businesses improve efficiency, reduce costs, and enhance production processes by providing real-time data, analytics, and insights.

The platform integrates with existing systems, enabling better decision-making, predictive maintenance, and improved workflow management.

  1. Challenge

Complete structural overhaul and redesign of the software to enable it to technically handle any client configuration and procedure for pharmaceutical packaging.

  1. My role

• Brainstorming

• AR research

• Competitor analysis

• Information architecture

• AR concept design

• Wireframing

• AR prototyping

• UI design

• Visual design

• Creation of In-depth design specification

• Style guide and design system

  1. Results
  • An augmented reality platform built on a flexible, node-based system for customizable workflows (graphs), independent of procedures. It integrates with applications like OptiworX Configurator, Operator (HoloLens 2), and Terminal (PC), and supports secondary devices such as RealWear HMT-1 and Tablets for seamless experiences.
  1. Empathize


  1. Project inception & workshops
  2. We kicked off the project with several collaborative workshops to refine the CTO’s vision into a clear, executable plan. Our main focus was to create a system based on a flexible, node-driven approach where each task could function independently within larger workflows. Using whiteboard sketches, we mapped out the concept and continuously refined it through team discussions.
  1. Define


  1. Research
  2. To ensure the success of our design, we conducted in-depth technical feasibility research, particularly on how visual elements like text, color, and shape interacted with HoloLens. Our findings pointed us toward the Mixed Reality Toolkit 2 (MRTK 2), which allowed us to effectively visualize and experiment with different concepts in mixed reality.
  1. Ideate


  1. UX/UI idea sketching
  2. I then sketched design solutions for task and group node behaviour, with examples for HoloLens 2 and tablet devices below.

HL2 task node sketch

HL2 collapsed task node sketch

Tablet task node sketch
  1. Design
  1. UX/ UI for Hololens 2
  2. We designed a color-coded hologram system for task nodes, employing a diagonal pattern to signal occupancy. These holograms were designed to collapse and expand based on user interaction. After multiple iterations and testing, we finalized a functional and intuitive design, optimizing for the immersive capabilities of HoloLens 2.
  1. Design
  1. UX/ UI for Tablets
  2. For Tablet users, we aimed to replicate the same functionalities offered by the HoloLens 2 but without the AR holograms. The design iterations focused on maintaining consistency with the HoloLens interface, ensuring a cohesive user experience across devices.
  1. Design
  1. UX/UI for RealWear headsets
  2. The design for the RealWear HMT-1 was customized to meet device-specific UI guidelines while aligning with the broader design vision. The integration of audio and speech interaction added an additional layer of usability, making the experience more hands-free and accessible.
  1. Ideate & Design
  1. Terminal App. redesign
  2. Parallel to the device-specific designs, I also worked on improving the UX/UI of the Terminal app, which is crucial for linking procedural data with operational devices. The redesign aimed to streamline the user flow and optimize functionality for seamless data management.
  1. Design & Development


  1. Design system
  2. To maintain design consistency across devices, I developed a comprehensive Design System. This included a color palette, text treatment guidelines, layout grids, and a Pattern Library featuring key UI components like buttons, Unity elements, and notification
  1. Development


  1. Design Specification
  2. Once the node designs were finalized, I created offline design specifications for handover to the Unity development team. Using Measure (a Sketch plugin), I ensured that the designs adhered to pharmaceutical privacy standards, facilitating a smooth transition into development.

Development

Support

I worked closely with developers, breaking down the app’s key elements into actionable tasks. This ensured clarity around the functionality and behaviors of each feature. As development on the HoloLens 2 progressed, I shifted my focus to provide detailed design specifications for the Tablet and RealWear apps.


Outcome

The project was successfully completed on time, with HoloLens 2’s advanced interaction capabilities fully integrated into the platform. The enhancements to the Terminal, Tablet, and RealWear apps further strengthened the OptiworX suite, creating a powerful, seamless AR experience across all devices. The result is a flexible, scalable mixed-reality platform that enhances productivity and operational efficiency for enterprises.


Tools used

  • Pen & paper, whiteboards, markers & post-its, Hololens, Hololens 2, Holographic Remoting Player, Video camera, Unity, Sketch, Illustrator, Microsoft Teams, Evernote, Principle, Marvel app, iPhone 6s, RealWear HMT-1 headset, Samsung Tab A.