Back to Case Studies

AR Sales Platform for a Pharmaceutical Product

This innovative app was specifically designed for Polpharma sales representatives to effectively showcase their new product – eye drops. The app offers an immersive augmented reality (AR) experience, guiding users through a walkthrough of an allergy season scenario.
Category: 
Pharmacology
Marketing

Client

ICR Sp. z o.o.

Industry

Insurance

Market

Poland

Engagement

PoC

Scope

Generative AI workflow

Team Size

2 Developers, QA, PM

MVP

2 months

Partnership

2 years (ongoing)
Project description

With the use of designated hardware, salesman are able to present the story of “The Eye” - a brand hero navigating the challenges of an allergy season on his little planet. Leveraging the seamless integration of storytelling and cutting-edge virtual reality (VR) technology, the app immerses users in an engaging and informative experience.

The first edition of the app turned out to be such a success that the company decided to proceed with a second edition. The updated version features character motion within the realm of the tiny planet, providing a dynamic alternative to the static product presentation.

Project results
About the problem

Traditional sales methods have been losing their effectiveness over the years due to increased competition in the pharmaceuticals and dietary supplements market. For this reason, one of the largest pharmaceutical companies in Poland - Polpharma, has decided to equip its sales representatives with modern sales tools utilizing augmented reality (AR) technology, while presenting their products to doctors. 

Advantages of sales experience using VR:

  • Introduces users to the brand's world
  • Presents the product, its features, and benefits in an innovative way
  • Captures the attention and remains memorable to the audience

The tool can also be provided to doctors as an educational tool, presenting allergy-related issues in an engaging manner and directly driving product sales.

Project scope
Step 1
Document Digitalization

The first step involved converting scanned documents into digital formats using OCR technology. This phase was crucial due to the diverse nature and quality of the scanned documents. Advanced OCR solutions were employed, capable of handling various text formats, handwriting, and even low-quality scans, ensuring high accuracy in digitization.

Step 2
Document Categorization

Once digitized, the documents were categorized into predefined classes such as medical reports, lab tests, and billing documents. This categorization was facilitated by a machine learning model trained on a large dataset of annotated healthcare documents. The model was fine-tuned to recognize and categorize documents accurately, even when the formats and templates varied significantly.

Step 3
Key Facts Retrieval

The extraction of key facts from the categorized documents was the next critical step. Using natural language processing (NLP) and machine learning algorithms, the system identified and extracted pertinent information such as patient names, birthdates, addresses, ICD codes, and details of medical procedures. The AI model was trained to understand the context and semantics of the healthcare domain, ensuring a high level of precision in fact retrieval.

Step 4
Medical Summary and Report Generation

The final step involved synthesizing the extracted information into coherent medical summaries and reports. Generative AI models, trained on a vast corpus of medical texts, were employed to generate summaries that were both accurate and easily comprehensible. These summaries provided a consolidated view of the patient's medical history and current claims, significantly aiding in the decision-making process.

Key features
Brand Hero
"The Eye" - dedicated product character
Storytelling
interactive, spatial product presentation
Product Leaflet
pharmaceutical product regulations
live chat
with doctor
knowledge
base
rehab
programs
fitbit
integration
analytical
dashboard
HIPAA
compliance
parameters
tracking
Project timeline
6 months
Product Discovery

The product vision was developed during two meetings with the client and involved designing that would meet business expectations. In addition to suggestions for development direction from our team, the client could also choose one of the product's stylistic proposals.

2 months
Product Development
Version 1.0

The first app version involved AR visualization utilizing a 3D model of The Eye. Our hero was presenting the product on a static display suspended in the room's space. The application also included navigational UI elements and a product pharmacological leaflet.

ongoing
Product Development
Version 2.0

In the latest application version, we were happy to introduce a virtual planet. The product is presented during The Eye’s dynamic walk of its various environments. The application has also gained new audio effects: a voice-over presenting the product, and dedicated sounds of nature and surroundings.

Project tech stack

Unity

3D Engine

C#

Programming language

ARKit

Development platform

Firebase

Analytics

UniRx

Reactive programming
Project tool stack

Jira Cloud

Project Management

Confluence Cloud

Project Documentation

Atlassian Cloud

Project Management

Slack

Project Communication

Notion

Project Documentation

Figma

UI/UX Design

Twillio

Video Calls Integration

Google Maps

Geolocation

Gmail

E-mails Integration
Technical description

The project was created based on the Unity 3D engine, which is often used for developing 3D games. The project was also supported by the use of ARFoundation and UniRx.

Combining Unity technology and the ARFoundation framework allows us for building applications for multiple AR-enabled platforms using a single API. Due to the client's preferred hardware, the platform was developed for iPad OS and iOS, but further scaling of the project to other platforms would be fairly easy if required.