BAYER: A digital human facilitates access to generative AI
With Lumi, Reply's experts have created a convenient source of information and a fascinating experience for BAYER employees. The Digital Human provides information about current technologies, encourages joint brainstorming and promotes understanding of AI and LLMs.
#Digital Human
#Generative AI
#Pharmaceutical &
chemical industry
,allowExpansion)
The challenge
Making BAYER's innovations tangible with generative AI
,allowExpansion)
The scenario
A unique multimedia experience
Innovation has always played an important role for the pharmaceutical and chemical company BAYER - whether in agriculture or healthcare. The focus is currently on the use of generative AI and Large Language Models (LLMs). BAYER commissioned the experts from Reply to develop a very special multimedia experience to make the latest developments tangible for employees and thus illustrate the possibilities but also the limits of the technology.
The solution
A new type of digital concierge
Lumi provides deep insights into the work of BAYER. By talking to the digital human, employees can learn more about the advanced technologies the company is working on or better understand BAYER's mission. Real-time movements, precise lip synchronization and natural responses make Lumi an impressively authentic conversation partner.
The special concierge not only answers questions, but also provides impulses himself and thus encourages joint brainstorming. Lumi draws on information from the Internet as well as from BAYER's internal intranet. The digital human also refers to QR codes during the conversation, which employees can use to call up additional content. All of this makes Lumi not only a particularly immersive experience, but also a multimedia one.
How we achieved this
Development of an authentic conversation partner
To realize Lumi, Reply's experts relied on BAYER's existing infrastructure for generative AI and the following technologies:
Unreal Engine
Through the implementation of a digital avatar based on the Unreal Engine, the experts have created a groundbreaking solution that enables an impressively authentic conversation through real-time movements and precise lip synchronization.
gRPC protocol
The avatar was developed using the gRPC protocol, which enables efficient data exchange between the front end and the back end.
AWS
The entire backend is seamlessly hosted by AWS to ensure optimal performance and scalability. To enable responses in multiple languages, the experts also relied on Azure services.
LLM & KNN
The interaction with the digital avatar is managed by a highly modern and precise Large Language Model (LLM) and an advanced semantic Artificial Neural Network (ANN) for intention recognition. This control enables the avatar to respond naturally to user requests and understand the context of a conversation.
The advantages
Redefining the boundaries of digital interaction
This innovative solution from Reply goes beyond conventional user interaction to create a natural, immersive and customized experience. By integrating BAYER-specific information, innovative approaches and a clear focus on generative AI, a unique solution has been created that pushes the boundaries of digital interaction. At the same time, Lumi allows BAYER employees to experience the possibilities and limitations of generative AI and LLMs in a very practical way. And so Lumi offers numerous advantages:
High user satisfaction through interactive integration
Tailor-made information package for every interested user
Strong demonstration of BAYER's technological commitment and pioneering role
Further training of employees in an entertaining way
Bayer is a global company with core competencies in the life science fields of health care and nutrition. Through its products and services, the company aims to benefit people and protect the environment by helping to solve fundamental challenges of an ever-growing and aging global population. Bayer is committed to making a significant contribution to sustainable development through its businesses. At the same time, the Group aims to increase its earning power and create value through innovation and growth. The Bayer brand stands for trust, reliability, and quality worldwide. In fiscal 2022, the Group generated sales of €50.7 billion with around 101,000 employees. Research and development spending, adjusted for special items, amounted to €6.2 billion.