Google Gemini is a family of multimodal large language models (LLMs) developed by Google DeepMind. Gemini LLMs perform generative artificial intelligence (genAI) analogous to OpenAI’s GPT-4.
GenAI can translate language, summarize text, recognize objects and text in images, and complement search engines and recommendation systems.
Resident engagement platforms, including Wellzesta Life leverage Google Gemini to produce human-readable “short descriptions” of uploaded documents. Document summarization involves two tasks:
- recognize text and its meaning in uploaded images, spreadsheets (Fig. 1), slides, and documents
- summarize the text in a style that is tuned for seniors
In this way, staff create documents and genAI creates the short description (Fig. 2). This saves staff time, creates efficiency, and provides robust search capabilities for the resident or member.
When browsing the resources section of Wellzesta Life, the short description appears below the document title for all documents within a folder (Fig. 3). Residents can scan the short description to determine relevance without having to open the document. This supports autonomy, autodidactic learning, and convenience.
The short description also improves search performance. The in-app search engine searches over document titles and short descriptions, producing relevant results within milliseconds – allowing the resident to quickly find what they need.
Figure 1. Screenshot of the uploaded document. The document is a spreadsheet that was exported as a pdf.
Figure 2. Screenshot of Wellzesta Active showing the auto-generated “short description” (max of 500 characters) of the uploaded document that was created by genAI. The short description can be edited by staff, if needed.
Figure 3. Screenshot from the Wellzesta Life App showing the card for the uploaded document that contains the document title and short description.
In conclusion, genAI can very simply make life easier for busy staff and team members and more convenient and valuable for residents, members, and families. Artificial Intelligence can certainly be complex and provide a vast amount of data, but it can also simply save time and make one’s experience easier (and a little more fun).