top of page
Teamwork

User Testing

On this page, we developed the final product of the Antibio Advisor website and performed Formative User Evaluations, which includes briefing the users, asking them to perform tasks as well as noting any observations. Furthermore, a general reflection is provided on how the interface could be improved upon thanks to the observations made.

Final Design

The following are a few screenshots depicting the final design of the website's pages:

Main Page

finaldesignmain1.png
finaldesignmain2-5.png

Learn More Page

finaldesignlearnmore.png

FAQ Page

finaldesignfaqs.png

Prescription Info Page

finaldesignprescriptioninfo.png

Map Page

finaldesignmap.png

Quiz Page

finaldesignquiz.png

Formative User Evaluation

Briefing for User Testing Session

​

Introduction: Thank you for participating in our user testing session for our medical chatbot focusing on Antimicrobial Resistance (AMR). Your valuable feedback will help us improve the user experience and effectiveness of our platform. Please feel free to express your thoughts openly.

 

Objective: The primary goal of this user testing session is to evaluate the functionality and user-friendliness of our medical chatbot and website in delivering information on Antimicrobial Resistance.

 

Overview of the Chatbot: Our chatbot is designed to provide users with accurate and reliable information on AMR, including details about medications, preventive measures, and related resources. The chatbot is an integral part of our website, and we want to ensure that it effectively meets the needs of our users.

​

Tasks: During this session, you will be given specific tasks to perform on the website. These tasks are designed to simulate real-world scenarios and assess how easily you can navigate the chatbot and find relevant information. Please think aloud as you perform these tasks, sharing your thoughts and impressions.

Tasks for User Testing Session

​

Introduction to the Chatbot

Task: “Start a conversation with the Chatbot”  

Objective: Evaluate how easily users can initiate a conversation and if they understand how to interact with the chatbot.

​

Chatbot Functionality

Task: “Explore the ChatBot and identify extra functionalities”

Objective: Evaluate how easily users can find and use the Text2Speech, Speech2Text, clear and volume slider within the chatbot.

​

Demo

Task: “Learn the main functionalities of the Home page”

Objective: Evaluate how easily a user can access the demo and how informative it is.

​

Learn More

Task: “Explore the website and find detailed information regarding AMR”

Objective: Evaluate how easily a user can access the Learn More and FAQ page.

​

Prescription Info

Task: “Find more information on this prescription – Penicillin OD 0-1-0”

Objective: Evaluate how easily a user can find information regarding their prescription.

​

Map

Task: “Locate the nearest pharmacy and find the shortest path to it”

Objective: Evaluate how easily a user can find and utilise the map page.

​

Quiz

Task: “Find a way to challenge yourself on this topic within the available resources."

Objective: Evaluate how easily a user can find and use the quiz page.

User Testing Observations

User 1

1. The user had no issues locating the ChatBot as they made use of the "Let's Chat" button. In relation to conversing with the ChatBot the user also had no issues in doing so.

​

2. The user managed to identify the extra functionality built into the ChatBot, however the user was unsure if the "SpeechToText" button was functioning due to a lack of feedback.

​

3. The user had no issue following along with the demo on initial page startup. However they found it difficult to restart the demo as they had  a hard time locating the "Start Demo" button.

​

4. The user opted to make use of the ChatBot initially to gather further information on AMR. Additionally the user eventually made use of the "Learn More"  page, however the "FAQ" page was not visited.

​

5. The user had no issues locating the "Prescription Info" page however they were unsure of how to display the requested  information correctly. This was resolved after the user followed the inbuilt page demo.

​

6. The user had no isses locating the "Map" page and selecting a route to a pharmacy.

​

7. The user had no issues locating the "Quiz" page and opted to take the quiz multiple times.

User 2

1. The user had no issues locating the ChatBot or conversing with it. The user opted to make use of the inital prompt questions.

​

2. The user managed to identify the extra functionality built into the ChatBot, however the user did not make use of the "SpeechToText" button.

​

3. The user opted to go to the "Learn more" page rather than make use of the demo functionality. The user remarked that they had already understood the functionality of the chat bot due to the prior tasks. 

​

4. The user  made use of the "Learn More"  page, in addition to the "FAQ" page to further learn about AMR.

​

5. The user asked the Chatbot for information on the prescription, however when the Chatbot did not provide adeqaute information they made use of the prescription info page successfully.

​

6. The user had no isses locating the "Map" page and selecting a route to a pharmacy after following the page demo.

​

7. The user had no issues locating the "Quiz" page and opted to take the quiz multiple times.

User 3

1. The user had no issues locating the ChatBot as they made use of the "Let's Chat" button. The user selected one of the initial prompt questions and proceeded to type further prompts in the input field. Difficulty were first encountered from a brief period when trying to locate the input field.

​

2. ​The user managed to identify all features, including clearing the conversation, text to speech, speech to text and adjusting the volume slider. However, some difficulty was experienced with understanding how the sSpeechToText functionality works.

​

3. The user had no issue following along with the demo on initial page startup. However, they were initially confused on where to locate the "Start Demo" button.

​

4. The user initially headed to the Prescription Info page, as they were unsure on what Anti-Microbial Resistance meant. Following this, they move to the Learn More page. The "FAQ" page was not visited.

​

5. The user had little to no issues with locating the Prescription Info page, however did not notice the scrollability of the dropdowns to find other answers. After some time, they realised this any completed the task successfully.

​

6. The user had no isses locating the "Map" page, however some difficulty was experienced with differentiating between the red and blue markers. This is because they clicked on the "See Map" button which scrolls over the Map Legend.

​

7. The user was confused on what the functionality of the "Let's Quiz" button does. Upon selecting the first answer, they thought the result would be displayed for the question immediately. However, they finished the quiz successfully and also managed to recognise how to retake the quiz.

Reflection

User 1

Strengths

  • Efficiently located and initiated conversation with the ChatBot using the "Let's Chat" button.

  • Successfully used the ChatBot for gathering information on AMR.

  • Easily navigated to the "Map" and "Quiz" pages without issues.

Weaknesses

  • Encountered difficulty in restarting the demo due to challenges locating the "Start Demo" button.

  • Uncertainty about the functionality of the "SpeechToText" button, lacking clear feedback.

  • Initial confusion on displaying information correctly on the "Prescription Info" page, resolved with the inbuilt demo.

Opportunities

  • Opportunity to enhance user guidance for the demo and clarify functionality feedback.

  • Potential to improve clarity on certain features, such as the "SpeechToText" button.

  • Option to further encourage exploration of additional pages like the "FAQ" for a comprehensive user experience.

Threats

  • Risk of user frustration if demo-related issues persist.

  • Potential dissatisfaction if features like "SpeechToText" remain unclear.

  • Threat of incomplete exploration of all available pages and features.

User 2

Strengths

  • Easily located and conversed with the ChatBot using initial prompt questions.

  • Successfully identified extra functionalities in the ChatBot.

  • Efficiently navigated through the "Map" and "Quiz" pages multiple times.

Weaknesses

  • Did not utilize the "SpeechToText" button.

  • Relied on the "Learn More" and "FAQ" pages, potentially missing out on the demo experience.

  • Required additional support from the Prescription Info page when the ChatBot did not provide adequate information.

Opportunities

  • Opportunity to encourage exploration of all available functionalities, including the "SpeechToText" feature.

  • Potential to guide users towards using the demo for a more comprehensive understanding.

  • Option to enhance ChatBot responses to reduce the need for additional information pages.

Threats

  • Risk of overlooking certain functionalities like "SpeechToText."

  • Potential incomplete understanding of the ChatBot's capabilities.

  • Threat of missed opportunities for a more immersive user experience.

User 3

Strengths

  • Successfully located the ChatBot using the "Let's Chat" button.

  • Identified and utilized all ChatBot features, including clearing the conversation and adjusting settings.

  • Navigated through the "Map" and "Quiz" pages, overcoming challenges.

Weaknesses

  • Initial difficulty in locating the input field during the conversation.

  • Confusion about the "Start Demo" button's location.

  • Issues with differentiating between markers on the "Map" page.

Opportunities

  • Opportunity to refine the user interface for smoother navigation.

  • Potential to improve clarity on the demo initiation process.

  • Option to enhance marker differentiation on the "Map" page for a more user-friendly experience.

Threats

  • Risk of user frustration with input field location and demo initiation.

  • Potential confusion with marker differentiation affecting the effectiveness of the "Map" page.

  • Threat of overlooking certain functionalities due to initial confusion.

General Overview

In line with the findings procured above, the general layout of the website and its components seems to be adequate for the finalised prototype stage. The website functionality seems to be working as intended with no errors or bugs being encountered by the users during evalutaion. However, several changes need to made to the website layout to ensure easier traversal and usage, these include:

​

  1. Ensure that the "Start Demo" button is more visible and eye catching to encourage the users to make use of it.

  2. Provide clear feedback to the user of what each ChatBot button does and when these functionalities are active.

  3. Alter the page titles to reflect to a greater degree what the contents of each page consist of. (Change from "Learn More" page to "AMR Info" page)

  4. Define clearly what the markers in the "Map" page denote.

bottom of page