Project #4 - Prototyping & Evaluation
INTRODUCTION
In this deliverable project, we focused on two main parts: build interactive versions and evaluating what is being built. In the first part, our group created a medium to high fidelity prototype of our proposed application, Eco-Reward app based on the ideas and wireframes from previous project deliverables. As a team, we worked together to turn our concept into a working design by using Figma as a prototyping tool platform. The prototype includes a homepage that acts as a starting point to handle three main tasks: Task 1 – Order Bulk Waste Pickup, Task 2 – Find Nearest Station, and Task 3 – Schedule Pickup. The prototype was designed to appear realistically (high fidelity in look) while offering basic interactions (medium fidelity in feel and breadth).
Moving on to the second part of the project, we focused on evaluating the prototype through usability testing. We carried out user testing for the three tasks with three different users: User 1 – Citizen, User 2 – Restaurant staff, and User 3 – Convenience store staff. All testings were conducted on 28th June 2025 around the UTM Johor Bahru Campus. Equipment used for the testing sessions including a camera, a smartphone and a laptop that involved three participants overall. A briefing note was used to guide the interview process and ensure that each testing session ran smoothly. After completing all three tasks, each user was asked several questions to share their thoughts, opinions, and suggestions about the prototype. Their feedback helped us better understand the user experience and identify areas that could be improved.
The feedback and observations collected from these tests will help us improve the overall design and usability of the Eco-Reward app. Through this process, we aim to create a user-friendly and helpful app that supports better waste management in the community. The results from this prototype and evaluation stage will guide the final improvements in our proposed application.
The user testing was conducted as follows:
- User 1 was tested by Parthiv Gunalan
- User 2 was tested by Muhammad Firdaus Bin Md Lani
- User 3 was tested by Mikael Haqimi Bin Nahar Junaidi
PROTOTYPE SCREENSHOTS
BRIEFING NOTES
- Welcome the User: “Hi! Thank you for being here today. I really appreciate your time and help in testing our app.”
- Brief the User on Purpose & Background:Read briefly the index card:
- Obtain Verbal Consent:“Just to confirm before we start: Do you consent to participate in this testing session, and for your screen and audio to be recorded while you complete the tasks? You can stop at any time if you're uncomfortable.” (Wait for verbal confirmation.)
- Present First Task: “Great! I’ll now give you your first task. I’ll read it out loud, and then you can read it again on your own.” (Hand the index card to the user.)
- Instruction if Unable to Complete: “If at any point during the task you feel stuck or unsure how to proceed, just say ‘terminate’ out loud. That will be the signal for me to move you to the next task. Don’t worry, this is a test of the app, not of you.”
- Begin Task: “Alright, you may begin whenever you’re ready.”
- Screen Record & Think-Aloud: (Begin recording screen and audio.) “Please say your thoughts out loud as you go through the task. Let me know what you’re thinking, what you’re trying to do, or what’s confusing.”
- Observe & Take Notes: (Silently observe and write notes. Don’t interfere unless they say "terminate" or finish the task.)
- Repeat Steps 4–8 for Tasks 2 & 3: “Now we’ll move on to the next task.”(Repeat the same process for Task 2 and Task 3.)
- Post-Task Interview:
- “What part of the app was easiest to use?”
- “What did you find difficult or confusing?”
- “Can you think of situations where you would use this app in real life?”
- “Does this app fit naturally into your lifestyle?”
- “Is there anything you wish the app could do that it currently doesn’t?”
- Thank the User:“Thank you so much for your time and feedback. We really appreciate your help. We sincerely thank you for supporting our project!”.
Continue: “This testing session is to evaluate how intuitive and effective the app is in helping users complete these tasks.”
TESTING WITH USERS
OBSERVATIONS
As part of our development process, we created a working prototype of our Eco Reward application and conducted user testing sessions to evaluate our app. 3 participants were invited to interact with the prototype in a controlled environment. Each participant was assigned three specific tasks designed to evaluate the core functionalities and overall usability of the app. During the testing session, some flaws were pointed which shows certain inconsistencies within the app.
During the testing phase, participants were generally able to complete Task 1 and Task 3 (order bulk waste pickup & scheduling a pick-up) without significant issues, demonstrating that the main features of the app were intuitive and accessible. However, Task 2 (finding nearest bin location) presented certain challenges that prevented users from completing it successfully. This highlighted an area of the prototype that requires further refinement and adjustment before the next phase of development.
Throughout the interviews, users remained engaged and were able to perform the tasks as instructed. Their observations and reactions provided valuable insights into both the strengths and areas for improvement in the app’s current design. The thinking out loud technique also enables us to properly evaluate how potential users may feel about our app. The feedback collected will play an essential role in guiding the next iteration of the prototype to ensure a more seamless user experience.
Findings
User 1:
● Problem: Users are unable to interact with the 'Choose your goods' in ‘Bulk Waste Pickup’ section, leading to confusion about what action is required.
○ Solution: Include a clear instruction statement indicating that users only need to enter the weight of the recyclable items, without needing to select specific types of goods.
User 2:
● Problem: The filter function is unintuitive, as users are unable to view detailed information about each recyclable component.
○ Solution: Add dedicated pages or modals that display comprehensive details of each item, allowing users to better understand, filter, and navigate the content.
● Problem: The app lacks an AI feature to assist users in identifying items to be sorted at recycling bins.
○ Solution: Integrate an AI-powered scanner that can automatically recognize and classify recyclable items, making it easier for users to sort them correctly.
User 3:
● Problem: The app only shows a general location of recycling bins without specific directions, making it difficult for users to find the exact spot.
○ Solution: Embed navigation features such as Google Maps or Waze integration and include actual images of the bin locations to improve accessibility and clarity.
● Problem: There is no FAQ or onboarding guide, which may cause confusion for new users.
○ Solution: Provide a comprehensive first-time user guide or walkthrough to help new users understand the app's functions and features from the start.
