Project Brief

For university assignment, I teamed up with four classmates to conduct a usability evaluation of the CELINE website. The collective data gathered is used here to design usability evaluation case study. We used following 4 methods to evaluate CELINE.

Team Size

5 UX Designers

Case Study designed individually

Role in Project

Led data analysis and coordinated usability testing for CELINE website evaluation.

Evaluation Covered

Heuristics
Quantitive
Qualitative
Accessibility

Evaluation Process & Methods

Evaluation Process & Methods

The evaluation aimed to improve the user experience on the CELINE website, from selecting items to checking out. We used 4 methods to enhance navigation and make shopping smoother and more enjoyable for users.

The evaluation aimed to improve the user experience on the CELINE website, from selecting items to checking out. We used 4 methods to enhance navigation and make shopping smoother and more enjoyable for users.

1

1

Heuristics Evaluation

Heuristics Evaluation

Nielsen's 10 Heuristics are guidelines for user interface design that prioritize simplicity, consistency, user control, error prevention, and feedback to improve usability and user experience in interactive systems.

Nielsen's 10 Heuristics are guidelines for user interface design that prioritize simplicity, consistency, user control, error prevention, and feedback to improve usability and user experience in interactive systems.

2

2

Qualitative Method

Qualitative Method

Qualitative data provide direct usability assessment by observing participant struggles with UI elements, identifying design issues, and allowing follow-up questions to gain insights into specific user experiences.

Qualitative data provide direct usability assessment by observing participant struggles with UI elements, identifying design issues, and allowing follow-up questions to gain insights into specific user experiences.

3

3

Quantitative Method

Quantitative Method

Qualitative data provide direct usability assessment by observing participant struggles with UI elements, identifying design issues, and allowing follow-up questions to gain insights into specific user experiences.

Qualitative data provide direct usability assessment by observing participant struggles with UI elements, identifying design issues, and allowing follow-up questions to gain insights into specific user experiences.

4

4

Accessibility Method

Accessibility Method

Nielsen's 10 Heuristics are guidelines for user interface design that prioritize simplicity, consistency, user control, error prevention, and feedback to improve usability and user experience in interactive systems.

Nielsen's 10 Heuristics are guidelines for user interface design that prioritize simplicity, consistency, user control, error prevention, and feedback to improve usability and user experience in interactive systems.

Results obtained from
Heuristic Evaluation

I used heuristics to evaluate the CELINE website because they provide a structured framework for identifying usability issues quickly and effectively, ensuring a user-friendly experience. No participants were recruited for this method.

Task flow to evaluate the website

  • Searching for a product

  • Gathering information on product sizing, delivery, and other details

  • Adding the product to the cart

  • Checking out the product

30

Total Usability Issues

This pie chart shows how many number of issues were recorded under which heuristic principle.

6

3

3

3

6

1

6

2

List of heuristics used in the evaluation of website

User control and freedom

Visibility of system status

Consistency and standards

Error prevention

Recognition rather than recall

Flexibility and efficiency of use

Aesthetic and minimalist design

Help users recognize, diagnose, and recover from errors

Visibility of system status

After adding an item to the bag, it shows “Shopping Bag”. But after removing the item, it doesn’t show whether the item has been removed or not. Instead it keeps user on the same cart page but now there is no “Shopping Bag” option in the navigation.

Severity 4

Key Takeaways from Qualitative Method

For our qualitative method, each of the five group members conducted an interview, capturing detailed insights and diverse perspectives on the CELINE website. This approach helped us deeply understand user experiences and pinpoint areas for improvement.

Participant’s Comments

Task for the participants to complete

Scenario: You want to buy a new boots in preparation for the cold UK winter weather. Remember, you have just won the lottery! So, you have lots to spend.

Goal: Choose a pair of boots for yourself. Ensure you check delivery times and prices and the correct sizing for your item. Put it in your basket for checkout later.

Task 1: To find a pair of boot of your own size.

Task 2: Obtain delivery information

Task 3: Checkout the item

Participant Emotion Analysis

Of the 36 comments recorded from 5 participants, 10 expressed confusion and frustration, 8 irritation, 3 surprise, and 1 satisfaction.

Participant Emotion Analysis

Of the 36 comments recorded from 5 participants, 10 expressed confusion and frustration, 8 irritation, 3 surprise, and 1 satisfaction.

Insights from Accessibility Audit

The accessibility audit employed both manual review and the WAVE Tool to identify usability gaps and compliance issues. This approach ensured the website meets universal design standards, providing an inclusive experience for all users.

1

Manual evaluation was done using 3 principles of WCAG 2.2 guidelines. (A Level & AA Level only).

Perceivable

Operable

Understandable

One additional approach was used for the evaluation, the task was done using keyboard and Screen Reader tool considering blind and visually impaired users.

2

Automatic evaluation was done using the WAVE tool

errors and contrast errors only

Highlights of finding from accessibility audit using both methods

Manual Method

Alt-text” guideline under perceivable principle was violated in this section. No text alternative was provided to this image

“Text Spacing” guideline under perceivable principle was violated in the navigation bar. The text was clearly not visible and the spacing was not according to the standards.

Automatic Method

15 errors were recorded under “contrast errors” in the navigation page. The text written on the image was not visible.

“44 errors” were recorded in the product listing page. Out of 44, 21 errors were under recorded for missing alternative text.

Data Analysis

Data from heuristics, quantitative and qualitative evaluations, and an accessibility audit was organized into effectiveness, efficiency, and satisfaction categories, identifying top-performing tasks for comprehensive analysis and understanding of findings.

1

Effectiveness, Efficiency, Satisfaction

2

Top Tasks

Data Evaluation

We gathered solid evidence to support our findings, then transformed them into valuable insights, and finally, seized opportunities from these insights. Let's explore three key findings and how they evolved into actionable insights and opportunities.

Insights Prioritisation

We prioritized urgent, high-impact insights, addressing critical usability issues first. A key step was incorporating a search feature into the top-priority quadrant.

Homepage Redesign

Based on the insights prioritisation, search and the top navigation bar were redesigned keeping heuristics and psychology principles at the centre focus. The above legend shows which methods, principles and insights were considered while doing the redesign.

Conclusion and Future Directions

In conclusion, the usability evaluation of the CELINE platform revealed valuable insights into its strengths and areas for improvement. User feedback pointed out key aspects of the experience that could be enhanced to better meet their needs and expectations.

Implementation of Recommendations.

Based on user feedback, we will prioritise and implement changes to improve the identified areas.

Regular Usability Testing

Regular usability testing will be conducted to ensure the ongoing effectiveness of these improvements.

User Feedback Loop

Establishing a system for continuous user feedback to keep the platform aligned with user needs.

Thanks for watching!

Thanks for watching!

Appreciate you taking the time to read this. Feel free to share any feedback or thoughts to help me improve !

Appreciate you taking the time to read this. Feel free to share any feedback or thoughts to help me improve !

Results obtained from Heuristic Evaluation

I used heuristics to evaluate the CELINE website because they provide a structured framework for identifying usability issues quickly and effectively, ensuring a user-friendly experience. No participants were recruited for this method.

Task flow to evaluate the website

  • Searching for a product

  • Gathering information on product sizing, delivery, and other details

  • Adding the product to the cart

  • Checking out the product

30

Total Usability Issues

This pie chart shows how many number of issues were recorded under which heuristic principle.

6

3

3

3

6

1

6

2

List of heuristics used in the evaluation of website

User control and freedom

Visibility of system status

Consistency and standards

Error prevention

Recognition rather than recall

Flexibility and efficiency of use

Aesthetic and minimalist design

Help users recognize, diagnose, and recover from errors

Visibility of system status

After adding an item to the bag, it shows “Shopping Bag”. But after removing the item, it doesn’t show whether the item has been removed or not. Instead it keeps user on the same cart page but now there is no “Shopping Bag” option in the navigation.

Severity 4

Key Takeaways from Qualitative Method

For our qualitative method, each of the five group members conducted an interview, capturing detailed insights and diverse perspectives on the CELINE website. This approach helped us deeply understand user experiences and pinpoint areas for improvement.

Participant Emotion Analysis

Of the 36 comments recorded from 5 participants, 10 expressed confusion and frustration, 8 irritation, 3 surprise, and 1 satisfaction.

Task for the participants to complete

Scenario: You want to buy a new boots in preparation for the cold UK winter weather. Remember, you have just won the lottery! So, you have lots to spend.

Goal: Choose a pair of boots for yourself. Ensure you check delivery times and prices and the correct sizing for your item. Put it in your basket for checkout later.

Task 1: To find a pair of boot of your own size.

Task 2: Obtain delivery information

Task 3: Checkout the item

Lets work together !

Your concept becomes my next project!

goreaditya491@gmail.com

+44 77747 34983

Lets work together !

Your concept becomes my next project!

goreaditya491@gmail.com

+44 77747 34983

Aditya Subhash Gore.

Aditya Subhash Gore.

Copyright 2024. All Rights Reserved

Copyright 2024. All Rights Reserved

Lets work together !

Your concept becomes my next project!

goreaditya491@gmail.com

+44 77747 34983