[tor-bugs] #27118 [UX/Research]: Usability Research: Onions - Valencia (was: Usability Research Results-Onions-Valencia)

[Tor Bug Tracker & Wiki]

#27118: Usability Research: Onions - Valencia
-------------------------+--------------------------
 Reporter:  nyinz        |          Owner:  nyinz
     Type:  project      |         Status:  assigned
 Priority:  Medium       |      Milestone:
Component:  UX/Research  |        Version:
 Severity:  Normal       |     Resolution:
 Keywords:  ux-team      |  Actual Points:
Parent ID:  #27010       |         Points:
 Reviewer:  antonela     |        Sponsor:
-------------------------+--------------------------
Changes (by antonela):

 * status:  new => assigned
 * cc: nyinz (removed)
 * owner:  antonela => nyinz
 * reviewer:   => antonela
 * type:  defect => project


Old description:

> Methodology: See attached
> Where: IFF18 Valencia, Spain
> Participants: Five (5) >>>>>this report shows results for 4 because a
> translation for the 5th user is required
>
> Results:
> 1.Summary of demographics
> 2.What users said
> 3.Conclusion
>
> **1.**
> The group consisted of 2 female and 3 male users aged 20-50
> Most of them use Tor daily and referred to themselves as ‘Technologist
> that has a good understanding of tools and how things work
>
> **2.**
> Q1 **What do you think you the onion means**?
>
> The interviewer was very engaging so and responses were sincere. Most
> users had 2-3 seconds delay but they see the onion as a safety icon
> Quote:
> “Green onion means that Tor is connected and working”
>
> Q2 **Why do you think these icons are different**?
>
> -Most users can tell that there’s a difference in level security say the
> onion with a lock is secure
> -They answered this question less confidently than Qn 1 (above)
>
> Q3 **What do you think this icon means**?
>
> Most users are skeptical about the safety of this icon and identify that
> there is a problem
> Quote:
> "It means hey be cautious!"
>
> Q4 **What do you think this icon means**?
>
> Most users answered  tentatively to this question and give mildly
> different responses, more like ‘guesses’. They don’t know what is going
> on, but they know it’s bad...
> Quote:
> "I would think the FBI is attacking my computer right now"
>

> Q5 **Order these icons from less secure to more secure**
>
> Most users understand that there are different levels of security and
> correctly ordered the icons
> They all seem excited to answer this question
>
> **3.**
>
> The sample group is well represented by males and females giving a
> broader view into how the icons are interpreted by the two sexes. They
> all have experience with technology and most are current users of the
> product.
> Users can identify the different states of icons. This is plus for the
> design team who worked hard on creating particular graphics for this
> purpose.

New description:

 Methodology:
 [https://trac.torproject.org/projects/tor/attachment/ticket/27118/User%20testing%20.onion%20states%20icons%20Methodology.pdf
 See Attachments]
 Where: IFF18 Valencia, Spain
 Participants: Five (5)*

 *This report shows results for 4 because a translation for the 5th user is
 required.

 **Results:**

 1. Summary of demographics
 2. What users said
 3. Conclusion

 **1.**

 - The group consisted of 2 female and 3 male users aged 20-50.
 - Most of them use Tor daily and referred to themselves as ‘Technologist
 that has a good understanding of tools and how things work.

 **2.**

 Q1 What do you think you the onion means?

 - The interviewer was very engaging so and responses were sincere. Most
 users had 2-3 seconds delay but they see the onion as a safety icon
 - Quote: “Green onion means that Tor is connected and working”

 Q2 Why do you think these icons are different?

 - Most users can tell that there’s a difference in level security say the
 onion with a lock is secure.
 - They answered this question less confidently than Qn 1 (above).

 Q3 What do you think this icon means?

 - Most users are skeptical about the safety of this icon and identify that
 there is a problem
 - Quote: "It means hey be cautious!"

 Q4 What do you think this icon means?

 - Most users answered tentatively to this question and give mildly
 different responses, more like ‘guesses’. They don’t know what is going
 on, but they know it’s bad...
 - Quote: "I would think the FBI is attacking my computer right now"

 Q5 Order these icons from less secure to more secure

 - Most users understand that there are different levels of security and
 correctly ordered the icons.
 - They all seem excited to answer this question.

 **3.**

 The sample group is well represented by males and females giving a broader
 view of how the icons are interpreted by the two sexes. They all have
 experience with technology and most are current users of the product.
 Users can identify the different states of icons. This is plus for the
 design team who worked hard on creating particular graphics for this
 purpose.

--

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/27118#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online