For each of my test sites I used the following entrance, test, and exit questions based on suggestions from Krug (2006 p.148-155) and the University of Texas (2006).
[Each test will be customized to reflect slightly different tasks as appropriate]
1. First, I’m just going to ask you to look at this page. As much as possible, it will help
me if you can try to think out loud so I know what you’re thinking about. What do
you think this site is for?
User’s Verbal comments:
Do you have any suggestions for making this task easier?
2. What strikes you about the page?
User’s Verbal comments:
3. What do you think you would click on first?
User’s Verbal comments:
Do you have any suggestions for making this task easier?
[Users will have a chance to free click now and explore the site]
4. You want to find a lesson plan for a language arts poetry. How would
you locate this resource?
Observe known click stream: I will check each step the user clicks
___ lesson plans (top bar)
___ language arts (right box) or ___language arts (bottom icons)
___ Poetry
___ Roll mouse over lesson plans (or click on these links)
OR
___ used search function
Did they use the right menu? ___ Did they notice it changed? ___
Did they use the graphic icons for subject matter? ___
If user does not follow the known path, what did s/he click on?
___
___
User’s Verbal comments:
Do you have any suggestions for making this task easier?
5. If you were looking for activities that you could use immediately in your classroom
Or at home with your child – where would you look?
Observe known click stream:
____ Printables (top bar)
____ Worksheets (bottom bar)
OR
___ used search function
If user does not follow the known path, what did s/he click on?
____
____
User’s Verbal comments:
Do you have any suggestions for making this task easier?
6. How would you locate resources for a thematic unit (combining more than one
curriculum subject matter/cross curricular) on this site? [only ask teachers]
Observe known click stream:
___ themes
___ search
If user does not follow the known path, what did s/he click on?
____
____
User’s Verbal comments:
Do you have any suggestions for making this task easier?
If user does not follow the known path, what did s/he click on?
____
____
7. How would you access the online student activities related to “music”?
Observe known click stream:
___Subjects (from the top box bottom menu bar)
___Music Education (from the right green customized menu links)
OR
___ music (bottom box)
OR
___ used search function
If user does not follow the known path, what did s/he click on?
____
____
User’s Verbal comments:
Do you have any suggestions for making this task easier?
8. How would you find a useful science lesson for 5th grade?
Observe known click stream:
___ lesson plans (top)
___ science (right box)
___ science 3-5
___ science (bottom table)
OR
___ used search function
If user does not follow the known path, what did s/he click on?
___
___
User’s Verbal comments:
Do you have any suggestions for making this task easier?
9. Can you locate resources for assessment?
Observe known click stream:
___ click on “Main Menu”
___ click on “Rubric”
OR
___ used search function
If user does not follow the known path, what did s/he click on?
___
___
User’s Verbal comments:
Any suggestions for making this (task) easier?
10. Locate the 5th grade alphabet soup math lesson plan.
Observe known click stream:
___ click on “Main Menu”
___ click on “Lesson plans” top bar
___ click on “math” right menu or ___click on bottom math icon
___ click on 3-5
___ click on alphabet soup
OR
___ used search function
Do you have any suggestions for making this task easier?
Exit survey
Please Let Me Know What You Think…
Example Teachnology web site Feedback
1. What features of the Teachnology web site were vague or confusing to you, if any?
2. What is your impression about navigating the site? Does it seem easy or difficult?
What makes it that way?
3. What else should be included on the Teachnology web site?
4. What did you like best about the site?
5. What did you like the least?
6. Do you think some people would have problems using the Teachnology web site? What kinds of people? What kinds of problems?
7. Would you like to make any other comments about Teachnology?
Okay - after my first interview I have decided to shorten the length. I'm afraid my other two volunteers are not as tech savvy as my original test subject. I will be a little more specific on a couple of questions and take away the last. My first subject spends many hours online and researching sites.
The last two interviews were interesting. One participant is an avid eBay seller and the other had only used the web occasionally in the last couple of years. He mainly checks sports stats, travel sites, and the local online newspaper. Subject two seemed comfortable with all three sites, however she mostly used the general search function to attempt each task. That is usually my last option when I'm looking for things on a page. She clearly felt the navigation was easy, however she totally related that to the search function. Subject three did not use the search function at all, and when I asked him later he admitted he didn't even see the search, yet alone realize what it was for.
Finally went to edit my DV tape, and lo and behold I had accidentally left the tape on while bringing in subject three. Yes, that means when I thought I was taking the pause record off, I was actually putting it on. It took me a couple of days to find someone else with time to do another interview. By then, I had lost my rhythm and the interview seemed stilted and a little less comfortable.
Although I did not have the original third test subject on video, I did learn some different things from his viewpoint. He only ever used the back button to try and return to the home page. Some of the menu links opened in new windows and he was unable to return. He became quite frustrated cliking 'back' with no success. I had to direct him back to the home page and I explained at the end of the test about the 'open in a new window' feature. He had no idea he could just close the window and his original page would be underneath. He was the least computer literate of the subjects and what to do with a search function.
References:
Krug, S. (2006) Don't make me think 2nd edition New Riders Publishing
University of Texas (2006) Develop the Usability Test Documents. Retrieved April 14, 2008 from http://www.utexas.edu/learn/usability/test.html
No comments:
Post a Comment