1. Collaboration Repository Featuring: Shane Ahern, Laheem Jordan, Judy Ma, Vam Makam, Joyojeet Pal IS 213 - Spring 2004 Re-Introducing…

2. Today’s Plan Introductions and Agenda 1st Interactive Prototype Refresher Heuristic Evaluation 2nd Interactive Prototype Comparison of both Pilot Usability Study Demo Next Iteration & Lessons Learned

3. Did you forget why we are doing this? No comprehensive existing directory that serves as a starting point for research in the field of IT and Regional Development Lack of access to experiential knowledge Researchers want to share their own opinions and comments on existing literature and field project implementations

4. First Interactive Prototype Refresher Changes based on feedback on paper prototype –Provided examples after each top level category of its sub-categories –Renamed the "Annotate" to "Add Comment“ –Used popup window rather than frames – preserve workspace –Did not require the user to login in order to add comments – differing opinions on this –Added a series of questions to Add Document to ensure proper classification

5. Heuristic Evaluation Most issues were for Simple and Natural Dialog Major HE issues addressed in second prototype: –Requiring disclaimer page for each added document –“Text to Comment” unclear –Need feedback when 0 search results returned –Long form on doc entry page, user could loose data –In general, needed more contextual help and more intuitive terms (i.e. comment vs annotate)

6. Changes in 2 nd Prototype Added more contextual help More feedback in error messages Provide feedback for 0 search results Added category hierarchy from card sorting study Made add document a two-step process. Made color and font changes to make more readable.

7. 1 st Prototype – Add Document

8. 2 nd Prototype – Add Document

10. 1 st Prototype - Search

11. 2 nd Prototype – Search

12. Pilot Usability Study The Lucky Participants #1#2#3 GenderMaleFemaleMale Age2627Unknown BriefUNIDO Fellow South Asian Studies Chair Tech Wiz AcademicsME PhDAsian Studies MA SIMS Student HomeBerkeleyOaklandSF

13. Pilot Usability Study Goal: We wanted to focus on the user experience, error rate, and task completion time Results: Users were generally pleased Error rates and longer times are usually caused by 1 or 2 issues Adding/Viewing comments were easier than expected Users were still confused about top navigation links and search

14. Latest Demo http://dream.sims.berkeley.edu/collabreposit ory/production/search/

15. Plans for Next Iteration Link for requesting document removal Make editing document process more intuitive since users are unlikely to read the help Comments toggle (expandable and collapsible) Rss aggregator Search on other sites (google.com)

16. Lessons Learned Don’t assume anything! Labels make a difference Be open to all of interviewee’s suggestions UI Preferences may show patterns by discipline - Computer Scientist versus Average User

17. Future Plans Beta Test repository with the IT and Development class in Fall 2004, use student papers/projects for annotation Share the product with World Bank – start seeking ways of importing their data Beta Test repository with WB data

18. Any questions?