Data Synthesis and Analysis November 8, 2016

Stages of Synthesis and Analysis Collect and organize the data. Make your data manageable. Mine the data. Identify what you see. Sort and cluster the data. Manipulate or reframe your data, as necessary. Identify insights. Discuss, articulate, incubate, and socialize your insights.

Before you begin… Remind yourself of the deliverables of the assignment a statement of the purpose of the research a description of the research method the group used (links or a copy of the instrument should be included for reference) a summary and discussion of the results of the data a description of the target user (persona) based on the data collected at least one visualization (graph, chart, images, maps etc.)

Organize data Keep a single repository of data collected by the team BUT, create a copy that you can organize for your own assignment.

Mine the data Before you begin, write out the objective of the assignment Comb through all the “files” for each participant to identify findings. Depending on the goals and the desired output for your research, pay attention to key points such as behaviors and attitudes or needs and goals. Gather useful findings, which can come in the form of user quotations, rephrased points, or facts. Color-code Post-it notes by participant, type of finding, or whatever system supports your creating the desired output.

Sort findings

Identify insights Discuss each pattern and point of synthesis as a team. Talk about why you think each is important and what it means. Recall exact quotations from participants, facial expressions, body language, feelings, and attitudes relating to the patterns. Articulate, in one simple statement, the insight that emerged out of each pattern or point of synthesis. Draft each insight on a Post-it note. But be flexible about changing them when you come back to them later.

Working with Quantitative Data

Quantitative Data Exercise Task Tester Participant 1 Participant 2 Participant 3 Finding the Home Page 5 10 15 50 Using the Search tool 7 45 Creating a profile 30 16 Logging out and closing the app Table 1: Time (in seconds) to complete four different tasks

Synthesize the Finding From table 1, it is apparent that the layout of our application was not very intuitive. For some participants, the application seemed to be easy to navigate and others took significantly longer to establish some tasks which leads our team to conclude that our application could be better designed in order to complete certain tasks. Each participant took at least twice as long to complete some tasks as the tester did. We also learned that because the design of our application is consistent with the interface of general iPhone designs, that those participants that were familiar with the iPhone completed tasks faster.

Synthesize the Finding From table 1, it is apparent that the layout of our application was not very intuitive. For some participants, the application seemed to be easy to navigate and others took significantly longer to establish some tasks which leads our team to conclude that our application could be better designed in order to complete certain tasks. Each participant took at least twice as long to complete some tasks as the tester did. We also learned that because the design of our application is consistent with the interface of general iPhone designs, that those participants that were familiar with the iPhone completed tasks faster.

Working with Qualitative Data

Describe one aspect of the presentation that went well? All of the team members spoke loudly and clearly, which presented the information effectively. In addition, the content of the slides was solid, but it could have been displayed better (less text on the slides) Their slides weren't full of information - they were easy to read and a good visual aid. Very good use of slides. Helped make the presentation very easy to follow. Easy to read at a glance. Displaying the prototype and the PowerPoint presentation at the same time was effective as it allowed us to look at the product while we learned about it. The use of two separate screens was highly useful. It allowed the transition from the content of the presentation to the prototype very smooth. They were very effective at handling their transitions, they communicated what the next speaker was going to be speaking about and they clearly handed off the next topic to one another. Their reflection put their work the past semester in context. It gave the audience a sense that they understood where they would be going with their project. They gave a very good review of their recommendations. I like that they said the options that they eliminated and provided their justifications. It made me more confident in their choice and made it evident that they had done the research. The presentation flowed smoothly from topic to topic. The team was able to effectively swap between their speakers to facilitate the transitions from each topic in their presentation at the same time. When the same speaker continued past a topic, they introduced the topic before speaking about it.

Organize into categories or tag your comments All of the team members spoke loudly and clearly, which presented the information effectively. In addition, the content of the slides was solid, but it could have been displayed better (less text on the slides) Their slides weren't full of information - they were easy to read and a good visual aid. Slides/Visual Very good use of slides. Helped make the presentation very easy to follow. Easy to read at a glance. Displaying the prototype and the PowerPoint presentation at the same time was effective as it allowed us to look at the product while we learned about it. The use of two separate screens was highly useful. It allowed the transition from the content of the presentation to the prototype very smooth. They were very effective at handling their transitions, they communicated what the next speaker was going to be speaking about and they clearly handed off the next topic to one another. Their reflection put their work the past semester in context. It gave the audience a sense that they understood where they would be going with their project. They gave a very good review of their recommendations. I like that they said the options that they eliminated and provided their justifications. It made me more confident in their choice and made it evident that they had done the research. The presentation flowed smoothly from topic to topic. The team was able to effectively swap between their speakers to facilitate the transitions from each topic in their presentation at the same time. When the same speaker continued past a topic, they introduced the topic before speaking about it.

Synthesize the findings “Their slides weren't full of information - they were easy to read and a good visual aid.” “Very good use of slides. Helped make the presentation very easy to follow. Easy to read at a glance.” “Displaying the prototype and the PowerPoint presentation at the same time was effective as it allowed us to look at the product while we learned about it.” The data indicated that one of the strengths of the team B’s presentation was their visual presentation, more specifically they thought that their PowerPoint slides were well done. For example, participant X indicated that the slides were, “easy to read at a glance.” Another participant, Y commented on how well the slides were integrated into the demonstration and noted that, “displaying the prototype and the PowerPoint presentation at the same time was effective as it allowed us to look at the product while we learned about it.”

Tips for writing up your analysis document Keep the objectives and the goals of the document in view as you write Don’t try and analyze everything Focus on the data that answers your key questions Focus on interesting patterns in your data Feel free to discuss your findings in the group, but the analysis document is to be written individually. Stay within the word limit Prepare a substantial draft of your document so that you can get substantial feedback from your peers (due on Monday 14)

Visualizing your Data

When should you use a graphic? If the reader has to process complex data or large amounts of data. If you require the reader to visualize the shape of the data If the reader will be trying to learn from or use your text, while reading it.

Graphics Choices for Readers Reader’s need Graphic   To see the surface detail or texture of an object Photograph To see the outline and essential parts of an object Line drawing To see percentages Pie chart To see lines of authority and responsibility Organizational chart To see steps in a process Flow chart To see values at discrete points in time Bar graph To see a continuous trend over time or some other independent variable Line graph To see the internal structure of something Cross-section To see how the parts of an object fit together Exploded diagram To locate precise values Table

Line vs. Pie Charts

Pie vs. Bar Charts

Tables Table taken from: http://www.w3.org/TR/WCAG20-TECHS/PDF20

Formatting Graphics Guidelines Use accurate and consistent proportions Label all parts clearly Give each graphic a label and title Integrate graphic into the text and refer to the graphic number in the text