Usability and Integration H. V. Jagadish

Many Sources of Data Text XML/semi-structured Experimental measurements Public databases Some data may have time/space variation Need to make sense of this big mess

Find Patterns in Data Conventional data mining seeks patterns that can be mathematically specified over (usually) global extents. Typically assume simple data structure. Need new approaches to find patterns in messy data.

Human in the Loop Hard for a machine to tell an interesting pattern apart from one that is not. Problem exacerbated when we seek smaller/localized patterns, or work with large vocabularies of possible patterns. Need human in the loop to make this judgment.

Computer-Assisted (Human) Analytics Patterns found by human and not by computer. Job of computer is to make patterns easy to find. So computer system must effectively support queries and display results. Eg.Visual Analytics

Organize Data for Analysis Join multiple complex temporal data streams into a “windowed” model suitable for efficient analysis. [Manish Singh] Permit organic change to schema as information needs evolve. [Eric Qian] Provide a spreadsheet interface for direct manipulation of complex and large data. Choose small sets of representatives effectively. [Ben Liu]

Access Data for Analysis Under-specified queries, particularly keyword queries. Derive “qunit” as response unit, mined from observed query logs. [Arnab Nandi] Visual manipulation algebra for analyzing large time-varying graphs with data on nodes and edges. [Anna Shaverdian]

Scientific Data Analysis Explain analysis results in terms of source data, even when the source may have been updated since. [Jing Zhang] Analyze gene expression microarray data, and electronic health record data, in light of known biomedical knowledge. [Fernando Farfan]