ENCODE Data Coordination at UCSC Kate Rosenbloom ENCODE DCC Technical Project Manager UCSC Genome Bioinformatics Group September 2010 Genome Browser SAB Review

ENCODE in a nutshell: Y3Q3 2 species (human, mouse) 3 years of production phase (2 years left) 17 grants, 27 labs 20 experiment types 27 browser tracks 140 cell & tissue types 1559 datasets

Topics: 1.DCC role in ENCODE 2.Progress since last SAB review 3.Challenges 4.Browser impact

DCC role in ENCODE Define data formats and submission process Load, display, curate, review & release data Collect metadata and documentation Provide public website, viz, tools User outreach & support Support consortium communications (wiki) Support analysis group

Data submission website: submissions as of September 2010

Lifecycle of a data submission sub.tar.gz lab uploads to submission website loaded uploaded pipeline validates and loads into database wrangler configures browser track data fails validation or loading validate failed, load failed displayed (on test browser) lab approves track on test browser Q/A reviews and releases approved, reviewing released (to public browser)

ENCODE track quality review Data format checks Description and metadata complete & correct Configurability Display at different zoom levels and visibilities Performance Does the data make biological sense ? Usability

Released Data: 27 tracks in hg18, representing 860 experiments as of September 2010

Features planned for Year 2: High-resolution wiggle (bigWig) DONE RNAseq display enhancements DONE NCBI accessioning of seq data IN PROGRESS Track search tool IN REVIEW Progress since last SAB review (Feb ‘09) Plus: Integrated regulatory track Hg19/GRCh37 migration BAM support (spec, validation, display, c-tracks) Mid-course review, 4 data freezes, 2 analysis workshops, DCC site review Mouse ENCODE

Integrated regulatory tracks UCSC-developed integrative ENCODE track – shows enrichment of histone modifications suggestive of enhancer and promoter activity, DNAse clusters indicating open chromatin, regions of transcription factor binding, and transcription levels, derived from ENCODE data collected in multiple cell lines.

ENCODE data at NCBI GEO: Caltech RNA-seq

Mouse ENCODE experiment matrix 4 grants funded by the ARRA, 3 are now submitting data more cell types more factors

Simple search looks at: Track names and labeling Tracl description Metadata terms (specifically ENCODE controlled vocabulary) Finding data in the browser: Simple free-text search

Advanced search allows selection by defined metadata terms. (Currently only for ENCODE tracks) This search finds histone modification H3K4me3 as seen in H1-hESC cells. Finding data in the browser: By metadata terms

The results of the search on the previous slide is a single track of histone modification H3K4me3 as seen in H1-hESC cells. Clicking ‘View in Browser’ will display this data. Results from track search

Challenges Number of labs, difficulty of some Metadata expansion, special handling beyond normal browser data Multiple customers: NHGRI, analysis group, labs, user community Production vs. research Mission expansion: GEO/SRA, standards, ARRA, year 5 Reporting overhead Engineering staff -> hire ‘wranglers’ Funding delays

Impact on browser Expanded data – mostly useful, some not so much Pushes development of viz, tools, formats for large datasets Competes for staff and mgmt resources

People at the DCC PI: Jim Kent Technical project manager: Kate Rosenbloom Engineering / Wrangling: Tim Dreszer, Venkat Malladi, Brian Raney, Cricket Sloan, Melissa Cline Outreach, usability: Melissa, OpenHelix (contractor) Submissions website: Galt Barber GEO tools: Krishna Roskin Quality assurance: Katrina Learned, Vanessa Swing Browser management: Donna Karolchik, Bob Kuhn, Ann Zweig

Reporting: Monthly Quarterly Annual

Additional slides

Plans Track search tool ENCODE tutorial Portal upgrade Complete GEO submissions Analysis tracks ARRA grants (protegenomics, epitope-tag) Release Mouse data

Browser features developed for ENCODE High resolution wiggle (bigWig) HTS formats (BAM and bigBed) BIG custom tracks View-based tracks Data selection matrix Metadata links Coming soon: Track Search

Initial tracks of mouse data (test browser)

GEO Submission Pipeline

Portal

ENCODE Outreach Publication: NAR 2010 Database issue (2011 update in press) Presentations: CSHL Statistical Analysis course June 2010, Stanford Computational Systems Bioinformatics, Aug 2010 Posters: CSHL Biology of Genomes May 2009, CSB 2010

OpenHelix ENCODE tutorial