“Driving Applications on the UCSD Big Data Freeway System” Keynote Lecture Cubic and UC San Diego Innovation Workshop UC San Diego February 26, 2014 Dr.

Slides:



Advertisements
Similar presentations
High Performance Cyberinfrastructure Is Required for the Era of Big Data Opening Workshop Presentation Whither Science in Mexico: an Analysis for Action.
Advertisements

A Systems Approach to Personalized Medicine Talk and Discussion NASA Ames Mountain View, CA March 28, 2013 Dr. Larry Smarr Director, California Institute.
The Quantified Self: Personal Monitoring and the Control of Health Interview by Andre de Fusco Future in Review 2011 Laguna Beach, CA May 26, 2011 Dr.
Reading Out the State of the Body and How it Changes Under Therapy Guest Lecture Pharmacy Informatics 2013 University of California San Diego June 7, 2013.
Calit2-Living in the Future " Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.
Large Memory High Performance Computing Enables Comparison Across Human Gut Microbiome of Patients with Autoimmune Diseases and Healthy Subjects XSEDE.
Deep Self - Quantifying the State of Your Body Invited Talk NextMed / MMVR20 San Diego February 21, 2013 Dr. Larry Smarr Director, California Institute.
“Tracking Immune Biomarkers and the Human Gut Microbiome: Inflammation, Crohn's Disease, and Colon Cancer” USC Monthly Seminar Series Physical Sciences.
Exploring Our Inner Universe Using Supercomputers and Gene Sequencers Physics Department Colloquium UC San Diego October 24, 2013 Dr. Larry Smarr Director,
Discussion Janssen La Jolla Research and Development La Jolla, CA
“Integrating Healthcare Informatics, Imaging, and Systems Biology-A Personal Example” Plenary Lecture 2nd IEEE Conference on Healthcare Informatics, Imaging,
Leveraging Biomedical Big Data: Quantified Self & Beyond Invited Talk FutureMed Singularity University NASA Ames Campus February 5, 2013 Dr. Larry Smarr.
Personal Data Tracking and the Digital Transformation of Healthcare Invited Talk University of Illinois Silicon Valley Round Table Palo Alto, CA December.
The First Year of Cal-(IT) 2 Report to The University of California Regents UCSF San Francisco, CA March 13, 2002 Dr. Larry Smarr Director, California.
“High Performance Cyberinfrastructure for Data-Intensive Research”
“A California-Wide Cyberinfrastructure for Data-Intensive Research” Invited Presentation CENIC Annual Retreat Santa Rosa, CA July 22, 2014 Dr. Larry Smarr.
“Building US/Mexico Collaborations Using Optical Networks” Opening Workshop Welcome Big Data Big Network 2 Calit2’s Qualcomm Institute February 10, 2014.
“Advances and Breakthroughs in Computing – The Next Ten Years” Invited Talk CTO Forum San Francisco, CA November 5, 2014 Dr. Larry Smarr Director, California.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CIF21) NSF-wide Cyberinfrastructure Vision People, Sustainability, Innovation,
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
Homeland Security Activities of Cal-(IT) 2 UC President’s Board on Science and Innovation Oakland, CA September 11, 2002 Dr. Larry Smarr Director, California.
SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO IEEE Symposium of Massive Storage Systems, May 3-5, 2010 Data-Intensive Solutions.
University of Kansas ITTC Research Overview Victor S. Frost Dan F. Servey Distinguished Professor Electrical Engineering and Computer Science Executive.
University of Kansas A KTEC Center of Excellence 1 Victor S. Frost Director, Information & Telecommunication Technology Center Dan F. Servey Distinguished.
Innovations in Web-Based Informal Science Education: DinoQuest Online Robert Nideffer, University of California, Irvine, UCGame Lab, Studio Arts Dept.
High Performance Wireless Research and Education Network
1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,
“A UC-Wide Cyberinfrastructure for Data-Intensive Research” Invited Presentation UC IT Leadership Council Oakland, CA May 19, 2014 Dr. Larry Smarr Director,
Building a Community Cyberinfrastructure to Support Marine Microbial Ecology Metagenomics Center for Earth Observations and Applications Advisory Committee.
“The Quantified Self Movement: The Technologies That Are Revolutionizing Health and Fitness” Panel Discussion MIT Enterprise Forum San Diego UC San Diego.
1 Research and Educational Innovations in Computer Games Walt Scacchi and California Institute for Telecommunications and Information Technology (Calit2)
“Mapping the Human Gut Microbiome in Health and Disease Using Sequencing, Supercomputing, and Data Analysis” Invited Talk Delivered by Mehrdad Yazdani,
“The Quantified Self: From Idiosyncratic Hobby to an Emerging Growth Industry” Invited Lecture Science & Technology Discovery Series Technology Alliance.
“An Integrated Science Cyberinfrastructure for Data-Intensive Research” Panel CISCO Executive Symposium San Diego, CA June 9, 2015 Dr. Larry Smarr Director,
“Calit2: A UC Experiment for Living in the Future" Talk to UCSD Near You La Jolla, CA April 11, 2006 Dr. Larry Smarr Director, California Institute.
“Creating a High Performance Cyberinfrastructure to Support Analysis of Illumina Metagenomic Data” DNA Day Department of Computer Science and Engineering.
Developing a North American Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E.
“Comparative Human Microbiome Analysis” Remote Video Talk to CICESE Big Data, Big Network Workshop Ensenada, Mexico October 10, 2013 Dr. Larry Smarr Director,
Cal-(IT) 2 : A Public-Private Partnership in Southern California U.S. Business Council for Sustainable Development Year-End Meeting December 11, 2003 Institute.
Innovative Research Alliances Invited Talk IUCRP Fellows Seminar UCSD La Jolla, CA July 10, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.
Dan Cayan Scripps Institution of Oceanography, UC San Diego USGS Water Resources Discipline much support from David Pierce, Mary Tyree, and other colleagues.
© Internet 2012 Internet2 and Global Collaboration APAN 33 Chiang Mai 14 February 2012 Stephen Wolff Internet2.
“Frontiers of Self-Tracking” Plenary Talk Quantified Self Conference 2012 Stanford University September 15, 2012 Dr. Larry Smarr Director, California Institute.
A High-Performance Campus-Scale Cyberinfrastructure For Effectively Bridging End-User Laboratories to Data-Intensive Sources Presentation by Larry Smarr.
“Big Data” and Data-Intensive Science (eScience) Ed Lazowska Bill & Melinda Gates Chair in Computer Science & Engineering University of Washington July.
Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.
Project GreenLight Overview Thomas DeFanti Full Research Scientist and Distinguished Professor Emeritus California Institute for Telecommunications and.
“Observing the Dynamics of the Human Immune System Coupled to the Microbiome in Health and Disease” CASIS Workshop on Biomedical Research Aboard the ISS.
Dan Cayan USGS Water Resources Discipline Scripps Institution of Oceanography, UC San Diego much support from Mary Tyree, Mike Dettinger, Guido Franco.
The Interaction of UCSD Industrial Partners, the Jacobs School of Engineering, and Cal-(IT) 2 Dr. Larry Smarr Director, California Institute for Telecommunications.
“Assay Lab Within Your Body: Biometrics and Biomes” Invited Lecture TSensors Summit La Jolla, CA November 12, 2014 Dr. Larry Smarr Director, California.
Dan Cayan Scripps Institution of Oceanography, UC San Diego USGS Water Resources Discipline much support from Mary Tyree, Guido Franco and other colleagues.
“The Pacific Research Platform: a Science-Driven Big-Data Freeway System.” Big Data for Information and Communications Technologies Panel Presentation.
“CAMERA Goes Live!" Presentation with Craig Venter National Press Club Washington, DC March 13, 2007 Dr. Larry Smarr Director, California Institute for.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
“The UCSD Big Data Freeway System” Invited Short Talk Workshop on “Enriching Human Life and Society” UC San Diego February 6, 2014 Dr. Larry Smarr Director,
“ OptIPuter Year Five: From Research to Adoption " OptIPuter All Hands Meeting La Jolla, CA January 22, 2007 Dr. Larry Smarr Director, California.
Simplifying Cloud Connectivity for Your Clients Presenter: Tom SharkeyTom Sharkey December 8,
Lecture Science & Entertainment Exchange National Academy of Sciences Los Angeles June 13, 2013 Dr. Larry Smarr Director, California Institute for Telecommunications.
Keynote Presentation NSF Workshop on Applications and Services in 2021
Is the Sierra Nevada going to lose its snow? Investigate how 21 st Century scenarios of climate change impact spring snowpack in California Dan Cayan(1,2),
“Adding Consumer-Generated and Microbiome Data to the Electronic Medical Record” Using Big Data to Advance Healthcare Panel National Health Policy Conference.
“Genomics: The CAMERA Project" Invited Talk 5 th Annual ON*VECTOR International Photonics Workshop UCSD February 28, 2006 Dr. Larry Smarr Director,
University of Illinois at Chicago Lambda Grids and The OptIPuter Tom DeFanti.
High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC.
“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.
Gadgets in health it Convergence of Wellness and Wireless
Canada’s National Research and Education Network (NREN)
DL4-Met Hydroclimate Data Logger
Optical SIG, SD Telecom Council
Presentation transcript:

“Driving Applications on the UCSD Big Data Freeway System” Keynote Lecture Cubic and UC San Diego Innovation Workshop UC San Diego February 26, 2014 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD 1

The Data-Intensive Discovery Era Requires High Performance Cyberinfrastructure Growth of Digital Data is Exponential –“Data Tsunami” Driven by Advances in Digital Detectors, Computing, Networking, & Storage Technologies Shared Internet Optimized for Megabyte-Size Objects Need Dedicated Photonic Cyberinfrastructure for Gigabyte/Terabyte Data Objects Finding Patterns in the Data is the New Imperative –Data-Driven Applications –Data Mining –Visual Analytics –Data Analysis Workflows Source: SDSC

The White House Announcement Has Galvanized U.S. Campus CI Innovations

CERN’s CMS Experiment Generates Massive Amounts of Data

UCSD is a Tier-2 LHC Data Center: CMS Flow into UCSD Physics Dept. Peaks at 2.4 Gbps Source: Frank Wuerthwein, Physics UCSD

Dan Cayan USGS Water Resources Discipline Scripps Institution of Oceanography, UC San Diego much support from Mary Tyree, Mike Dettinger, Guido Franco and other colleagues Sponsors: California Energy Commission NOAA RISA program California DWR, DOE, NSF Planning for climate change in California substantial shifts on top of already high climate variability UCSD Campus Climate Researchers Need to Download Results from Remote Supercomputer Simulations to Make Regional Climate Change Forecasts

average summer afternoon temperature average summer afternoon temperature 7 GFDL A2 1km downscaled to 1km Hugo Hidalgo Tapash Das Mike Dettinger

Protein Data Bank (PDB) Needs Bandwidth to Connect Resources and Users Archive of experimentally determined 3D structures of proteins, nucleic acids, complex assemblies One of the largest scientific resources in life sciences Source: Phil Bourne and Andreas Prlić, PDB Hemoglobin Virus

Protein Data Bank Usage Is Growing Over Time More than 300,000 Unique Global Visitors per Month Up to 300 Concurrent Users ~10 Structures are Downloaded per Second 7/24/365 Increasingly Popular Web Services Traffic Source: Phil Bourne and Andreas Prlić, PDB

Collaboration Between EVL’s CAVE2 and Calit2’s VROOM Over 10Gb Wavelength EVL Calit2 Source: NTT Sponsored ON*VECTOR Workshop at Calit2 March 6, 2013

Global Innovation Centers are Being Connected with 10,000 Megabits/sec Clear Channel Lightpaths Source: Maxine Brown, UIC and Robert Patterson, NCSA 100 Gbps Commercially Available; Research on 1 Tbps

Creating a Big Data Freeway System: Use Optical Fiber with 1000x Shared Internet Speeds NSF CC-NIE Has Awarded Optical Switch Phil Papadopoulos, SDSC, Calit2, PI

Arista Enables SDSC’s Massively Parallel 10G Switched Data Analysis Resource 12

High Performance Wireless Research and Education Network National Science Foundation awards , and

HPWREN Topology, 360 Degree Cameras Source: Hans Werner Braun, HPWREN PI

Various Real-Time Network Cameras for Environmental Observations Source: Hans Werner Braun, HPWREN PI

San Diego County Digital Weather Stations: High Spatial Density Reads Out Time-Changing Atmosphere Source: Jessica Block, Calit2

Trigger real-time computer-generated alerts, if: condition “A” AND condition “B” AND condition “C” OR condition “D” exists, in which case several San Diego emergency officers are being paged or ed during such alert conditions, based on HPWREN data parameterization by a CDF Division Chief. This system has been in operation since Date: Wed, 4 Aug :31: Subject: URGENT weather sensor alert LP: RH=26.1 WD=135.2 WS=1.9 FM=6.8 AT=80.7 at More details at Relative Humidity Wind speed Wind direction Fuel moisture Source: Hans Werner Braun, HPWREN PI

By Measuring the State of My Body and “Tuning” It Using Nutrition and Exercise, I Became Healthier 2000 Age Age Age I Arrived in La Jolla in 2000 After 20 Years in the Midwest and Decided to Move Against the Obesity Trend I Reversed My Body’s Decline By Quantifying and Altering Nutrition and Exercise

I Used a Variety of Emerging Personal Sensors To Quantify My Body & Drive Behavioral Change Withings/iPhone- Blood Pressure Zeo-Sleep Azumio-Heart Rate MyFitnessPal- Calories Ingested FitBit - Daily Steps & Calories Burned Withings WiFi Scale - Daily Weight

From One to a Billion Data Points Defining Me: Big Data Coming to the Electronic Medical Record (EMR) Billion: My Full DNA, MRI/CT Images Million: My DNA SNPs, Zeo, FitBit Hundred: My Blood Variables One: My Weight Weight Blood Variables SNPs Microbial Genome Today’s EMR Tomorrow’s EMR

Visualizing Time Series of 150 LS Blood and Stool Variables, Each Over 5-10 Years Calit2 64 megapixel VROOM

Only One of My Blood Measurements Was Far Out of Range--Indicating Chronic Inflammation Normal Range <1 mg/L Normal 27x Upper Limit Episodic Peaks in Inflammation Followed by Spontaneous Drops Complex Reactive Protein (CRP) is a Blood Biomarker for Detecting Presence of Inflammation

Consumer Self Measurement is Exploding Totally Outside of the Medical Complex From the First San Francisco QS Meetup in 2008 To 116 Cities in 37 Countries in Four Years

The Self-Monitoring Business Has Reached Market Takeoff MyFitnessPal –40 Million Users –Aug 2013 Raised $18M Series A, Led by Kleiner Perkins Fitbit –Has Raised ~$70M BodyMedia Was Bought by Jawbone –For ~$100M Zeo Sleep Monitor –Closed Down in 2013 More Mergers Likely as the Shakeout Continues

Mobile Health Market Projected to be $30B-$60B by 2015 Source: Rick Valencia, Qualcomm Life mHealth Technology Progression

Platforms Enable Expanding Ecosystems Empowering Many to Serve Diverse Customer Sets Interactive Coaching Platform Weight LossWellnessBrandsEventsCoaches Training Companies Social Activity Platforms Source: Kristian Rauhala, PEAR Sports LLC