Dan Klein, IDM Symposium, 4/18/2017

Slides:



Advertisements
Similar presentations
National Institute of Advanced Industrial Science and Technology Advance Reservation-based Grid Co-allocation System Atsuko Takefusa, Hidemoto Nakada,
Advertisements

Tableau Software Australia
Attie Naude 14 May 2013 Windows Azure Mobile Services.
MAP REDUCE PROGRAMMING Dr G Sudha Sadasivam. Map - reduce sort/merge based distributed processing Best for batch- oriented processing Sort/merge is primitive.
SSRS 2008 Architecture Improvements Scale-out SSRS 2008 Report Engine Scalability Improvements.
GENI Experiment Control Using Gush Jeannie Albrecht and Amin Vahdat Williams College and UC San Diego.
SALSA HPC Group School of Informatics and Computing Indiana University.
Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
T Sponsors Sameer Chabungbam Principal Program Manager, Microsoft Connector API Apps BizTalk Summit 2015 – London ExCeL London | April 13th & 14th.
Academic Advisor: Prof. Ronen Brafman Team Members: Ran Isenberg Mirit Markovich Noa Aharon Alon Furman.
Module 12 Installing and Upgrading to SharePoint 2010.
1 DAN FARRAR SQL ANYWHERE ENGINEERING JUNE 7, 2010 SCHEMA-DRIVEN EXPERIMENT MANAGEMENT DECLARATIVE TESTING WITH “DEXTERITY”
Microsoft Azure Introduction ISYS 512. Microsoft Azure Microsoft Azure is a cloud.
Tutorial 1: Getting Started with Adobe Dreamweaver CS4.
ArcGIS Network Analyst: Network Analysis with ArcGIS Online
Projects. High Performance Computing Projects Design and implement an HPC cluster with one master node and two compute nodes. (Hint: use Rocks HPC Cluster.
Financial Services Developer Conference Excel Solutions with CCS Antonio Zurlo Technology Specialist HPC Microsoft Corporation.
Nimrod/G GRID Resource Broker and Computational Economy David Abramson, Rajkumar Buyya, Jon Giddy School of Computer Science and Software Engineering Monash.
MapReduce: Simplified Data Processing on Large Clusters Jeffrey Dean and Sanjay Ghemawat.
Searchlets Customer: Paul English Advisor: Prof. Ethan Bolker Team : Satish, Di, Quan
Support.ebsco.com My EBSCOhost Tutorial Tutorial.
Service Computation 2010November 21-26, Lisbon.
CSE 548 Advanced Computer Network Security Document Search in MobiCloud using Hadoop Framework Sayan Cole Jaya Chakladar Group No: 1.
Leveraging ArcGIS Online Elevation and Hydrology Services
Simplifying Resource Sharing in Voluntary Grid Computing with the Grid Appliance David Wolinsky Renato Figueiredo ACIS Lab University of Florida.
Introduction to the Adapter Server Rob Mace June, 2008.
Access 2013 Platform Overview Access Low up-front investment Easy to evolve and iterate Easy adoption One version of the truth Easy to collaborate.
Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.
SALSA HPC Group School of Informatics and Computing Indiana University.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.
1 Implementing Monitoring and Reporting. 2 Why Should Implement Monitoring? One of the biggest complaints we hear about firewall products from almost.
MOSS Design Presentation -Senior Project-. MOSS MOSS Server System 1. MOSS Application 2. Server 3. Client SIU-E Code Cop System 1. SIU-E.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
Near Real-Time Verification At The Forecast Systems Laboratory: An Operational Perspective Michael P. Kay (CIRES/FSL/NOAA) Jennifer L. Mahoney (FSL/NOAA)
Azure Automation Tao Yang & Pete Zerger ARC311 Microsoft Ignite 2015
Powered by iPlant Consuming iPlant Services in Your Portals.
RIA to visualize the health of a project Team #4 Midterm presentation February 28,2008.
A Technical Overview Bill Branan DuraCloud Technical Lead.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Master Cluster Manager User Interface (API Level) User Interface (API Level) Query Translator Avro NTA Query Engine NTA Query Engine Job Scheduler Avro.
Accounting in DataGrid HLR software demo Andrea Guarise Milano, September 11, 2001.
SharePoint Saturday SharePoint 2010 BI Insights Saturday, 16 th October, 2010 MIC - Kuwait.
WHO WILL BENEFIT FROM THIS TALK TOPICS WHAT YOU’LL LEAVE WITH Developers looking to build applications that analyze big data. Developers building applications.
AZ PASS User Group Azure Data Factory Overview Josh Sivey, Solution Partner October
/16 Final Project Report By Facializer Team Final Project Report Eagle, Leo, Bessie, Five, Evan Dan, Kyle, Ben, Caleb.
Wednesday NI Vision Sessions
Implementation of Classifier Tool in Twister Magesh khanna Vadivelu Shivaraman Janakiraman.
SharePoint Permissions Manager 2017 – Product Demo
Mobile App Trends: lifecycle, functions, and cognitive
SQL Server Reporting Service & Power BI
DTK-Tools Benoit Raybaud, Research Software Manager.
Network Analysis with ArcGIS Online
Calibration and Optimization Methods for Stochastic Epi Models
Initial Adaptation of the Advanced Regional Prediction System to the Alliance Environmental Hydrology Workbench Dan Weber, Henry Neeman, Joe Garfield and.
Housing application Presented by Phil Callaghan MD Caltech CRM
HC Hyper-V Module GUI Portal VPS Templates Web Console
Hydrographic Data as a Service
SharePoint Permissions Manager
Technical Capabilities
Internet Protocols IP: Internet Protocol
Building and running HPC apps in Windows Azure
Dtk-tools Benoit Raybaud, Research Software Manager.
Project Change Control
Server & Tools Business
DBOS DecisionBrain Optimization Server
Presentation transcript:

Dan Klein, IDM Symposium, 4/18/2017 A Simple Optimization Algorithm for Stochastic (Epi) Objective Functions Dan Klein, IDM Symposium, 4/18/2017

A First-Order Optimization Method for DTK Overview Direction from Numerical Derivative State in a D-dimensional box User provides initial guess, x0 f Choose ascent direction, dx Update state: x  x + k dx x2 Line search, pick k ε-ball x0 x1

Applications and Implementation Applications (9x, max likelihood) HIV-Zimbabwe: VMMC, PrEP (Dan) HIV-Kenya: VMMC, PrEP (Adam) HIV-Nyanza: VMMC, PrEP (Anna) HIV-South Africa: Vaccine (Christian) HIV-Uganda: SEARCH trial (Britta) Typhoid-Santiago: Vaccine (Jillian) LSHTM and Avenir soon! Likelihood Implementation Algorithm now in dtk-tools Runs locally or via COMPS Iteration

Computational Modeling Platform Service (COMPS) Web User Interface RESTful API Web Databases Job, Asset, Suites, Experiments, Simulations, Work Items SQL Server ( Fail Over ) Climate Data Storage Postgres SQL Databases Simulation Data Storage Climate Data Storage Workers Input File Creation Simulation Building HPC Job Scheduling Clean up Iterative Algorithms Workers Worker Hosting Service Input File Creation Workers Demographics Merge Nodes Nan Check Builder Worker HPC Job Scheduling Worker Clean up Worker HPC Clusters On Premise CAGE User Interface ( Dashboard, Search, Output Data Visualization, Geospatial Visualization, Input Data Visualization ) Clients RESTful API Authentication Search Service Asset Service Input File Creation Usage Metrics Work Items High Performance Storage Area Network

Stochastic Gradient Optimization Demo?

Available Software Tools for Model Optimization Stochastic gradient ascent Code is ready to go and available in dtk-tools Visit the software panel session this afternoon Visit the software session tomorrow Come talk to Dan Klein, or email dklein@idmod.org More advanced algorithm (Dr. Atiye Alaeddini, IDM) Parallel Simultaneous Perturbation Optimization (PSPO) Uncertainty quantification around optimal point Implementing global optimization later this year with TingYu Ho, student of Prof. Zabinsky