Mouse Brain Atlas Meeting Use cases e.g. identify genes at a location, and expressing cells; supporting workflows: data publication and registration, visualization, annotation (incl. collaborative delineation), single-slice, cross-slice and cross-scale query, integration at various levels… Mapping the workflows to infrastructure Registration (3d to 3d; 2d to 3d; based on coordinates; taxonomy (w/BIRNLex), a combination; cross-scale, etc.); image registration workflow; gene expression registration Visualization: MBAT/WOMBAT Integration: Interop API, mediator

Mouse BIRN: Brain Image Analysis Systems SMART Atlas (UCSD) BIRN Atlas Interoperability API MBAT (BIRN) NeuroTerrain (Drexel) SHIVA (UCLA)

3D Anatomical Analysis Software The Harvard SPL Anatomy Browser / 3D Slicerhttp://splweb.bwh.harvard.edu:8000/pages/papers/AnatomyBrowser/current/ BRAINS2/IPL (The University of Iowa - another BIRN participant) The Pitt Supercomp. Center Volume Browser (Wetzel et al.) Mouse Brain Image Visualizer (MBIV) (Bennett et al. - used for Hof atlas) 3DViewnixhttp://mipgsun.mipg.upenn.edu/~Vnews/ ANFI (X11+Motif based medical imaging environment - including a volume browser) AMIDE (Gnome-based anatomical volume browser) Mayo Clinic's ANALYZEhttp:// BLOX (JHU) BrainImageJava (Stanford Psych. Neuroimaging Lab) BrainMaps.org (UC Davis - though really 2D, it should be considered capable of interoperating in 3D the way SMART Atlas does - even it cannot do this now) BrainVoyager QX (Rainer Goebel et al. at ﾊ Brain Innovation B.V., Maastricht, The Netherlands) Brede (Finn 〉 up Nielsen - ﾊ IMM, Tech. U. of Denmark - XML-based from the outset) CARET/SumsDB (David van Essen, John Harwell, et al. - Wash. U. St. Louis) NCMIR 3D Visualization Toolshttp://ncmir.ucsd.edu/Downloads/Software/overview.htmhttp://ncmir.ucsd.edu/Downloads/Software/overview.htm XANAT/Conexus/Large-Scale Viz (UCDavis/Stanford Psych/UCI) FMRIDC Tool (Dartmouth) DPTools (Denis Ducreux - France) EM3D (U.J. McMahan - Stanford Neurobiology) /Imaris (Bitplane AG) Amira (Mercury Computer Systems) /FormZ (auto-des-sys) itk-SNAP (currently - Penn Image Computing & Science Lag, Radiology, U.Penn) Java Image Viz (JIV - McGill U.) MIPAV (NIH) MRI3DX (Aston U., Birmingham UK) MRIView (Los Alamos NL) NeuroLens (MGH Martinos Imaging Center) NMV (Neuromorphometrics, Inc. - somewhat SMART Atlas-like) OsiriX - Skandha4/Brain Visualizer (U. Washington, Structural Informatics Group) SPM5 (UCL, ﾊ Wellcome Department of Imaging Neuroscience - U ) SurfRelax (NYU) Volume One (VOLUME-ONE developers group, Japan - OpenGL/gtk+) VoxBo (U. Penn.) VTK CISG Registration Toolkit (Thomas Hartkens, ﾊ Guy's Hospital, UC London - ) Volume Visualization and Navigation Toolhttp:// WFU PickAtlas (Wake Forest U., ANSIR resource)

Web-oriented Mouse BIRN Atlasing Tool (WoMBAT) BIRN Atlas Interoperability API Messaging to synchronize & share atlas data set selection current atlas position VOIs - object geometry & ontology-based labels integrated analysis of brain section data sets aligned to any given atlas Messaging implementation generators & listeners WSDL web-services + binary attachments process monitoring and control Promotes Re-use & Integration

NeuroTerrain Atlasing System 2005/2006 Progress Report NT Atlas Server Re-architected as ANSI C/C++ Unix daemon app Integrates Macrovoxel atlas data sets with brain region VOIs in a unified coordinate space Responds to client slice requests via TCP socket-based data stream Tuned for optimal performance under low & high network latency (local LAN vs. public Internet) Tools for building Macrovoxel data sets

NeuroTerrain Atlasing System 2006/2007 Plans NT Atlas Server Integrated, seamless zooming of aligned multi- dimensional data sets Tools for tighter integration of VOI definitions with BIRNLex Web service-based access to NT atlas aligned datasets (e.g., the Mouse Brain Library, etc.) Tools to integrate user-submitted brain segmentation Implementation of the BIRN Atlas Interoperability API Dedicated NT Server (dual 2GHz XNode) at BIRN-CC

NeuroTerrain Atlasing System 2005/2006 Progress Report NetOStat Client (NT-SDK) Re-architected as a Java-based dev kit components for integration in any Java application - client or server Provides complete implementation of the NT Server API Select data set, slice data at arbitrary angles, switch slice axis (C/H/S), zoom & pan, view selected VOIs, save images, reslice for segmentation Tuned for optimal performance under low & high network latency (local LAN vs. public Internet) NetOStat application serves as developer template

NeuroTerrain Atlasing System NetOStat Client (NT-SDK) From Mac only To platform independent Java

NeuroTerrain Atlasing System 2006/2007 Plans NetOStat Client (NT-SDK) Continue network tuning Complete bi-directional implementation of BIRN Atlas Interoperability API in NT-SDK Complete simultaneous, multi-session capability Complete multiplatform testing - Windows, Linux, & Webstart Link with NT Image Repository server - deliver NT- aligned data sets to any implementing application Web-service client to SRB & Mediator

Recent Additions to MBAT (UCLA) Bonfire Browser –Query Bonfire server, display results Improved Brain Graph Editing and Display Integrated Gene Expression Tool –Query/display individual user data on BIRN –uArray Server –GeneNetwork –BIRN CC Mediator (Barlow/Zapala data)

MBAT – Future Plans (UCLA) Expand annotation searching for gene expression Query/Display in-situ images Add 2d 3d interface with NeuroTerrain Server and Smart Atlas

In the last 6 months (UCSD) Closed the loop on image registration –Image registration workflow on the portal –Spatial registry in Oracle Spatial, with WS API –Load an image into Jibber – define registration points and compute transformation matrix – warp with Jetsam – serve the warped image as ArcIMS service – update record in spatial registry (including SDO, thumbnails, etc.) – discover the image by querying from Smart Atlas –Components implemented as web services, callable from other apps The Bonfire module in SA and MBAT

Image Registration Workflow Step 1: Select an image in SRB, and start warping with Jibber

… select a warped image for conversion to image service Step 2: After warping is done, spatial registry is updated to reflect it; warped images are listed …

Step 3: Review image metadata … and spatial metadata in spatial registry

Step 4: Find the image in spatial registry … … by specifying a search shape in Smart Atlas

Development Ideas (UCSD) Registering more images in the spatial registry, testing, validation… Tools for data curation in spatial registry Registering 3D volumes in a similar fashion Integrating 3d cutting tools Registering oblique slices Web services and workflows for registering other data types, modeled after image registration Wrapping spatial selection requests as Web services Atlas interoperability API and server: connection with mediator API Portalizing atlas functionality BIRN-enabled tools (plugins for Photoshop, Excel, to allow upload/search/download from BIRN – need a survey of popular tools?) Exchanging relative location information, for cross-scale communication Better organization of ArcIMS image services, and serving images in OGC-compatible formats Using ERMapper IWS or ESRI's Image server to serve large BIRN images into Photoshop and web clients

BIRN Tools Find by Location Find by Taxonomies Upload and Register Define a selection polygon in MBAT (2D or 3D) Open an attribute selection form, w/Bonfire etc. Authenticate and start image registration workflow