Ecogrid update and future plan: from Local, Regional to Global 2005 NSC-NSF Annual Meeting Taipei, 8, July, 2005 Fang-Pang Lin National Center for High-performance Computing National Applied Research Laboratory Collaboratory for Ecological Research in Taiwan Fang-Pang Lin National Center for High-performance Computing National Applied Research Laboratory

2 New Frontier: Merging of Environmental Science and Information Technology Previously Unobtainable Observations and Understanding Enabling Technology Advance science Science Drivers Focus development Persistent Infrastructure Broaden impact Education & Capacity Building Develop human resources Sustained Collaboration Build teams and trust Source: Tim Kratz, Peter Arzberger et al.at NSC-NSF 2005 annual meeting

3 “The World is Flat”*  Fundamental changes are underway in how:  Researchers interact with each other and with resources  Resources are distributed and accessed on the network  Science and education are conducted  This is leading to new  Research and educational paradigms  Discoveries and innovations  Networks of people Multidisciplinary, multi-institutional, international  Ecology is a global science  Demanding global approaches  Providing future opportunities for creating previously unobtainable observations and understanding * Thomas Friedman

4 “Bandwidth” and “degree of connectivity” are the new measures of power … Three distinguishing factors to harness power –Culture to exploit & share knowledge –Competitive setting that embraces change –Ability to partner Thomas Friedman, New York Times, P.11 11/Apr/1998

5 The plan for the cyber- Infrastructure Commercial network Profits Educational Network Education Innovation Research Network Grids Source: Whey Fone Tsai, 2003

6

7

8 Frequency of measurement Spatial extent Annual 100 km MonthlyWeeklyDailyHourlyMin. Sec. 10 km 1 km 100 m 10 m 1 m 10 cm Existing Sensor Networks random selection from Ecology 2003 Source: John Porter et al., Bioscience, July, 2005 Sensor networks allow high frequency observations over broad spatial extents

9 The Vision: Nerve ending of Taiwan in terms of Network (Last-Mile for TWAREN) Focus on National Ecological Observation for supporting sustainable development of the island. The Plan ： 2003: Fushan, Nan-Jen-Shan, Kenting, Tatachia, Guan-Dai-ShiKenting 2004: Yuan-yan Lake, Remote islands 2005: Coastal areas and Agricultural areas The Technology ： Grid-based system design Hierarchical Network structure. Hybrid comm. Protocols: GSM, GPRS, WLAN, P2P, RF Remote data communication (sensor-based) Remote control & Grid-based automation (sensors & robots) TERN sites KING sites

10

11 DateTimeCONDMSG FROM All Network transmission status 05/07/0801:05:30SGVC"05/07/08 01:05:30", S GVC connected (CONNECT 9600/V42). 05/07/0801:06:21SYYL_Met"05/07/08 01:06:21", S YYL_Met connected. 05/07/0801:06:22WYYL_Met"05/07/08 01:06:22", W YYL_Met E08 error count: 2. 05/07/0801:06:26SYYL_Met"05/07/08 01:06:26", S YYL_Met Area1 at location 16687, collected 504 FS words. 05/07/0801:06:28SYYL_Met"05/07/08 01:06:28", S YYL_Met disconnected. 05/07/0801:35:29SGVC"05/07/08 01:35:29", S GVC connected (CONNECT 9600/V42). 05/07/0801:36:26SYYL_Buoy"05/07/08 01:36:26", S YYL_Buoy connected. 05/07/0801:36:49SYYL_Buoy"05/07/08 01:36:49", S YYL_Buoy Area1 at location 58573, collected 1528 FS words. 05/07/0801:36:50FYYL_Buoy"05/07/08 01:36:50", F YYL_Buoy area 2 does not exist.

12

13 Typhoon Yuan Yang Lake, Taiwan – August 2004 Part of a growing global lake observatory network - An example of episodic events and threshold dynamics Access can be difficult during the most interesting times Photo by Peter Arzberger, October 2004 Used by NSF Director Feb 2005

14 Plan for Global Lake and Coral Reef Observation AS/NCHC Meeting 7-0, Mar 2005 at San Diego supported by NSF, Moore foundation and PRAGMA 10 Lakes: New Zealand, Australia, Canada, US, Korea, UK, Finland,Taiwan 4 Coral Reefs sites: Breat Barrier Reef, World Bank Coral Reef efforts, US LTER, NOAA, TW LTER

15

16

17 1st camera 2nd camera 3rd camera Optical connector Kenting Ecosite ~2.4G WiFi Field server Taipower Admin office Taipower Exibition Center

18 Architecture (I)

19 Architecture (II)

20

21

22 Basic Planning for IMS  Stakeholders:  Managers (Funding/Manpower/Strategy)  Executive Managers (plan/coordination/auditing)  Scientists (e.g. Ecologists)  Information Managers  IT Developers

23  1. Information Manager (IM)  1.1 IM Definition and Responsibility  1.2 QA/QC  1.3 Training courses   2. Portal  2.1 Basics  Scenarios:  Ecologists => login => upload => registration  Data description guidelines  1) Data/Information  composite attributes: numerics->place/time/objectives/people/equipment/owners … etc  cross references (Database layer)  Data Format  First row Row should be Definition according to EML  EML, Usage tables for cross references between the version of Chinese and that of English.   3. Sensors/equipment   4. Access Points   5. Network   Backbone issues: GSN and TANET2/TWAREN   Last miles: ADSL/GPRS/RF   Local sensor network: Local Sensor Network  RF (~900MHz)  RF (~150MHz)  IEEE (2.4GHz 54/11Mbps, 100 meters depending on power)  IEEE (WiMAX, 75Mbps, 30 miles)  Others   Hook-up Mechanism   Equipments  Pairing Structure: One to One, One to many  Details listed   6. Data format conversion  Excel -> saved as ascii (csv=> mysqls, oracles) 

24 Need to build a project registration interface Ecologist Project registration Define requirement Device procurement Site IM Create project db schema Register new schema to common data interface IT executive manager coordinate IT resources IT Specialist Design infrastructure Device procurement Link new schema to common interface YesNo Site IM Stream Data? Site IM, IT Specialist, Ecologist Test and deploy Site IM same data collected already? NO yes Site IM Operation Need to write operation manual Made by Hsiu-Mei, May 2005

25 GLEON Site Architecture (by Tony Fountain) Common Interface Layer Data Acquisition Data Management Data Analysis and Modeling Data Logger Database Models Sensor Net Middleware Comm. & Ctl. Web Services Sensor QA/QC Agent Data-related Web Services Analytical Web Services... The components and the relationships are only tentative to start the discussion.

26 GLEON Network Architecture (by Tony Fountain) Common Interface Layer Data Acquisition Data Management Data Analysis and Modeling Data Logger Database Models Sensor Net Middleware Comm. & Ctl. Web Services Sensor QA/QC Agent Data-related Web Services Analytical Web Services... Common Interface Layer Data Acquisition Data Management Data Analysis and Modeling Data Logger Database Models Sensor Net Middleware Comm. & Ctl. Web Services Sensor QA/QC Agent Data-related Web Services Analytical Web Services... Common Interface Layer Data Acquisition Data Management Data Analysis and Modeling Data Logger Database Models Sensor Net Middleware Comm. & Ctl. Web Services Sensor QA/QC Agent Data-related Web Services Analytical Web Services... Portal Lake Site 1 Lake Site 2 Lake Site 3 Desktop & Mobile Users Note that each site implements the Interface Layer, but the actual site architectures are independent and site-specific.

27

28 Fishery Observatory in Open Ocean (Fishery sites in plan: Pintong, Ilan and/or Penhu) Fishery Observatory in Open Ocean (Fishery sites in plan: Pintong, Ilan and/or Penhu) (After Tim Acker et. Al., BioSonics Inc.) Wireless network antenna Fishery Platform/Observatory in Ocean Production management system Observational servers Source: Chi-Yuan Lin, TFRIN

29 ( , photo by 周秀美, NCHC)

30 Sensor Grid Portal (T.H.Chen and C.K. Sun, NCHC)  Provide Basics of a General Grid Platform and allow further development into a domain specific platform, such as IM for ecological research  Need a component which is aware of the status of resources in the grid environment, and be able to dispatch/redirect jobs to the most appropriate resources,  Integrate computing resource and storage resource using Grid middleware:  Computing middleware  Storage middleware  The ultimate goal is to have a complete grid platform and a user portal, so that NCHC could maximize the value of its hardware and knowledge center, enable end users to access various NCHC grid resources through the single entry, with user friendly Web interfaces.  Portal Server 注意！ ← 每頁右下角之簡報主題 請至母片修改。

31 Solutions  Part of Computing  Use Globus as computing middleware  Provides both Web Services (utilizing Axis engine) and Java APIs as the interfaces for job submission and other functions.  Utilize a RDB (MySQL) to store Meta Scheduler data.  Provides design information for the “MetaScheduler”.  Part of Storage  Use SRB as storage middleware  SRB client and the Data mover component  Authentication and authorization  Part of Portal Server  LifeRay Portal server  Portal user management and user profile integration with Globus and SRB.  Integrate with GT2 CoG  Integrate with SRB JARGON

32 NCHC Portal Architecture

33 Configuration  Hardware environment and Software function Service machine 2 SRB Server Globus server Simple CA SRB Utilities GRIS Service machine 1 Grid Portal Meta-scheduler Globus server SRB Utilities Certificate GIIS TCP/IP Network Other Grid service machines Globus server SRB Utilities Certificate GRIS Other Grid service machine Globus server SRB Utilities Certificate GRIS

34