1. GISC Exeter Status GISC Seoul Workshop, Jeju, Korea, 2012-11-07
Chris Little, Met Office, RTH & GISC Focal Point
© Crown copyright Met Office 1

3. Screen shot
© Crown copyright Met Office 3

4. Exeter GISC Current Status - 1
Built & running in Operational Environment since
Formally declared operational at WMO EC
55000 Conformant metadata records (UK, MF, DWD, JMA)
Cache is ingesting datasets per 24 hours (mainly GRIB, SYNOP, TEMP) 350MB
Harvest over RMDCN or Internet
Can Replicate (?) over RMDCN
Increased RMDCN access from 2Mb to 6Mb (100Mb/s limit)
Catalogue functions OK: DAR Discovery, Access, Retrieval, harvesting & synchronization
Cache functions: difficulty with security architecture delayed contractual acceptance
ECMWF records soon.
Was Replication problem perhaps RMCN 2Mb/s related?.
3.8 now installed. Harvesting currently either RMDCN or Internet but not both at same time yet. Not a lot of work to address.
Some DWD ~10,000 records seem to have validation problem
Slef-registration limited because of Web experience: 16M users in two ours in bad weather, WOW: 25 million obs registered and uploaded in several months

5. Exeter GISC Current Status - 2
Building DCPC instance
Assigned metadata ownership, written detailed metadata guidance
24/7 service desk and shift staff ready
Initially, no self-registered users
Only authorised NHMS users
Harness initially for or download
Harness for FTP Operational File Switch DART in development

6. Main Communications Links from Exeter
Use of internet to provide backup connections.
Montreal connection migrating from frame relay to RMDCN.
Currently working on RMDCN connection to Indian Met Dept.
© Crown copyright Met Office 6

8. Underpinning Infrastructure - 1
RMDCN access: 2 x 6Mb/s, no load sharing
Possible to upgrade to 2x100Mb/s - just money
Upgraded for extra links: Opera radar, WIS traffic
New direct links: South Africa, Canada, India (testing)
ECWMF traffic on separate 100Mb/s link
Internet link 2 x 100+Mb/s,
Will be upgraded to 2 x 1000Mb/s for research
Trans-Atlantic NESDIS link 1.5Mb/s

9. Underpinning Infrastructure - 2
MSS: IBL Moving Weather
Some traffic moved back from FTP ATD servers to MSS
Cheaper, faster, much more headroom
More precise/less forgiving data rules
WMO GTS traffic only 15-20% of total MSS
Some Internet ftp links
FSS: centralised FTP AFD server: DART
IronPort gateway: messages/day

10. Exeter daily traffic

11. RMDCN annual usage

12. Rest of the Year!

13. Exeter Annual Traffic

14. WMO Message Switching System

15. WMO Message Switching System

16. MSS Data traffic

17. DART FTP File Switch

18. DART FTP File Switch

19. IronPort e-mail gateway

20. RTH Exeter availability
Availability figures for period July 2010 to June 2011:
WMO message switch – 99.94%
FTP file switch – 100%
gateway – 100%

21. Support Service orientated organisation
Service Desk, 24/7, 4 level support
ITIL Version 3 compliant
Many staff ITIL qualified: basic & advanced
BMC Remedy tool:
Incidents
Restoration
Problems
Changes
Asset and Configuration management
Service desk used for International, 30 country project MyOcean

22. Other aspects Dual IT Halls and access lines
Extensive sophisticated backup power
World leading energy efficiencies
Existing services back-up abroad:
ICAO WAFC: Washington
WMO EERA: Toulouse (Nuclear & other Pollution Dispersion)
Offsite recovery: Aberdeen forecasters – people not IT

23. UKMO OpenWIS plans Agreed with Météo-France and other partners:By
Receive v3.10 of the Open-WIS software from the supplier and test.
Météo-France accepts Open-WIS from the prime contractor and issues licences.
Agree how OpenWIS will be supported and evolved (i.e. open-source management arrangements and the role of AKKA).
Plan and time-scales to be agreed with Météo-France and other partners:
/04 Test OpenWIS v3.10 fully to resolve defects
/04 Carry out performance and failover testing with Météo France
onwards: Further develop the harness for GISC purposes.
Review the IT architecture. Dependent on earlier steps.
Review how the software delivers DCPC requirements including data harness.
Agreement time-scales with Météo-France to provide the joint virtual GISC service.

24. OpenWIS Future activities
Acceptance
Start year warranty
Full Operational Service
Release as Open Source software, with governance
MFI offer commercial installation & support
Rollout:
External DCPCs (ECMWF, EUMETSAT, IPY, …), NCs
Internal DCPCs (9 in Met Office )
“build your catalogue metadata entries for your data”
Opera Data Centre to be a vDCPC, joint with Météo-France
Other NCs or DCPCs in UK?
Back-up with Météo-France
Out of Country back-up for Public Weather Service
© Crown copyright Met Office

25. Exeter Future activities
Rollout to more Met Office DCPCs
Rollout to more countries in RA-VI
Improve connectivity of GTS/RMDCN/MTN
What other NCs or DCPDCs would we allow in UK?
Opera Data Centre to be a vDCPC, joint with M-F
BAS to discuss being a vDCPC for IPY
BADC to discuss being a second NC
Out of Country back-up for Public Weather Service
Build your catalogue metadata entries for your data

26. WMO Future activities Lots of WMO Technical work:
Agree cache replication mechanism (OpenWIS proposes Bit Torrent over RMDCN)
Tighten WMO Core ISO19115 Metadata interoperability
“Business as Usual” operating procedures with CMA, JMA, …
Back-up between UK & France OpenWIS and DWD IBL
Improve connectivity of GTS/RMDCN/MTN (ITT in 2012/13)
Rollout:
more countries in RA-VI and MTN
WMO ET work – metadata, registries
Open source release of OpenWIS, community building
VCP and project activities (e.g. Algeria,…, Zambia)
© Crown copyright Met Office

27. RMDCN - Next Generation
Contract has been re-tendered after 10 years
Cut over plan milestones:
Pilot sites to
Initial deployment to
Reliability testing to
Main migration to
Switch off old network
Same or increased bandwidth
Technology & price refresh after 3 & 6 years

28. Questions & Answers
© Crown copyright Met Office

29. Spare slides, to be used only if required
© Crown copyright Met Office

30. Internet and Web traffic
‘Wave’, Invent’ & WOW (public beta test!)
Also secure sites for other customers
Hot failover clusters in two IT Halls
2 x 100Mb/s, scalable up at 24 hours notice
Public Web site hits in two hours in bad weather, page impressions/day normally.
Contract for Akamai edge servers to cope – pages tailored, dynamic, not static HTML
Service desk support

31. Hardware 2 x IBM Supercomputer 2 x IBL ‘Moving Weather’ MSS
2 x ‘DART’ FTP/ADL Servers DMZ partitions according to partners/collaborators/customers
MS Exchange Servers + IronPort Gateways
XAML/OpenAM Authentication servers (was OpenSSO)
Virtualised server farm
Serious Mass storage – 17PB
IT Halls – 8MW cooling, 6MW Generators, 2.5MW load, 200KW Photovoltaic

32. OpenWIS Open Source Geonetwork (Catalogue)
Licence compatibility with Open AM licence
Use with or without modifications
More secure, more scalable
DWD used OAI-PMH Java API
Open SSO / Open AM (Security)
Licence
Interfaces definition
Middleware with standards based interfaces
Postgres D/B
Possibility to add different software
© Crown copyright Met Office

33. GTS Link with NOAA-TOC Washington
Increase in binary traffic (GRIB/T4) due to the large amount of synoptic data now being exchanged in BUFR format (table driven codes – TDC), rather than traditional alphanumeric codes (TAC).
© Crown copyright Met Office 33

34. NMC GTS connectivity from Exeter
Connection
Circuits
Protocol
Infrastructure
Brussels, Belgium
CCT = 2Mbytes IP BW = 2Mbytes
Alphanumeric, GRIB & T4
FTP
RMDCN
Montreal, Canada
CCT = 64Kbytes IP BW = 64Kbytes
All data
IP Sockets / FTP
Frame Relay / Internet backup
Copenhagen, Denmark
CCT = 10Mbytes IP BW = 5Mbytes
Alphanumeric & T4
IP sockets
Reykjavik, Iceland
Dublin, Ireland
De Bilt, Netherlands
IP Sockets
Oslo, Norway
Lisbon, Portugal
Madrid, Spain
IP Sockets & FTP
ECMWF, United Kingdom
CCT = 40Mbytes IP BW = 40Mbytes
Megastream
Montreal circuit currently being migrated to the RMDCN.
© Crown copyright Met Office 34

35. NMC GTS MSS daily traffic
Messages in
Files in
Messages out
Files out
Volume in (Mbytes)
Volume out (Mbytes)
Brussels, Belgium
1190
778
9779
1971 10 57
Montreal, Canada
1646
400
93677
2692 2
657
Copenhagen, Denmark
1605
n/a
56322 11 89
Reykjavik, Iceland
226
221
17796
1675 8 21
Dublin, Ireland
406
2784
87599
1481
473
125
De Bilt, Netherlands
9747
76296
136
185
Oslo, Norway
3015
55167 78
Lisbon, Portugal
872
301
30165
1261 25 36
Madrid, Spain
2847
25226
3409 4 41
ECMWF, United Kingdom
3022
1355
142054
2378
12068
2965
Total
24576
5839
594081
14867
12739
4254
© Crown copyright Met Office

36. RMDCN daily usage

37. Rest of day, other line!

38. RMDCN daily usage

39. RMDCN weekly usage

40. Dart FTP AFD Server Traffic