1. Network Upgrades {50.02.10.08} Networks Projects Briefing 12/17/03 Phil DeMar; Donna Lamore Data Comm. Group Leaders

2. Perimeter Protection Upgrade Project {50.02.10.08.02} Pilot project firewalled on FCC3 LAN continues:  Select TD desktops (6-8) to be added to pilot:  Expect TD to request to move IC area LAN behind firewall after experiences w/ pilot Yellow/green zone planning in hibernating phase:  It will resume w/ significant effort after DHCP Registration project is in production  Targeting some macro-level (Div/Section) yellow zone deployment this FY  Openness of yellow/green zone boundary still a major issue

3. Core Network Upgrades {50.02.10.08.04} FY03 upgrades:  FCC Hub & FCC2 server 6509s upgraded to Sup720Gs:  1000B-T available on FCC2  New border router in place but not in production yet:  New platform; need to verify NetFlow collection, etc  Existing border router will assume redundancy role Planned FY04 upgrades:  10 Gigabit ethernet support for FCC core routers:  Expect StarLight infrastructure to sharply increase traffic levels  WH core router upgraded to Sup720 & 10GE  DNS servers migrated to Linux w/ disk mirroring

4. High Density Computing Facility Project {50.02.10.08.05} Fiber infrastructure planning:  A high number of FCC-to-WBL s/m fibers is planned  Contracting a manhole survey for path/duct availability  Fiber to additional FT areas may be added on:  More s/m fiber to New Muon  Replace last remaining bit of coax (PS6 – PAB) with m/m fiber Internal cabling within HDCF:  Investigating feasibility of structured cabling to central pt versus distributed switches

5. HDCF Project (cont) Network device planning for HDCF:  CDF, D0, & CMS work groups to be extended to HDCF:  Dedicated switches for CDF, D0, CMS HDCF systems  10GE links will be the default back to CDF, D0, CMS FCC LANs  Systems will not have to be readdressed  A general use switch will be provided for other systems:  Will be a separate, new subnet  Requires readdressing of other  Size of general switch dependent on # of systems moving…

6. Esnet Link Upgrade Project {50.02.10.08.06} Planning based on receiving an OC48 upgrade later this year:  New 10 gigabit-capable DMZ switch needed at some pt  10 GE interfaces for the border router as well  Aggregating 1 GE links a possible short term patch Preliminary discussions w/ ESnet on deploying ESnet-supported Chicago area MAN:  Alternate upgrade path for our ESnet connectivity  Dependent on sharing StarLight fiber w/ ESnet

7. ESnet MAN optical ring, production service T320 ESnet provisioned point-to- point circuits via λs Site gateway router one optical fiber pair M10 telecom local loop site equip. Transitional only Site gateway router M10 site equip. Qwest hub Monitor host Secure terminal server ESnet mgmt. domain telecom local loop site equip. ESnet provisioned point-to- point circuits via MPLS Ethernet switch Router DWDM terminal ESnet MAN Architecture

8. WH FTTD Project {50.02.10.08.07} General model:  Replace pillar hubs (particularly 10Mb/s hubs) with fiber to the desktop  Cost estimate is ~$300/office (not counting switch ports)  Try to do four tower/floors per year ( at ~$10k per…)  Hope to avoid one-of upgrades to 100Mb/s or higher… CD/EAG WH offices targeted in FY03:  WH9W done; WH8E & WH6E will be completed soon  WH7W needs addtl fiber to complete  WH9X (CMS) left for later

9. WH FTTD Project (cont) PeopleSoft network access protection project:  CSPP Review: Move sensitive PeopleSoft systems off of shared LANs:  Requires dedicated switch ports for certain WH5W, WH8W, WH15 offices  Putting in FTTD connections to 6 WH5W & 2 WH8W offices:  Expect to be completed by end-of-year  More to follow?

10. Small Network Upgrade Projects {50.02.10.08.08} MINOS Near end LAN:  Temporary MINOS LAN established in New MUON  Design completed & switch ordered for production network in MINOS Hall General site switch upgrades:  FT area aggregation switch upgrade in progress:  All remaining 10Mb/s FT locations being upgraded to 100Mb/s  Planning on upgrading Village & Site 38/39 aggregation switches in FY04 FT farms being upgraded to 1000B-T capability

11. Small Network Upgrade Projects (cont) Network Management LAN created in FCC & WH:  Isolates access to core network devices/servers  Will investigate in this FY extending it to reach remote network devices via VLAN Monitoring of network services implemented:  Verifies network service application is working  DNS, DHCP, & NTP WH wireless LAN access points migrated to dedicated switch ports:  Conference rooms are next

12. CDF Network Upgrades {50.02.10.08.09} FY03 FCC upgrades:  Catalyst 6509 for CAF phase III  1000B-T for worker nodes  720 Gb/s fabric for CAS switch  720 Gb/s fabric for FCC1 CAF  Installation set for Thursday…  10 Gigabit CAS  CAF links FY03 Off-line upgrade:  6513 chassis replaced 6509  256Gb/s supervisor w/ routing

13. CDF Network Upgrades (cont.) FY04 plans (under way):  6509 for FY04 CAF nodes under procurement  720 Gb/s switch fabric; all 10/100/1000B-T; 10GE uplink  Initial deployment at New Muon, w/ later migration to HDCF  On-line event collector 6509 ordered & due this week  Installation expected to be completed within 30 days  On-line switch upgrades under procurement:  Sup720 and one 48-port 10/100/1000B-T module  Reconstruction farm switch upgrade also under way:  Sup720 and one 48-port 10/100/1000B-T module

14. CDF Network Upgrades (cont.) FY04 plans (not active at this time) :  Upgrade off-line network core switch:  720Gb/s switch fabric  1000B-T/1000B-SX support in portacamps areas  Separate LAN for wireless

15. D0 Network Upgrades {50.02.10.08.10} FY03 FCC upgrades:  FCC1 CAB farm consolidated on CAS (new 6513 chassis)  Old FCC1 CAB 6509 moved to FCC2 for CAB expansion:  1000B-T ports for new nodes  720Gb/s switch fabric FY03 Off-line upgrade:  720Gb/s switch fabric  Waiting to do installation  1000B-T ports for DAB

16. D0 Network Upgrades (cont.) FY04 plans (not active at this time) :  720 Gb/s supervisor for D0 CAS switch (FCC1)  Additional switch(es) for CAB & recon farm expansion  10GE links between FCC1 CAS, FCC2 CAB, and HDCF  Completion of last phase of DAB FTTD project:  Need additional fiber installed  Introduction of 1000B-T support in D0 area

17. CMS Network Upgrades {50.02.10.08.11} FY03 network upgrade completed:  Designed around (4) 24-port 10/100/1000 switches w/ two server & 22 worker nodes each;  Stackable backplane makes them act as a virtual big switch  Uplink is aggregation of 4 gigabit ethernet links EthCh: 4x1 =4Gbps 1 - 24 25 - 49 C3750 50 - 74 74 - 98 C3750 X6816-GBIC or X6516-GBIC X6516-GBIC 1000BaseX SUP720 X6516-GBIC 1000BaseX X6548-RJ21 10/100BaseTX CMS FCC1 6509

18. CMS Network Upgrades (cont.) Network model based on computing cells with server/worker traffic local to each small switch  Concerns about:  Effective uplink aggregation beyond 4 x 1Gb/s  High data volume traffic movement (no 10GE capability, at present) FY04 plans:  Waiting on CMS specifications on FY04 needs