Fermilab T1 infrastructure D. Petravick LHC OPN Meeting CASPUR, April 4, 2006

D Petravick - CASPUR LHC OPN Meeting Current FermiLight Path Mission: R&D, overflow Terminates in 6506 2ea 10 gigabit 2 ea 1 gigabit Used for > 13 projects, including R2, CMS to date 4/4/06 D Petravick - CASPUR LHC OPN Meeting

DOE Presence at Starlight Fermilab has a dark fiber to starlight. Argonne has iWire fiber to starlight. FNAL and ANL proposed Chicago MAN. Physically, contractually independent fibers Acquire fiber FNAL<->ANL Light w/ CIENA equipment Provision lambdas to ESNET Retain existing capabilities. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

D Petravick - CASPUR LHC OPN Meeting MAN overview (FNAL) IDEA: FNAL and ANL provision lambdas to the MAN. FNAL, ANL control a ring of fiber to Starlight FNAL, light point to point paths Not a protected loop BGP provides failover. No breakout at peer lab Also, Spur to the NBC building where QWEST is. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Optical infrastructure CIENA metro Fermi Light path iWire Expand w/ 4200’s to provision ESNET MAN Status: Evaluated Requisition, formal installation pending. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

D Petravick - CASPUR LHC OPN Meeting Production (routed) ESNET will furnish 10 gig link to NBC building dedicated to FNAL MAN will provide redundant paths to FNAL Can see the end of the commercially provided 0.622 gb link. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Proposed OPN provisioning ESNET SDN will carry the OPN from FNAL to USLHCNET at Starlight. Fermilab proposes 10 Gb dedicated provisioning ESNET proposes that SDN will be MPLS, inside, present vlan to USLHCNET, FNAL internal infrastructure. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Other CMS provisioning FNAL proposes Additional 10 Gig channels from FNAL over SDN ESNET will make any reasonable connections to MAN 6509. For any party transferring w/FNAL 4/4/06 D Petravick - CASPUR LHC OPN Meeting

FNAL operational role in ESNET MAN Monitoring the channels at Layer 1 MAN operation is joint ANL/FNAL, organization is pending. Initially FNAL 24x7 support is available +1-630-840-2345 Support will evolve Traffic at our (extended) border, w/ usual support for wide systems. n.b. FNAL “research” links are independent of ESNET, and are still there. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Networking within FNAL Computer Security Campus Network Engineering. 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Computer Security Policy History of firewalls and performance is problematic. New CSPP does not not require firewalls, and allows for bypass if present Passed scrutiny by outside experts -- “DOE site assist visit” FNAL supplies Compensatory Controls in its security infrastructure -- automated scanning, blocking, etc. Figure illustrates pattern 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Campus Network Engineering CMS fits into the same general pattern as other large computing workgroups. Competent networking makes the two main locations for computing transparent. 30 gig workgroup connectivity is being extended. Alternate paths available for data intensive flows. 4/4/06 D Petravick - CASPUR LHC OPN Meeting