1. Fermilab T1 infrastructure
D. Petravick
LHC OPN Meeting
CASPUR, April 4, 2006

2. D Petravick - CASPUR LHC OPN Meeting
Current
FermiLight Path
Mission:
R&D, overflow
Terminates in 6506
2ea 10 gigabit
2 ea 1 gigabit
Used for > 13 projects, including R2, CMS to date
4/4/06
D Petravick - CASPUR LHC OPN Meeting

3. DOE Presence at Starlight
Fermilab has a dark fiber to starlight.
Argonne has iWire fiber to starlight.
FNAL and ANL proposed Chicago MAN.
Physically, contractually independent fibers
Acquire fiber FNAL<->ANL
Light w/ CIENA equipment
Provision lambdas to ESNET
Retain existing capabilities.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

4. D Petravick - CASPUR LHC OPN Meeting
MAN overview (FNAL)
IDEA: FNAL and ANL provision lambdas to the MAN.
FNAL, ANL control a ring of fiber to Starlight
FNAL, light point to point paths
Not a protected loop
BGP provides failover.
No breakout at peer lab
Also, Spur to the NBC building where QWEST is.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

5. Optical infrastructure
CIENA metro
Fermi Light path
iWire
Expand w/ 4200’s to provision ESNET MAN
Status:
Evaluated
Requisition, formal installation pending.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

6. D Petravick - CASPUR LHC OPN Meeting
Production (routed)
ESNET will furnish 10 gig link to NBC building dedicated to FNAL
MAN will provide redundant paths to FNAL
Can see the end of the commercially provided gb link.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

7. Proposed OPN provisioning
ESNET SDN will carry the OPN from FNAL to USLHCNET at Starlight.
Fermilab proposes 10 Gb dedicated provisioning
ESNET proposes that SDN will be MPLS, inside, present vlan to USLHCNET, FNAL internal infrastructure.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

8. Other CMS provisioning
FNAL proposes Additional 10 Gig channels from FNAL over SDN
ESNET will make any reasonable connections to MAN 6509.
For any party transferring w/FNAL
4/4/06
D Petravick - CASPUR LHC OPN Meeting

9. FNAL operational role in ESNET MAN
Monitoring the channels at Layer 1
MAN operation is joint ANL/FNAL,
organization is pending.
Initially FNAL 24x7 support is available
Support will evolve
Traffic at our (extended) border, w/ usual support for wide systems.
n.b. FNAL “research” links are independent of ESNET, and are still there.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

10. Networking within FNAL
Computer Security
Campus Network Engineering.
4/4/06
D Petravick - CASPUR LHC OPN Meeting

11. Computer Security Policy
History of firewalls and performance is problematic.
New CSPP does not not require firewalls, and allows for bypass if present
Passed scrutiny by outside experts -- “DOE site assist visit”
FNAL supplies Compensatory Controls in its security infrastructure -- automated scanning, blocking, etc.
Figure illustrates pattern
4/4/06
D Petravick - CASPUR LHC OPN Meeting

12. Campus Network Engineering
CMS fits into the same general pattern as other large computing workgroups.
Competent networking makes the two main locations for computing transparent.
30 gig workgroup connectivity is being extended.
Alternate paths available for data intensive flows.
4/4/06
D Petravick - CASPUR LHC OPN Meeting