Data centre network map A FibreFab Partner Resource

DATA CENTRE TOPOLOGY introduction This presentation is to support our Partners gain a solid, basic understanding of the design and layout of a data centre FibreFab have the products and solutions required to support the needs for ever increasing speeds, port density and physical layer complexity for the data centre with Optronics Ultra High Density (UHD solutions), multi-fibre assemblies, and parallel optic solutions

BASIC DATA CENTRE TOPOLOGY

GENERIC ARCHITECTURE ISO/IEC 24764 ENI ENI ENI External Network Interface MD Main Distribution ID Intermediate Distribution ZD Zone Distribution LDP Local Distribution Point EO Equipment Outlet Backbone Cabling Horizontal Cabling MD MD ID ID ZD ZD LDP LDP EO EO EO EO EO

TIA-942-A DATA CENTRE TOPOLOGY LEGEND

DATA CENTRE SPACES DIAGRAM

DISTRIBUTORS AND CROSS CONNECTS ANSI/TIA-942-A (942-B DRAFT) CENELEC EN 50173-5 ISO/IEC 24764 DESCRIPTION ENI (in the ENTRANCE ROOM) ENI The entrance room may include both access provider and customer-owned cabling. This space may include the access provider demarcation hardware and access provider equipment and the location where conversion takes place between cabling that is suitable for outside plant applications and cabling that is suitable for premises (i.e., inside plant) applications. The entrance room interfaces with the data center through the MDA. However, direct connections from intermediate distribution areas (IDAs) or horizontal distribution areas (HDAs) to the entrance rooms are permitted to avoid exceeding circuit distance limitations. The entrance room may be adjacent to or combined with the MDA. MC (in the MDA) MD The MDA includes the main cross-connect (MC), which is the central point of distribution for the data center structured cabling system. Equipment typically located in the MDA includes: Core routers, Core, spine, or interconnection layer LAN/SAN switches, High-performance computing switches, PBX or voice gateways, T-3 (M13) multiplexers IC (in the IDA) ID The intermediate distribution area (IDA) is the space that supports the intermediate cross-connect. It may be used to provide a second level cabling subsystem in data centers too large to be accommodated with only MDAs and HDAs. The IDA is optional and may include active equipment such as LAN/SAN switches. HC (in the HDA) ZD The HDA is used to serve equipment not supported by a horizontal cross-connect (HC) or zone distributor (ZD) in an IDA or MDA. The I-IDA is the distribution point for cabling to the EDAs. Equipment typically located in the HDA includes: LAN/SAN/KVM switches. This equipment is used to provide network connectivity to the end equipment located in the EDAs. A small data center may not require any HDAs as the entire data center may be able to be supported from the MDA. A typical data center will have several HDAs. Zone Outlet or Consolidation Point (in the ZDA) LDP The ZDA is an optional interconnection point within the horizontal cabling located between the HDA and the EDA to allow frequent reconfiguration and added flexibility. Horizontal cabling shall contain no more than one ZDA between the HC in the HDA and the mechanical termination in the EDA. EO (in the EDA) EO The EDA is the space allocated for end equipment, including all forms of telecommunications equipment (e.g., computer equipment, telephony equipment).

ENTRANCE ROOM (ENI) The entrance room is the location for access provider equipment, demarcation points and interface with other campus locations. It typically houses telecommunications access provider equipment and is the location where access providers typically hand off circuits to the customer. This hand-off point is called the demarcation point. It is where the telecommunications access provider’s responsibility for the circuit typically ends and the customer’s responsibility for the circuit begins. The entrance room will house entrance pathways, protector blocks for balanced twisted-pair entrance cables, termination equipment for access provider cables, access provider equipment, and termination equipment for cabling to the computer room.

MAIN DISTRIBUTION AREA (MD/MC) The main distribution area (MDA) is located within the computer room and includes the main cross-connect (MC), which is the central point of distribution for the structured cabling system in the data center. Every data center shall have at least one MDA. Equipment typically located in the MDA includes: Core routers Core, spine, or interconnection layer LAN and SAN switches High-performance computing switches PBX or voice gateways T-3 (M13) multiplexers The MDA may serve one or more IDAs, HDAs, and EDAs within the data center and one or more telecommunications rooms (TRs) located outside the computer room space to support office spaces, operations center, and other external support rooms. The MDA may include a horizontal cross-connect (TIA) or zone distributor (ISO/CENELEC) when equipment areas are served directly from the MDA.

MEET ME ROOM (MMR/MD) A "meet-me room" (MMR) is a place within a colocation centre (or carrier hotel) where service providers can physically connect to one another and exchange data without incurring local loop fees. An Internet Exchange Point can also be present in a meet-me room to allow many organizations in the MMR to interchange traffic without having to make physical interconnections between every possible pair of organizations. Services provided across connections in an MMR may be voice circuits, data circuits, or Internet protocol traffic. To interconnect, companies order a patch from their cage or suite to the MMR, and then arrange for the organization running the facility to connect them together. These physical connections may be an optical fiber cable, coaxial cable, twisted pair, or any other networking medium.

INTERMEDIATE DISTRIBUTION AREA (ID/IC) The intermediate distribution area (IDA) includes the intermediate cross-connect (IC/ID) and It may be used to provide a second level of backbone cabling subsystem in data centers too large to be accommodated with only MDAs) and HDAs. The IDA is optional and may include active equipment such as LAN and SAN switches The IDA may include the horizontal cross-connect (TIA) or zone distributor (ISO/CENELEC) for equipment areas served directly from the IDA.

HORIZONTAL DISTRIBUTION AREA (ZD/HC) The horizontal distribution area (HDA) is the space that supports cabling to the EDAs. The HDA houses cross-connects and active equipment (switches) for connecting to the equipment distribution area and storage area network (SAN). The LAN, SAN, console, and KVM switches that support the end equipment are also typically located in the HDA. The MDA may serve as a HDA for nearby equipment or for the entire computer room. There should be a minimum of one horizontal cross-connect (HC) per floor. The HC may be in a HDA, IDA, or MDA. Additional HDAs may be required to support equipment beyond the horizontal cable length limitation.

ZONE DISTRIBUTION AREA (LDP/CP) The ZDA is an optional interconnection point within the horizontal cabling located between the HDA and the EDA to allow frequent reconfiguration and added flexibility. Cross-connection shall not be used in the ZDA. No more than one ZDA shall be used within the same horizontal cable run. There shall be no active equipment in the ZDA. Coaxial or twisted-pair connections in a ZDA should be limited to 288 to avoid cable congestion, particularly for enclosures meant to be placed overhead or under 2 ft. x 2 ft. (or 600 mm x 600 mm) access floor tiles.

EQUIPMENT DISTRIBUTION AREAS The EDA is where equipment enclosures and racks house the servers and where the horizontal cabling from the HDA is terminated at patch panels. EDA areas shall not serve the purposes of an entrance room, MDA, IDA, or HDA. Horizontal cables are terminated in EDAs on equipment outlets. Point-to-point cabling is permitted between equipment located in the EDA. Cable lengths for point-to-point cabling between equipment in the EDA should be no greater than 10 m (33 ft) and should be between equipment in adjacent racks or cabinets in the same row. This point-to-point cabling should be routed in cable management or accessible pathways, and not interfere with fixed cabling. Where point to point cabling is used between cabinets, each end of a cable shall be labeled with a permanent label. When point to point cables are no longer used, the cables shall be removed.

TELECOMMUNICATIONS ROOM (TR) Connected to the Data Center MDA through backbone cabling, TRs are spaces for housing equipment, cable terminations and cross connects that serve office areas on specific floors. In addition to voice, data, and wireless systems, TRs can house equipment for life safety/fire systems, security, and building automation systems. In data centers, the TR is a space that supports cabling to areas outside the computer room. The TR is normally located outside the computer room but, if necessary, it can be combined with a MDA, IDA, or HDA. The data center may support more than one TR if the areas to be served cannot be supported from a single TR.

APPENDIX

BACKBONE CABLING The backbone cabling within the Data Center provides the critical connections between the entrance room, MDA, IDA and HDA. Recognized Backbone Cabling Media 100-ohm balanced twisted-pair cable (ANSI/TIA-568.2-D) with category 6A or higher recommended 850 nm Laser-Optimized 50/125 um multimode fiber cable OM3 or OM4 (ANSI/TIA-568.3-D), with OM4 recommended Single-mode optical fiber cable (ANSI/TIA-568.3-D) 75-ohm (734 and 735 type) coaxial

HORIZONTAL CABLING The horizontal cabling within the Data Center provides the connection between the HDA and EDA and SAN, including the optional ZDA. Recognized Horizontal Cabling Media 4-pair 100-ohm balanced twisted-pair cable (ANSI/TIA-568.2-D) – category 6, category 6A, or Category 8, with category 6A or higher recommended; 850 nm Laser-Optimized 50/125 um multimode fiber cable OM3 or OM4 (ANSI/TIA-568.3-D), with OM4 recommended; Single-mode optical fiber cable (ANSI/TIA-568.3-D); and 75-ohm (734 and 735 type) coaxial cable (Telcordia Technologies GR-3175) – used for T-1, 1508 T-3, E-1, and E-3 circuits only.

TRADITIONAL SWITCH ARCHITECTURE

LEAF AND SPINE (FAT TREE)

FULL MESH