Storage connected to optical fiber switch

Storage systems connect to optical fiber switches using Fibre Channel (FC) SANs, enabling high-speed, low-latency communication with redundancy and scalability.

Fibre Channel Switches and SAN Topology

A Fibre Channel switch is a network device that forms the core of a SAN, allowing multiple storage devices and servers to communicate over optical fiber cables . Switches can be deployed individually or in multi-switch fabrics, providing zoning, device lookup, and redundancy. High-end switches, called Fibre Channel Directors, offer large port counts and high availability for backbone SAN infrastructure . SANs typically use a switched-fabric topology, where each storage system and server connects to one or more switches. This topology allows multiple paths between hosts and storage, improving performance and fault tolerance .

Optical Fiber Connections

Storage systems connect to FC switches using optical fiber cables, which come in three main types:

• Shortwave multimode (OM2) – orange cables, suitable for distances up to 125 meters at 16 Gb/s .
• Laser-optimized multimode (OM3/OM4) – aqua cables, supporting higher speeds and longer distances.
• Single-mode (longwave) – yellow cables, supporting distances up to 10 km at 16–32 Gb/s . The choice of cable depends on the adapter speed, distance, and network design.

Redundancy and Multipathing

For reliability, servers and storage systems often have dual Host Bus Adapters (HBAs) connected to separate fabrics (Fabric A and Fabric B). Each fabric has its own set of switches, and zoning is configured per fabric to control access between hosts and storage controllers . This ensures that if one fabric fails, the other maintains connectivity.

Switch Features and Management

Modern FC switches, such as the Cisco MDS 9124V, provide:

• High-speed 64-Gbps ports for all-flash arrays and high-performance hosts.
• Automatic zoning and nonblocking forwarding.
• Support for NVMe/FC workloads without hardware upgrades.
• Advanced diagnostics, inter-switch link (ISL) monitoring, and link-level error correction . Switches can be stacked or interconnected via dedicated high-speed ports to scale the SAN while maintaining low latency and high throughput .

Summary

Connecting storage to an optical fiber switch involves:

1. Using Fibre Channel adapters on storage and servers.
2. Selecting appropriate optical fiber cables based on speed and distance.
3. Deploying redundant fabrics for high availability.
4. Configuring zoning and multipathing to control access and ensure failover.
5. Leveraging modern FC switch features for performance, scalability, and diagnostics. This setup provides a high-performance, scalable, and resilient SAN suitable for enterprise storage environments.