š Lab Objectives
- Understand Spine-Leaf architecture design principles
- Identify spine layer and leaf layer components and roles
- Design and configure a scalable spine-leaf topology
- Calculate bandwidth capacity using Cisco formulas
- Analyze east-west and north-south traffic flows
- Implement and test leaf-spine interconnections
- Document performance metrics and optimization strategies
šÆ Scenario Overview
Your organization is designing a new data center infrastructure to support :
- High-Performance Computing: Significant east-west traffic workloads
- Cloud Services: Variable bandwidth requirements for virtualization
- Growth Planning: Current 100+ servers scaling to 500+ servers
- Latency Requirements: Sub-millisecond response times for applications
- Scalability: Future expansion without topology redesign
š” Key Concept: Spine-Leaf architecture is the modern standard for data center networks, providing non-blocking fabrics with multiple high-speed paths, enabling efficient server-to-server (east-west) communication .
šļø Spine-Leaf Architecture Overview
Architecture Components
š Spine Layer
Description: High-speed backbone switches or routers forming the core of the fabric
Characteristics:
- Interconnected in full-mesh topology
- Each spine connects to every leaf switch
- Provides high-bandwidth transport
- Does not connect to end devices directly
š Leaf Layer
Description: Switches connecting directly to endpoints (servers, storage, virtualization hosts)
Characteristics:
- Each connects to every spine switch
- Forms the access layer of the fabric
- Provides redundant paths upward
- Enables server connectivity
⨠Advantages of Spine-Leaf Architecture
| Advantage |
Description |
Business Impact |
| Non-Blocking |
Multiple high-speed paths reduce bottlenecks and provide maximum throughput between any two endpoints |
Maximum server-to-server performance |
| Low Latency |
Direct connections between leaf and spine switches provide efficient communication with minimal delay |
Sub-millisecond response times |
| Linear Scalability |
New leaf switches can be added without affecting overall network performance or requiring topology redesign |
Growth without architecture changes |
| East-West Optimized |
Specifically designed for server-to-server communication rather than client-server (north-south) traffic |
Data center efficiency |
| Simplified Ops |
Predictable, symmetric design makes network easier to manage and troubleshoot |
Reduced operational complexity |
| High Redundancy |
Multiple independent paths provide natural fault tolerance and improved security through network segmentation |
Business continuity assurance |
ā ļø Design Considerations
Primary Design Concern: The leading concern for Spine-Leaf architecture is the number of cables and network equipment required to scale the bandwidth. A full-mesh topology between spine and leaf layers requires significant cabling and port density .
Bandwidth Scaling Formula
Switch BW Capacity = (Inter-slot Switching Capacity Ć Number of I/O Slots) + [(Number of SE Modules Ć Inter-slot Switching Capacity) / 2]
Full Duplex Switch BW Capacity = (Switch BW Capacity) Ć 2
š Cisco Data Center Switches for Spine-Leaf
| Switch Series |
Description |
Port Density |
Interface Types |
Best Use |
| Nexus 9500 |
Modular switches with comprehensive line card support |
Scalable 1-400 Gbps |
1G, 10G, 25G, 40G, 50G, 100G, 200G, 400G Ethernet |
Spine layer for large-scale deployments |
| Nexus 9000 |
Operates in Cisco ACI or Cisco NX-OS mode |
48-128 ports |
10G, 25G, 40G, 100G Ethernet |
Spine or leaf layer with ACI fabric capabilities |
| Nexus 7000 |
Designed for top-of-rack deployments |
24-128 ports |
10G, 40G, 100G Ethernet |
Leaf layer connecting servers and storage |
| Nexus 3550 |
Ultra-low latency platform with programmable capabilities |
16-32 ports 400G |
400G Ethernet |
High-speed leaf or spine layer |
š ļø Lab Equipment Setup
| Component |
Quantity |
Specification |
Purpose |
| Spine Switches |
2-4 |
Cisco Nexus 9500 or 9000 Series |
Core fabric layer |
| Leaf Switches |
4-8 |
Cisco Nexus 9000 or 7000 Series |
Access layer for servers |
| Server/Endpoint Connections |
16-64 ports |
Virtual machines or physical servers |
Generate traffic for testing |
| 100G Ethernet Cables |
20-40 |
DAC or optical connections |
Spine-Leaf interconnections |
| 10G/25G Ethernet Cables |
20-40 |
DAC or optical connections |
Server-to-Leaf connections |
š Minimal Lab Topology (Recommended for Learning)
Topology Details :
⢠2 Spine switches providing redundant paths
⢠4 Leaf switches each connecting to both spine switches
⢠Each leaf can support 12-16 server connections
⢠Total potential: 48-64 connected servers
⢠All leaf-to-spine connections are 100Gbps
⢠All server-to-leaf connections are 10Gbps or 25Gbps
āļø Spine-Leaf Configuration Steps
1Phase 1: Physical Setup - Cable Interconnections in Full-Mesh
For a 2-Spine, 4-Leaf topology :
- Connect Spine-1 to all 4 Leaf switches (Ports 1-4)
- Connect Spine-2 to all 4 Leaf switches (Ports 5-8)
- Connect servers to Leaf switches (Ports 1-12 per leaf)
- Verify all cables are properly seated and visible
- Label cables for easy troubleshooting
Connection Pattern:
Spine-1 Eth1 ā Leaf-1 Eth49
Spine-1 Eth2 ā Leaf-2 Eth49
Spine-1 Eth3 ā Leaf-3 Eth49
Spine-1 Eth4 ā Leaf-4 Eth49
(Repeat pattern for Spine-2 on Ethernet 50 of each Leaf)
2Phase 2: Device Configuration - Spine Switches
Configure basic Spine switch parameters:
! Access Spine-1 Console
configure terminal
hostname Spine-1
interface Ethernet 1/1-4
description Leaf-facing ports
no shutdown
exit
exit
! Repeat for Spine-2 with similar configuration
3Phase 2: Device Configuration - Leaf Switches
Configure basic Leaf switch parameters:
! Access Leaf-1 Console
configure terminal
hostname Leaf-1
interface Ethernet 1/49-50
description Spine-facing ports
no shutdown
exit
interface Ethernet 1/1-12
description Server-facing ports
no shutdown
exit
exit
! Repeat for Leaf-2, Leaf-3, and Leaf-4
4Phase 3: Connectivity Verification
Verify all connections are active :
Spine-1# show interface brief
Spine-1# show interface Ethernet 1/1-4 status
Spine-1# show interface Ethernet 1/1-4 transceiver
Expected Output:
- All spine-to-leaf ports should show "up, up" status
- Transceiver information should display correctly
- Errors and drops should be 0
5Phase 4: Bandwidth Calculation
Using Cisco formulas for bandwidth calculation :
Example Calculation for Nexus 9500 Spine:
Inter-slot Switching Capacity = 38.4 Tbps
Number of I/O Slots = 2
Switch BW Capacity = (38.4 Tbps Ć 2) + [(0 Ć 38.4 Tbps) / 2] = 76.8 Tbps
Full Duplex Capacity = 76.8 Tbps Ć 2 = 153.6 Tbps
Lab Calculation Task:
- Calculate total bandwidth available from your configured spine switches
- Calculate per-leaf available bandwidth
- Calculate server-to-server east-west bandwidth capacity
- Document oversubscription ratios
6Phase 5: Traffic Testing
Deploy traffic generation tools to test topology:
- East-West Traffic: Server-to-server communication across leaf switches
- North-South Traffic: Server-to-external network through spine layer
- Measurements: Latency, throughput, packet loss, and convergence time
! Monitor traffic on spine ports
Spine-1# show interface Ethernet 1/1 stats
Spine-1# show interface Ethernet 1/1 counters
š¦ Lab Deliverables & Verification
Required Deliverables
- Deliverable 1 - Spine-Leaf Topology Diagram : Detailed topology diagram showing all components and connections, spine and leaf switch placement and roles, all server connections and address assignments, cable types and interface assignments, traffic flow patterns (east-west and north-south), redundancy paths and failover mechanisms
- Deliverable 2 - Bandwidth Capacity Analysis : Complete bandwidth calculations for topology, switch-level bandwidth calculations using Cisco formulas, per-spine and per-leaf bandwidth availability, east-west traffic capacity between leaf pairs, oversubscription ratio analysis, scalability projections for future expansion
- Deliverable 3 - Configuration Documentation : Complete configuration scripts for all devices, spine switch configurations, leaf switch configurations, interface configurations and naming conventions, redundancy and failover configurations, QoS and traffic prioritization settings
- Deliverable 4 - Performance Testing Results : Comprehensive traffic testing and performance analysis, east-west latency measurements, north-south throughput results, packet loss and error rates, convergence time measurements, comparison to design specifications
- Deliverable 5 - Scaling and Expansion Plan : Documentation of growth strategies, how to add additional leaf switches, bandwidth scaling calculations for expansion, hardware requirements for 500+ server deployment, timeline and resource planning, cost analysis for scaled deployment
ā
Lab Completion Checklist
- ā Understood spine-leaf architecture design principles
- ā Identified spine and leaf layer roles and components
- ā Configured full-mesh spine-to-leaf interconnections
- ā Verified all spine-leaf connections are active and operational
- ā Calculated bandwidth capacity using Cisco formulas
- ā Analyzed east-west traffic flows
- ā Generated and tested traffic patterns
- ā Documented performance metrics and results
- ā Created scaling and expansion strategy
- ā Completed all five deliverables professionally
ā Lab Completion Indicator: You have successfully completed Lab 2.2 when you can design a complete spine-leaf topology, calculate bandwidth capacity, configure all devices, verify connectivity, and understand how the architecture optimizes for east-west data center traffic flows .