[c-nsp] Port-channel weirdness VSS

Koen k.vdh at solcon.nl
Tue Apr 13 06:09:36 EDT 2010


Hi,

We seem to have a issue with port-channel load-balancing between two
of our VSS instances. On both VSS sides we configured 8
interfaces to 1 port-channel.

At some point we see packetloss between servers connected to both VSS
instances when we put production traffic on it.

We have 4 physical connections connected from switch vss001a to switch
vss002a going through our MPLS core with an x-connect.

The same goes for the vss001b and vss002b.

            PO22
vss001a   VSS001    vss001b
| | | |             | | | |
| | | | x-connects  | | | |
| | | |             | | | |
vss002a   VSS002    vss002b
            PO20

vss001 is running 12.2.33-SXH2a
vss002 is running 12.2.33-SXH5


I read somewhere on the cisco site that VSS doesn't want to send traffic
over the VSL link between the physical switches...

Should we configure 2 port-channels on both VSS instances with 4
member interfaces to solve this?

Thanks in advance,

Koen

----------------8<-----------8<---------------
Detailed Technical information:

VSS001 122-33.SXH2a
-------------------
interface Port-channel22
  no switchport
  ip address 10.32.7.49 255.255.255.252
  no ip redirects
  no ip unreachables
  no ip proxy-arp
  ip accounting access-violations

# all the members have the same configuration
interface GigabitEthernet1/4/39
  no switchport
  no ip address
  speed 1000
  duplex full
  no cdp enable
  spanning-tree portfast
  channel-protocol lacp
  channel-group 22 mode active


vss001#sh etherchannel 22 detail
Group state = L3
Ports: 8   Maxports = 16
Port-channels: 1 Max Port-channels = 16
Protocol:   LACP
Minimum Links: 0
         Ports in the group:
         -------------------
Port: Gi1/4/39
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 3           Load = 0x44        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/4/39  SA      bndl      32768         0x16      0x16    0x1428      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/4/39  SA      bndl      32768         0x0       0x14     0x1902
0x3D

Age of the port in the current state: 3d:22h:22m:49s

Port: Gi1/4/40
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 0           Load = 0x03        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/4/40  SA      bndl      32768         0x16      0x16    0x1429      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/4/40  SA      bndl      32768         0x0       0x14     0x1903
0x3D

Age of the port in the current state: 3d:22h:22m:49s

Port: Gi1/4/41
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 2           Load = 0x88        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/4/41  SA      bndl      32768         0x16      0x16    0x142A      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/4/41  SA      bndl      32768         0x0       0x14     0x1904
0x3D

Age of the port in the current state: 3d:22h:22m:49s

Port: Gi1/4/42
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 1           Load = 0x30        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/4/42  SA      bndl      32768         0x16      0x16    0x142B      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/4/42  SA      bndl      32768         0x0       0x14     0x1905
0x3D

Age of the port in the current state: 3d:22h:22m:49s

Port: Gi2/4/39
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 4           Load = 0x60        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/4/39  SA      bndl      32768         0x16      0x16    0x2428      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/4/39  SA      bndl      32768         0x0       0x14     0x2902
0x3D

Age of the port in the current state: 0d:17h:11m:03s

Port: Gi2/4/40
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 5           Load = 0x11        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/4/40  SA      bndl      32768         0x16      0x16    0x2429      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/4/40  SA      bndl      32768         0x0       0x14     0x2903
0x3D

Age of the port in the current state: 0d:17h:05m:46s

Port: Gi2/4/41
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 7           Load = 0x0A        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/4/41  SA      bndl      32768         0x16      0x16    0x242A      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/4/41  SA      bndl      32768         0x0       0x14     0x2904
0x3D

Age of the port in the current state: 0d:17h:05m:43s

Port: Gi2/4/42
------------

Port state    = Up Mstr In-Bndl
Channel group = 22          Mode = Active      Gcchange = -
Port-channel  = Po22        GC   =   -         Pseudo port-channel = Po22
Port index    = 6           Load = 0x84        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/4/42  SA      bndl      32768         0x16      0x16    0x242B      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/4/42  SA      bndl      32768         0x0       0x14     0x2905
0x3D

Age of the port in the current state: 0d:17h:11m:15s

                 Port-channels in the group:
         ----------------------

Port-channel: Po22    (Primary Aggregator)

------------

Age of the Port-channel   = 3d:22h:24m:19s
Logical slot/port   = 14/5          Number of ports = 8
HotStandBy port = null
Passive port list   = Gi1/4/39 Gi1/4/40 Gi1/4/41 Gi1/4/42 Gi2/4/39 Gi2/4/40
Gi2/4/41 Gi2/4/42
Port state          = Port-channel L3-Ag Ag-Inuse
Protocol            =   LACP
Fast-switchover     = disabled

Ports in the Port-channel:

Index   Load   Port     EC state        No of bits
------+------+------+------------------+-----------
   3     44     Gi1/4/39 Active    2
   0     03     Gi1/4/40 Active    2
   2     88     Gi1/4/41 Active    2
   1     30     Gi1/4/42 Active    2
   4     60     Gi2/4/39 Active    2
   5     11     Gi2/4/40 Active    2
   7     0A     Gi2/4/41 Active    2
   6     84     Gi2/4/42 Active    2

Time since last port bundled:    0d:17h:05m:44s    Gi2/4/41
Time since last port Un-bundled: 0d:17h:05m:50s    Gi2/4/41

Last applied Hash Distribution Algorithm: Adaptive


VSS002 122-33.SXH5
------------------
interface Port-channel20
  no switchport
  ip address 10.32.7.50 255.255.255.252
  no ip redirects
  no ip unreachables
  no ip proxy-arp
  ip accounting access-violations

# all the members have the same configuration
interface GigabitEthernet1/9/1
  no switchport
  no ip address
  speed 1000
  duplex full
  no cdp enable
  spanning-tree portfast
  channel-protocol lacp
  channel-group 20 mode active


vss002#show etherchannel 20 detail
Group state = L3
Ports: 8   Maxports = 16
Port-channels: 1 Max Port-channels = 16
Protocol:   LACP
Minimum Links: 0
         Ports in the group:
         -------------------
Port: Gi1/9/1
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 3           Load = 0x11        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/9/1   SA      bndl      32768         0x14      0x14    0x1902      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/9/1   SA      bndl      32768         0x0       0x16     0x1428
0x3D

Age of the port in the current state: 3d:22h:19m:43s

Port: Gi1/9/2
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 0           Load = 0x22        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/9/2   SA      bndl      32768         0x14      0x14    0x1903      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/9/2   SA      bndl      32768         0x0       0x16     0x1429
0x3D

Age of the port in the current state: 3d:22h:19m:52s

Port: Gi1/9/3
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 2           Load = 0x44        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/9/3   SA      bndl      32768         0x14      0x14    0x1904      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/9/3   SA      bndl      32768         0x0       0x16     0x142A
0x3D

Age of the port in the current state: 3d:22h:19m:50s

Port: Gi1/9/4
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 1           Load = 0x88        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi1/9/4   SA      bndl      32768         0x14      0x14    0x1905      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi1/9/4   SA      bndl      32768         0x0       0x16     0x142B
0x3D

Age of the port in the current state: 3d:22h:19m:52s

Port: Gi2/9/1
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 7           Load = 0x11        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/9/1   SA      bndl      32768         0x14      0x14    0x2902      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/9/1   SA      bndl      32768         0x0       0x16     0x2428
0x3D

Age of the port in the current state: 0d:17h:08m:06s

Port: Gi2/9/2
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 4           Load = 0x22        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/9/2   SA      bndl      32768         0x14      0x14    0x2903      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/9/2   SA      bndl      32768         0x0       0x16     0x2429
0x3D

Age of the port in the current state: 0d:17h:02m:52s

Port: Gi2/9/3
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 5           Load = 0x44        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/9/3   SA      bndl      32768         0x14      0x14    0x2904      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/9/3   SA      bndl      32768         0x0       0x16     0x242A
0x3D

Age of the port in the current state: 0d:17h:02m:47s

Port: Gi2/9/4
------------

Port state    = Up Mstr In-Bndl
Channel group = 20          Mode = Active      Gcchange = -
Port-channel  = Po20        GC   =   -         Pseudo port-channel = Po20
Port index    = 6           Load = 0x88        Protocol =   LACP

Flags:  S - Device is sending Slow LACPDUs   F - Device is sending fast
LACPDUs.
         A - Device is in active mode.        P - Device is in passive mode.

Local information:
                             LACP port     Admin     Oper    Port 
  Port
Port      Flags   State     Priority      Key       Key     Number
State
Gi2/9/4   SA      bndl      32768         0x14      0x14    0x2905      0x3D

Partner's information:

           Partner Partner   LACP Partner  Partner   Partner  Partner
Partner
Port      Flags   State     Port Priority Admin Key Oper Key Port Number
Port State
Gi2/9/4   SA      bndl      32768         0x0       0x16     0x242B
0x3D

Age of the port in the current state: 0d:17h:08m:18s

                 Port-channels in the group:
         ----------------------

Port-channel: Po20    (Primary Aggregator)

------------

Age of the Port-channel   = 13d:21h:35m:38s
Logical slot/port   = 14/5          Number of ports = 8
HotStandBy port = null
Passive port list   = Gi1/9/1 Gi1/9/2 Gi1/9/3 Gi1/9/4 Gi2/9/1 Gi2/9/2
Gi2/9/3 Gi2/9/4
Port state          = Port-channel L3-Ag Ag-Inuse
Protocol            =   LACP
Fast-switchover     = disabled
Load share deferral = disabled

Ports in the Port-channel:

Index   Load   Port     EC state        No of bits
------+------+------+------------------+-----------
   3     11     Gi1/9/1  Active    2
   0     22     Gi1/9/2  Active    2
   2     44     Gi1/9/3  Active    2
   1     88     Gi1/9/4  Active    2
   7     11     Gi2/9/1  Active    2
   4     22     Gi2/9/2  Active    2
   5     44     Gi2/9/3  Active    2
   6     88     Gi2/9/4  Active    2

Time since last port bundled:    0d:17h:02m:49s    Gi2/9/3
Time since last port Un-bundled: 0d:17h:02m:51s    Gi2/9/3

Last applied Hash Distribution Algorithm: Fixed


More information about the cisco-nsp mailing list