Networking-Forums.com

Professional Discussions => Routing and Switching => Topic started by: Seittit on January 30, 2015, 05:53:05 AM

Title: CSR 1000v latency issues
Post by: Seittit on January 30, 2015, 05:53:05 AM
Good morning.

Has anyone else ran into issues with latency on the CSR1000v platforms? Like, REALLY REALLY bad latency?

I have emulated INE's topology with 20 CSR1000v routers within an ESXi hypervisor environment, but packets take several seconds to reach each other. I've added an out-of-band management IP address on an isolated network, but still having the issues. Dr. Google hasn't revealed anyone else experiencing this issues.

Here's router two pinging its peer router 1. These guys are on the same OOB management
R2#ping 192.168.1.1
Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 192.168.1.1, timeout is 2 seconds:
.....
Success rate is 0 percent (0/5)


bumping up the timeout shows how awful the latency is:
R2#ping 192.168.1.1 timeout 2600
Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 192.168.1.1, timeout is 2600 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 2390/5905/9766 ms
R2#


Title: Re: CSR 1000v latency issues
Post by: Seittit on January 30, 2015, 06:00:10 AM
attached: network setup and system resources

it doesn't seem to be an issue with my esx machine nor network utilization.
Title: Re: CSR 1000v latency issues
Post by: Seittit on January 30, 2015, 07:33:23 AM
amazing, a reboot of the routers solved everything.

R2#ping 192.168.1.1
Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 192.168.1.1, timeout is 2 seconds:
.!!!!
Success rate is 80 percent (4/5), round-trip min/avg/max = 3/3/4 ms
R2#ping 192.168.1.1
Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 192.168.1.1, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 3/3/4 ms
Title: Re: CSR 1000v latency issues
Post by: icecream-guy on January 30, 2015, 08:13:16 AM
They were sleeping and you woke them up  :rofl:


remember, if at first you don't succeed, reboot.
Title: Re: CSR 1000v latency issues
Post by: deanwebb on January 30, 2015, 12:13:49 PM
I need a "have you tried turning it off and on again" smiley. I'd add it now, but I'm about to head out to lunch.
Title: Re: CSR 1000v latency issues
Post by: that1guy15 on January 30, 2015, 12:55:47 PM
Odd, no havent seen that one. But I do reboot about once every few weeks. Also make sure you dont boot too many at once as the they are pretty sensitive about CPU load. To be safe I boot 3 at a time with 5 minutes in between.
Title: Re: CSR 1000v latency issues
Post by: Seittit on January 30, 2015, 02:51:43 PM
Quote from: that1guy15 on January 30, 2015, 12:55:47 PM
Also make sure you dont boot too many at once as the they are pretty sensitive about CPU load. To be safe I boot 3 at a time with 5 minutes in between.

Good call, I gave my whitebox a mini-heart attack earlier :D
Title: Re: CSR 1000v latency issues
Post by: that1guy15 on January 30, 2015, 04:21:19 PM
Also make sure you are running the current recommended code. Some of the older code revs are not too stable and have a ton of issues.

Im currently running Version 15.4(3)S1
Title: Re: CSR 1000v latency issues
Post by: wintermute000 on January 30, 2015, 04:28:12 PM
PowerCLI, use a delay interval.... problem solved.

Connect-VIServer -Server 192.168.0.15 -User xxxx\xxxx -Password xxxx
Start-VM -VM SP-LAB-P1
sleep XYZ
!!! repeat

FWIW I think its just a combination of desktop class and non HCL hardware. My CSRs running across 2x sandy bridge i5s and a dvswitch (across a d-link lol, hey it does vlans) average around 30-40ms latency. With Juniper fireflies its up to 70-80ms. I am running off shared storage (iSCSI) as well.
Title: Re: CSR 1000v latency issues
Post by: deanwebb on January 30, 2015, 07:18:32 PM
Shouldn't this be in the switching and routing section?
Title: Re: CSR 1000v latency issues
Post by: deanwebb on January 31, 2015, 10:50:59 AM
Quote from: deanwebb on January 30, 2015, 12:13:49 PM
I need a "have you tried turning it off and on again" smiley. I'd add it now, but I'm about to head out to lunch.

:itcrowd:

There. It's in the "more" section of smileys. now I'm moving this to R&S.