UPDATED: VoIP Speed Test

Posts: 2251 · Posted: Thu Jun 08, 2006 3:41 pm Post subject:

MrMark wrote:

Well...I can only say that it remains inaccurate for me.

I asked the programmer to review your test results and this is his reply.

Quote:

Daniel,

We get this a lot as some people do not like the results when they are slow however MySpeed is very accurate indeed and every time I have been sent a full audit report MySpeed has been proved correct. As a point of reference MySpeed is coded to operate a highly granular 1 millisecond clock (assuming the PC can handle it) . If you review our benchmark page on speed testers you will get a feel of this subject. http://www.myspeed.com/support/benchmarks.html.

How to review the detail of the test – any MySpeed tester can request the detail audit report which audits all the traffic at the TCP level to a 1 millisecond granulation, it is definitive. This is acquired by simply hitting the keyboard letter ‘i’ when the test completes.

I have examined the customers two tests and provided a summary review (a full review is too big a task right now). Interestingly out of the two tests only the worst one was listed.

A summary of the audit for this customers test is as follows, my comments are marked as <<==

Customer’s SPEED test
1st test

max pause=63 ms = this indicates a high TCP hang time which is not good, remember the timer is operating at 1ms, for 63 ms no data moved at all
DOWNLOADED 7,192,572 bytes in 8002 ms (7,190,768 bps) SZ=104857600 F1=819208 F2=0 EX=96845820
[0,1600) = 1,438,062 bytes (7,190,310 bps)
[1600,3200) = 1,428,419 bytes (7,142,095 bps)
[3200,4801) = 1,435,418 bytes (7,172,607 bps)
[4801,6401) = 1,448,091 bytes (7,240,455 bps)
[6401,8002) = 1,442,580 bytes (7,208,394 bps)
QOS=98% (1428419/1448091)
UPLOADING via mss.upload.port=20001
socket buffers: snd=65536 rcv=8192
UPLOADED 201,480 bytes in 7440 ms (216,640 bps) == This shows the first test was 216,640 and the test timed out at 6720ms (should be 8000) indicates problems
115 ms======== RTT is erratic almost doubling in a series of 3 independent tests
60 ms
71 ms
RTT=60/82 (/205.234.111.151:80)
2nd test

max pause=169 ms= this indicates excessive TCP hang time for 163 ms no data moved at all
DOWNLOADED 7,011,696 bytes in 8002 ms (7,009,936 bps) SZ=104857600 F1=857496 F2=0 EX=96988408
[0,1600) = 1,379,070 bytes (6,895,350 bps)
[1600,3200) = 1,351,541 bytes (6,757,705 bps)
[3200,4801) = 1,412,666 bytes (7,058,918 bps)
[4801,6401) = 1,430,038 bytes (7,150,190 bps)
[6401,8002) = 1,438,380 bytes (7,187,407 bps)
QOS=93% (1351541/1438380)
UPLOADING via mss.upload.port=20001
socket buffers: snd=65536 rcv=8192
UPLOADED 84,680 bytes in 6720 ms (100,808 bps) == This shows dramatic reduction from the first test more than 100% reduction and the test timed out at 6720ms (should be 8000)
77 ms
61 ms
64 ms
RTT=61/67 (/205.234.111.151:80)
--------------------------------------------------------------------------------
Customer’s Voip simulation
1st test
Loss: 0.0% (=0/749)
Order: 100.0% (=560252/560252)
Jitter: ave=6.34ms, max=370.60614152202936ms== excessive Jitter
tickres=1 ms
2nd test
Loss: 0.0% (=0/749)
Order: 100.0% (=560252/560252)
Jitter: ave=7.54ms, max=62.78237650200268ms=== much improved Jitter the point being something is affecting traffic
tickres=1 ms

Finally if you do a review of the database for all Road Runner network tests you will see upload is consistently low indicating a pattern.

I have included the upload test below to show that MySpeed is capable of measuring very high upload speeds without issue.

socket buffers: snd=65536 rcv=8192
UPLOADED 26,014,380 bytes in 7480 ms (27,822,864 bps)========= 27 meg test
15 ms
13 ms
13 ms
RTT=13/13 (205.234.111.151/205.234.111.151:80)

I hope this helps.

Posts: 132 · Vonage Forum Senior Joined: Apr 06, 2004 Posts: 132

First, I can confirm that speakeasy is not my ISP - it's roadrunner, as the later post of my test results suggest.

Secondly, I am not saying that the test is not good, or that it is not "cool", or anything like that - I'm just saying that the results do not agree with my empirical results when using Voip over this connection.

Thirdly, I'm not sure how my real-world internet performance or Voip experience could be much better than they are, but if there is room for improvement, I want it!

If anyone can tell me how to coerce my ISP into doing whatever they need to do to produce a better test result, I would certainly be willing to give that a try.

Posts: 132 · Vonage Forum Senior Joined: Apr 06, 2004 Posts: 132

dconnor wrote:

The speed test (not this site) is located just outside of Washington DC in the $53 Million Equinix Data Center in Ashburn VA.

This data center is also the home of hundreds of *.gov servers such as fbi.gov

Try a Tracert to this IP: 205.234.111.151 and see what you get.

Okay, here is the result:

Tracing route to unknown151.111.234.205.defenderhosting.com [205.234.111.151]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms 192.168.0.1
2 23 ms 10 ms 141 ms 10.53.160.1
3 18 ms 12 ms 11 ms gig2-1.rsbgtxros-rtr1.houston.rr.com [24.28.101.81]
4 18 ms 11 ms 12 ms srp8-1.hstntxtid-rtr2.houston.rr.com [24.28.100.219]
5 11 ms 12 ms 12 ms gig12-0-0.hstntxtid-rtr4.houston.rr.com [24.93.34.98]
6 41 ms 31 ms 24 ms son0-1-0.dllatxl3-rtr1.texas.rr.com [24.93.33.217]
7 37 ms 32 ms 34 ms 4.71.12.17
8 26 ms 24 ms 26 ms ae-14-55.car4.Dallas1.Level3.net [4.68.122.144]
9 34 ms 26 ms 27 ms savvis-level3-ge.Dallas1.Level3.net [4.68.111.90]
10 26 ms 24 ms 33 ms dpr1-ge-2-2-0.dallasequinix.savvis.net [204.70.194.17]
11 26 ms 24 ms 26 ms bhr1-pos-5-0.fortworthda1.savvis.net [204.70.134.10]
12 60 ms 27 ms 26 ms dcr2-so-6-0-0.dallas.savvis.net [204.70.192.50]
13 70 ms 23 ms 60 ms bcs1-so-2-0-0.Washington.savvis.net [204.70.192.54]
14 68 ms 57 ms 75 ms cpr1-pos-9-0.VirginiaEquinix.savvis.net [206.24.238.98]
15 64 ms 71 ms 62 ms bcs1-so-2-0-0.Washington.savvis.net [204.70.192.54]
16 66 ms 70 ms 67 ms r03-8.iad.defenderhosting.com [205.234.111.18]
17 68 ms 64 ms 61 ms cpr1-pos-15-3.virginiaequinix.savvis.net [206.24.227.46]
18 67 ms 61 ms 60 ms unknown151.111.234.205.defenderhosting.com [205.234.111.151]

Trace complete.

Posts: 2251 · Posted: Thu Jun 08, 2006 6:38 pm Post subject:

Your trace looks clean Mark.

I guess what I would summarize is this:

The detailed results show that you do have an issue, one that should be effecting your Voip.

You claim that it is not effecting your calls, which is a good thing. Chances are that you might not know just how good it could be.

Not knowing what the SpeakEasy test uses to gauge performance, I can only guess that their test is not uncovering your issues, but ours is.

As for your ISP, I would provide them the programmers comments above and the detailed results that you can obtain by pressing the "i" key after the test is complete.

I hope this helps.

Posts: 27 · Vonage Forum Junior Joined: Jun 03, 2006 Posts: 27

Houston and Washington are not that far apart but 60 milliseconds accross 18 hops is a good clean trace. The second to last hop is odd, switching off the subnet at .18 only to return one hop later to .151. That needs investigation.

Posts: 2251 · Posted: Thu Jun 08, 2006 9:09 pm Post subject:

Julianp wrote:

Houston and Washington are not that far apart but 60 milliseconds accross 18 hops is a good clean trace. The second to last hop is odd, switching off the subnet at .18 only to return one hop later to .151. That needs investigation.

I do not see that hop, Juilianp.

The only one I see that might be a problem (and maybe not if MrMark did 2-3 more tracert) was his own modem at hop #2 (with hop #1 being his router)

2 23 ms 10 ms 141 ms 10.53.160.1

Where do you see the 151?

Posts: 27 · Vonage Forum Junior Joined: Jun 03, 2006 Posts: 27

dconnor wrote:

Julianp wrote:

Houston and Washington are not that far apart but 60 milliseconds accross 18 hops is a good clean trace. The second to last hop is odd, switching off the subnet at .18 only to return one hop later to .151. That needs investigation.

I do not see that hop, Juilianp.

The only one I see that might be a problem (and maybe not if MrMark did 2-3 more tracert) was his own modem at hop #2 (with hop #1 being his router)

2 23 ms 10 ms 141 ms 10.53.160.1

Where do you see the 151?

Sorry for the confusion I was referring to the IP address 205.234.111.18 not milliseconds. This routes off the subnet only to return to 205.234.111.151 one hop later. Just odd, not a problem.

Posts: 1424 · Posted: Thu Jun 08, 2006 9:24 pm Post subject:

He is talking about hops 16, 17 and 18. It does look odd. My traceroutes go from 16 to 18 without that intermediate hop.

Code:

16 66 ms 70 ms 67 ms r03-8.iad.defenderhosting.com [205.234.111.18]
17 68 ms 64 ms 61 ms cpr1-pos-15-3.virginiaequinix.savvis.net [206.24.227.46]
18 67 ms 61 ms 60 ms unknown151.111.234.205.defenderhosting.com [205.234.111.151]

Code:

8 5 ms 4 ms 4 ms r03-8.iad.defenderhosting.com [205.234.111.18]
9 5 ms 4 ms 4 ms unknown151.111.234.205.defenderhosting.com [205.234.111.151]

MrMark, does hop 17 consistantly appear in your traceroutes?

Posts: 2251 · Posted: Thu Jun 08, 2006 9:30 pm Post subject:

Ok, I am sorry.

You are referring to this hop, not ms:

17 68 ms 64 ms 61 ms cpr1-pos-15-3.virginiaequinix.savvis.net [206.24.227.46]

Please do reply to scerruti question above, MrMark.

Posts: 27 · Vonage Forum Junior Joined: Jun 03, 2006 Posts: 27

scerruti wrote:

He is talking about hops 16, 17 and 18. It does look odd. My traceroutes go from 16 to 18 without that intermediate hop.

Code:

16 66 ms 70 ms 67 ms r03-8.iad.defenderhosting.com [205.234.111.18]
17 68 ms 64 ms 61 ms cpr1-pos-15-3.virginiaequinix.savvis.net [206.24.227.46]
18 67 ms 61 ms 60 ms unknown151.111.234.205.defenderhosting.com [205.234.111.151]

Code:

8 5 ms 4 ms 4 ms r03-8.iad.defenderhosting.com [205.234.111.18]
9 5 ms 4 ms 4 ms unknown151.111.234.205.defenderhosting.com [205.234.111.151]

MrMark, does hop 17 consistantly appear in your traceroutes?

1 <1 ms <1 ms <1 ms 192.168.0.1
2 20 ms 20 ms 20 ms lo1-lon3-adsl20.nildram.net [195.112.5.29]
3 19 ms 20 ms 19 ms ge-1-0-1.cr2.gs1.bb.pipex.net [84.12.224.29]
4 20 ms 21 ms 20 ms lon1-9.nildram.net [84.12.224.14]
5 19 ms 20 ms 19 ms g3-18.cr05.tn5.bb.pipex.net [62.72.141.37]
6 20 ms 20 ms 20 ms cr02.ldn01.pccwbtn.net [195.66.224.167]
7 93 ms 92 ms 92 ms dtg.ge10-2.br02.ash01.pccwbtn.net [63.218.94.150
]
8 96 ms 95 ms 96 ms r03-8.iad.defenderhosting.com [205.234.111.18]
9 94 ms 93 ms 96 ms unknown151.111.234.205.defenderhosting.com [205.
234.111.151]

I do not get the intermediate hop either. Strange.