Ticket ID: SIXXS #6253602 Ticket Status: Invalid PoP: usqas01 - OCCAID Inc. (Ashburn, Virginia)
Packet Loss on PoP
Shadow Hawkins on Monday, 09 January 2012 22:17:28
Hi,
There appears to be constant packet loss between 10% - 30% to the Ashburn PoP. I am only seeing this loss on the PoP's IPv6 address, IPv4 appears to be fine.
The Latency graphs also show the packet loss.
https://www.sixxs.net/misc/latency/?pop_usqas01=yes&last=1week
Checking from various servers to PoP's v6 interface.
From: 2610:48:100:904::3
will@neo:~$ mtr --report usqas01.sixxs.net
HOST: neo Loss% Snt Last Avg Best Wrst StDev
1.|-- vl260.gw-o-neville.net.ma 0.0% 10 1.3 0.8 0.7 1.3 0.2
2.|-- gi7-2.gw-orono.net.maine. 0.0% 10 0.6 0.7 0.6 1.1 0.1
3.|-- te23.gw-bangor.net.maine. 0.0% 10 0.9 6.0 0.8 52.5 16.3
4.|-- te2-1.gw-portland.net.mai 0.0% 10 4.0 4.1 3.9 4.1 0.1
5.|-- te2-2.gw-portland2.net.ma 0.0% 10 4.3 4.3 4.2 4.6 0.1
6.|-- nox300gw1-vl-736.ipv6.nox 0.0% 10 8.8 12.6 8.5 46.0 11.7
7.|-- 2001:468:601:3::100 0.0% 10 26.8 30.0 8.7 187.8 55.8
8.|-- xe-2-1-1.113.rtr.chic.net 0.0% 10 30.8 47.6 30.8 83.5 15.7
9.|-- 10gigabitethernet4-1.core 0.0% 10 39.5 36.8 31.9 44.8 5.2
10.|-- 10gigabitethernet7-2.core 0.0% 10 37.6 41.9 37.6 46.3 3.1
11.|-- 10gigabitethernet2-3.core 0.0% 10 38.9 42.2 37.3 47.8 3.8
12.|-- ibr01-ve96.asbn01.occaid. 0.0% 10 61.2 61.0 60.7 61.3 0.2
13.|-- equi6ix.dc.hotnic.net 0.0% 10 37.8 38.2 37.8 38.9 0.4
14.|-- sixxs-asbnva-gw.customer. 20.0% 10 38.3 38.1 37.5 38.6 0.4
From: 2001:470:1f10:f80::2
root@debian:~# mtr --report usqas01.sixxs.net
HOST: debian Loss% Snt Last Avg Best Wrst StDev
1. 2001:470:1f10:f80::1 0.0% 10 7.9 8.4 7.7 9.1 0.5
2. gige-g3-4.core1.chi1.he.net 0.0% 10 4.8 4.9 4.7 5.2 0.2
3. 10gigabitethernet7-2.core1.n 0.0% 10 30.4 29.8 22.3 42.4 6.4
4. 10gigabitethernet2-3.core1.a 0.0% 10 27.8 28.4 27.3 31.2 1.2
5. ibr01-ve96.asbn01.occaid.net 0.0% 10 28.2 28.2 27.9 28.8 0.2
6. equi6ix.dc.hotnic.net 0.0% 10 28.8 28.2 27.9 28.8 0.3
7. sixxs-asbnva-gw.customer.occ 20.0% 10 28.6 29.1 28.6 29.5 0.4
From: 2001:49f0:4006:3::439f:2c08
root@zebra:~# mtr --report usqas01.sixxs.net
HOST: zebra Loss% Snt Last Avg Best Wrst StDev
1. 2001:49f0:4006::1 0.0% 10 0.6 19.5 0.6 160.2 49.7
2. 2001:559::311 0.0% 10 1.4 1.6 1.4 1.9 0.1
3. 2001:558:0:f74a::2 0.0% 10 0.4 0.6 0.4 1.6 0.5
4. if-13-0-0.943.core3.SQN-SanJ 0.0% 10 67.3 67.1 66.7 67.5 0.3
5. if-ae15.1881.tcore2.LVW-LosA 0.0% 10 66.8 68.2 66.7 80.3 4.3
6. if-12-0-0.15.mcore3.LAA-LosA 0.0% 10 67.6 67.3 66.8 68.2 0.4
7. POS4-0-0.mse2.SV1-SantaClara 0.0% 10 100.8 112.2 79.4 270.2 64.7
8. if-2-12.mse1.SV1-SantaClara. 0.0% 10 132.8 94.9 79.2 177.8 33.5
9. 2001:5a0:2400::1e 0.0% 10 93.7 130.4 93.1 296.4 71.8
10. bbr01-v442.lsan01.occaid.net 0.0% 10 93.8 112.6 93.3 225.6 41.4
11. bbr01-v441.atln01.occaid.net 0.0% 10 97.3 107.4 97.3 158.5 19.4
12. bbr01-g0-1.asbn01.occaid.net 10.0% 10 98.2 101.4 97.6 121.9 7.7
13. equi6ix.dc.hotnic.net 0.0% 10 101.2 148.5 97.9 345.0 88.6
14. sixxs-asbnva-gw.customer.occ 30.0% 10 97.5 126.8 94.2 315.0 83.0
From: 2001:49f0:a05e::2
[root@stingray ~]# mtr --report usqas01.sixxs.net
stingray.managemydedi.com Snt: 10 Loss% Last Avg Best Wrst StDev
2001:49f0:a05e::1 0.0% 0.6 0.7 0.4 1.5 0.3
2001:49f0::16 0.0% 0.6 28.6 0.4 281.5 88.8
2001:559::30d 0.0% 1.3 1.3 1.1 1.5 0.1
pos-2-10-0-0-cr01.dallas.tx.ibone.comcast.ne 0.0% 16.0 15.9 15.7 16.0 0.2
pos-0-2-0-0-pe01.1950stemmons.tx.ibone.comca 0.0% 18.4 18.4 16.9 19.7 0.9
2001:5a0:300:500::1d 0.0% 15.6 15.7 15.5 16.0 0.2
if-ae2.2.tcore1.DT8-Dallas.ipv6.as6453.net 0.0% 21.3 19.6 15.5 50.3 10.9
if-ae7.2.tcore1.AEQ-Ashburn.ipv6.as6453.net 0.0% 55.5 55.6 55.4 57.0 0.5
if-ae2.2.tcore2.AEQ-Ashburn.ipv6.as6453.net 0.0% 55.5 60.3 55.3 104.6 15.6
if-ae8.1508.tcore2.LVW-LosAngeles.ipv6.as645 0.0% 87.7 87.7 87.7 87.8 0.1
if-12-0-0.15.mcore3.LAA-LosAngeles.ipv6.as64 0.0% 87.9 87.8 87.7 87.9 0.1
POS4-0-0.mse2.SV1-SantaClara.ipv6.as6453.net 0.0% 100.5 123.7 100.3 218.3 48.3
if-2-1.mse1.SV1-SantaClara.ipv6.as6453.net 0.0% 100.5 135.4 100.2 331.9 78.5
2001:5a0:2400::1e 0.0% 171.7 193.9 153.7 317.7 50.8
bbr01-v442.lsan01.occaid.net 0.0% 155.1 165.3 149.0 260.7 35.0
bbr01-v441.atln01.occaid.net 0.0% 154.1 163.7 153.6 212.2 18.6
bbr01-g0-1.asbn01.occaid.net 0.0% 151.8 175.2 148.9 384.8 73.8
equi6ix.dc.hotnic.net 20.0% 154.6 164.1 154.6 177.2 8.6
sixxs-asbnva-gw.customer.occaid.net 30.0% 149.8 154.2 149.8 177.6 10.3
The packet loss can also be observed via the distributed traceroute.
http://www.sixxs.net/tools/traceroute/?pop=usqas01-6&dpop=other&dest=www.maine.edu
IPv6 traceroute from usqas01.sixxs.net @ OCCAID Inc., AS30071 to www.maine.edu :
Hop Node Loss% Sent Last Avg Best Worst StDev ASN Organisation
1. 2001:4830:e6:7::1 0.0% 5 1.5 1.4 1.3 1.5 0.1 30071 TowardEX Technologies Network
sixxs-gw.hotnic.us.occaid.net.
2. 2001:504:0:2::6939:1 40.0% 5 1.3 7.3 1.3 10.5 5.2 EQUINIX-IX-V6
10gigabitethernet2-2.core1.ash1.he.net.
3. 2001:470:0:227::2 0.0% 5 2.2 2.4 2.2 3.3 0.5 6939 Hurricane Electric
4. ??? 100.0 5 0.0 0.0 0.0 0.0 0.0
5. 2001:468:ffff:646::1 0.0% 5 31.1 40.6 30.4 79.4 21.7 UCAID
6. 2001:468:63f:28::2 20.0% 5 35.4 35.5 35.4 35.6 0.1 UCAID
7. 2610:48::45 40.0% 5 35.2 34.8 34.5 35.2 0.3 557 University of Maine System
te2-3.gw-portland.net.maine.edu.
8. 2610:48::3a 20.0% 5 37.5 38.1 37.5 38.7 0.6 557 University of Maine System
te2-1.gw-bangor.net.maine.edu.
9. 2610:48::65 20.0% 5 38.1 38.3 37.9 38.9 0.5 557 University of Maine System
te11.gw-orono.net.maine.edu.
10. 2610:48::26 20.0% 5 38.7 38.7 38.3 39.1 0.4 557 University of Maine System
gi2-3.gw-o-neville.net.maine.edu.
11. 2610:48:100:820::67 20.0% 5 38.9 38.6 38.1 39.0 0.4 557 University of Maine System
orwell.unet.maine.edu.
It is occurring over my tunnels to outbound destinations as well.
T75362
T49825
Thanks,
Will
State change: invalid
Jeroen Massar on Monday, 09 January 2012 23:23:09
The state of this ticket has been changed to invalid
Packet Loss on PoP
Jeroen Massar on Monday, 09 January 2012 23:24:22
The outbound traceroute shows that the return path is either dropping or ratelimiting icmp, nothing much we can do about.
Posting is only allowed when you are logged in. |