some routes not working coming in - resolved

[Stephen]

We are seeing some routes giving "TTL expired in transit." this is making some servers not load for clients at times, we are working on this to trace down what is going on.

 

[Stephen]

Re: some routes not working coming in.

it seems there is an issue with cogent that is causing some IPs to hit a loop in routing and never making to our network. I am seeing this on Bellsouth DSL here in Miami, and clients are seeing it as well, as we have a number of chats open.

 

[Stephen]

Re: some routes not working coming in.

here is where it is down:

10 29 ms 29 ms 29 ms axr00aep-so-0-0-0.bellsouth.net [65.83.238.40]
11 29 ms 28 ms 33 ms axr01aep-ge-5-0-0.bellsouth.net [65.83.238.35]
12 29 ms 28 ms 28 ms xer00lax-so-0-1-0.bellsouth.net [65.83.236.192]

13 88 ms 29 ms 28 ms g11-0.core01.atl01.atlas.cogentco.com [154.54.10
.25]
14 248 ms 30 ms 28 ms p10-0.core01.atl01.atlas.cogentco.com [154.54.5.
109]
15 35 ms 35 ms 35 ms p14-0.core01.jax01.atlas.cogentco.com [154.54.3.
198]
16 42 ms 42 ms 43 ms p15-0.core01.mia01.atlas.cogentco.com [66.28.4.1
37]
17 43 ms 42 ms 42 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
18 43 ms 42 ms 42 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]
19 43 ms 42 ms 43 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
20 43 ms 44 ms 43 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]
21 44 ms 43 ms 43 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
22 43 ms 43 ms 44 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]
23 44 ms 45 ms 44 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
24 45 ms 43 ms 44 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]
25 45 ms 44 ms 44 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
26 44 ms 45 ms 45 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]
27 44 ms 44 ms 44 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
28 45 ms 45 ms 45 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]
29 45 ms 45 ms 44 ms p5-0.core02.mia03.atlas.cogentco.com [154.54.3.6
]
30 45 ms 45 ms 45 ms p10-0.core01.mia01.atlas.cogentco.com [154.54.3.
189]

 

[Stephen]

Re: some routes not working coming in.

It looks like things are under control now, going around cogent. There was about a 10% drop in traffic during this time.

 

[Stephen]

Re: some routes not working coming in.

Now even direct cogent ISPs are back to working fully.

We just got word that cogent was performing scheduled maintenance. We were not notified of the maintenance so we could not alert others of it. However we are working to rectify this in the future.
Previously only users on cogent would get a return path via cogent, as it was the "fastest route", now even if you come in via cogent you will go out via internap.