[outages] Outages Digest, Vol 82, Issue 6

Patrick Ready pat at danthemute.com
Wed Mar 11 12:09:45 EDT 2015


I work for a company that services VOIP phones in the Philly/South Jersey
area. We saw a various ammount of Verizon FioS/IDE connections lose the
ability to route to vendors on various places on the internet around this
time. We failed the ones we could over to a back up connection and
corrected issues. Suspected higher end routing change/issue.

On Wed, Mar 11, 2015 at 12:00 PM, <outages-request at outages.org> wrote:

> Send Outages mailing list submissions to
>         outages at outages.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://puck.nether.net/mailman/listinfo/outages
> or, via email, send a message with subject or body 'help' to
>         outages-request at outages.org
>
> You can reach the person managing the list at
>         outages-owner at outages.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Outages digest..."
>
>
> Today's Topics:
>
>    1. Verizon Northern NJ (James Cornman)
>    2. Re: Verizon Northern NJ (Dan Langille)
>    3. Issues reaching Verion NJ/NY (Dan Spataro)
>    4. Re: Verizon Northern NJ (Jeremy Chadwick)
>    5. Re: Verizon Northern NJ (joel jaeggli)
>    6. Re: Verizon Northern NJ (Charles Sprickman)
>    7. Re: Verizon Northern NJ (Jason Lixfeld)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Tue, 10 Mar 2015 17:48:26 -0400
> From: James Cornman <james at atlanticmetro.net>
> To: "outages at outages.org" <outages at outages.org>
> Subject: [outages] Verizon Northern NJ
> Message-ID: <-7282723577044655635 at unknownmsgid>
> Content-Type: text/plain; charset=UTF-8
>
> We've had a lot of customers that are having problems with Verizon
> FiOS and other IP services within the past 40 minutes. Mainly
> concentrated in the northern New Jersey area. Are there any other
> reports of this?
>
> -James
>
>
> ------------------------------
>
> Message: 2
> Date: Tue, 10 Mar 2015 18:06:30 -0400
> From: Dan Langille <dan at langille.org>
> To: James Cornman <james at atlanticmetro.net>
> Cc: "outages at outages.org" <outages at outages.org>
> Subject: Re: [outages] Verizon Northern NJ
> Message-ID: <C9F41142-CBCA-426C-A84B-3C2E65BAE0D4 at langille.org>
> Content-Type: text/plain; charset=utf-8
>
>
> > On Mar 10, 2015, at 5:48 PM, James Cornman via Outages <
> outages at outages.org> wrote:
> >
> > We've had a lot of customers that are having problems with Verizon
> > FiOS and other IP services within the past 40 minutes. Mainly
> > concentrated in the northern New Jersey area. Are there any other
> > reports of this?
>
> I'm a Verizon customer and from home between 5:16pm to about 5:41pm I had
> no connection to various services
> HE.net and various other places. I'm in Media, PA.  All good now.
>
> ?
> Dan Langille
> http://langille.org/
>
>
>
>
>
>
>
> ------------------------------
>
> Message: 3
> Date: Tue, 10 Mar 2015 22:06:30 +0000
> From: Dan Spataro <dspataro at corp.nac.net>
> To: "outages at outages.org" <outages at outages.org>
> Subject: [outages] Issues reaching Verion NJ/NY
> Message-ID: <9c786d409dda4f7abebc5e27e801fff2 at exch2013-1.hq.nac.net>
> Content-Type: text/plain; charset="us-ascii"
>
> At about 5:06pm we completely lost connectivity to Verizon via Telia. We
> since routed Verizon through NTT and we are now seeing 70ms+ latency in
> Verizons network. One of our end users is reporting problems reaching
> twitter and other sites from their NJ FIOS. Anyone else seeing problems?
>
>
> 4. ae-30.r06.nycmny01.us.bb.gin.ntt.net
>
>                                              0.0%    15    3.0   2.4   1.9
>  3.0   0.3
>  5. 0.xe-7-1-0.BR3.NYC4.ALTER.NET
>
>                                               0.0%    15    1.6   2.9
>  1.4  12.1   3.2
>     xe-0.verizonbusiness.nycmny01.us.bb.gin.ntt.net
>     0.xe-11-3-0.BR3.NYC4.ALTER.NET
>     0.xe-11-3-0.BR3.NYC4.ALTER.NET
>  6. Bundle-Ether1100.NWRKNJ-LCR-22.verizon-gni.NET
>
>                                              0.0%    15   78.5  81.1  78.2
> 84.5   2.1
>     Bundle-Ether1100.NWRKNJ-LCR-21.verizon-gni.NET
>     Bundle-Ether1100.NWRKNJ-LCR-21.verizon-gni.NET
>  7. ???
>  8. pool-173-70-118-168.nwrknj.fios.verizon.net
>
>                                               0.0%    14   89.9  87.4
> 82.3  90.8   2.5
>
>
>
>
> Daniel Spataro
> Net Access Corporation
> (v) 973-590-5144
> (e) dspataro at corp.nac.net
>
>
>
>
> ------------------------------
>
> Message: 4
> Date: Tue, 10 Mar 2015 15:46:56 -0700
> From: Jeremy Chadwick <jdc at koitsu.org>
> To: James Cornman <james at atlanticmetro.net>
> Cc: "outages at outages.org" <outages at outages.org>
> Subject: Re: [outages] Verizon Northern NJ
> Message-ID: <20150310224656.GA33954 at icarus.home.lan>
> Content-Type: text/plain; charset=us-ascii
>
> This just got posted (Email seems delayed but the web archive[1] seems
> fine): https://puck.nether.net/pipermail/outages/2015-March/007661.html
>
> A colleague of mine on Verizon FiOS in NY reported to me the exact same
> problems as being reported here.  In other words: it wasn't just you.
>
>
> [1]: https://puck.nether.net/pipermail/outages/2015-March/thread.html
>
> --
> | Jeremy Chadwick                                   jdc at koitsu.org |
> | UNIX Systems Administrator                http://jdc.koitsu.org/ |
> | Making life hard for others since 1977.             PGP 4BD6C0CB |
>
> On Tue, Mar 10, 2015 at 05:48:26PM -0400, James Cornman via Outages wrote:
> > We've had a lot of customers that are having problems with Verizon
> > FiOS and other IP services within the past 40 minutes. Mainly
> > concentrated in the northern New Jersey area. Are there any other
> > reports of this?
> >
> > -James
> > _______________________________________________
> > Outages mailing list
> > Outages at outages.org
> > https://puck.nether.net/mailman/listinfo/outages
>
>
> ------------------------------
>
> Message: 5
> Date: Tue, 10 Mar 2015 16:16:31 -0700
> From: joel jaeggli <joelja at bogus.com>
> To: James Cornman via Outages <outages at outages.org>
> Subject: Re: [outages] Verizon Northern NJ
> Message-ID: <54FF7B4F.9070605 at bogus.com>
> Content-Type: text/plain; charset="windows-1252"
>
> On 3/10/15 2:48 PM, James Cornman via Outages wrote:
> > OS and other IP services within the past 40 minutes. Mainly
> > concentrated in the northern New Jersey area. Are there any other
> > reports of this?
>
> we have customer who can't reach us for there yeah.
>
> > -James
>
>
> -------------- next part --------------
> A non-text attachment was scrubbed...
> Name: signature.asc
> Type: application/pgp-signature
> Size: 243 bytes
> Desc: OpenPGP digital signature
> URL: <
> https://puck.nether.net/pipermail/outages/attachments/20150310/a6e1ef9d/attachment-0001.sig
> >
>
> ------------------------------
>
> Message: 6
> Date: Tue, 10 Mar 2015 20:00:24 -0400
> From: Charles Sprickman <spork at bway.net>
> To: joel jaeggli <joelja at bogus.com>
> Cc: James Cornman via Outages <outages at outages.org>
> Subject: Re: [outages] Verizon Northern NJ
> Message-ID: <D6D46EA5-6D92-470D-A188-5A4C1DFCC90D at bway.net>
> Content-Type: text/plain; charset="windows-1252"
>
> From Optonline in Morristown I?m seeing drops to a server off business
> FiOS outside Philly.
>
> Looks like there?s no intermediate between OOL and VZ either:
>
>  1  10.240.176.233 (10.240.176.233)  8.719 ms  7.099 ms  7.766 ms
>  2  67.59.225.220 (67.59.225.220)  8.379 ms  10.610 ms  7.925 ms
>  3  rtr2-ge1-10.mhe.prnynj.cv.net (67.83.242.5)  9.210 ms
>     ool-4353f20d.dyn.optonline.net (67.83.242.13)  9.598 ms  9.476 ms
>  4  64.15.7.49 (64.15.7.49)  9.244 ms
>     65.19.119.193 (65.19.119.193)  9.222 ms
>     64.15.7.41 (64.15.7.41)  8.662 ms
>  5  451be0d2.cst.lightpath.net (65.19.120.210)  11.150 ms
>     64.15.0.52 (64.15.0.52)  11.240 ms
>     451be0d2.cst.lightpath.net (65.19.120.210)  11.470 ms
>  6  0.xe-2-3-0.GW13.NYC1.ALTER.NET (152.179.220.57)  9.715 ms
>     0.TenGigE0-0-0-6.GW8.EWR6.ALTER.NET (152.179.61.85)  16.414 ms
>     0.xe-2-3-0.GW13.NYC1.ALTER.NET (152.179.220.57)  10.204 ms
>  7  * B400.PHLAPA-LCR-21.verizon-gni.net (130.81.163.133)  21.193 ms
>     P0-4-0-0.PHLAPA-LCR-22.verizon-gni.net (130.81.22.61)  19.623 ms
>  8  * * *
>  9  static-xxxx 25.310 ms  20.195 ms  24.948 ms
>
> VZ has been having some interesting issues the past few months.  Maybe the
> last of the UUNet people finally left. :)
>
> Charles
>
> On Mar 10, 2015, at 7:16 PM, joel jaeggli via Outages <outages at outages.org>
> wrote:
>
> > On 3/10/15 2:48 PM, James Cornman via Outages wrote:
> >> OS and other IP services within the past 40 minutes. Mainly
> >> concentrated in the northern New Jersey area. Are there any other
> >> reports of this?
> >
> > we have customer who can't reach us for there yeah.
> >
> >> -James
> >
> >
> > _______________________________________________
> > Outages mailing list
> > Outages at outages.org
> > https://puck.nether.net/mailman/listinfo/outages
>
> -------------- next part --------------
> A non-text attachment was scrubbed...
> Name: signature.asc
> Type: application/pgp-signature
> Size: 495 bytes
> Desc: Message signed with OpenPGP using GPGMail
> URL: <
> https://puck.nether.net/pipermail/outages/attachments/20150310/0c3b93e8/attachment-0001.sig
> >
>
> ------------------------------
>
> Message: 7
> Date: Tue, 10 Mar 2015 21:02:19 -0400
> From: Jason Lixfeld <jason at lixfeld.ca>
> To: Charles Sprickman <spork at bway.net>
> Cc: James Cornman via Outages <outages at outages.org>
> Subject: Re: [outages] Verizon Northern NJ
> Message-ID: <DFE03362-9C32-4CD9-9D53-6B7D8B518D9B at lixfeld.ca>
> Content-Type: text/plain; charset=windows-1252
>
> Has this cleared up for folks?  I have one customer who reported issues
> reaching Verizon Toronto via Level 3 around the time when it was first
> reported here (just after 5pm EDT).  I?m waiting for confirmation that the
> issue has cleared for them; I don?t see it myself from the same ASN as the
> customer who reported the problem, but I figured I?d ask anyway.
>
> > On Mar 10, 2015, at 8:00 PM, Charles Sprickman via Outages <
> outages at outages.org> wrote:
> >
> > From Optonline in Morristown I?m seeing drops to a server off business
> FiOS outside Philly.
> >
> > Looks like there?s no intermediate between OOL and VZ either:
> >
> > 1  10.240.176.233 (10.240.176.233)  8.719 ms  7.099 ms  7.766 ms
> > 2  67.59.225.220 (67.59.225.220)  8.379 ms  10.610 ms  7.925 ms
> > 3  rtr2-ge1-10.mhe.prnynj.cv.net (67.83.242.5)  9.210 ms
> >    ool-4353f20d.dyn.optonline.net (67.83.242.13)  9.598 ms  9.476 ms
> > 4  64.15.7.49 (64.15.7.49)  9.244 ms
> >    65.19.119.193 (65.19.119.193)  9.222 ms
> >    64.15.7.41 (64.15.7.41)  8.662 ms
> > 5  451be0d2.cst.lightpath.net (65.19.120.210)  11.150 ms
> >    64.15.0.52 (64.15.0.52)  11.240 ms
> >    451be0d2.cst.lightpath.net (65.19.120.210)  11.470 ms
> > 6  0.xe-2-3-0.GW13.NYC1.ALTER.NET (152.179.220.57)  9.715 ms
> >    0.TenGigE0-0-0-6.GW8.EWR6.ALTER.NET (152.179.61.85)  16.414 ms
> >    0.xe-2-3-0.GW13.NYC1.ALTER.NET (152.179.220.57)  10.204 ms
> > 7  * B400.PHLAPA-LCR-21.verizon-gni.net (130.81.163.133)  21.193 ms
> >    P0-4-0-0.PHLAPA-LCR-22.verizon-gni.net (130.81.22.61)  19.623 ms
> > 8  * * *
> > 9  static-xxxx 25.310 ms  20.195 ms  24.948 ms
> >
> > VZ has been having some interesting issues the past few months.  Maybe
> the last of the UUNet people finally left. :)
> >
> > Charles
> >
> > On Mar 10, 2015, at 7:16 PM, joel jaeggli via Outages <
> outages at outages.org> wrote:
> >
> >> On 3/10/15 2:48 PM, James Cornman via Outages wrote:
> >>> OS and other IP services within the past 40 minutes. Mainly
> >>> concentrated in the northern New Jersey area. Are there any other
> >>> reports of this?
> >>
> >> we have customer who can't reach us for there yeah.
> >>
> >>> -James
> >>
> >>
> >> _______________________________________________
> >> Outages mailing list
> >> Outages at outages.org
> >> https://puck.nether.net/mailman/listinfo/outages
> >
> > _______________________________________________
> > Outages mailing list
> > Outages at outages.org
> > https://puck.nether.net/mailman/listinfo/outages
>
>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
> ------------------------------
>
> End of Outages Digest, Vol 82, Issue 6
> **************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20150311/9b7615b1/attachment.htm>


More information about the Outages mailing list