[cisco-voip] Webex Teams Down

Stephen Welsh stephen.welsh at unifiedfx.com
Tue Sep 25 12:59:17 EDT 2018


Cisco staff have been told to use Jabber in the meantime instead, so obviously a long outage (planned or not) was anticipated.

Stephen

On 25 Sep 2018, at 17:41, Ryan Huff <ryanhuff at outlook.com<mailto:ryanhuff at outlook.com>> wrote:

Some of us are talking like this was a planned outage / maintenance on their part? Do we know this was planned? All the status updates are written with break/fix language. That could be CYA, but I really don’t think this was planned.

If we make it to 9:22PM Eastern though, that’ll be a full 24 hours You has the over / under on a 24 hour outage?

On Sep 25, 2018, at 12:02, Lelio Fulgenzi <lelio at uoguelph.ca<mailto:lelio at uoguelph.ca>> wrote:

Mr. robot strikes again!

<image001.jpg>

---
Lelio Fulgenzi, B.A. | Senior Analyst
Computing and Communications Services | University of Guelph
Room 037 Animal Science & Nutrition Bldg | 50 Stone Rd E | Guelph, ON | N1G 2W1
519-824-4120 Ext. 56354 | lelio at uoguelph.ca<mailto:lelio at uoguelph.ca>

www.uoguelph.ca/ccs<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.uoguelph.ca%2Fccs&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=x38MZE7%2FdRN4kUqmsfPQi9oR5DieHA2OGUrsAMzCrVQ%3D&reserved=0> | @UofGCCS on Instagram, Twitter and Facebook

<image002.png>

From: Anthony Holloway <avholloway+cisco-voip at gmail.com<mailto:avholloway+cisco-voip at gmail.com>>
Sent: Tuesday, September 25, 2018 11:48 AM
To: Matthew Loraditch <MLoraditch at heliontechnologies.com<mailto:MLoraditch at heliontechnologies.com>>
Cc: Ryan Huff <ryanhuff at outlook.com<mailto:ryanhuff at outlook.com>>; Lelio Fulgenzi <lelio at uoguelph.ca<mailto:lelio at uoguelph.ca>>; Cisco VoIP Group <cisco-voip at puck.nether.net<mailto:cisco-voip at puck.nether.net>>
Subject: Re: [cisco-voip] Webex Teams Down

I don't know why, but I like the beginning of this sentence:

"However, once this thermal buffer was depleted..."

I'm going to use that in my next RCA for a Call Center outage.

On Tue, Sep 25, 2018 at 10:43 AM Matthew Loraditch <MLoraditch at heliontechnologies.com<mailto:MLoraditch at heliontechnologies.com>> wrote:
This one almost seems like an "act of god" or hacking had to take place. If you want to read about an interesting one MS had with Azure a few weeks ago look here on 9/4 https://azure.microsoft.com/en-us/status/history/<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fstatus%2Fhistory%2F&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=08bYvYAtbZ5zFPJrtiETSi%2F%2FF2RyDge6SLEsZATw8ec%3D&reserved=0>
[https://azurecomcdn.azureedge.net/cvt-4ba1ac63410bb2bbe9f1c2a7bedc57894bbe9754309d9d380deedcdf7850047e/images/shared/social/azure-icon-250x250.png]<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fstatus%2Fhistory%2F&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=08bYvYAtbZ5zFPJrtiETSi%2F%2FF2RyDge6SLEsZATw8ec%3D&reserved=0>

Azure status history | Microsoft Azure<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fazure.microsoft.com%2Fen-us%2Fstatus%2Fhistory%2F&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=08bYvYAtbZ5zFPJrtiETSi%2F%2FF2RyDge6SLEsZATw8ec%3D&reserved=0>
Check the status history of Microsoft Azure services here.
azure.microsoft.com<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fazure.microsoft.com&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=3c9jFHko5ByKpDuDoLmMK8iqsufIaqHpjeG6whQpkZU%3D&reserved=0>




Matthew Loraditch​

Sr. Network Engineer


p: 443.541.1518<tel:443.541.1518>



w: www.heliontechnologies.com<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.heliontechnologies.com%2F&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=b%2B3akW6apRqADABAQkYG%2BY44jKqCx%2B2tJFDQkCjtPv8%3D&reserved=0>

 |

e: MLoraditch at heliontechnologies.com<mailto:MLoraditch at heliontechnologies.com>


[cid:image098391.png at E8E94ABB.AD966C39]


[Facebook]<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=SSuv6lsqCBxSkqq%2BdILR9%2BytlDQZctc8CWARnxEiky8%3D&reserved=0>



[Twitter]<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=6dXa9aioG64Z56tL5lgJuPLTVkAKzzxb46qI0rw8uRs%3D&reserved=0>


[LinkedIn]<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fhelion-technologies&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702468694&sdata=4II3PnOZx2QO6wqxqCkcdc2c%2Bx4JAZqIq6iYIWFVUEk%3D&reserved=0>







________________________________
From: cisco-voip <cisco-voip-bounces at puck.nether.net<mailto:cisco-voip-bounces at puck.nether.net>> on behalf of Ryan Huff <ryanhuff at outlook.com<mailto:ryanhuff at outlook.com>>
Sent: Tuesday, September 25, 2018 11:37 AM
To: Lelio Fulgenzi
Cc: Cisco VoIP Group
Subject: Re: [cisco-voip] Webex Teams Down

That’s the value prop of the cloud though; “we take away the risk of your on-prem infrastructure, but you have to pay for that in control of your service, experience and ability to troubleshoot”.

I tell folks all the time risk mitigation paid for by giving up control is never a good idea.

- Ryan

On Sep 25, 2018, at 11:30, Lelio Fulgenzi <lelio at uoguelph.ca<mailto:lelio at uoguelph.ca>> wrote:



I know that for my maintenance activities I evaluate the risk vs potential impact vs backout requirements to understand how much effort I put in to preparing things. One time I scavenged our e-waste pile for compatible HP hardware and purchased old CPUs for an upgrade to ensure that I had at most a 90minute backout (plugging wires and turning up servers x 9). Restoring from backup was just too long in this case.



I don’t begin to fathom the complexity of the webex backend service, but I find it hard to believe there were not options available to ensure a quick and orderly backout plan – not simply restoring from backup. Would it be expensive? Sure, but define “expensive” relative to the impact this has caused.













---

Lelio Fulgenzi, B.A. | Senior Analyst

Computing and Communications Services | University of Guelph

Room 037 Animal Science & Nutrition Bldg | 50 Stone Rd E | Guelph, ON | N1G 2W1

519-824-4120 Ext. 56354 | lelio at uoguelph.ca<mailto:lelio at uoguelph.ca>



www.uoguelph.ca/ccs<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.uoguelph.ca%2Fccs&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=yua1o604Vv%2BNmPcIYf2eL2C%2BnEbhURI0VdzZpczhq%2Bs%3D&reserved=0> | @UofGCCS on Instagram, Twitter and Facebook



<image001.png>



From: cisco-voip <cisco-voip-bounces at puck.nether.net<mailto:cisco-voip-bounces at puck.nether.net>> On Behalf Of Ryan Huff
Sent: Tuesday, September 25, 2018 11:20 AM
To: Anthony Holloway <avholloway+cisco-voip at gmail.com<mailto:avholloway+cisco-voip at gmail.com>>
Cc: Cisco VoIP Group <cisco-voip at puck.nether.net<mailto:cisco-voip at puck.nether.net>>
Subject: Re: [cisco-voip] Webex Teams Down



I my 17 years doing this, I have never once caused or suffered a seemingly unexplained and unexpected 10+ hour outage of all service to an environment/application.



That’s the difference, control.



Sent from my iPhone

On Sep 25, 2018, at 11:05, Anthony Holloway <avholloway+cisco-voip at gmail.com<mailto:avholloway+cisco-voip at gmail.com>> wrote:

In my mind, this is no different than an on prem migration/upgrade/change/etc going south.  The fact that the impacted service is in the cloud, is not important.  Even if the Internet connection itself went down, that's no different than a private MPLS outage.



From an end user's perspective, whether cloud or on prem, the service is simply unavailable.  From a CIO perspective, someone else screwed up, and someone else is working on it.  I don't see why this is different or interesting.



What is it that do I not get?



On Tue, Sep 25, 2018 at 9:11 AM Palmer, Brian <Brian.Palmer at bcbsfl.com<mailto:Brian.Palmer at bcbsfl.com>> wrote:

This sure is rather wild that it has been down for so long.  We only have a few boards, but I do hope that every business user is reviewing the word “cloud” and how great it really is within this context.





From: cisco-voip <cisco-voip-bounces at puck.nether.net<mailto:cisco-voip-bounces at puck.nether.net>> On Behalf Of Matthew Loraditch
Sent: Tuesday, September 25, 2018 9:43 AM
To: Ryan Huff <ryanhuff at outlook.com<mailto:ryanhuff at outlook.com>>; Matt Jacobson <m4ttjacobson at gmail.com<mailto:m4ttjacobson at gmail.com>>
Cc: cisco-voip at puck.nether.net<mailto:cisco-voip at puck.nether.net>
Subject: Re: [cisco-voip] Webex Teams Down



The RFO for this one is going to be a doozy. On meetings they are migrating all users who had been upgraded to Video Platform 2.0 back to 1.0. I have no idea of the scope but that seems like a pretty big undertaking and a tiny insight into how screwed up whatever happened is.






Matthew Loraditch​


Sr. Network Engineer



p: 443.541.1518<tel:443.541.1518>




w: http://defang.bcbsfl.com/defang.php?url=www.heliontechnologies.com<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttp%3A%2F%2Fwww.heliontechnologies.com%2F&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=xeohdPO%2BSPVAg40lNJs4m9vTS67ZQYFktRoMmS%2Fc6SU%3D&reserved=0>


 |


e: MLoraditch at heliontechnologies.com<mailto:MLoraditch at heliontechnologies.com>





<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>




<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>



<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>








From: cisco-voip <cisco-voip-bounces at puck.nether.net> On Behalf Of Ryan Huff
Sent: Tuesday, September 25, 2018 9:36 AM
To: Matt Jacobson <m4ttjacobson at gmail.com>
Cc: cisco-voip at puck.nether.net
Subject: Re: [cisco-voip] Webex Teams Down<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>

 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>

Who wants to go in with me on creating an on-prem DR application for individual WebEx Teams domains? Lol ... the cloud ... yup, let’s do that ...<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>

 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>

The cloud is a little like networking before segmentation .... anything impacts everything 🤔<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702624947&sdata=GclDqO3p1q%2BWUoIIZ2kmf3jixSHbukKmXTRc91SsvLM%3D&reserved=0>

The only things I can think of that could possibly take this long would be like having to restore things from backup or waiting on uber large database indices to rebuild or reindex ..... hope things get restored soon!<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>


On Sep 25, 2018, at 07:22, Matt Jacobson <m4ttjacobson at gmail.com> wrote:<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

Webex meetings is still working, but you can’t dial in with video endpoints. <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

On Tue, Sep 25, 2018 at 15:10 Bernhard Albler <bernhard.albler at gmail.com> wrote:<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

yeah, crazy outage, basically the full working day for us here in Europe<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

it also impacts CMR for customers on Video Platform v2 ( which should be most)<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

On Tue 25. Sep 2018 at 12:39, Ryan Huff <ryanhuff at outlook.com> wrote:<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

I haven't seen one this long this since the early days of Spark ... been down since 9:22PM eastern on 9-24-18 ... wow ....<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702781206&sdata=N2jmD4AVBYlwJVEVAoQVL6y3Yt2zsGtt1LW%2FudNUIms%3D&reserved=0>

 <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

 <image1.png><https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

_______________________________________________
cisco-voip mailing list
cisco-voip at puck.nether.net
http://defang.bcbsfl.com/defang.php?url=https://puck.nether.net/mailman/listinfo/cisco-voip<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

--<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

Bernhard Albler, +4369917207384
--
"Was Nachwelt! Wie komm' ich dazu was für die Nachwelt zu tun? Was hat denn die Nachwelt für mich getan?"
--Carl Friedrich Zelter<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

_______________________________________________
cisco-voip mailing list
cisco-voip at puck.nether.net
http://defang.bcbsfl.com/defang.php?url=https://puck.nether.net/mailman/listinfo/cisco-voip<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

We comply with applicable Federal civil rights laws and do not discriminate. <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

You may access the Non-Discrimination and Accessibility Notice here.<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

Language Assistance Available: <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881702937459&sdata=FoWEJO07zibLK%2BWix7R%2FtXRqwqsCVtWs3Z%2FEnImSBng%3D&reserved=0>

Español, Kreyol Ayisien, Tiếng Việt, Português, 中文, français, Tagalog, русский, italiano, Deutsche, 한국어, Polskie, Gujarati, ไทย, العربية, 日本語, فارسی<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881703093717&sdata=o6jjCcq%2BDyljvHKjPjajGf%2BbmHF%2B1W6LCvqWoRL2wXY%3D&reserved=0>

Florida Blue is a trade name of Blue Cross and Blue Shield of Florida, Inc.  Blue Cross and Blue Shield of Florida, Inc., and its subsidiary and affiliate companies are not responsible for errors or omissions in this e-mail message. Any personal comments made in this e-mail do not reflect the views of Blue Cross and Blue Shield of Florida, Inc.  The information contained in this document may be confidential and intended solely for the use of the individual or entity to whom it is addressed.  This document may contain material that is privileged or protected from disclosure under applicable law.  If you are not the intended recipient or the individual responsible for delivering to the intended recipient, please (1) be advised that any use, dissemination, forwarding, or copying of this document IS STRICTLY PROHIBITED; and (2) notify sender immediately by telephone and destroy the document. THANK YOU.<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881703093717&sdata=o6jjCcq%2BDyljvHKjPjajGf%2BbmHF%2B1W6LCvqWoRL2wXY%3D&reserved=0>

_______________________________________________
cisco-voip mailing list
cisco-voip at puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-voip<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881703093717&sdata=o6jjCcq%2BDyljvHKjPjajGf%2BbmHF%2B1W6LCvqWoRL2wXY%3D&reserved=0>

_______________________________________________
cisco-voip mailing list
cisco-voip at puck.nether.net
https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Fcisco-voip&data=02%7C01%7C%7Ca10d1791a9b34c9b0c2408d622f86156%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734847508091071&sdata=uVYGNqnf6KI5c6AjBnCjdSwHi5pdBzvsg5KQoM0Qn4I%3D&reserved=0<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881703093717&sdata=o6jjCcq%2BDyljvHKjPjajGf%2BbmHF%2B1W6LCvqWoRL2wXY%3D&reserved=0>

_______________________________________________
cisco-voip mailing list
cisco-voip at puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-voip<https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdefang.bcbsfl.com%2Fdefang.php%3Furl%3Dhttps%3A%2F%2Ffacebook.com%2Fheliontech&data=02%7C01%7C%7C88aac0c6ac994bb7387408d623005747%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636734881703093717&sdata=o6jjCcq%2BDyljvHKjPjajGf%2BbmHF%2B1W6LCvqWoRL2wXY%3D&reserved=0>
<image002.png><image001.jpg>_______________________________________________
cisco-voip mailing list
cisco-voip at puck.nether.net<mailto:cisco-voip at puck.nether.net>
https://puck.nether.net/mailman/listinfo/cisco-voip

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/cisco-voip/attachments/20180925/a44610f1/attachment.html>


More information about the cisco-voip mailing list