<html><body><div style="font-family: tahoma,new york,times,serif; font-size: 12pt; color: #000000"><div>Yes, everyone is entitled to their opinion... yours seem to be stuck in 1988... as we say, that was then and this is now...(BTW, I too have been involved in the industry for over 30+ years).</div><div><br data-mce-bogus="1"></div><div>The internet is no-longer an 'American thing', it began to become global ever since it transitioned from the University Networks into a Public Network....</div><div><br></div><div>You seem to be confusing ARIN, ICANN etc with NANOG.... and imply as if the shift of network standards control to an International Body vs an American Body is responsible for malicious traffic ...</div><div><br data-mce-bogus="1"></div><div>So if I apply your logic, then ... President Eisenhower who commissioned the National Highway infrastructure, is also responsible for the crime that happens involving anyone using a a getaway car as well as all the people who get killed on the road.... After all, all the smart folks who were responsible for the design and implementation of the National Highway system were also the experts in the Automotive industry at that time ?</div><div><br data-mce-bogus="1"></div><div>Get over it, you can stop wearing a tin hat, and get a global perspective on things...</div><div><br></div><div data-marker="__SIG_PRE__">Faisal Imtiaz<br>Snappy Internet & Telecom<br></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><blockquote style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"GregoryB" <gb20090101@gmail.com><br><b>To: </b>"Faisal Imtiaz" <faisal@snappytelecom.net><br><b>Cc: </b>"voiceops@voiceops.org" <voiceops@voiceops.org><br><b>Sent: </b>Sunday, March 20, 2016 1:56:45 PM<br><b>Subject: </b>Re: [VoiceOps] . DDOS Attacks and ITSP's<br></blockquote></div><div data-marker="__QUOTED_TEXT__"><blockquote style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><div class=""><blockquote class=""><div class=""><div class="" style="font-family: tahoma, 'new york', times, serif; font-size: 12pt;" data-mce-style="font-family: tahoma, 'new york', times, serif; font-size: 12pt;"><div class=""><span style="font-size: 12pt;" class="" data-mce-style="font-size: 12pt;">That is a bunch of Bull !, and fear mongering.... </span></div><div class=""><br class=""></div><div class="">ARIN is an organization that manages assignment... they are not a Traffic COP nor are they responsible for checking packet content !</div></div></div></blockquote></div><div class=""><br class=""></div>You’re entitled to your own opinion.<div class=""><br class=""></div><div class="">I have my own very practical and day to day experience in networking [since 1988], routing and security as well as contacts in industry ever since.</div><div class=""><br class=""></div><div class="">Also I still have very fresh memories from previous “deregulation” when [the only, back then] domain registrar - Internic had been removed from the power and ICANN formed (1998).</div><div class="">But that was related to only the domain name space. Now the integrity and reachability (neutrality?) of the whole Internet is at stake.</div><div class="">I’m not saying ARIN (or RIPE, LACNIC, etc.) is ideal, but the collective expertise of people involved there (because those people actually work or worked for technical, routing, infrastructure, etc. departments of backbone Internet providers and largest as well as all possible ranges telecom providers) combined with regular gathering of engineers and network administrators who exchange their experience provides as a good environment to collect, analyze and further systematise network matters.</div><div class=""><div class="">-- <br class="">Regards,<br class="">G.B.</div><br class=""><div><blockquote class=""><div class="">On Mar 20, 2016, at 12:35 PM, Faisal Imtiaz <<a href="mailto:faisal@snappytelecom.net" class="" target="_blank" data-mce-href="mailto:faisal@snappytelecom.net">faisal@snappytelecom.net</a>> wrote:</div><div class=""><div class=""><div style="font-family: tahoma, 'new york', times, serif; font-size: 12pt;" class="" data-mce-style="font-family: tahoma, 'new york', times, serif; font-size: 12pt;"><div class=""><span style="font-family: Helvetica, Arial, sans-serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; background-color: #ffffff; display: inline !important;" class="" data-mce-style="font-family: Helvetica, Arial, sans-serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; background-color: #ffffff; display: inline !important;">>>I don’t know of _who_ else may have more expertise in developing and deploying attack mitigation solutions than ARIN.</span></div><div class=""><br class=""></div><div class="">Get real, just because they assign IP's and ASN's does not mean that they have dpi expertise.... !</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">>>><span style="font-family: Helvetica, Arial, sans-serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; background-color: #ffffff; display: inline !important;" class="" data-mce-style="font-family: Helvetica, Arial, sans-serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; background-color: #ffffff; display: inline !important;">IMHO - it’s going worsen soon because of another vicious cycle of “deregulations” and passing on more control over the Internet to 3rd (foreign) parties.</span></div><div class=""><br class=""></div><div class="">That is a bunch of Bull !, and fear mongering.... </div><div class=""><br class=""></div><div class="">ARIN is an organization that manages assignment... they are not a Traffic COP nor are they responsible for checking packet content !</div><div class=""><br class=""></div><div class="">Faisal Imtiaz<br class="">Snappy Internet & Telecom<br class=""></div><hr id="zwchr" class=""><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: #1010ff; margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class="" data-mce-style="border-left-width: 2px; border-left-style: solid; border-left-color: #1010ff; margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;"><b class="">From: </b>"GregoryB" <<a href="mailto:gb20090101@gmail.com" class="" target="_blank" data-mce-href="mailto:gb20090101@gmail.com">gb20090101@gmail.com</a>><br class=""><b class="">To: </b>"<a href="mailto:voiceops@voiceops.org" class="" target="_blank" data-mce-href="mailto:voiceops@voiceops.org">voiceops@voiceops.org</a>" <<a href="mailto:voiceops@voiceops.org" class="" target="_blank" data-mce-href="mailto:voiceops@voiceops.org">voiceops@voiceops.org</a>><br class=""><b class="">Sent: </b>Saturday, March 19, 2016 1:28:01 PM<br class=""><b class="">Subject: </b>Re: [VoiceOps] . DDOS Attacks and ITSP's<br class=""></blockquote></div><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: #1010ff; margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class="" data-mce-style="border-left-width: 2px; border-left-style: solid; border-left-color: #1010ff; margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;">Just in case anyone may have any doubts… ARIN is again under the attack (2nd time this month).<div class="">I don’t know of _who_ else may have more expertise in developing and deploying attack mitigation solutions than ARIN.<br class=""><div class="">IMHO - it’s going worsen soon because of another vicious cycle of “deregulations” and passing on more control over the Internet to 3rd (foreign) parties.<br class=""><div class="">==</div><div class=""><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Date: Fri, 18 Mar 2016 15:37:48 -0400</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">From: ARIN <</span><a href="mailto:info@arin.net" style="font-family: Monaco; font-size: 10px;" class="" target="_blank" data-mce-href="mailto:info@arin.net" data-mce-style="font-family: Monaco; font-size: 10px;">info@arin.net</a><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">></span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">To: </span><a href="mailto:arin-announce@arin.net" style="font-family: Monaco; font-size: 10px;" class="" target="_blank" data-mce-href="mailto:arin-announce@arin.net" data-mce-style="font-family: Monaco; font-size: 10px;">arin-announce@arin.net</a><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Subject: [arin-announce] ARIN DDoS Attack</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Message-ID: <</span><a href="mailto:56EC590C.1030902@arin.net" style="font-family: Monaco; font-size: 10px;" class="" target="_blank" data-mce-href="mailto:56EC590C.1030902@arin.net" data-mce-style="font-family: Monaco; font-size: 10px;">56EC590C.1030902@arin.net</a><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">></span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Content-Type: text/plain; charset=utf-8; format=flowed</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Starting at 1:25 PM EDT on Friday, 18 March, a DDoS attack began against</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">ARIN. This was and continues to be a sustained attack against our</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">provisioning services, email, and website. We initiated our DDoS</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">mitigation plan and are in the process of mitigating various types of</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">attack traffic patterns. All our other public-facing services (Whois,</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Whois-RWS, RDAP, DNS, IRR, and RPKI repository services) are not</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">affected by this attack and are operating normally.</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">We will announce an all clear 24 hours after the attacks have stopped.</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Regards,</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Mark Kosters</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">Chief Technology Officer</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;"><span style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">American Registry for Internet Numbers (ARIN)</span><br style="font-family: Monaco; font-size: 10px;" class="" data-mce-style="font-family: Monaco; font-size: 10px;">==</div><div class=""><br class="">I have reasons of not wanting to provide my address nor name.</div><div class="">==<br class=""><br class=""><div class=""><blockquote class=""><div class="">On Mar 19, 2016, at 12:42 PM, Tim Linn <<a href="mailto:timothyl@voipinnovations.com" class="" target="_blank" data-mce-href="mailto:timothyl@voipinnovations.com">timothyl@voipinnovations.com</a>> wrote:</div><div class=""><div class=""><div class="">Ryan,</div><div class=""><br class=""></div><div class="">This is a great discussion to start. I can't contribute at this time, but I certainly plan on giving you guys all of the information about what we at VI have been doing, what has worked, what hasn't worked, what we saw, what we didn't see, etc. Certain contacts may not allow me to name company names, but I still think we can give out enough information to be useful.</div><div class=""><br class=""></div><div class="">We definitely plan on giving this information out. Like you said, events like these are typically embarrassing and companies don't like to come out and describe exactly how negligent or naive they were to allow it.</div><div class=""><br class=""></div><div class="">I feel that getting the knowledge out there is much more important than our pride though. Right now, we're not giving out a whole lot of information on what we are doing in fear that it will be "used against us." I do somewhat agree with your assessment about these people knowing this stuff already, but at this point we don't want to take the chance (as irrational as that seems).</div><div class=""><br class=""></div><div class="">Once we're in a more stable place, I will certainly work with our Networking Engineer, Owner, and Operations Manager on trying to talk them into giving out the most information possible to arm you guys in the event that this occurs to any of you.</div><div class=""><br class=""></div><div class="">In the meantime, if you have any questions, please feel free to email me. I will do my best to help as much as I can.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Timothy Linn</div><div class="">Lead Systems Engineer</div><div class="">Voip Innovations</div><div class=""><br class=""></div><div class=""><br class=""></div><div id="composer_signature" class=""><div style="font-size: 85%; color: #575757;" class="" data-mce-style="font-size: 85%; color: #575757;">Sent from my Verizon Wireless 4G LTE smartphone</div></div><br class=""> <br class=""> -------- Original message --------<br class=""> From: <a href="mailto:voiceops-request@voiceops.org" class="" target="_blank" data-mce-href="mailto:voiceops-request@voiceops.org">voiceops-request@voiceops.org</a> <br class=""> Date: 2016/03/19 12:00 (GMT-05:00) <br class=""> To: <a href="mailto:voiceops@voiceops.org" class="" target="_blank" data-mce-href="mailto:voiceops@voiceops.org">voiceops@voiceops.org</a> <br class=""> Subject: VoiceOps Digest, Vol 81, Issue 38 <br class=""> <br class=""><div class="PlainText"><br class=""> ----------------------------------------------------------------------<br class=""> <br class=""> Message: 1<br class=""> Date: Fri, 18 Mar 2016 17:07:56 -0700<br class=""> From: Ryan Delgrosso <<a href="mailto:ryandelgrosso@gmail.com" class="" target="_blank" data-mce-href="mailto:ryandelgrosso@gmail.com">ryandelgrosso@gmail.com</a>><br class=""> To: "<a href="mailto:voiceops@voiceops.org" class="" target="_blank" data-mce-href="mailto:voiceops@voiceops.org">voiceops@voiceops.org</a>" <<a href="mailto:voiceops@voiceops.org" class="" target="_blank" data-mce-href="mailto:voiceops@voiceops.org">voiceops@voiceops.org</a>><br class=""> Subject: [VoiceOps] DDOS Attacks and ITSP's<br class=""> Message-ID: <<a href="mailto:56EC985C.6050203@gmail.com" class="" target="_blank" data-mce-href="mailto:56EC985C.6050203@gmail.com">56EC985C.6050203@gmail.com</a>><br class=""> Content-Type: text/plain; charset="utf-8"; Format="flowed"<br class=""> <br class=""> With the current mega-thread about VI I figured I would get an <br class=""> educational discussion going about DDOS. Search the archives, Ive <br class=""> probably started this discussion a few times in the past but each time <br class=""> the context is different.<br class=""> <br class=""> I have given talks at several different venues (anyone here a CFCA <br class=""> member, or been to a Metaswitch forum event?) about DDOS and what the <br class=""> current arsenal of internet attacks means to voice. Unfortunately many <br class=""> network operators treat DDOS like a shameful thing and don't share <br class=""> information about it. This makes it that much harder for network <br class=""> operators to do the right thing and take meaningful and decisive action <br class=""> and ultimately makes the jobs of the attackers that much easier.<br class=""> <br class=""> Keep in mind sharing these kinds of tactics isn't "helping the <br class=""> attackers". They know this stuff. Its OK to tell them what they know. <br class=""> Who doesn't know this stuff are other operators that haven't been hit yet.<br class=""> <br class=""> Have you been hit by DDOS? Have you built out solutions to cope with DDOS?<br class=""> <br class=""> Ill start things off:<br class=""> <br class=""> 1. How do you know its a DDOS and something isn't just broken?<br class=""> 1. netflow<br class=""> 2. SBC retransmissions (this will often be your first warning)<br class=""> 3. Significant deviation from normal traffic volumes<br class=""> 2. As a VoIP carrier, my network looks like a DDOS attack all the time<br class=""> (oodles of UDP traffic). this makes most commercial solutions a<br class=""> square peg / round hole problem.<br class=""> 3. DDOS survivability must be designed into the network not bolted on.<br class=""> 1. Place Access SBC's, Peering SBC's, Webservers, etc on different<br class=""> networks and on different BGP adertisements.<br class=""> 2. Have multiple access SBC's on different networks / routers / BGP<br class=""> advertisements<br class=""> 3. Use DNS to home ALL clients. When your Access SBC succumbs to a<br class=""> reflection attack you can flip your customers using SRV records<br class=""> to the surviving SBC's. Customers using straight IP will remain<br class=""> down.<br class=""> 4. Use CDN networks like Cloudflare / Cloudfront or just put<br class=""> webservers in EC2. Keep web away from voice. Webservers are<br class=""> attack magnets.<br class=""> 5. Build defense in depth. Your network is a medieval castle, have<br class=""> moats and walls and soldiers.<br class=""> 4. Be a good netizen. If you are an ISP, implement BCP38. No open DNS<br class=""> recursors, no open NTP or SNMP services that are reflection targets.<br class=""> Leave no loaded weapons for others in your network.<br class=""> 5. Traffic scrubbing services typically don't mix well with VoIP<br class=""> carriers. This is basically the TSA of the network. (there are<br class=""> exceptions, the price tags have commas).<br class=""> 6. How do you go about testing your protections? Don't just sit smugly<br class=""> in your house made of straw.<br class=""> 7. Most upstream carrier DDOS protection strategies include "blackhole<br class=""> the destination to protect the network". This saves them but<br class=""> accomplishes your attackers goal.<br class=""> 8. Do you know how big of a DDOS it actually takes to hurt you? Ill bet<br class=""> its less than you think.<br class=""> <br class=""> <br class=""> So lets hear it. Who has experience on this front? What would you like <br class=""> to share? Comments on the above?<br class=""> <br class=""> -Ryan<br class=""></div>This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received this message in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Unauthorized interception of this e-mail is a violation of federal criminal law. We reserve the right, when permitted by law, to scan electronic communications, including e-mail and instant messaging, for the purposes of security and compliance with our internal policy.</div>_______________________________________________<br class="">VoiceOps mailing list<br class=""><a href="mailto:VoiceOps@voiceops.org" class="" target="_blank" data-mce-href="mailto:VoiceOps@voiceops.org">VoiceOps@voiceops.org</a><br class=""><a href="https://puck.nether.net/mailman/listinfo/voiceops" class="" target="_blank" data-mce-href="https://puck.nether.net/mailman/listinfo/voiceops">https://puck.nether.net/mailman/listinfo/voiceops</a><br class=""></div></blockquote></div><br class=""></div></div></div><br class="">_______________________________________________<br class="">VoiceOps mailing list<br class=""><a href="mailto:VoiceOps@voiceops.org" class="" target="_blank" data-mce-href="mailto:VoiceOps@voiceops.org">VoiceOps@voiceops.org</a><br class="">https://puck.nether.net/mailman/listinfo/voiceops<br class=""></blockquote></div></div></div></div></blockquote></div><br class=""></div><br></blockquote></div></div></body></html>