<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Local Loop &#187; fail</title>
	<atom:link href="http://localloop.co.za/tag/fail/feed/" rel="self" type="application/rss+xml" />
	<link>http://localloop.co.za</link>
	<description>Internet and Networking in South Africa</description>
	<lastBuildDate>Sat, 09 Jul 2011 00:48:00 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.1</generator>
		<item>
		<title>RSAWeb (sort of) responds</title>
		<link>http://localloop.co.za/2010/02/rsaweb-sort-of-responds/</link>
		<comments>http://localloop.co.za/2010/02/rsaweb-sort-of-responds/#comments</comments>
		<pubDate>Thu, 18 Feb 2010 15:21:56 +0000</pubDate>
		<dc:creator>Simeon Miteff</dc:creator>
				<category><![CDATA[General]]></category>
		<category><![CDATA[Regulatory]]></category>
		<category><![CDATA[Technical]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[ispa]]></category>
		<category><![CDATA[RSAWeb]]></category>
		<category><![CDATA[spammers]]></category>

		<guid isPermaLink="false">http://localloop.co.za/?p=512</guid>
		<description><![CDATA[Shortly after my post revealing that RSAWeb (among others) provide hosting for known South African spammers, I got an email from their Technical Director, Mark Slingsby, asking how recent my lookups were1, and requesting me to name the offenders2 so that his sysadmin team can follow up. I replied with a detailed response, noting that [...]]]></description>
			<content:encoded><![CDATA[<p>Shortly after my <a href="http://localloop.co.za/2010/02/ispa-members-provide-hosting-for-local-spammers/">post</a> revealing that RSAWeb (among others) provide hosting for known South African spammers, I got an email from their Technical Director, Mark Slingsby, asking how recent my lookups were<sup><a href="http://localloop.co.za/2010/02/rsaweb-sort-of-responds/#footnote_0_512" id="identifier_0_512" class="footnote-link footnote-identifier-link" title="The post started with the words &amp;#8220;This morning&amp;#8221;&amp;#8230;">1</a></sup>, and requesting me to name the offenders<sup><a href="http://localloop.co.za/2010/02/rsaweb-sort-of-responds/#footnote_1_512" id="identifier_1_512" class="footnote-link footnote-identifier-link" title="Couldn&amp;#8217;t they get the list off the ISPA site and do their own lookups?">2</a></sup> so that his sysadmin team can follow up.</p>
<p>I replied with a detailed response, noting that the MX record points to a web virtual-hosting box at RSAWeb that isn&#8217;t accepting SMTP (I imagine having a broken MX suits Dynamic Seminars just fine), and that the website is a RSAWeb domain parking page.</p>
<p>Mark responded with this:</p>
<blockquote><p>Thanks for putting this out in the wild, we do not condone spam &#038; spammers. Unfortunately its always difficult to isolate these spammers as they tend to be small and difficult to detect unless we notice an abuse pattern or receive spam complaints! However we always make a concerted effort to stop these guys. Spam is inherintly evil and we have terminated the services of spammers that havent even made this ISPA hall of shame list (and will continue to do so).</p></blockquote>
<p>He also said they&#8217;ve suspended the hosting until they have concluded their investigation. When I checked this afternoon, the domain parking page was still up, so I don&#8217;t know what they mean by &#8220;suspended&#8221;. Also, the specific spammer is number one out of twenty-five on the ISPA list, which hardly makes them small, or difficult to detect.</p>
<p>Nevertheless, RSAWeb at least took notice, which is probably more than I can say for the others in my ISPA members hall of shame.</p>
<ol class="footnotes"><li id="footnote_0_512" class="footnote">The post started with the words &#8220;This morning&#8221;&#8230;</li><li id="footnote_1_512" class="footnote">Couldn&#8217;t they get the list off the ISPA site and do their own lookups?</li></ol>]]></content:encoded>
			<wfw:commentRss>http://localloop.co.za/2010/02/rsaweb-sort-of-responds/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>ISP Fail: FNBConnect and Internet Solutions. Who screwed up?</title>
		<link>http://localloop.co.za/2009/08/isp-fail-fnbconnect-and-internet-solutions-who-screwed-up/</link>
		<comments>http://localloop.co.za/2009/08/isp-fail-fnbconnect-and-internet-solutions-who-screwed-up/#comments</comments>
		<pubDate>Mon, 17 Aug 2009 09:56:35 +0000</pubDate>
		<dc:creator>Simeon Miteff</dc:creator>
				<category><![CDATA[Technical]]></category>
		<category><![CDATA[bgp]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[fnbconnect]]></category>
		<category><![CDATA[IS]]></category>
		<category><![CDATA[MTN Business]]></category>
		<category><![CDATA[peering]]></category>
		<category><![CDATA[SAIX]]></category>

		<guid isPermaLink="false">http://localloop.co.za/?p=252</guid>
		<description><![CDATA[The /16 route being announced by First National Bank&#8217;s new IPConnect ADSL-based consumer ISP, FNBCONNECT (AS37028) disappeared from the Internet Solutions (AS3741) local routing table somewhere between last week Wednesday (2009/08/12) and Friday (2009/08/14). It seems their transit via First National Bank&#8217;s own network went down. FNB, in turn, buys transit via IS and MTN [...]]]></description>
			<content:encoded><![CDATA[<p>The /16 route being announced by First National Bank&#8217;s new IPConnect ADSL-based consumer ISP, FNBCONNECT (AS37028) disappeared from the Internet Solutions (AS3741) local routing table somewhere between last week Wednesday (2009/08/12) and Friday (2009/08/14).</p>
<p>It seems their transit via First National Bank&#8217;s own network went down. FNB, in turn, buys transit via IS and MTN Business. FNBConnect&#8217;s transit via Telkom SA (SAIX) is still working though, so they are reachable from MTN Business (and the rest of the Internet) via SAIX.<div id="attachment_254" class="wp-caption alignright" style="width: 210px"><img src="http://localloop.co.za/wp-content/uploads/2009/08/whoscrewedup1.png" alt="Spot the odd one out..." title="Spot the odd one out..." width="200" height="347" class="size-full wp-image-254" /><p class="wp-caption-text">Spot the odd one out...</p></div><br />
It&#8217;s hard to tell who is to blame even when you can check the routes on route servers for each provider&#8217;s network. The reason why is because BGP routes could be filtered on either end of a link. This is of course convenient for the providers, as they can (and do!) always blame the other party. When it gets fixed, you never hear who did the fixing. It is however fun to try and infer who screwed up their filters.</p>
<p>In the graph on the right I&#8217;ve used green to indicate the links and ASNs we know for sure are getting the FNBCONNECT route. Orange indicates the links and ASNs of unknown status, while red shows what is definitely not working.</p>
<p>We at least know that their transit to IS via FNB worked when I <a href="http://localloop.co.za/archives/188">first blogged about FNBCONNECT</a>:</p>
<p><code>* 41.183.0.0/16 168.209.255.8 0 3741 17148 37028 i</code></p>
<p>So which is more likely, SAIX screwed up their outbound filters on their peering links to IS but not to MTN Business, or IS screwed up their inbound peering filters and its only showing now because their preferred route was via their customer?</p>
<p>This is possibly the third time I&#8217;ve noticed a peering problem involving IS, where no problem existed between IS&#8217; peer and another peer (like SAIX or MTN Business).</p>
<p>The end result? IS is routing like we&#8217;re back in 1996!:<br />
<code><br />
local-route-server>traceroute 41.183.0.0</p>
<p>Type escape sequence to abort.<br />
Tracing the route to 41.183.0.0</p>
<p>  1 ar2-rba-tnr-gi0-3-11.ip.isnet.net (196.34.7.195) [AS 3741] 0 msec 4 msec 4 msec<br />
  2 core1b-rba-gi1-0-5.ip.isnet.net (196.26.0.181) [AS 3741] 4 msec 4 msec 4 msec<br />
  3 mi-za-rba-p5-gi0-1-101.ip.isnet.net (168.209.164.49) [AS 3741] [MPLS: Label 2594 Exp 1] 172 msec 172 msec 176 msec<br />
  4 mi-uk-dock-p3-po2-0.ip.isnet.net (168.209.224.65) [AS 3741] [MPLS: Label 2859 Exp 1] 172 msec<br />
  5 core1a-dock-gi1-0-0-101.ip.isnet.net (168.209.164.0) [AS 3741] 184 msec 176 msec<br />
  6 core1b-dock-gi0-0-2.ip.isnet.net (168.209.246.1) [AS 3741] 176 msec *  172 msec<br />
  7 gi8-13.mpd01.lon02.atlas.cogentco.com (149.6.148.1) 180 msec 176 msec 172 msec<br />
  8 te4-2.ccr01.lon01.atlas.cogentco.com (130.117.1.201) 172 msec<br />
  9 vl3493.mpd01.lon01.atlas.cogentco.com (130.117.2.17) 172 msec<br />
    te3-1.mpd01.lon01.atlas.cogentco.com (130.117.3.225) 176 msec<br />
    vl3493.mpd01.lon01.atlas.cogentco.com (130.117.2.17) 172 msec<br />
 10 te1-2.ccr01.lon05.atlas.cogentco.com (130.117.49.94) 172 msec 176 msec<br />
 11 149.6.2.194 184 msec 180 msec 180 msec<br />
 12 rrba-ip-esr-1-ge-6-0-0.telkom-ipnet.co.za (196.43.11.166) [AS 5713] 184 msec 184 msec 184 msec<br />
 13 first-national-bank-gw.telkom-ipnet.co.za (196.25.207.178) [AS 5713] 188 msec 188 msec 188 msec<br />
=== snip ===<br />
</code></p>
<p><strong>Update:</strong><br />
Dear Readers</p>
<p>I&#8217;ve decided that if I&#8217;m going to moan, complain, and accuse ISPs of FAILure on this blog, then I should at least follow my accusations up, and provide constructive post-mortem commentary (where possible). So here goes:</p>
<p>IS->FNBConnect traffic is flowing via FNB again. Also see the comment from Nick Treasure (IS).</p>
<p>Regards,<br />
Simeon.</p>
]]></content:encoded>
			<wfw:commentRss>http://localloop.co.za/2009/08/isp-fail-fnbconnect-and-internet-solutions-who-screwed-up/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>ISP Fail: Private ASN on the Verizon/IS peering link</title>
		<link>http://localloop.co.za/2009/05/isp-fail-private-asn-on-the-verizonis-peering-link/</link>
		<comments>http://localloop.co.za/2009/05/isp-fail-private-asn-on-the-verizonis-peering-link/#comments</comments>
		<pubDate>Wed, 27 May 2009 10:40:22 +0000</pubDate>
		<dc:creator>Simeon Miteff</dc:creator>
				<category><![CDATA[Technical]]></category>
		<category><![CDATA[bgp]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[Hetzner]]></category>
		<category><![CDATA[IS]]></category>
		<category><![CDATA[MTN Business]]></category>
		<category><![CDATA[peering]]></category>
		<category><![CDATA[remove-private-as]]></category>
		<category><![CDATA[verizon]]></category>

		<guid isPermaLink="false">http://localloop.co.za/?p=215</guid>
		<description><![CDATA[Spotted on local-route-server.is.co.za today: * 41.203.16.0/22 168.209.255.8 0 3741 2905 65419 i * 41.203.20.0/23 168.209.255.8 0 3741 2905 65419 i * 41.203.22.0/23 168.209.255.8 0 3741 2905 65419 i * 41.203.24.0/21 168.209.255.8 0 3741 2905 65419 i * 41.204.216.0/22 168.209.255.8 0 3741 2905 65419 i * 41.204.220.0/23 168.209.255.8 0 3741 2905 65419 i * 196.22.132.0/22 168.209.255.8 [...]]]></description>
			<content:encoded><![CDATA[<p>Spotted on <code>local-route-server.is.co.za</code> today:</p>
<p><code>*  41.203.16.0/22   168.209.255.8                          0 3741 2905 65419 i<br />
*  41.203.20.0/23   168.209.255.8                          0 3741 2905 65419 i<br />
*  41.203.22.0/23   168.209.255.8                          0 3741 2905 65419 i<br />
*  41.203.24.0/21   168.209.255.8                          0 3741 2905 65419 i<br />
*  41.204.216.0/22  168.209.255.8                          0 3741 2905 65419 i<br />
*  41.204.220.0/23  168.209.255.8                          0 3741 2905 65419 i<br />
*  196.22.132.0/22  168.209.255.8                          0 3741 2905 65419 i<br />
*  196.22.136.0/21  168.209.255.8                          0 3741 2905 65419 i<br />
*  196.30.125.0     168.209.255.8                          0 3741 2905 65419 i</code></p>
<p>It looks like Hetzner is announcing these to MTN Business (previously Verizon Business SA) using an autonomous system number from the private range (64512 to 65535). That is perfectly reasonable as long as MTN Business strips the private ASN when they announce these routes on the Internet.</p>
<p>Doing this is easy (<i>neighbor x.x.x.x remove-private-AS</i>), and as far as I can tell, they get it right on their links to SAIX and Verizon Business Europe/US, but as you can see, not on their link to Internet Solutions.</p>
]]></content:encoded>
			<wfw:commentRss>http://localloop.co.za/2009/05/isp-fail-private-asn-on-the-verizonis-peering-link/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Because DOC policy is working so well for us&#8230;</title>
		<link>http://localloop.co.za/2008/09/because-doc-policy-is-working-so-well-for-us/</link>
		<comments>http://localloop.co.za/2008/09/because-doc-policy-is-working-so-well-for-us/#comments</comments>
		<pubDate>Fri, 19 Sep 2008 15:04:27 +0000</pubDate>
		<dc:creator>Simeon Miteff</dc:creator>
				<category><![CDATA[Regulatory]]></category>
		<category><![CDATA[doc]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[policy]]></category>
		<category><![CDATA[vans]]></category>
		<category><![CDATA[zimbabwe]]></category>

		<guid isPermaLink="false">http://localloop.co.za/?p=58</guid>
		<description><![CDATA[As if they haven&#8217;t caused enough problems already, the DOC plans to help our friends in Zimbabwe fly their communications sector into a hillside too! The Department of Communications (DOC) says SA will use its position as the chair of SADC to drive ICT issues in the region, in particular Zimbabwe. &#8220;Our ICT intellectual affairs [...]]]></description>
			<content:encoded><![CDATA[<p>As if they haven&#8217;t caused <a href="http://www.itweb.co.za/sections/telecoms/2008/0809191420.asp?A=LEG&#038;S=Legal%20View&#038;O=FPLEAD">enough problems</a> already, the DOC plans to help our friends in Zimbabwe fly their communications sector into a hillside too!</p>
<blockquote><p>The Department of Communications (DOC) says SA will use its position as the chair of SADC to drive ICT issues in the region, in particular Zimbabwe. &#8220;Our ICT intellectual affairs and trade branch will come up with an ICT proposal in which key issues, such as digital migration, will form part of the SADC programme,&#8221; says DOC spokesman Joe Makhafola.<br />
&#8211; <a href="http://www.moneyweb.co.za/mw/view/mw/en/page201650?oid=225849&amp;sn=Detail">Moneyweb</a></p></blockquote>
]]></content:encoded>
			<wfw:commentRss>http://localloop.co.za/2008/09/because-doc-policy-is-working-so-well-for-us/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

