Blog

AT&T Network Engineers will be performing a planned maintenance on Birmingham-Alabama
Access Router 1. The work will be performed on 11/18/2010, during the maintenance
window of 12:00AM-6:00AM, local time. AT&T's goal is to successfully complete the
task and restore service within the stated time frame.

We apologize for any inconvenience that you may experience.
We expect service to be impacted somewhat during the maintenance window.

AT&T Engineers will be performing an IOS upgrade.

AT&T Network Engineers will be performing a planned maintenance on
Birmingham-Alabama Access Router 1. The work will be performed on 10/5/2010,
during the maintenance window of 12:00AM-6:00AM, local time. AT&T's goal is
to successfully complete the task and restore service within the stated time frame. 

We apologize for any inconvenience that you may experience.
We expect service to be impacted somewhat during the maintenance window.

AT&T Network Engineers will be performing a router reload.

Sept 3, 2010 – We are experiencing an outage that started at 4:00pm.  We are working with AT&T on a resolution.  The ticket is currently in the testing stages and we do not know what the upstream issue is.   The problem is definitely outside our network, and we are waiting on news from the upstream providers in order to get an estimated time to repair.

Update 7:50 pm.  Looks like everything is back up. AT&T has still not informed us of what the problem was, but because of the Labor Day weekend they were slower than usual in their response.  We are working on adding an additional provider to add more redundancy since we cannot count on them.

Sept 4, 2010 – AT&T never did contact us about the resolution to the problem and they automatically closed their ticket.  However, this morning we are continuing to experience issues related to this problem.   As of 8:50am, most sites/services are being impacted.  We have re-opened a ticket with AT&T and are hoping they will work on this in a timely manner, but right now it does not seem like they want to work on a holiday weekend.

Update 11:25am  – Finally got some needed info from AT&T.  They have a major fiber cut between Anniston and Talladega due to construction work.   Estimated Time to Repair is 1:00pm CDT.   This issue is affecting a large area.

Update 11:31am – Well, that was quick.  They just told us 1:00, but everything just came online.

We have upgraded our alternate webmail interface.   Our alternate interface can be found at https://webmail.internetpro.net.   We have just upgraded it to the newest version available.  This interface includes several advantages over our traditional interface, including an HTML editor and drag-and-drop ability using AJAX.   However, the alternate interface is not integrated into your email settings or your server-side filtering.  Feel free to try out either interface to see which one suits your needs better.

Update: We have added a button on our home page under the Online Email Center which links to the alternate interface. We hope you enjoy it.

As of 9:50am, our phones have gone out and we are unable to make outgoing calls or receive incoming calls. We are working with our telco provider to resolve the issue. If you have an immediate need, please email us at support@internetpro.net with a callback number.

10:20am – Our phone system is back online and we do not anticipate any additional issues.

We are replacing some hardware that is about to fail in one of our web servers.  The server will go down for a short time and will affect some web hosting customers.  The downtime should be very short, and this is a necessary replacement to keep the server from failing later.  – 10:20pm

Server back online at 10:28.  We have tested it and all sites look OK.  Eight minutes downtime.

At 4:22pm we experienced an outage of our primary circuit. It is an upstream outage and seems to be causing issues with Verizon phones and multiple carriers as well.  We are working with upstream providers on a resolution.

5:19pm – The issue is a major fiber cut between Birmingham and Talladega.  There is no current estimated time to repair.

10:15pm – Estimated Time to Repair is now 3:00am.  AT&T has identified two problems — the fiber cut and a hardware issue caused by the bouncing circuit.  If they fix either one or the two, our circuits should normalize.

3:25am – Service seems to be fully restored.  Some networks/carriers still affected by the issue, and complete restoration of all fiber is now estimated to be repaired by 4:00am CDT.

Don’t forget:  You can follow updates such as these on Twitter by following @netsolinc.

One of our wireless base units is experiencing a problem.  This is only affecting a few customers.  The first issue was reported at 4:27pm and was “fixed” at 4:43pm, but the unit is continuing to fail.  We are in the process of diagnosing the problem and rerouting affected customers to our redundant wireless base units. It is currently 6:15pm.

All customers are have been successfully rerouted to redundant systems.  The primary system is currently operational as well, but we will be testing it to find the issue causing the sporadic malfunction. 6:30pm