This category contains information about events that may affect your service such as maintenance or outages. It also contains announcements on new products releases and enhancements.
Power Distribution Failure
December 19, 2024 – 7:30am – This morning we had a failure of one of our power distribution units. It affected a lot of systems which caused most of our services to be offline. This affected email, web sites, phone systems (including ours), and other systems. We have identified the issue and implemented a workaround. Most systems have come back online, but we are still working to bring a few up. We will be posting more later.
Update – 7:40am – We had reports that the email system was not authenticating. The backend part of the system failed to come online, but we have brought it online now and all services regarding mail seem to have recovered. Some email may be delayed in reaching your mailbox.
Update – 7:55am – We believe that all affected systems are online and functioning normally. If you have a system that is still not working for you, please contact us at support@internetpro.net via the chat in the lower right of this screen, or call us at 256-547-6817.
Update – 8:28am – We were made aware of a few shared websites that did not come back online. This was because of a web server misconfiguration that would have been caught during normal operation, but the reboot due to the power failure caused the bad config to be loaded and kept some sites from working properly. This has been resolved.
This issue was caused by a failure of one of our network-controlled power distribution systems. We use that type of system to be able to automatically and remotely reboot systems as well as to check power loads, battery conditions, etc. The entire bank of outlets failed, and caused some systems without redundant power supplies to go down. Unfortunately, there were a couple of critical bottlenecks there which caused other systems that had not gone offline to be unreachable. We will be scheduling maintenance in the near future to replace the unit and that will be done during off-peak hours. We will also be evaluating the bottlenecks made relevant in this failure and will be working to implement design changes to prevent a recurrence.