2024-09-16 - GLOBAL - Firebox Webblocker Service not available
Incident Report for WatchGuard Technologies
Postmortem



Event Summary: The WatchGuard Firebox WebBlocker service was degraded impacting some of our WebBlocker customers in our Europe region between, approximately, September 16th 06:45 UTC and 07:10 UTC.  Customers may have experienced 5XX errors.  The event is now resolved, and the service is operating normally for all WatchGuard Firebox WebBlocker users.



Event Findings: On September 16th, at approximately 07:10 UTC, our engineers were alerted to a potential issue with the WebBlocker service.  We reached out to our 3rd party provider of the service, and they were able to mitigate the issue by re-routing a subset of traffic to another region.  Our 3rd party provider has performed an in-depth analysis with their cloud provider and has already taken action to mitigate the risk of recurrence.



We sincerely apologize for the impact on our affected customers, and we know the stability of our services is important to you and your business. At WatchGuard, we will never be satisfied with anything less than perfect operational performance and will continue to do everything we can to drive improvements across our services.

Posted Sep 24, 2024 - 20:31 UTC

Resolved
We are no longer experiencing alerts on the Webblocker service and this incident is now resolved. The service is operating normally at this time.
Posted Sep 16, 2024 - 08:00 UTC
Monitoring
Our systems show alerts on the Webblocker service are returning to normal and we're monitoring to ensure system stability. We'll post our next update in 30 minutes, if not sooner.
Posted Sep 16, 2024 - 07:39 UTC
Investigating
We're investigating alerts on the Webblocker service. Once we determine the impact and scale of these errors we'll post our next update in 30 minutes, if not sooner.
Posted Sep 16, 2024 - 07:26 UTC