Online.net Services status

  • Status Closed
  • Percent Complete
    100%
  • Task Type Bug Report
  • Category Backend / Core
  • Severity High
  • Priority High

FS#1314 - [Scaleway] NAT issues on PAR1

We identified a problem with our NAT in PAR1, causing various network issues (UDP traffic especially).
Our network team is still investigating the root cause and will work on updating our NAT as soon as we are ready to do so.

We will keep this status updated as much as possible with more information.
In the meantime, feel free to contact our support team should you have any question or particular network issue.

Thank you for your patience.

This task does not depend on any other tasks.

Closed by  Dedibox (dedibox)
Thursday, 12 July 2018, 13:37 GMT
Reason for closing:  Fixed
Thursday, 12 July 2018, 13:37 GMT
During a planned NAT upgrade we've bumped into a minor issue, that impacted less than 1% of customers' traffic in very specific cases. After some investigation we have taken the decision to perform a rollback.

Our NAT farm is redundant and the network is designed to dynamically reroute traffic around dysfunctional or maintained elements, so the NAT machines, which we took out of production to perform the rollback were not forwarding customer traffic. This was done as expected, however for some of the NAT machines, rollback procedure took more time than expected, and at some point too many machines were taken out of production. Our NAT farm was operating at about 50% of normal capacity. During this period PAR1 customers suffered from insufficient bandwidth.

Loading...