All Systems Operational
Redpill Linpro Nordic Cloud Operational
Container Platform infrastructure Operational
Compute Infrastructure Operational
Datacentres Operational
OSL2 Operational
OSL3 Operational
OSL4 Operational
Network Infrastructure Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Our data centre operator GlobalConnect has notified us of their intention to perform service on several components of the the electricity infrastructure in our OSL2 data centre.

Technical personnel from GlobalConnect and their service partner Coromatic will be on-site while the maintenance is in progress.

On Tuesday the 28th the maintenance is expected to cause loss of power supply redundancy on our equipment. We will have personnel on-site that whole day, just in case this uncovers other latent failures in our infrastructure (such as a defective power supply).

The maintenance schedule is as follows (all times CET):

Monday the 27th:

* 08:00-12:00: Service on the mains supply switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the power supply will be manually changed back to the mains supply before the UPS battery banks run empty.
* 12:00-14:00: Service on the generator supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
* 14:00-16:00: Service on the UPS bypass switch. In this period, the data centre will be powered normally and have normal redundancy. (The UPS bypass switch is only used while servicing UPS-es.)

Tuesday the 28th:

* 08:00-12:00: Service on the A distribution side switch. In this period, all in-rack power distribution units connected to the A side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single A-connected power supply or (or a previously failed B-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the B side.
* 12:00-16:00: Service on the B distribution side switch. In this period, all in-rack power distribution units connected to the B side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single B-connected power supply or (or a previously failed A-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the A side.

Wednesday the 29th:

* 08:00-11:00: Service on UPS 1. In this period, UPS 2 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 11:00-13:30: Service on UPS 2. In this period, UPS 1 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 13:30-16:00: Service on UPS 3. In this period, UPS 1 and 2 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).

Thursday the 30th:

* 08:00-12:00: Service on the main UPS switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the data centre will lose power until either the service is complete or the supply is manually changed back to mains supply.
* 12:00-16:00: Service on generator 1 supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
Posted on Jan 22, 15:15 CET
Network maintenance in OSL2 Jan 28, 01:00-06:00 CET
In this maintenance window, we intend to upgrade the operating system of our data centre switches in OSL2 to the latest bug-fix release recommended by the manufacturer.

While the work is in progress, the redundancy in the data centre network will be reduced from 1+1 to 1+0.

If the upgrade goes according to plan and no unexpected faults occur while the redundancy is reduced, customers are not expected to experience any significant outage.

Note: some of our customers have private leased circuits connected to the equipment that will be upgraded. Some of those circuits do not have any redundancy, and will as a result experience a longer downtime. The customers in question will be notified directly.
Posted on Jan 20, 18:36 CET
Our data centre operator GlobalConnect has notified us of their intention to perform service on several components of the the electricity infrastructure in our OSL2 data centre.

Technical personnel from GlobalConnect and their service partner Coromatic will be on-site while the maintenance is in progress.

On Tuesday the 28th the maintenance is expected to cause loss of power supply redundancy on our equipment. We will have personnel on-site that whole day, just in case this uncovers other latent failures in our infrastructure (such as a defective power supply).

The maintenance schedule is as follows (all times CET):

Monday the 27th:

* 08:00-12:00: Service on the mains supply switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the power supply will be manually changed back to the mains supply before the UPS battery banks run empty.
* 12:00-14:00: Service on the generator supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
* 14:00-16:00: Service on the UPS bypass switch. In this period, the data centre will be powered normally and have normal redundancy. (The UPS bypass switch is only used while servicing UPS-es.)

Tuesday the 28th:

* 08:00-12:00: Service on the A distribution side switch. In this period, all in-rack power distribution units connected to the A side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single A-connected power supply or (or a previously failed B-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the B side.
* 12:00-16:00: Service on the B distribution side switch. In this period, all in-rack power distribution units connected to the B side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single B-connected power supply or (or a previously failed A-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the A side.

Wednesday the 29th:

* 08:00-11:00: Service on UPS 1. In this period, UPS 2 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 11:00-13:30: Service on UPS 2. In this period, UPS 1 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 13:30-16:00: Service on UPS 3. In this period, UPS 1 and 2 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).

Thursday the 30th:

* 08:00-12:00: Service on the main UPS switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the data centre will lose power until either the service is complete or the supply is manually changed back to mains supply.
* 12:00-16:00: Service on generator 1 supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
Posted on Jan 22, 15:16 CET
Our data centre operator GlobalConnect has notified us of their intention to perform service on several components of the the electricity infrastructure in our OSL2 data centre.

Technical personnel from GlobalConnect and their service partner Coromatic will be on-site while the maintenance is in progress.

On Tuesday the 28th the maintenance is expected to cause loss of power supply redundancy on our equipment. We will have personnel on-site that whole day, just in case this uncovers other latent failures in our infrastructure (such as a defective power supply).

The maintenance schedule is as follows (all times CET):

Monday the 27th:

* 08:00-12:00: Service on the mains supply switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the power supply will be manually changed back to the mains supply before the UPS battery banks run empty.
* 12:00-14:00: Service on the generator supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
* 14:00-16:00: Service on the UPS bypass switch. In this period, the data centre will be powered normally and have normal redundancy. (The UPS bypass switch is only used while servicing UPS-es.)

Tuesday the 28th:

* 08:00-12:00: Service on the A distribution side switch. In this period, all in-rack power distribution units connected to the A side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single A-connected power supply or (or a previously failed B-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the B side.
* 12:00-16:00: Service on the B distribution side switch. In this period, all in-rack power distribution units connected to the B side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single B-connected power supply or (or a previously failed A-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the A side.

Wednesday the 29th:

* 08:00-11:00: Service on UPS 1. In this period, UPS 2 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 11:00-13:30: Service on UPS 2. In this period, UPS 1 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 13:30-16:00: Service on UPS 3. In this period, UPS 1 and 2 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).

Thursday the 30th:

* 08:00-12:00: Service on the main UPS switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the data centre will lose power until either the service is complete or the supply is manually changed back to mains supply.
* 12:00-16:00: Service on generator 1 supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
Posted on Jan 22, 15:16 CET
Our data centre operator GlobalConnect has notified us of their intention to perform service on several components of the the electricity infrastructure in our OSL2 data centre.

Technical personnel from GlobalConnect and their service partner Coromatic will be on-site while the maintenance is in progress.

On Tuesday the 28th the maintenance is expected to cause loss of power supply redundancy on our equipment. We will have personnel on-site that whole day, just in case this uncovers other latent failures in our infrastructure (such as a defective power supply).

The maintenance schedule is as follows (all times CET):

Monday the 27th:

* 08:00-12:00: Service on the mains supply switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the power supply will be manually changed back to the mains supply before the UPS battery banks run empty.
* 12:00-14:00: Service on the generator supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
* 14:00-16:00: Service on the UPS bypass switch. In this period, the data centre will be powered normally and have normal redundancy. (The UPS bypass switch is only used while servicing UPS-es.)

Tuesday the 28th:

* 08:00-12:00: Service on the A distribution side switch. In this period, all in-rack power distribution units connected to the A side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single A-connected power supply or (or a previously failed B-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the B side.
* 12:00-16:00: Service on the B distribution side switch. In this period, all in-rack power distribution units connected to the B side will lose power. The vast majority of our equipment have two redundant power supplies connected to both the A and B side, and will continue operating normally. However, any equipment with a single B-connected power supply or (or a previously failed A-connected power) will go down. We will have personnel on-site in this period that can quickly reconnect such equipment to the A side.

Wednesday the 29th:

* 08:00-11:00: Service on UPS 1. In this period, UPS 2 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 11:00-13:30: Service on UPS 2. In this period, UPS 1 and 3 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).
* 13:30-16:00: Service on UPS 3. In this period, UPS 1 and 2 will remain on-line. Fault tolerance will be reduced to 2N (normally 3N).

Thursday the 30th:

* 08:00-12:00: Service on the main UPS switch. In this period, the data centre will be powered by the emergency generator. The health of the generator will be continously monitored. Should the generator fail, the data centre will lose power until either the service is complete or the supply is manually changed back to mains supply.
* 12:00-16:00: Service on generator 1 supply switch. In this period, the data centre will be powered by the mains supply. Should the mains supply fail, the supply will manually be changed to the generator before the UPS battery banks run empty.
Posted on Jan 22, 15:17 CET
Past Incidents
Jan 27, 2020

No incidents reported today.

Jan 26, 2020

No incidents reported.

Jan 25, 2020

No incidents reported.

Jan 24, 2020

No incidents reported.

Jan 23, 2020

No incidents reported.

Jan 22, 2020

No incidents reported.

Jan 21, 2020
Completed - The scheduled maintenance has been completed.
Jan 21, 04:17 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 21, 01:00 CET
Scheduled - In this maintenance window, we intend to upgrade the operating system of our data centre switches in OSL3 to the latest bug-fix release recommended by the manufacturer.

While the work is in progress, the redundancy in the data centre network will be reduced from 1+1 to 1+0.

If the upgrade goes according to plan and no unexpected faults occur while the redundancy is reduced, customers are not expected to experience any significant outage.

Note: some of our customers have private leased circuits connected to the equipment that will be upgraded. Some of those circuits do not have any redundancy, and will as a result experience a longer downtime. The customers in question will be notified directly.
Jan 13, 14:34 CET
Jan 20, 2020

No incidents reported.

Jan 19, 2020

No incidents reported.

Jan 18, 2020

No incidents reported.

Jan 17, 2020

No incidents reported.

Jan 16, 2020

No incidents reported.

Jan 15, 2020
Resolved - Global Connect has now repaired the damaged fibre cable, all impacted circuits came back up at 08:10 local time.
Jan 15, 08:25 CET
Update - Global Connect is confirming that there is an outage in their optical fibre network impacting multiple customers of theirs.

The reference number is INC000000419337. Updates from Global Connect may be tracked at https://www.globalconnect.no/driftsmeldinger (Norwegian).
Jan 13, 09:59 CET
Identified - Our monitoring systems are reporting multiple link down events in our optical fibre ring in Oslo. The cut appears to be in the Økern area, and occurred at 09:05 local time. The fault has been escalated to our optical fibre provider Global Connect.

There are no observations of the fibre cut causing any impact to customer systems at this time, as traffic is automatically re-routed across the ring in the opposite direction. However, the network currently operates with reduced fault tolerance and capacity.
Jan 13, 09:51 CET
Jan 14, 2020
Completed - The scheduled maintenance has been completed.
Jan 14, 06:00 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 14, 01:00 CET
Update - We will be undergoing scheduled maintenance during this time.
Jan 6, 12:54 CET
Update - Update incorrect specification of components affected.
Jan 6, 12:53 CET
Update - We will be undergoing scheduled maintenance during this time.
Jan 6, 12:51 CET
Scheduled - In this maintenance window, we intend to upgrade the operating system of our data centre switches in OSL4 to the latest bug-fix release recommended by the manufacturer.

While the work is in progress, the redundancy in the data centre network will be reduced from 1+1 to 1+0.

If the upgrade goes according to plan and no unexpected faults occur while the redundancy is reduced, customers are not expected to experience any significant outage.
Jan 6, 12:51 CET
Jan 13, 2020
Resolved - The attack appears to have ceased completely at around 22:57 local time.

It was a DNS amplification DDoS attack directed at a specific customer of ours.
Jan 13, 23:10 CET
Monitoring - The attack began at 22:12 local time, and was large enough to congest several of our IP transit links. This will have caused degraded performance and packet loss on traffic from/to the Internet.

Our two IP transit providers started mitigation (scrubbing) at 22:17 and 22:35.

The attack is still ongoing, but the small amount of attack traffic that still makes it through to our network no longer poses any problem for us. We will continue to monitor the situation.
Jan 13, 22:49 CET
Identified - We have been hit with a DDOS attack and are mitigating.
Jan 13, 22:40 CET