Storage system issues causes Kebnekaise login and fileaccess problems

The batch queues on Kebnekaise are stopped, therefor no new jobs will be allowed to start.

We are working with resolving the problem in contact with our vendor, we will post updates here when we have more information

** Update ** The problem witrh the storage system was resolved 13:00 and the cluster if back up again with accessnodes available and queues enabled

Maintance Revision high voltage 2021 affects systems from 18.00 2021-08-16 until 2021-08-17 12:00

The affected systems will be closed for user interactions and no jobs will be running during that time.

UPDATE 2021-08-16: 17:20 The cluster is now back online again and available to users

Problems with project storage, mkdir fails and new directories cannot be created

The exact cause is not known but we are doing active debugging together with our vendor. During the debugging we have blocked the starting of new batch jobs. You can still submit jobs but they will not start until the problem is solved.

* SOLVED 2021-06-12 01:17 *

The problem was finially identified and a workaround put in place.

The system is now back in production.

We are noticing intermittent file server crashes causing problems. This causes problems with the file systems for $HOME and project storage. As a user it is mostly noticed by logins getting stuck after authentication and/or really slow filesystem access (simple ls might takes minutes).

The exact cause is not known but we are doing active debugging together with our vendor. During the debugging we might block the starting of new batch jobs. You can still submit jobs but they will not start.

Dear users,

During this maintenance, 2021-03-22 - 2021-03-25, we’re going to do some upgrades on the parallel file system, where home directories and project storage is located, along with other upgrades on Kebnekaise itself.

Since this maintenance affects the parallel file system we have to drain the batch nodes from running jobs. Login sessions will be disabled and active sessions will be terminated, during that period.