Hej alla!
Nu är underhållet av servrarna hos NORDUnet färdigt.
Tjänsterna ska fungera som vanligt från och med nu.
mvh
Monika Allöv Andersson
Systemförvaltare - Sunet mediatjänster
System administrator - Sunet media services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
Hej alla!
Det har varit lite olika turer fram och tillbaka gällande det planerade
underhållsarbetet i Danmark.
Nu görs allt samma helg, närmare bestämt nu till helgen.
Nedan ser ni vad som gäller.
mvh
Monika Allöv Andersson
Systemförvaltare - Utbildningsstödjande tjänster
System administrator - Educational Services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
---------- Forwarded message ---------
Från: NORDUnet Status Notification <
do-not-reply(a)d3l31203d313yz.cloudfront.net>
Date: mån 25 nov. 2024 kl 16:42
Subject: Scheduled Maintenance Notification from NORDUnet Status
To: <monika.allov-andersson(a)sunet.se>
Scheduled Maintenance Reminder NORDUnet Status
*Title:* Infrastructure Maintenance (Kaltura, Zoom)
*Planned Start:* November 30, 2024 07:00 UTC
*Expected End:* December 1, 2024 20:00 UTC
*Affected Infrastructure*
*Components:* Zoom, Kaltura
*Locations:* Mediaspace, Transcoding, Live streaming, On-Premise,
Recording, REACH, Analytics
*Details:*
There will be an infrastructure maintenance in Denmark.
This was previously planned over two weekends doing one datacenter per
weekend.
Now both datacenters will be done on one weekend.
The operation requires all nodes of the clusters to be in maintenance mode
at the same time, which in practical terms means that the cluster will be
"shut down".
And in order for this to happen, all VMs in the clusters will have to be
powered off for the duration.
Downtime is expected during the maintenance window on Saturday. Sunday is
reserved.
Impact:
- Kaltura will be completely down during the operation.
- Zoom Cloud Recordings might have longer delivery time.
- Zoom Virtual Room Connector Load Balancers will be down.
Users can either use the Public Cloud CRC or use the Hybrid CRC servers
directly:
dk-bal-zp2-hcrc-001 A 185.174.119.220
dk-bal-zp2-hcrc-002 A 185.174.119.221
dk-bal-zp2-hcrc-003 A 185.174.119.222
se-tug-zp3-hcrc-001 A 89.46.17.220
se-tug-zp3-hcrc-002 A 89.46.17.221
se-tug-zp3-hcrc-003 A 89.46.17.222
dk-ore2-zp5-hcrc-001 A 185.174.118.220
dk-ore2-zp5-hcrc-002 A 185.174.118.221
dk-ore2-zp5-hcrc-003 A 185.174.118.222
Manage Subscription
<https://status.nordu.net/pages/subscriber/manage/6135c0c26fcce8052dde4f06/6…>
| Visit Status Page <https://status.nordu.net>
Powered by Status.io <https://status.io>
Hej alla!
Som ni har sett så är problemet med cloud recordings äntligen löst. Det har
dessutom dykt upp en hel massa inspelningar som gjordes för längesen som nu
finns hos användaren.
Alla inspelningar gjorda före 7 september som inte har dykt upp, kommer
inte att göra det.
mvh
Monika Allöv Andersson
Systemförvaltare - Utbildningsstödjande tjänster
System administrator - Educational Services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
Äntligen.
Se nedan.
mvh
Monika Allöv Andersson
Systemförvaltare - Utbildningsstödjande tjänster
System administrator - Educational Services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
---------- Forwarded message ---------
Från: NORDUnet Status Notification <
do-not-reply(a)d3l31203d313yz.cloudfront.net>
Date: mån 25 nov. 2024 kl 11:12
Subject: Status Notification from NORDUnet Status
To: <monika.allov-andersson(a)sunet.se>
Incident Update NORDUnet Status
*Current Status:* Operational
*Started:* September 2, 2024 12:22 UTC
*Resolved:*
*Affected Infrastructure*
*Components:* Zoom
*Locations:* Recording
*Update:*
The final problem, ref. last weeks update, has been resolved and everything
is back to normal operation, with 0 recordings being lost this week.
It has also been possible to recover most of the old missing recordings and
these have been processed as well.
For now we consider the issue to be resolved. A permanent solution will be
deployed later.
Manage Subscription
<https://status.nordu.net/pages/subscriber/manage/6135c0c26fcce8052dde4f06/6…>
| Visit Status Page <https://status.nordu.net>
Powered by Status.io <https://status.io>
Hej alla.
Senaste uppdateringen från NORDUnet om Zoom Cloud Recording
Med vänliga hälsningar,
Peter Häggstrand
SUNET
Från: Jørgen Qvist <qvist(a)nordu.net>
Datum: fredag 22 november 2024 09:03
Ämne: [Mediagroup] Zoom on-premise recording issue update 20241122
OBS: Detta mail kommer från en avsändare utanför din organisation.
All,
The final problem, ref. last weeks update, has been resolved and everything is back to normal operation, with 0 recordings being lost this week.
It has also been possible to recover most of the old missing recordings and these have been processed as well.
For now we consider the issue to be resolved. A permanent solution will be deployed later.
Unless something changes this is the last update in the series.
Brgds,
Jørgen Qvist
email: qvist(a)nordu.net
mobile: +45-31621400
Please read NORDUnets Data Protection Policy - https://nordu.net/privacy-policy/ & Legal Notice - https://nordu.net/legal-notice/
On 16 Nov 2024, at 20.12, Jørgen Qvist <qvist(a)nordu.net> wrote:
All,
Sorry about the delayed update.
Things are continuing to improve. The changes made last week has uncovered an NFS permission problem on the recording servers that Zoom has been able to reproduce. A fix for this will be deployed over the weekend.
Again, we will monitor this closely,,,
Next update Friday November 22’nd.
Brgds,
Jørgen Qvist
email: qvist(a)nordu.net
mobile: +45-31621400
Please read NORDUnets Data Protection Policy - https://nordu.net/privacy-policy/ & Legal Notice - https://nordu.net/legal-notice/
Hej alla!
Se nedan.
mvh
Monika Allöv Andersson
Systemförvaltare - Utbildningsstödjande tjänster
System administrator - Educational Services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
---------- Forwarded message ---------
Från: NORDUnet Status Notification <
do-not-reply(a)d3l31203d313yz.cloudfront.net>
Date: mån 18 nov. 2024 kl 09:53
Subject: Status Notification from NORDUnet Status
To: <monika.allov-andersson(a)sunet.se>
Incident Update NORDUnet Status
*Current Status:* Degraded Performance
*Started:* September 2, 2024 12:22 UTC
*Resolved:*
*Affected Infrastructure*
*Components:* Zoom
*Locations:* Recording
*Update:*
Things are continuing to improve. The changes made last week has uncovered
an NFS permission problem on the recording servers that Zoom has been able
to reproduce. A fix for this was deployed over the weekend.
Manage Subscription
<https://status.nordu.net/pages/subscriber/manage/6135c0c26fcce8052dde4f06/6…>
| Visit Status Page <https://status.nordu.net>
Powered by Status.io <https://status.io>
Hej alla!
Ny uppdatering gällande problemen med cloud-recordings.
All,
Sorry about the delayed update.
Things are continuing to improve. The changes made last week have uncovered
an NFS permission problem on the recording servers that Zoom has been able
to reproduce. A fix for this will be deployed over the weekend.
Again, we will monitor this closely,,,
Next update Friday November 22’nd.
Brgds,
Jørgen Qvist
mvh
Monika Allöv Andersson
Systemförvaltare - Utbildningsstödjande tjänster
System administrator - Educational Services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
Hej alla!
Se nedan.
Mvh
Monika
Skickat från min iPhone
Vidarebefordrat
> Ämne: [Mediagroup] Re: Zoom on-premise recording issue update 20241101
>
> All,
>
> Unfortunately the change to the storage hardware and logical infrastructure did not resolve the problem.
>
> We did however uncover a problem where the recorders are started before the NFS mounts are fully setup. We have tried to implement a fix for this and we are currently seeing an improvement of the situation.
>
> We will monitor this closely.
>
> Next update Friday November 15, late as I will be travelling back from the US.
>
> Brgds,
>
> Jørgen Qvist
>
>
> Please read NORDUnets Data Protection Policy - https://nordu.net/privacy-policy/ & Legal Notice - https://nordu.net/legal-notice/
>
>
> _______________________________________________
> Mediagroup mailing list -- mediagroup(a)lists.nordu.net
> To unsubscribe send an email to mediagroup-leave(a)lists.nordu.net
Hej!
Det här kom i fredags:
All,
Unfortunately the new version of the Recording Connector did not resolve
the problem.
Zoom is continuing to work on a solution at their end.
NORDUnet has in a maintenance window Thursday October 31, made changes to
the Recording Nodes storage hardware and logical infrastructure, for two of
the operational Zoom Zones. We will monitor the impact before making
further changes.
Next update Friday November 8.
Brgds,
Jørgen Qvist
mvh
Monika Allöv Andersson
Systemförvaltare - Utbildningsstödjande tjänster
System administrator - Educational Services
Sunet - Swedish University Computer Network
Vetenskapsrådet | Swedish Research Council
Phone: +46 72 394 78 58
All,
enclosed is the Zoom Root Cause Analysis (RCA) of the issue encounter
between 17 and 21 UTC on 20241022.
The effect of the issue was that users on a subset of sub-accounts could
not start/join meetings and instead received 3010 errors.
The issue was triggered when NORDUnet was doing planned maintenance on a
Zoom Zone, removing that Zone from all sub-accounts.
Zoom had recently deployed a new security feature that had a flaw which
then returned a completely empty Zone list to these sub-accounts, that then
had no active Zoom Zone to connect to.
The workaround was to disable the security feature which restored
operations.
A fix has been deployed that permanently has resolved the problem.
Full Zoom RCA enclosed.
NORDUnet regrets the problems encountered due to this.
Brgds,
Jørgen Qvist
Please read NORDUnets Data Protection Policy -
https://nordu.net/privacy-policy/ & Legal Notice -
https://nordu.net/legal-notice/
_______________________________________________
Mediagroup mailing list -- mediagroup(a)lists.nordu.net
To unsubscribe send an email to mediagroup-leave(a)lists.nordu.net
