A GroupWise service hung at approximately 8:30 AM today, Wednesday, June 18, causing a short delay in mail delivery. The affected server (GW1) was rebooted and full services restored around 8:53 AM. During the server reboot, 8:45 AM – 8:53 AM, web client access to GroupWise was not available.
We apologize for the service disruption.
-Computing and Communications Services
A scheduled firewall upgrade was not successful and technical staff had to back out of the change. However, some applications did not recover properly. RAMSS, Confluence and Jira were affected. RAMSS services were restored around 9:16 am. Confluence and Jira services were restored around 9:20 am. The issue was reported at 8:42 am and our technical and support teams are investigating the root cause.
We apologize for the service interruption.
Computing and Communications Services
At approximately 8:15 am today, CCS started receiving reports of a general slow response when accessing core Ryerson applications as well as the Internet.
Preliminary investigation indicates the problem to be with the network core firewall cluster. CCS IT Security staff are investigating the problem.
UPDATE: The root cause of the problem has been identified. Normal services have been restored as of ~ 9:10 AM. A review of the system logs indicate that the problem may have started around 2:15 AM.
We apologize for the service interruption.
Computing and Communications Services
Late last night all connectivity to the Digital Media Zone in 10 Dundas, along with the AMC Theatres, and the Bookstore was lost. It was determined and confirmed this morning via a site visit that somewhere in an underground tunnel the fiber links to all these locations has been severely damaged or severed.
Although Ryerson has a high degree of network redundancy we do not have have fiber redundancy to all the switches in all buildings.
We do not have an estimated time to repair at this time and apologize for the disruption this outage will cause.
Update July 1, 2012 at 14:20: CCS staff will not be able to enter the tunnel system until the morning of July 2 to do a more complete inspection.
Update July 2, 2012 at 12:20: The cable damage was caused by rodents that got into a cable box and chewed through the cable. Staff estimate repairs will be complete later this afternoon.
Update July 2, 2012 at 12:42: Service was restored just after 12 noon today.
-Computing and Communications Services
A nightly backup job that normally runs between 2 AM – 6 AM on GWP2 failed to complete and prevented the startup of the post office agent. The server was power cycled and services were restored around 7:30 AM. The affected user community included various administrative staff groups.
We apologize for the service disruption.
– Computing and Communications Services
At approximately 10:07 AM today, Friday June 22, one of the five Blackboard application servers started experiencing intermittent slow access response. The server is being removed from the load balance pool and will be rebooted later to clear the problem.
We apologize for the service interruption.
-Computing and Communications Services
A failure with one of the GroupWise servers (GW1) caused GroupWise Web & Internet mail delivery to become unavailable around 7:03 AM on Saturday June 16, 2012 Services were restored at approximately 7:53 AM.
We apologize for the service disruption.
-Computing and Communications Services
The live webcast of the Ryecast system is currently unavailable.
We are investigating the issue an hope to restore service shortly.
Friday morning convocation ceremonies are being recorded and will be available to view when the Ryecast service is available.
We apologize for any inconvenience.
Computing and Communications Services
UPDATE:
The issue with RU-Secure has been identified by the vendor. It is a combination of exceeding the allowed number of VLANs per SSID and a bug in the current code that disables some SSIDs due to a buffer overflow.
The number of VLANs has been reduced and the wireless access points will be re-booted gradually to maintain connectivity for the users who are currently connected through “Ryerson” SSID.
At 8:00 am, service was affected to the Wireless Access Points in the West/South corner of the Campus (ENG, RCC, SCC, GCM, ILC, SID & SBB). The Access Points were broadcasting the “Ryerson” SSID only, preventing users of the RU-Secure SSID from accessing the WiFi network in those areas. The wireless controller to where these Access Points are attached will be re-booted.
The cause is under investigation.
We apologize for the service interruption.
Computing and Communications Services.
my.ryerson and all applications accessed through the my.ryerson portal were uvailable this morning, Friday, June 16 between 6 am – 7:48 am due to scheduled work being done during our preventive maintenance window.
We apologize for any inconvenience.
-Computing and Communications Services
