Major Network Service Disruption – Monday, April 09 2012 11:55 AM

Posted on April 9, 2012 by Casey Carvalho

A distribution layer network switch failure occurred at 11:50 AM on Monday, April 09 2012, causing a network outage on the west side of the campus including TRS. WiFi access may have been affected across the entire campus.   The problem is currently being investigated.   We’ll provide an update once more details are available.

Update 12:35, Monday, April 9, 2012:

The outage lasted almost one hour (from 11:10 to 12:05) during which time wired network access in the following buildings was intermittent or extremely slow due to high CPU utilization in the distribution switches:

  • KHW
  • CE
  • VIC
  • AMC
  • POD
  • LIB
  • JOR

Wireless access all over the campus was down with the exception of TRS.

The problem began while CCS was making network configuration changes that should not have had any impact on the network.

Update 1:19 pm, Monday, April 9, 2012:

The config change (that appears to have triggered the outage) was on our distribution network level switches for our WiFi controllers. We do not know why the change resulted in the network switches’s high CPU usage for a prolonged period of time.

We have opened a ticket with the switch provider.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories | Comments Off on Major Network Service Disruption – Monday, April 09 2012 11:55 AM

Finance service outage: Wednesday April 4, 2012 7:50 PM – 8:55 PM

Posted on April 4, 2012 by Casey Carvalho

The Finance server became unresponsive around 7:50 PM today, Wednesday, April 4th, 2012, as a result of it having exhausted all available system memory (RAM).    On-call staff restored services by 8:55 PM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in OGF | Comments Off on Finance service outage: Wednesday April 4, 2012 7:50 PM – 8:55 PM

Groupwise Web Service Interruption – Saturday, March 31, 2012 7:07 PM – 8:15 PM

Posted on March 31, 2012 by Casey Carvalho

The GroupWise server responsible for providing Web, Internet and Notifylink access to GroupWise became inaccessible at approximately 7:07 PM on Saturday, March 31st.  Service was restored at 8:15 PM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in GroupWise | Comments Off on Groupwise Web Service Interruption – Saturday, March 31, 2012 7:07 PM – 8:15 PM

RMS web service disruption, Friday, March 30 2012 11:40 AM – 12:15 PM

Posted on March 30, 2012 by Casey Carvalho

An application level error between an application server and a database server caused RMS web applications to be slow or unresponsive, starting around 11:40 AM this morning.   The impacted services included the password reset utility and the Blackboard course shell request utility under my.ryeson.

Services were rully restored by 12:15 PM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

 

Posted in All Categories | Comments Off on RMS web service disruption, Friday, March 30 2012 11:40 AM – 12:15 PM

OGF system service disruption – Friday, March 23 2012 2:30 PM – 4:15 PM

Posted on March 23, 2012 by Casey Carvalho

The OGF (Finance) database system was restarted around 4 PM today to correct a problem with some workflow processes that were not being executed.  Services were restored around 4:15 PM.

We are investigating why the workflow process was not working as expected.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in OGF | Comments Off on OGF system service disruption – Friday, March 23 2012 2:30 PM – 4:15 PM

Groupwise Web Service Interruption – Thursday, March 22, 2012 6:15 PM – 6:54 PM

Posted on March 23, 2012 by Casey Carvalho

The GroupWise server responsible for providing Web & Internet access to GroupWise became inaccessible at approximately 6:15 PM on Thursday, March 22.  Service was restored at 6:45 PM. We are still investigating the cause of the outage.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories, GroupWise | Tagged | Comments Off on Groupwise Web Service Interruption – Thursday, March 22, 2012 6:15 PM – 6:54 PM

Service Interruption Due to Data Centre Firewall Problem – 7:15 am,Tuesday, March 13, 2012 – UPDATE

Posted on March 13, 2012 by kwoo

UPDATE: 10:20 am, Tuesday, March 13, 2012

The problem has been isolated to a departmental server.  The server was sending large amounts of data, causing the firewall to go to high levels of utilization.   The server has since been taken off-line.  Utilization on the firewall has returned to normal.  All servers are back on-line.  Technical Support will be restarting services on the core servers to restore services.

++++++++++++++++++++++++++++++++++

Access to Core applications have been interrupted due to a problem with a firewall.  The following services have been affected; RAMSS, OGF Financials, Ryerson web CMS, CQ, Jira, some Coldfusion web services for CE, TPHI and Spark IM.

IT Security is currently trouble-shooting the problem.

We apologize for the service interruption.

Computing and Communications Services.

Posted in All Categories, Firewall | Comments Off on Service Interruption Due to Data Centre Firewall Problem – 7:15 am,Tuesday, March 13, 2012 – UPDATE

Groupwise web access outage: Wedn., March 07, 2012 8:20 AM – 8:50 AM

Posted on March 7, 2012 by Casey Carvalho

The GroupWise Webmail services hung at approximately 8:20 AM today, Wednesday, March 7 2012.   Other services affected on the server included Notifylink updates, access to the document library and inter-post office communication.  An attempt to restart the services was not successful and a reboot of the server was required.    Full services were restored around 8:50 AM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories, GroupWise | Comments Off on Groupwise web access outage: Wedn., March 07, 2012 8:20 AM – 8:50 AM

GroupWise Webmail Services down: Friday, March 2, 2012 5:30 AM

Posted on March 2, 2012 by Casey Carvalho

The GroupWise Webmail services went down at approximately 5:30 AM today, Friday, March 2nd 2012.   We are working on the problem and expect services to be restored soon after 9 AM.

Update: Services were fully restored at 9:09AM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories, GroupWise | Comments Off on GroupWise Webmail Services down: Friday, March 2, 2012 5:30 AM

www.ryerson.ca intermittent performance issue: Wednesday, Feb. 29 2012

Posted on February 29, 2012 by Casey Carvalho

Since approximately 6:20 AM this morning, CCS has received reports that the www.ryerson.ca website was loading slowly.    We are working with the Web Services team in University Advancement to improve the performance of  the system. Calendar loading performance have been  improved and we will continue to work with the Web Services team and the vendor to improve  performance.

-Computing and Communications Services

Posted in All Categories | Comments Off on www.ryerson.ca intermittent performance issue: Wednesday, Feb. 29 2012