Some Users Could Not Reach Services at www.library.ryerson.ca and ezproxy.lib.ryerson.ca – 16:30, Wed., April 11, 2012

Posted on April 11, 2012 by

At approximately 16:30 today the domain names www.library.ryerson.ca and ezproxy.lib.ryerson.ca became unresolvable. External and internal users were having different problems. The records for www.library.ryerson.ca were missing from the database, at this time we are unable to find a cause for this deletion. The information was re-entered the information and manually push it to all internal and external nameservers. The names were resolvable at approx 18:30.

Posted in All Categories | Tagged | 2 Comments

Groupwise partial service outage: Wednesday, April 21 2012 06:30 AM – 08:20 AM

Posted on April 11, 2012 by Casey Carvalho

The GroupWise post office that provides services to most admin departments, including HR,  failed to complete its regular overnight maintenance cycle and had to be rebooted this morning.    Services were impacted from 6:30 AM to 8:20 AM.

Please accept our apologies for this service disruption.

-Computing and Communications Services

Posted in GroupWise | Comments Off on Groupwise partial service outage: Wednesday, April 21 2012 06:30 AM – 08:20 AM

Major Network Service Disruption – Tuesday, April 10 2012 8:15 AM – 8:30 AM

Posted on April 10, 2012 by Casey Carvalho

A distribution layer network switch failure occurred at approximately 8:15 AM on Tuesday, April 10 2012, causing a network outage on the west side of the campus including TRS. The problem is similar to yesterday’s incident and is currently being investigated. Services were restored around 8:30 AM.

The outage affected wired network access in the following buildings with intermittent or extremely slow connectivity due to high CPU utilization in the distribution switches:

  • KHW
  • CE
  • VIC
  • AMC
  • POD
  • LIB
  • JOR

Wireless access all over the campus was down with the exception of TRS.

The problem began when CCS network staff were attempting to repair a network switch.    The change should not have had any impact on the network.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories | Comments Off on Major Network Service Disruption – Tuesday, April 10 2012 8:15 AM – 8:30 AM

Major Network Service Disruption – Monday, April 09 2012 11:55 AM

Posted on April 9, 2012 by Casey Carvalho

A distribution layer network switch failure occurred at 11:50 AM on Monday, April 09 2012, causing a network outage on the west side of the campus including TRS. WiFi access may have been affected across the entire campus.   The problem is currently being investigated.   We’ll provide an update once more details are available.

Update 12:35, Monday, April 9, 2012:

The outage lasted almost one hour (from 11:10 to 12:05) during which time wired network access in the following buildings was intermittent or extremely slow due to high CPU utilization in the distribution switches:

  • KHW
  • CE
  • VIC
  • AMC
  • POD
  • LIB
  • JOR

Wireless access all over the campus was down with the exception of TRS.

The problem began while CCS was making network configuration changes that should not have had any impact on the network.

Update 1:19 pm, Monday, April 9, 2012:

The config change (that appears to have triggered the outage) was on our distribution network level switches for our WiFi controllers. We do not know why the change resulted in the network switches’s high CPU usage for a prolonged period of time.

We have opened a ticket with the switch provider.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories | Comments Off on Major Network Service Disruption – Monday, April 09 2012 11:55 AM

Finance service outage: Wednesday April 4, 2012 7:50 PM – 8:55 PM

Posted on April 4, 2012 by Casey Carvalho

The Finance server became unresponsive around 7:50 PM today, Wednesday, April 4th, 2012, as a result of it having exhausted all available system memory (RAM).    On-call staff restored services by 8:55 PM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in OGF | Comments Off on Finance service outage: Wednesday April 4, 2012 7:50 PM – 8:55 PM

Groupwise Web Service Interruption – Saturday, March 31, 2012 7:07 PM – 8:15 PM

Posted on March 31, 2012 by Casey Carvalho

The GroupWise server responsible for providing Web, Internet and Notifylink access to GroupWise became inaccessible at approximately 7:07 PM on Saturday, March 31st.  Service was restored at 8:15 PM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in GroupWise | Comments Off on Groupwise Web Service Interruption – Saturday, March 31, 2012 7:07 PM – 8:15 PM

RMS web service disruption, Friday, March 30 2012 11:40 AM – 12:15 PM

Posted on March 30, 2012 by Casey Carvalho

An application level error between an application server and a database server caused RMS web applications to be slow or unresponsive, starting around 11:40 AM this morning.   The impacted services included the password reset utility and the Blackboard course shell request utility under my.ryeson.

Services were rully restored by 12:15 PM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

 

Posted in All Categories | Comments Off on RMS web service disruption, Friday, March 30 2012 11:40 AM – 12:15 PM

OGF system service disruption – Friday, March 23 2012 2:30 PM – 4:15 PM

Posted on March 23, 2012 by Casey Carvalho

The OGF (Finance) database system was restarted around 4 PM today to correct a problem with some workflow processes that were not being executed.  Services were restored around 4:15 PM.

We are investigating why the workflow process was not working as expected.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in OGF | Comments Off on OGF system service disruption – Friday, March 23 2012 2:30 PM – 4:15 PM

Groupwise Web Service Interruption – Thursday, March 22, 2012 6:15 PM – 6:54 PM

Posted on March 23, 2012 by Casey Carvalho

The GroupWise server responsible for providing Web & Internet access to GroupWise became inaccessible at approximately 6:15 PM on Thursday, March 22.  Service was restored at 6:45 PM. We are still investigating the cause of the outage.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories, GroupWise | Tagged | Comments Off on Groupwise Web Service Interruption – Thursday, March 22, 2012 6:15 PM – 6:54 PM

Service Interruption Due to Data Centre Firewall Problem – 7:15 am,Tuesday, March 13, 2012 – UPDATE

Posted on March 13, 2012 by

UPDATE: 10:20 am, Tuesday, March 13, 2012

The problem has been isolated to a departmental server.  The server was sending large amounts of data, causing the firewall to go to high levels of utilization.   The server has since been taken off-line.  Utilization on the firewall has returned to normal.  All servers are back on-line.  Technical Support will be restarting services on the core servers to restore services.

++++++++++++++++++++++++++++++++++

Access to Core applications have been interrupted due to a problem with a firewall.  The following services have been affected; RAMSS, OGF Financials, Ryerson web CMS, CQ, Jira, some Coldfusion web services for CE, TPHI and Spark IM.

IT Security is currently trouble-shooting the problem.

We apologize for the service interruption.

Computing and Communications Services.

Posted in All Categories, Firewall | Comments Off on Service Interruption Due to Data Centre Firewall Problem – 7:15 am,Tuesday, March 13, 2012 – UPDATE