my.ryerson and CAS, uPortal, RAMSS service interruption: Jan. 1 8:00 AM – Jan. 1 9:25 AM

At approximately 8:00 AM this morning (Jan 1, 2013) the CAS authentication service became unresponsive. uPortal and RAMSS were also affected. We believe the problem is likely the same one that affected CAS on December 26 – a problem with the SSL accelerators:

http://servicealerts.blog.ryerson.ca/2012/12/26/my-ryerson-and-cas-service-interruption-dec-26-811-am/

The CAS web servers have been restarted at 8:40 AM but not all services are back to normal.

While CCS did take steps following the Dec 26 problem that seemed to work during the Dec 28 and 30 enrolment periods we are investigating why the problem recurred this morning.

Please accept our apologies for the frustration and inconvenience this morning’s outage caused.

-Computing and Communications Services

Posted in All Categories | 15 Comments

my.ryerson and CAS service interruption: Dec. 26 8:11 AM – Dec. 26 9:08 AM

At 8:11 AM this morning (Dec 26, 2012) both the my.ryerson.ca portal and the CAS authentication service became unresponsive. CCS staff are investigating and we will update this alert when more information becomes available.

Update 9:08 AM: Service has been restored by restarting services for both the my.ryerson.ca portal and CAS authentication system. We are investigating the cause of the outage and can see that the service is still slow for some people.

Update 8:21 PM: As a preventative measure uPortal and CAS will be restarted at 6 AM on Dec. 28 and 30 and on Jan. 1 and 3. As a result there will be a brief outage of a few minutes after 6 AM on those mornings.

Update Dec. 27, 2012 at 12:37 PM: Preliminary investigations have shown that an SSL accelerator may have been overwhelmed by requests beginning at roughly 8:03 AM on Dec 26. A second SSL accelerator has been added in order to increase capacity. Additional CCS staff will monitor systems performance during the opening of the next RAMSS enrolment period.

Note: SSL (Secure Sockets Layer) is a protocol designed to securely encrypt information in transit on the Internet. The SSL accelerator is a network device that provides high-speed encryption/decryption services. It improves application performance by relieving servers of complex public key and bulk encryption tasks.

Please accept our apologies for this outage.

-Computing and Communications Services

Posted in All Categories | 7 Comments

CFAPS print service disruption: Friday, Dec. 21 2012 11:28 AM – 13:40 PM

A corrupt HP print driver caused some users of the Central File and Print Sharing(CFAPS) service to experience printing problems between 11:28 AM – 13:40 PM today, Friday, Dec. 21.   The print server was restarted and normal services restored at 13:40 PM.

We apologize for the inconvenience.

-Computing and Communications Services

Posted in All Categories | Comments Off on CFAPS print service disruption: Friday, Dec. 21 2012 11:28 AM – 13:40 PM

Scheduled RAMSS outage, December 24, 2012 from 5:30 am to 12 noon

Due to a hydro power upgrade project that must be completed at Ryerson, RAMSS will be unavailable on December 24, 2012 from 5:30 am to 12 noon. This is unavoidable and we apologize in advance for the inconvenience that this may cause to some students.

Note: In case that the work cannot be performed on December 24, it will be rescheduled for December 27 from 1 am to 7 am.

UPDATE (Dec. 24, noon): The electrical work is still ongoing and we expect full services restored around 2 PM.

-Computing and Communications Services

Posted in All Categories, RAMSS | Tagged | Comments Off on Scheduled RAMSS outage, December 24, 2012 from 5:30 am to 12 noon

Mailing list (listserv) server outage: Wed., Dec. 19, 2012 2:00 PM – 3:15 PM

The mail server (listserv) stopped responding this afternoon around 2:00 PM due to a loose network cable.     Service was restored around 3:15 PM. Messages submitted during this period were queued up on the RMail system and started being processed after the service was restored.

We apologize for the inconvenience.

-Computing and Communications Services

Posted in RMail | Comments Off on Mailing list (listserv) server outage: Wed., Dec. 19, 2012 2:00 PM – 3:15 PM

CAS service interruption: Dec. 16 11:7 PM – Dec 17 2:12 AM

Central Authentication Service (CAS) application server’s threads had reached the max and could not handle new requests at 11:57 PM on December 16, 2012. Services were restored at 2:12 AM on December 17, 2012.

This affected all CASified applications, including my.ryerson portal and all applications accessed through the portal, Google Applications, Confluence and Jira.

We apologize for the inconvenience.

-Computing and Communications Services

Posted in All Categories, Blackboard, eHR, Google Apps, my.ryerson, RAMSS | Tagged , , , , | Comments Off on CAS service interruption: Dec. 16 11:7 PM – Dec 17 2:12 AM

RMS (Resource Management System) Issues – Friday, Dec. 14 – 12:40 PM to 2:00 PM

Due to an issue with the application servers, users of RMS Web applications, including Online Identity Activation, Manage My Online Resources and RMS Administration may have experienced intermittent access between 12:40 PM and 2:00 PM today, Friday, December 14.

The exact cause is unknown at this time, and is currently being investigated.

We apologize for the inconvenience.

-Computing and Communications Services

Posted in All Categories | Comments Off on RMS (Resource Management System) Issues – Friday, Dec. 14 – 12:40 PM to 2:00 PM

LDAP authentication outage: Wednesday, Dec. 12, 2012 7:15 AM – 8:11 AM – Update

Update:  This affected CASified applications, including Gmail, Blackboard, my.ryerson.ca, Confluence, Jira and impacted wireless Access.

===============================================================

The LDAP (Lightweight Directory Access Protocol) proxy servers used for authentication, including authentication of CAS systems (my.ryerson.ca), stopped responding around 7:15 am.   Services were restored around 8:11 am.   We are still investigating the cause of the problem.

We apologize for the inconvenience.

-Computing and Communications Services

Posted in All Categories, Blackboard, eHR, Google Apps, LDAP, my.ryerson, RAMSS, wireless | Tagged , , , , , , | Comments Off on LDAP authentication outage: Wednesday, Dec. 12, 2012 7:15 AM – 8:11 AM – Update

Google Apps service disruption – Monday Dec. 10

Google mail experienced issues on Monday Dec. 10 from 11:54AM – 12:00 Noon and from 12:04 PM to 12:16 PM.

Users may have experienced slow performance or may have experienced errors with Gmail, Calendar and Google Documents.

We apologize for any inconvenience.

-Computing and Communications Services

December 12 – Google has published an update on the issue:

http://static.googleusercontent.com/external_content/untrusted_dlcp/www.google.com/en/us/appsstatus/ir/plibxfjh8whr44h.pdf

 

Posted in All Categories, Google Apps | Comments Off on Google Apps service disruption – Monday Dec. 10

my.ryerson.ca service disruption – Monday, Dec. 10 – 11:11 PM to Tuesday Dec. 11 – 7:30 AM

One of the my.ryerson.ca portal application servers became unresponsive  around 11:11 PM  on Monday December 10th, causing users directed to the server to experience slow response times or an error message.  The application was restarted on the server and services restored at 7:30 AM on Tuesday Dec. 11.  We are continuing to investigate the root cause of the problem and why there was no automated alert when the problem first occurred.

We apologize for any inconvenience.

-Computing and Communications Services

Posted in All Categories | Comments Off on my.ryerson.ca service disruption – Monday, Dec. 10 – 11:11 PM to Tuesday Dec. 11 – 7:30 AM