Confluence and Jira outage: Tuesday, Jan. 22 2012 11:15 AM – noon

We will be doing some emergency maintenance on Confluence and Jira from 11:15 AM – noon, today.  During this period services will not be available.

We apologize for the inconvenience.

– Computing and Communications Services

Posted in All Categories | Comments Off on Confluence and Jira outage: Tuesday, Jan. 22 2012 11:15 AM – noon

FAX / XMedius service outage: Monday, Jan. 21 2013 9:00AM

The XMedius FAX service has been unavailable since 9:00 AM due to a performance issues on a new RAID storage system.   We are planning to migrate the server’s storage to a new RAID system overnight to correct the problem.

We apologize for any inconvenience this problem may cause.

– Computing and Communications Service

Posted in All Categories | Comments Off on FAX / XMedius service outage: Monday, Jan. 21 2013 9:00AM

Alfresco service outage: Sunday, Jan. 20 2013 8:53 PM – 9:35 PM

While troubleshooting a storage performance problem, the Alfresco database became unavailable at approximately 8:53 PM.   Services were restored around 9:35 PM.   The outage affected the Admissions and Campus Facilities and Sustainability document  management systems.

Update: A problem with the storage provided to Alfresco caused database crashes aroudn 1:19 AM.  Staff are looking into the problem.

We apologize for any inconvenience this problem may cause.

– Computing and Communications Service

Posted in All Categories | Comments Off on Alfresco service outage: Sunday, Jan. 20 2013 8:53 PM – 9:35 PM

VMware performance degradation – Sunday, Jan. 20 2013

VMware has been experiencing a performance degradation due to the migration of the storage from one storage RAID array to another.   Technical staff are working with the vendor to determine the cause of the problem.    Some virtual servers have been migrated to another RAID array.   Updates will be provided periodically until the problem is resolved.

Update 1:  We continue to experience performance degradation.  A few virtual machines have been migrated to a different storage RAID system, and we will continue this process overnight.

Update 2 (Monday, Jan 21, 11:30pm):  We are still experiencing performance issues, but a number of virtual servers have been migrated to a different RAID storage system where performance is good.   The migration process is slow because the READs off the current storage is slow.  We’re scheduling a number of batch migrations over night. 

Update 3 (Tuesday, Jan 22, 11:20pm):  Some performance issues are still present, but we have migrated many virtual servers (VMs) from the affected RAID system to a different RAID system where the performance is good.   The migration process is continuing overnight.  The vendors continue to investigate and are narrowing down the source of the problem.  We expect the impact to be minor on Wednesday morning.

Final update  (Friday, Jan 25, 8:45 am): By Tuesday evening, overall performance had improved.  We continued the migration of virtual machines overnight and services behaved normally throughout the day.  The migration of the virtual machines completed last night.   A failing IO module on the disk array was replaced on Wednesday, but vendor support continues their investigation.  However, the VMware infrastructure will stay on the new storage array system and will not be migrated back.

We apologize for any inconvenience this problem caused.

– Computing and Communications Services

Posted in All Categories | Comments Off on VMware performance degradation – Sunday, Jan. 20 2013

Ryerson Gmail – Mail Quota Issue

Some people have reported issues with their Ryerson Gmail quota.  Gmail reports that their mail box is full and that they are using 99% of their 1 GB limit.  They should have a 25 GB limit instead of 1 GB.

Anyone who experiences this problem is unable to save or send email.

If you experience this issue, please contact the CCS Help Desk at 416-979-5000 ext. 6806 or by email to help@ryerson.ca

CCS has raised the issue with Google and they are fixing the accounts that have this problem.  It may take up to 48 hours for an account to be fixed.

We apologize for any inconvenience this problem may cause.

– Computing and Communications Services

Posted in All Categories | Comments Off on Ryerson Gmail – Mail Quota Issue

CS/RAMSS & Ryerson Mobile Service Disruption: Saturday, Jan. 19, 2013 2:00 AM

A server crash of one of the RAMSS servers was occurred this Saturday morning at approximately 2 AM. As a result RAMSS information was not available in Ryerson Mobile until the service was restarted around 6:50 AM.  The server crash is related to a hardware problem, yet to be identified by the vendor.   As a precaution, we will be migrating the services from this server to a different server this afternoon to avoid other incidents due to the yet unidentified root cause of the hardware problem.   During this move, RU Mobile web services will not be available.   The expected outage will be from approximately 8:00 PM to 11:00 PM.

We apologize for any inconvenience.

-Computing and Communications Services

Posted in All Categories, RAMSS | Comments Off on CS/RAMSS & Ryerson Mobile Service Disruption: Saturday, Jan. 19, 2013 2:00 AM

Issues accessing some Ryerson systems – Friday, January 18, 2013

Due to an issue with an upgrade to Ryerson’s Central Authentication system, some Ryerson applications became unavailable this morning. The problem was resolved at 2:15 PM today.  The applications affected are:

  • Your Library Account
  • Research Information System (RIS)
  • Faculty Annual Report (FAR)
  • Faculty Course Survey (FCS)
  • Ethics Review

We apologize for the disruption in service

– Computing and Communications Services

Posted in All Categories | Comments Off on Issues accessing some Ryerson systems – Friday, January 18, 2013

Hardware issues with CS/RAMSS servers, January 16 and January 17

Two of the four RAMSS (PeopleSoft Campus Solutions) application servers crashed at approximately 00:02 am on Wednesday, January 16. They both came back up normally. However, during the day on Wednesday, January 16, we started  experiencing the same issues issues with these two servers and one web server. We suspect that this is now a hardware issue and we are currently working with vendor to resolve the issue.

Availability of RAMSS information within Ryerson Mobile ( http://m.ryerson.ca)  is also affected.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in All Categories, RAMSS | Tagged | Comments Off on Hardware issues with CS/RAMSS servers, January 16 and January 17

CS/RAMSS & Ryerson Mobile Service Disruption: Wednesday, Jan. 16, 2013 2:45 PM

At approximately 2:45 PM, one of the RAMSS front end servers crashed and rebooted.   This server runs an integration broker that provides  student schedule information to Ryerson Mobile users.   This service has been unstable since 2:45PM.   We are in the process of restoring the service.

Update 9:15PM:  We are continuing to have problems with the stability of the application.   We are working with the vendor to isolate the problem and address the issue, which seems to be hardware related.

Update 11:40 PM: RAMSS services were restored around 11:00 PM.  The RU Mobile application is still down, and we’re doing currently doing firmware patching before we attempt to bring it back up.

We apologize for any inconvenience.

-Computing and Communications Services

Posted in All Categories, eResources, RAMSS | Comments Off on CS/RAMSS & Ryerson Mobile Service Disruption: Wednesday, Jan. 16, 2013 2:45 PM

CAS/my.ryerson Service Disruption: Wednesday, Jan. 16 2013 9:15 AM

At approximately 9:15AM we started experiencing intermittent connectivity to LDAP servers.   This in turn is affecting CAS (Central Authentication System ) logins, including the my.ryerson.ca portal.   Some users may experience slowness and a few may not be able to login.   Staff are investigating the problem and hope to have full service restored soon. This note will be updated as more information becomes available.

Update: The problem was traced to a CAS ticket replication failure, causing read time outs.  The issue was resolved at 9:47 AM.

Please accept our apologies for the disruption in service.

-Computing and Communications Services

Posted in eResources, LDAP, my.ryerson | Comments Off on CAS/my.ryerson Service Disruption: Wednesday, Jan. 16 2013 9:15 AM