New York University Faculty of Arts and Science College of Arts and Science Graduate School of Arts and Science

CIMS Systems Critical Announcements

Announcements of an urgent nature, such as disruptions of network connectivity and scheduled and unscheduled maintenance of servers, are posted here.

Subscribe to get email updates.

Network Problems

March 6th, 2014

CIMS continues to experience severe network latency this morning. We continue to work with ITS, who manage the network infrastructure, and as of this morning the equipment vendor, Cisco, is working on it as well. Naturally, we hope this will be resolved soon and appreciate your patience.

Security/Software Updates (Linux reboots)

Compute nodes as well as desktop machines WILL BE REBOOTED on Wednesday (January 15th).  Rolling updates will be applied to machines between 8:00pm and midnight. In an effort to try and minimize any corrupted files or lost work, please save all your data and logout of any linux systems before 8:00pm. Many of the updates have already been made on several linux machines in the computer lab located in WWH 229. We urge people to test any packages that are critical to their work and let us know if they encounter any problems before the updates occur. The machines that have been updated are:

  • pubbox49.cims.nyu.edu
  • pubbox44.cims.nyu.edu
  • pubbox16.cims.nyu.edu
  • pubbox29.cims.nyu.edu
  • pubbox46.cims.nyu.edu
  • pubbox30.cims.nyu.edu
  • pubbox10.cims.nyu.edu
  • pubbox39.cims.nyu.edu
  • pubbox51.cims.nyu.edu
  • pubbox52.cims.nyu.edu
  • pubbox41.cims.nyu.edu

Some significant software updates include (but are not limitted to):

  • Linux kernel (automatic REBOOT)

Security/Software Updates (Linux reboots)

Compute nodes as well as desktop machines WILL BE REBOOTED on Thursday (Nov 7th).  Rolling updates will be applied to machines between 8pm and 12am. In an effort to try and minimize any corrupted files or lost work, please save all your data and logout of any linux systems before 8pm. Many of the updates have already been made on several linux machines in the computer lab located in WWH229. We urge people to test any packages that are critical to their work and let us know if they encounter any problems before the updates occur. The machines that have been updated are:

  • pubbox49.cims.nyu.edu
  • pubbox43.cims.nyu.edu
  • pubbox44.cims.nyu.edu
  • box110.cims.nyu.edu
  • pubbox16.cims.nyu.edu
  • pubbox29.cims.nyu.edu
  • pubbox46.cims.nyu.edu
  • pubbox30.cims.nyu.edu
  • pubbox10.cims.nyu.edu
  • pubbox39.cims.nyu.edu
  • pubbox51.cims.nyu.edu
  • pubbox52.cims.nyu.edu
  • pubbox41.cims.nyu.edu

Some significant software updates include (but are not limitted to):

  • Linux kernel (automatic REBOOT)

Server Outage

10/15/2013, 12 pm: Please be advised that we experiencing problems with one of the file servers from which home directories are accessed. It is in the process of resharing home directories, so we hope services will be restored to normal within the next half hour or so. We apologize for the inconvenience.

Security/Software Updates (Linux reboots)

Compute nodes as well as desktop machines WILL BE REBOOTED on Thursday (Aug 22nd).  Rolling updates will be applied to machines between 8pm and 12am. In an effort to try and minimize any corrupted files or lost work, please save all your data and logout of any linux systems before 8pm. Many of the updates have already been made on several linux machines in the computer lab located in WWH229. We urge people to test any packages that are critical to their work and let us know if they encounter any problems before the updates occur. The machines that have been updated are:

  • WWH229: pubbox1.cims.nyu.edu
    WWH229: pubbox10.cims.nyu.edu
    WWH229: pubbox16.cims.nyu.edu
    WWH229: pubbox26.cims.nyu.edu
    WWH229: pubbox33.cims.nyu.edu
    WWH229: pubbox34.cims.nyu.edu
    WWH229: pubbox41.cims.nyu.edu
    WWH229: pubbox45.cims.nyu.edu
    WWH229: pubbox46.cims.nyu.edu

Some significant software updates include (but are not limitted to):

  • Linux kernel (automatic REBOOT)

 A full list of all software updates for linux and solaris is available on the update page.

June 21-22 Planned Power Outage Update

Timeline:

Shutdown of fileservers begins around 5 pm on Friday, June 21, and all systems should be down by 6 pm. At this point CIMS Windows and Linux desktop computers will be unusable for the duration of the outage.

Depending on how work progresses and how quickly network services to CIMS servers can be restored, the outage should last until some time between late afternoon and the evening of Saturday, June 22.

We strongly urge users to take this time off from their CIMS computer accounts and plan to work offline if at all by copying needed files to alternative systems. However, we plan to make some services available as best as we can during the outage. What follows is subject to change, so please refer to it again.

Services that will be available during the outage:

Wired and wireless networking throughout Warren Weaver Hall should remain available, so people should be able to use personal desktops and laptops in their offices.

Networking and non-CIMS systems in 715/19 Broadway should be unaffected. We will run temporary services on systems housed in that building as follows.

Access to user files:

After 5 pm on Friday, 6/21, users will be able to login to  access.cims.nyu.edu and have read-only access to a backup copy of their home directory. Because this copy is from a nightly backup, it will only reflect changs made through early on Friday. If you make changes  on Friday that you want to keep working on through the outage, you should copy those files to a personal computer before the outage (after the outage your files on the "real" systems will be back to their pre-outage state). We advise people to user an scp client to copy files to personal machines. Files under user data directories (ie, /data) will not be available.

If you login to access.cims.nyu.edu using an ssh client you may get error messages because the directory is not writeable, but it should work nonetheless.

Web Services:

We will continue to maintain our web presence using static content on all CIMS, departmental and related web sites. This too will be read-only, so dynamic content, cannot be updated. Also, changes made in the last day before the outages may not appear on these temporary web sites.

CIMS Email accessible on webmail.cims.nyu.edu:

The CIMS mail system will be shut down around 5 pm, and will remain unavilable for up to an hour while we bring it up on a backup server. CIMS Mail will only be accessible by logging into webmail.cims.nyu.edu. We cannot allow imap or connections due to the unpredictabitiy  of the various imap clients and the devices on which they may run. That is, we do not want to risk mail on these clients to get out of sync during the outage with the possibility they can't fix themselves through normal operation.

  • New mail will reside in your INBOX
  • A read-only copy of your inbox as it existed on Thursday evening will be listed as INBOX-ReadOnly. Like with the home directories, this is actually a backup copy run over night.
  • Mail from Thursday evening through the shutdown will appear as a folder called INBOX-0621. This is all email that will have come in over the course of the day on Friday up until the shutdown, so it is basically for redundancy.
  • Read-only versions of your regular mail folders should be accessible by their familiar names listed below the temporary writeable "INBOX files."

 

Security/Software Updates (Linux reboots)

Compute nodes as well as desktop machines WILL BE REBOOTED on Thursday (May 23rd).  Rolling updates will be applied to machines between 8pm and 12am. In an effort to try and minimize any corrupted files or lost work, please save all your data and logout of any linux systems before 8pm. Many of the updates have already been made on several linux machines in the computer lab located in WWH229. We urge people to test any packages that are critical to their work and let us know if they encounter any problems before the updates occur. The machines that have been updated are:

  • WWH229: pubbox1.cims.nyu.edu
    WWH229: pubbox10.cims.nyu.edu
    WWH229: pubbox16.cims.nyu.edu
    WWH229: pubbox26.cims.nyu.edu
    WWH229: pubbox33.cims.nyu.edu
    WWH229: pubbox34.cims.nyu.edu
    WWH229: pubbox41.cims.nyu.edu
    WWH229: pubbox45.cims.nyu.edu
    WWH229: pubbox46.cims.nyu.edu

Some significant software updates include (but are not limitted to):

  • Linux kernel (automatic REBOOT)

 A full list of all software updates for linux and solaris is available on the update page.

Planned Power Outage

Courant is coordinating with ITS to schedule a power outage in the Warren Weaver Hall data center for electrical work related to the installation of new UPS (Uninterruptible Power Supply) systems, which will provide emergency backup power to the entire data center. The outage will be substantial, lasting approximately 16-24 hours, during which time Courant's primary system and network services in Warren Weaver Hall will be unavailable. At this time, the proposed target date for the outage is Saturday, June 22nd, 2013. We will know more about specific timing as planning progresses.

This work must be scheduled for this summer, as the current UPS infrastructure for the data center is both obsolete and inadequate. Because this data center serves as the hub of Courant's computing and network services, the impact of this outage will be significant, but so will the benefits, though the objective is that users will never be aware of them.

During the outage:

While Courant's primary file and mail servers will be unavailable, and network connectivity throughout Warren Weaver Hall, both wired and wireless, will be out of commission, systems and network connectivity at 715/719 Broadway will remain available.

To minimize the impact of the outage on our community, fail-over equipment housed in 715 Broadway will be used to keep CIMS, Math, CS and research web services on-line, as well as to provide "read only" access to files and mail, enabling users to continue working using alternative storage space, either on their personal computers or temporary disk space Courant will provide.

After the Outage:

Following this initial phase of the work, a second outage of CIMS equipment will need to be planned for a later date to connect our circuit panels to the new UPS systems. This subsequent outage will be considerably shorter in duration than the first.

At present, we have limited backup power capacity protecting only our critical servers and disk systems. Once the transition is completed, however, this protection will extend to secondary services and computing resources, protecting long-running jobs and generally enabling us to withstand planned and unplanned power disruptions lasting as long as 15-30 minutes. The most practical advantage of this is that it will ensure smooth transitions between Con Edison and NYU Co-gen power in cases when such transfers are necessary.

Incoming Mail

There was an issue with incoming email from
outside that may have resulted in some mail
being returned to the sender. The issue has been
resolved, but if you were expecting email you have not
received, you may want to have the sender resend it.
Sorry for the inconvenience.


Security/Software Updates (Linux reboots)

Compute nodes as well as desktop machines WILL BE REBOOTED on Thursday (March 7th).  Rolling updates will be applied to machines between 8pm and 12am. In an effort to try and minimize any corrupted files or lost work, please save all your data and logout of any linux systems before 8pm. Many of the updates have already been made on several linux machines in the computer lab located in WWH229. We urge people to test any packages that are critical to their work and let us know if they encounter any problems before the updates occur. The machines that have been updated are:

  • WWH229: pubbox1.cims.nyu.edu
    WWH229: pubbox10.cims.nyu.edu
    WWH229: pubbox16.cims.nyu.edu
    WWH229: pubbox26.cims.nyu.edu
    WWH229: pubbox33.cims.nyu.edu
    WWH229: pubbox34.cims.nyu.edu
    WWH229: pubbox41.cims.nyu.edu
    WWH229: pubbox45.cims.nyu.edu
    WWH229: pubbox46.cims.nyu.edu

Some significant software updates include (but are not limitted to):

  • Linux kernel (automatic REBOOT)

 A full list of all software updates for linux and solaris is available on the update page.

 

Archive