General Information

ABOUT CISER'S GENERAL RESEARCH COMPUTING SYSTEM

CISER RESEARCH NODES (formerly known as "the Athena nodes"):
- CISER maintains a group of state-of-the-art multi-processor computing nodes for social science researchers at Cornell.
  - These include both 32-bit, 64-bit, and x64 systems and are accessible by Remote Desktop from home or office for all account holders.
  - Each node includes an array of software for both quantitative and qualitative data analysis.
  - An attached file server provides disk space for over 800 current account holders. With the use of the CISER VPN this file server may be mapped directly to a user's desktop.
SYSTEMS SUMMARY:
- The CISER Research Computing nodes currently include the following. Please note that this list may change from time to time as older servers are retired and new ones added.
  - Athena01, Athena02:
    - Unisys ES7000 systems, running Microsoft Windows Server 2003 Datacenter Edition.
  - Athena64, Athena65:
    - Unisys ES7000 systems, running Microsoft Windows Server 2003 Datacenter Edition for 64-bit architecture.
    - Each of these nodes has sixteen (16) Itanium 2 (1.3GHz) processors and 64 GB of RAM.
  - RSCH102, RSCH103, RSCH104, RSCH105:
    - These are Dell R900 systems, running Microsoft Windows Server 2003 Datacenter Edition x64
    - Each of these nodes has four Quad-core processors (=16 cpu's each), 128 GB of RAM, and over 400 GB of temp space on the T:\drive
- The CISER Research File server:
A more detailed list of hardware specifications for each of the computing nodes is at http://ciser.cornell.edu/pub/ComputingHardwareSpecifications.shtm

A list of the available software on each of these nodes is at http://ciser.cornell.edu/athena/athena_software.shtml

To apply for an account on CISER's Research Nodes please fill out the form at http://ciser.cornell.edu/athena_newacct.shtml
- Accounts are usually set up within 24 hours, although it may take up to 48 hours during busy times of the semester. All social science researchers at Cornell, as well as their research staff and student research assistants, are eligible for CISER Research Computing accounts.

CISER DATA ARCHIVE:

CISER's Data Archive files also reside on the file server attached to the CISER Research Computing nodes. For information about locating and using these data please see the CISER Data Archive web page.

Requirements for Using the CISER Research nodes

SYSTEM AND SOFTWARE REQUIREMENTS

OPERATING SYSTEM REQUIREMENTS:
- Windows 2000, XP Professional, 2003, or Vista is required in order to have fully supported access to CISER's Research nodes.
  - CISER does not support access from older Windows operating systems (Windows 95, 98, or ME).
- Mac OS X users who have Remote Desktop installed also may use CISER's Research nodes, though CISER support for that platform is limited.

SOFTWARE REQUIREMENTS:
- Access to the CISER's Research Computing Nodes is by one of the following methods:
  - Remote Desktop client (*CISER recommended method*) :
    - Remote Desktop is pre-installed on all Windows XP Professional, Windows 2003, and Windows Vista systems, and also on some Windows 2000 systems.
      - example: Start --> All Programs --> Accessories --> Communications --> Remote Desktop Connection
    - Windows 2000 users without the pre-installed version may download the (free) Remote Desktop Connection Software
    - Mac OS X users may download a free Remote Desktop Connection Client for Mac. There are currently two versions:
      - Remote Desktop Connection Client 1.0.3 for Mac OS X
      - Remote Desktop Connection Client for Mac 2.0 (Beta 2)
  - Remote Desktop Web Connection via Internet Explorer.
    - This method requires the use of Microsoft Internet Explorer. Other internet browsers will not work.
    - Your Internet Explorer must be Version 4.0 or higher.
- Access to the CISER file server is available:
  - Via the U:\ drive mapped to each CISER Research Node.
  - or by mapping your CISER home directory to your local PC
  - NOTE:
    - Telnet to the CISER Research Nodes or associated file server is not allowed.
    - FTP to the CISER Research Nodes or associated file server is not allowed.

SYSTEM USAGE POLICIES FOR THE CISER RESEARCH COMPUTING SYSTEMS:

FILE STORAGE POLICY:
- The CISER Research Nodes and associated file server are for research use only.
  - These nodes are not to be used for the storage or backup of personal media files, or for watching streaming video. Violations of this policy will result in the loss of access privileges.
E-MAIL POLICY:

CISER users are not allowed to set up e-mail accounts on the nodes.
CISER users may, however, log on to Cornell webmail or other web-based e-mail from the research nodes in order to move research related files via e-mail attachment. All such files must be saved in the user's home directory on the CISER file server.

LOG ON AND LOG OFF POLICIES:

See instructions for Disconnecting vs Logging Off . It is important to know the difference and use each option appropriately.

RESOURCE USAGE POLICY:
- All users are expected to be considerate of others, and to refrain from any intentional monopolization of the system resources (cpu, memory, disk space, etc) of the computing nodes and/or the file server.

CISER Research Nodes: First Time User Information

INSTRUCTIONS FOR FIRST TIME USERS

Here is a brief outline of the main steps for using the CISER Research nodes:

Log on to any Research node via Remote Desktop Web Connection or Remote Desktop Client.
- See the Research Node usage page for a list of available nodes.
- This initial logon is necessary in order to authenticate your userid and password with the domain so that you can use the VPN later.
You'll need to reset the temporary password you received from CISER when your account was set up.
- See password requirements for the rules about settting passwords.
Log in tips:
- Use the domain name ("ciserrsch") and your netid for the "user" field:
  - Example: "ciserrsch\cam6".
- Be sure the "log on to" field is set to: "ciserrsch" (NOT to "this computer").
  - Click on the "options" button if the "log on to" box does not show up.
Set up your CISER Research Node Desktop.

How to set up your working environment on the CISER Research Nodes .

Once you're done, be sure to log off. Don't just disconnect.

When working on the research nodes always follow this rule:
- Use the "disconnect" option (the X in the top right corner of the window) only when you have a process running and want to leave your CISER session.
- In all other cases please choose "log off" from the Start Menu. Inactive disconnected sessions use resources unnecessarily, misrepresent total machine usage, and can cause problems for you when you change your password in the future!

Optional: Set up the CISER VPN (Virtual Private Network) client for transferring files between your local computer and the CISER file server.
- Note: There are at least 3 ways to move files between your local computer and the CISER file server. Each is described in the "How to Move Files..." section of this document. The VPN is the most secure method of the three, but is not required.

CISER Research Nodes: Passwords and Account Lockout Policies

HOW TO SET YOUR PASSWORD for the CISER Research Nodes

PASSWORD RESETS:
- If you forget you password you can request a new temporary password from ciser@cornell.edu
  - note: We cannot look up passwords for you. Once you receive the new temporary password you will be required to change it to one of your choosing. See password requirements below.
PASSWORD REQUIREMENTS:

Each password must have at least eight characters. Each password must contain at least three out of the following four elements among its first eight characters:
- uppercase letters
- lowercase letters
- special character
- digits
Each password must differ from the user's login name or full name, or any permutation of either. For comparison purposes, an upper case letter and its corresponding lower case letter are equivalent.
New passwords must differ from the old by at least three characters.
There will have to be 25 password changes using different passwords before a password may be reused.
Users will be prompted to change their password every 42 days.
Accounts that have been inactive for 6 months will be contacted; if no response is received, accounts will be disabled.

PASSWORD POLICIES:

It is against Cornell's Computing Policy Regarding Abuse of Computers and Network (see http://www.cit.cornell.edu/computer/policies/abuse.html ), and CISER's policy as well, for you to share your account and password with any other person!
Please do not form a password by appending a digit to a word--this type of password is easily guessed.
Never leave your password in plain text (unencrypted) in any file in your home directory. Passwords stored in this way are easily stolen.

WHEN TO CHANGE YOUR PASSWORD:

any time you think yours has been compromised, or when you get a message that your password is about to expire.
but NOT when you have current jobs running! In order to prevent account lockouts, check to be sure that you have ended your jobs and logged completely off all other CISER Research Nodes before changing your password. Disconnected sessions on other nodes, set up under you old password, will generate periodic account lockouts.

HOW TO CHANGE YOUR PASSWORD BEFORE IT EXPIRES:

Disconnect any network drives you have mapped from the file server ("ciserrschdfs") to your local PC
- On your local PC:
  - Start --> right click on My Network Places --> choose "disconnect network drive".
  - Select the drive you have mapped to "ciserrschdfs" then click "OK".
- Drives may be re-mapped after your password has been changed.
Log on to any CISER Research Nodes via Remote Desktop Web Connection or Remote Desktop Client
- See the CISER Research Node usage page for a list of available nodes.
Log off all disconnected and/or active sessions on other nodes

Use Terminal Services Manager on the current node.
note: If you have jobs running we recommend you wait until those have been completed before proceeding with this step.

Use the Windows Security Window to change your password
- Details:
  - Start --> Settings --> Windows Security
  - OR be sure you are in full-screen mode (toggle to and from full-screen mode with Ctrl-Alt-Break) and then do Ctrl-Alt-End to open the Windows Security window.
  - Be sure to follow these password requirements.

HOW TO CHANGE YOUR PASSWORD AFTER IT HAS EXPIRED:
- Disconnect any network drives you have mapped from the file server ("ciserrschdfs") to your local PC
  - Details:
    - On your local PC:
    - Drives may be re-mapped after your password has been changed.
- Log on to any CISER Research Nodes via Remote Desktop Web Connection or Remote Desktop Client
  - See the CISER Research Node usage page for a list of available nodes.
  - Do NOT try to connect via a mapped drive for this step.
- Change your password following the on-screen instructions
  - Be sure to follow these password requirements.
  - NOTE: If there are no on-screen instructions and you have successfully logged on with your old password, then follow Step 4 in the section above.
- *Before logging off!* do this:
  - Use Terminal Services Manager to check for and log off any disconnected sessions on other nodes.
    - note: if you have active or disconnected sessions on any node that were started with the old password, you will most likely experience periodic lockouts as those sessions continue to send your old password to the domain.
    - note: if you experience an "account lockout" before you can log off an old session see the Account Lockout FAQ.

HOW TO CHECK NODE USAGE:

Method one: CHECK NODE USAGE ON ANY NODE TO WHICH YOU ARE LOGGED ON:
- On the CISER Research Nodes:
  - Start --> Run --> type in "taskmgr" and click "OK" (or right-click an empty spot on the taskbar, choose "Task Manager" and click "OK")
  - Select the "Performance" tab to see current CPU and memory usage.
    - If usage is high you may wish to log off that node and switch to another node.

Method two: CHECK NODE USAGE FOR ALL NODES:
- Users may view the current CPU usage, memory usage, and temp disk space availability on all CISER Research nodes via the web: View Current CPU usage on the CISER Research nodes

Connecting to the CISER Research Nodes with Remote Desktop Web Connection

HOW TO CONNECT TO THE CISER RESEARCH NODES ("CISER Research Nodes"):

Method A: Remote Desktop Web Connection (requires Internet Explorer)

Use Internet Explorer go to http://athena.ciserrsch.cornell.edu/tsweb/

IMPORTANT NOTES!

This will only work with Internet Explorer. It will not work with Netscape or other browsers.
The first time you do this you may get a pop-up window asking you if you wish to download and install "Active-X".

Just say "yes". This only takes a few seconds.
You may also get an additional security prompt , to which you should reply with "yes".

In the "Remote Desktop Web Connection" window type in the address for the CISER Research Node of your choice as shown below:
Leave the "Send logon information... " box blank.
Keep the Full-screen option (or experiment with other screen sizes if you like.)

Full-screen mode allows you to view the Research Node desktop in its entirety without the distraction of the taskbar on your local desktop.
The alternative (when you choose a screen size) is "Window" mode, which allows you to see your local taskbar and start menu, as well as the Research Node desktop. You will most likely need to scroll within the window to see the Research Node taskbar, start menu, etc...
NOTE: After you're logged on you can toggle out and back from Full Screen mode to Window mode by using Ctrl+Alt+Break

Then choose "Connect"

TIP: If your "Connect" button fails to work (i.e. if it is grayed out) then you have probably not downloaded and installed "Active-X", as instructed above. If you get a general error message it probably means you are using a browser other than Internet Explorer.

TO LOG ON: When the Windows Log On box appears enter your netid and your CISER Research password (example below)

Choose "CISERRSCH" as the location for "Log on to:"

note: The "Log on to" box may be viewed (or hidden) with the "Options" button.

Choose "OK"

TIP:

Remember that once you are logged on you can toggle toggle out and back from Full Screen mode to Window mode by using Ctrl+Alt+Break.

Connecting to CISER Research nodes with Remote Desktop

HOW TO CONNECT TO THE CISER RESEARCHNODES

Method B (CISER Recommended Method!): USE THE REMOTE DESKTOP CLIENT ON YOUR PC OR MAC

Remote Desktop client is pre-installed on Windows XP Professional, Windows 2003, and Vista operating systems. It is either installed or may be downloaded for Windows 2000 systems.
- Windows 2000 users without the pre-installed version may download the (free) Remote Desktop Connection Software
- Note: Access with earlier versions of Windows (Windows 95,98, and ME) is not supported by CISER.
Mac OS X users may download the (free) Remote Desktop Connection Client 1.0.3 for MAC OS X

Example for Windows XP:

Go to Start --> Programs --> Accessories --> Communications --> Remote Desktop Connection.

note: the precise command words may vary slight with other version of Windows or with MAC OS X. Use your system help menu to search for"Remote Desktop" or "TerminalServices" to find the application on your system.

Type in the name of the node to which you wish to connect as shown, and choose "Connect".

A credentials window may appear as shown below. Enter the domain name and your userid in the "User name" field, as shown below. Note: Currently the entry of your password in this particular window is NOT required, and you may check "Remember my password" to bypass this window the next time your log on to this particular node.
Next you will most likely see a window asking to verify that you trust the computer to which you are connecting. You should keep the default settings and choose "yes" as your response. Note that you have agreed to share local disk* and clipboard with the remote node.

*Important note: Checking the "Allow access to your local disk drives" box will not immediately allow you to share your local disk with the node -- there are other steps you must follow if you wish to transfer files to or from the CISER Research Nodes and your local computer. See How to Transfer Files for more information regarding that topic.

TO LOG ON: When the Windows Log On box appears enter your netid and your CISER Research password (example below)

Choose "CISERRSCH" as the location for "Log on to:"

note: The "Log on to" box may be viewed (or hidden) with the "Options" button.

Choose "OK".

TIP:

Once you are logged on you can toggle toggle out and back from Full Screen mode to Window mode by using Ctrl+Alt+Break.

How to use the CISER Research nodes: Your Working Environment

HOW TO SET UP YOUR WORKING ENVIRONMENTON THE CISER RESEARCH COMPUTING NODES:

FINDING AND USING YOUR "HOME DIRECTORY"

ABOUT HOME DIRECTORIES:
- Your home directory resides in a user folder on the CISER file server (rschdfs) which is mapped as the U:\ drive on every CISER Research Computing node. Users' home directories are assigned to sub-folders such as "user1", "user2" ... "user9".
- The specific path to your home directory will be in a e-mail that you receive from ciser when you set up your computing account. (example: "U:\user5\cam6")
- Your home directory is where all of your research files should be stored!
  - Files in your home directory are backed up daily* AND they are accessible from any computing node
    - (*As long as you do not alter the system or administrator privileges to your folder or its contents.
- One way to navigate to your home directory from any computing node is to go to "Start --> My Computer" then type the full pathname for your home directory (example "U:\user5\cam6") in the address bar of that window.
- note: Your "My Documents" folder is also located in your home directory (example: "U:\user5\cam6\My Documents"). Use of the "My Documents" folder is purely optional and is a matter of preference. See below for more detail.

TO CREATE A SHORTCUT TO YOUR HOME DIRECTORY
- From a CISER Research Computing node, go to "Start --> My Computer".
- Under "Network Drives" and you will see the following entry
  - "rschdfs on 'AthenaDC2 (ciserrsch.cornell.edu)'(U:)".
- Double click on that icon and you will see the list of user home directories.
- Double-click on the appropriate user folder (example: "user5") and then locate the folder with your own netid (example "cam6").
- RIGHT-CLICK on the folder with your netid and then choose "send to" --> and then "desktop".
  - This will create a shortcut on the desktop of that computing node so that everytime you log on to the node you can use the shortcut to go directly to your home directory.
    - You will need to do this the first time you log on to any computing node (i.e. once for each node)

USING YOUR "MY DOCUMENTS" FOLDER (optional)

ABOUT YOUR "MY DOCUMENTS" FOLDER
- Your "My Documents" folder is located in your home directory (for example "U:\user5\cam6\My Documents". See above for more detail.

Use of the My Documents folder is purely optional. You may choose to create folders in the top level of your home directory (example "U:\user5\cam6") instead of in your My Documents folder.
Users should NOT rename this folder as it is used by various applications. Renaming may result in some applications not working properly.
You can get to your My Documents folder by typing "My Documents" in any explorer window or via shortcuts created by one of two methods below.
Use of the My Documents folder for file storage is optional and is simply a matter of preference.

CREATING OR USING A SHORCUT TO YOUR "MY DOCUMENTS" FOLDER
- Recommended way of creating a shortcut to your My Documents folder.
  - Go to your home directory (see above) and look for the documents folder labeled with your own netid (example: "cam6's documents")
  - RIGHT-CLICK on that folder and choose "send to" --> and then "desktop".
  - Creating your My Documents shortcut like this will mean that the proper pathname will show up in the address bar of the explorer window each time your open the shortcut. (example: "U:\user5\cam6\My Documents"
- Using the system created shortcuts to My Documents folder
  - Some computing nodes contain system created shortcuts to your My Documents folder.
  - In these the pathname that will appear at the top level will just be "My Documents" but the pathname for subfolders will show up with the full address of the mapped drive.
    - For example if I go to a subfolder called "mydata" inside my "My Documents" folder by means of this shortcut the pathname will show up as:
      "\\ciserrsch.cornell.edu\rschdfs\User5\cam6\My Documents\mydata"
      instead of the more familiar
      "U:\User5\cam6\My Documents\mydata"
    - Both pathnames are correct, and point to exactly the same folder.

SETTING UP YOUR CISER RESEARCH COMPUTING DESKTOP

(Optional)
- As described above, you can easily create shortcuts on your CISER Research Computing desktop to your home directory, and you may also set up shortcute to any folder within it:

right-click on the desired folder icon and choose "Send To" --> "Desktop"

You can also create shortcuts to applications (such as SAS, SPSS, Stat, etc) that you use frequently

Start --> All Programs --> right click on the desired application and choose "Send To --> Desktop" or "Pin to Start Menu", etc.

You will need to set up your shortcuts once for each computing node, since user profiles are unique on each node.

IMPORTANT TIPS ABOUT DOWNLOADING AND STORING FILES ON THE CISER RESEARCH COMPUTING NODES:

Whenever you download files directly from the internet to any computing node be sure to direct the download to your home directory on the U:\ drive. Do not download files to the desktop or anywhere on the C:\ drive of any node.
Save all program output to your home directory. In many cases you may need to specify the path and file name within your code.
See How to Manage your Files for more information.

IDENTIFYING DRIVES, PATHNAMES, and FILETYPES

USEFUL TIP for any Windows environment (including the computing nodes)
To help you identify pathnames of drives, folders, files, and identify filetypes do the following:

Start --> Double-click on "My Computer"
Go to Tools --> Folder Options.
Select the "View" tab.
Check the following two boxes:

"Display the full path in the address bar".
"Display the full path in the title bar".

UNcheck:

"Hide file extensions for known file types".

Click the "Apply" button.
Click the "Like Current Folder" button.
Click "OK".

How to Manage Your Files from the CISER Research Nodes

STORING FILES IN YOUR HOME DIRECTORY

DO store all of your files (data, programs, etc) on the U:\ drive in your home directory.
- Example: "U:\user5\cam6"

Files in your home directory are accessible from all CISER Research Nodes and are backed-up up daily*.
- *as long as you do not alter the admistrator or system permissions to your folder!
This DOES include your My Documents folder which is automatically directed to your home directory.
Files stored in your home directory are secure and not accessible by other users, unless you give them specific permission to selected files or folders.

Do NOT store your files on the C:\ drive of any node, or on any CISER Research Node "desktop".

The C:\ drive is reserved for the operating system.
User files on the C:\ drive are NOT backed up and can cause system problems.
- This includes files stored on the "desktop" of each CISER Research Node
Please ignore the Windows created directory with your netid on the C:\ drive.
- Example:
  - DON'T USE THIS: "C:\Documents and Settings\cam6"
  - DO USE THIS: "U:\user5\cam6\My Documents" or "U:\user5\cam6"

TEMPORARY WORK (SCRATCH) SPACE

There is a "T:\" drive on each CISER Research Node which is used by most applications (SAS, Stata, etc) for temporary work space. Users may create their own folders in this space, as well, but should keep in mind the following:
- Files on the T:\ drive are NOT backed up and will be deleted after one week of non-use.
- Default permissions for user created folders on the T:\ drive allow access by others.
- The T:\ drive is local to each node, and the files on the T:\ drive of any node are not accessible from any other node.

ABOUT FILE BACKUP

Files in your home directory (U:\UserX\netid), including the files in your My Documents folder, are backed-up daily. Files in the "T:\" drive (temporary scratch space) on the CISER Research Nodes are NOT backed-up. Users should not store files on the C:\ drive or on the "desktop" of any CISER Research Node.

HOW TO TRANSFER FILES TO AND FROM THE CISER RESEARCH CLUSTER (for Windows users)* (note: Mac users should refer to Alternate Method A2 (below).

Most secure method for moving files to and from the CISER file server:

Run the CISER VPN and Map the CISER file server to your local PC

This is the preferred method for moving files to and from your PC (running Windows 2000 or Windows XP) and the file server attached to the CISER Research Cluster. Explicit directions are in the links above. This method allows you to drag and drop files from your local drives to your home directory (U:\UserX\netid) without even logging on to the CISER Research Nodes.

Alternate methods for moving files to and from the CISER file server:

Alternate Method A1: (for Windows users)*

Map your local drives to an CISER Research Node:
This method does not require use of the CISER VPN.
Log on to any CISER Research Node using the Remote Desktop client, but select the OPTIONS button before connecting, as shown below:

Enter the node address as usual
Select the Options button:
Choose the "Local Resources" tab
Select the "More" button
Select the local disk you wish to use in your Remote session, then select "OK". You will be returned to the Local Resources Tab.
Choose "Connect" and you will see the Credentials window. Enter your CISER Research credentials.
Now you will see the trust verification window. Confirm that both boxes are checked to allow access to your local disk drives and your local clipboard and choose "Yes"
- At this point you should be connected to the Terminal Services session on the node you have selected. Enter your CISER Research user credentials.
- To see you locally mapped drives go to Start --> My Computer --> and look under network drives!

Alternate Method A2: (*for Mac Users)
Alternate Method B: (all users)

Send files to and from the server via Cornell's web based e-mail.
- This should work for any CISER Research user:
- From any CISER Research Node you may use Internet Explorer to connect to Cornell University web mail (webmail.cornell.edu) and send or receive files as e-mail attachments to or from yourself. Not recommended for large files.

Alternate Method C:
- FTP to another server from the CISER Research nodes.

How to Use the CISER Research Nodes: File Management: Compression

COMPRESSING FILES

To conserve disk space on the CISER research nodes, users should compress large files in their directories while those files are not actively in use. There are several ways to accomplish this.

The recommended way to compress SAS datasets is to use SAS to create compressed observations. For instructions on how to do this, please see: http://ciser.cornell.edu/FAQ/SAS/new_compress.shtml.

There are three methods of file compression that are available on all of the CISER research nodes, with may be used on any type of file:

The "Windows Compression" utility, which is used from Windows Explorer:
This method very easy to use, but it is platform dependent. Files that are compressed in this manner may be used in their compressed state by most software packages on CISER Research. Unless the user makes changes to their Windows folder options, the only way to determine if a file is compressed is to check its properties, because the file name remains unchanged. For more information about using this utility please see: CISER Research_c5aa.shtml.

The "GZIP / GUNZIP" utility, which is used in a Command Prompt interface:
This method is platform independent. Files that are gzipped can be copied to any other operating system and uncompressed by many different software packages including gzip, WinZIP, Stuffit Expander, and 7-Zip. However, files must be uncompressed before they can be used by software packages on CISER Research. Compressed files receive a ".gz" extension so it's obvious if they are compressed. This method usually produces the best compression ratio. For more information about using this utility please see CISER Research_c5ab.shtml.

The "WinZip" utility:
WinZip is a popular compression utility which creates zipped archives with a .zip extension. Each file can be compressed separately, or a group of files can be compressed together into one zipped file. The WinZip interface is available on each CISER Research node's Programs menu. For more information about using this utility go to "Programs->WinZip->Help Manual" on any CISER Research node.

How to Use the CISER Research Nodes: Compression with NTFS

USING THE WINDOWS NTFS COMPRESSION UTILITY:

Please note before using:

You may encounter an error when compressing very large files. For files over 500 MB in size, we recommend that you use gzip instead.
CISER has tested files compressed by this utility with most of the software packages on CISER Research, and has encountered no problems. However, we cannot guarantee that all programs run on CISER Research will work on NTFS compressed files.

Compressing files:

Open the folder where you have the file(s) you want to compress.

Highlight the file(s) you want to compress. While they're still highlighted, right-click on one of them and choose "Properties". Click on the "General" tab, and notice how the number of bytes shown for "Size" and "Size on disk" are not very different.

Click on the "Advanced..." button.

Check the "Compress contents to save disk space" box, and click "OK".

Back in the "Properties" window, click "Apply". Notice how number of bytes shown for "size on disk" has significantly decreased. Click "OK".

Notes:

Even though a file is compressed, the bytes shown in the folder are what the file would be in its uncompressed state. To visibly distinguish which files are compressed without having to check their properties, you can change a setting under "Folder Options":
1. Go to Start->Settings->Control Panel->Folder Options.
2. Click on the "View" tab.
3. Check the first box which says "Display compressed files and folders with alternate color", and click "OK".
This will make the file names of all compressed files a different color than uncompressed file names, when viewed from within a Windows folder. Unfortunately, this color setting is not carried across all nodes, so you will need to set each node that you want this to work on individually.

If you want all the files within a folder to be compressed, you can right-click on the folder name instead of a file name. If you add or copy a file into a compressed folder, it is compressed automatically. If you move a file from a different CISER Research drive into a compressed folder, it is also compressed. However, if you move a file from the same CISER Research drive into a compressed folder, the file retains its original state, either compressed or uncompressed.

Although this utility appears to allow you to use compressed files with software packages as if the files weren't compressed, what's actually happening is that the system is uncompressing the file each time you use it, and re-compressing it when done. If you plan to work on a compressed file more than one time per session, it would be beneficial to both you and the system for you to manually uncompress the file, work on it, and then manually re-compress it before logging off. This will save both your time and the system's resources.

For files larger than 4 GB, there is some loss of stability and reliability when using Windows NTFS compressed files with SAS and other applications. If your file is very large, please uncompress it before using it and then recompress it when your done.

Compressed files and folders cannot be encrypted.

Additional information about Windows NTFS Compression may be found at: http://www.ntfs.com/ntfs-compressed.htm.

How to Use the CISER Research Nodes: Compression with GZIP

USING THE GZIP / GUNZIP UTILITY:

Go to Start->Programs->Accessories->Command Prompt toopen a command prompt window.

In the command prompt window, change the directory to where the filesyou want to compress are. For example, if your files are in the "U:\Users\ikh1\temp"directory, type "cd U:\Users\ikh1\temp" (and press <Enter> onthe keyboard). NOTE: If the commandprompt begins with a different drive letter such as "C:\", you'llneed to type in the drive letter and a colon such as U: andpress <Enter> on the keyboard before typing in the full directory.

To see the files in the current directory, type "dir". To compressall these files using gzip, type "gzip * " (gzip <asterisk>). When the prompt reappears, type "dir" again. Notice that all thefiles now have a ".gz" extension, and their file sizes are much smaller.
NOTE: If you can't see the ".gz" extension in your windows folders, then you can change a folder option to make it visible: open "My Computer", go to "Tools->Folder Options..." and choose the "View" tab. Make sure the "Hide extensions for known file types" box is unchecked, click on the "Apply to All Folders" button, and then click on "OK".

When you need to work with these files again, follow steps 1 & 2above, and then type "gunzip * ". All the files in the directorywill be returned to their original size.

Notes:

It isn't necessary to compress all the files in the directory. Whentyping the command line, you can use a file name in place of the asteriskto gzip or gunzip just one file. You can also gzip or gunzip a group offiles with similar names using wildcards. For more information about wildcards,please see: http://kb.iu.edu/data/ahsf.html.

To gzip/gunzip files recursively (i.e. when you want to also compressall the files in all the sub-directories), you can add the " -r "option: "gunzip -r * ".

While a file is gzipped, it's possible to see it using "zcat". For example, to look at the gzipped file, "uncod.dat.gz", type "zcatuncod.dat.gz | more". It's important to pipe the output to "more" toget one screen at a time, or the entire file will run through the commandwindow at once. (the pipe "|" character is usuallylocated in the upper [shift] position of the backslash \ key.)

zcat pipe image

To scroll through the output one screen at a time, press the spacebar. To stop the output and return to the command prompt, press <CTRL>C.

Additional information about GZIP / GUNZIP may be found at: http://water.usgs.gov/GIS/gzip/gzip_doc.txt.

To get a free copy of the GZIP / GUNZIP utility for your computer, see http://www.gzip.org/#exe.

How to use the CISER Research nodes: File Access Control

C6. HOW TO CONTROL ACCESS TO YOUR FILES:

DEFAULT PERMISSIONS

By default the permissions set up for your home directory ("U:\UserX\<your netid>") allow you full control over your files and folders. Only you and the system and system administrators have access to your files on the CISER file server. You may control who has access to your files and folders and what type of access they have. You may add individual users or groups to the list of people who have access to all or selected files, while restricting access to all others. See below for instructions.

GIVING OTHER ACCESS TO YOUR FILES:

To add access for other users to selected folders or files:

Right click on the icon for the folder or file to which you wish to give them access.
Select "properties", then choose the "security" tab.
At the top of the security window you will see a list which includes the individuals and groups with current access to your files.
Click the "ADD" button to the right of the current list of users.
A window will appear that has a textbox under "Enter the object names to select:"

In this textbox you can enter the name or netid of the person who you wish to add, click on "Check Names" and the entry for that person should appear. Then click "OK".

The new names should now appear in the security window and their default permissions are shown in the checkboxes in the lower half of the window.
You can modify the level of access for any listed user:

Highlight the user's name at the top of the window.
Check or un-check various "ALLOW" boxes to modify access.
IMPORTANT: do NOT check any "DENY" boxes!

TIPS:

If users are given permission to subdirectories or files, but not your main directory, they will need to know the full pathname of the folder to which they have permission in order to access those files.

For example: You can give a colleague access to "U:\UserX\your netid\research" but not to other folders in "U:\UserX\your netid" by modifying the security properties of the "research" folder (see below). The colleague will need to type in the full pathname "U:\UserX\your netid\research" in any explorer window (or use that pathname in program code) to access files in that directory.

RESTRICTING ACCESS

By default, only you and the system and its administratorshave access to your files on the CISER file server.

It is important that you do NOT remove or alter permissions for the "system" and for "administrators". Altering either will prevent some applications from working AND may mean that your files do NOT get backed up!

However, you may add selected individuals to your access list,you can restrict or modify their access as follows:

Right-click on the icon for the folder or files in question, select "properties", then choose the "security" tab.

You will see a list at the top of the properties window of theindividuals and groups with access to your files.
When each name is highlighted the permissions granted that person show up in the "ALLOW" checkboxes at the bottom.

You can modify the level of access for any listed user:

Highlight the user's name at the top of the window.
Check or un-check various "ALLOW" boxes to modify access.
IMPORTANT: do NOT check any "DENY" boxes!

Or you can remove that user'saccess altogether:

Highlight the user's name in the top of the window.
Select the "REMOVE" button.

If a box appears that says you cannot remove that group or person because the object is inheriting permissions from a parent say" OK ", then uncheck the box at the bottom ofthe properties windows that says "Allow inheritable permissionsfrom the parent to propagate to this object". Then choose "copy" fromthe three options that appear. Then proceed to "REMOVE" the group from the list.

Click "APPLY" to complete the changes then select "OK" to exit the box.

How to Use the CISER Research Nodes: Printing

HOW TO PRINT FROM A CISER RESEARCH NODE:

Printing to locally attached printers *:
- Note: This method works with either Remote Desktop Web Connection or the Remote Desktop Client on your local computer.
- Connect to a CISER Research node to see if the print driver for your local printer is installed.
  - Start --> Settings --> Printers.
    - If your printer IS listed you should be able to print directly from CISER Research to your local printer(s).
    - If your printer is NOT shown in the current list of printers, send ciser@cornell.edu a message containing your specific printer model information and ask to have the printer driver installed.
* Your local printer should be set to LPT1, USB, or COM port.
Printing to a networked printer:
- Contact ciser@cornell.edu for details. You will need to know the name of the server to which you are attached, as well as the share name of the printer.

Note: If for some reason you are unable to print from the CISER Research nodes you have the option of transferring the files to your local computer and printing from there.

Using the CISER Research Nodes:� Managing Programs and Processes on the CISER Research Cluster

ABOUT RUNNING PROGRAMS:

The applications (SAS, SPSS, Stata, etc) on any node are independent of those same applications on any other node.
- Therefore output created on one node must be saved to your home directory in order to be accessible by any other node.
You must be logged on to an CISER Research node in order to run applications there.
- If you attempt to run a program file on the CISER file server from a drive mapped to your local PC --- it will search for and run the relevant application on your local PC

DIRECTING PROGRAM OUTPUT:

Be sure to direct output from your programs to your home directory on the CISER file server ("ciserdfs1" mapped as U:\UserX\your netid) or to temporary scratch space (the "T:" drive on any node). Do not attempt to write to the "C:" drive of the CISER Research nodes.
- See How to Manage Your Files for more detailed information about disk space.

MANAGING PROCESSES ON THE NODE TO WHICH YOU ARE LOGGED ON:

Use Task Manager on any node to identify and manage the applications you have running on that node.
- Start --> Run --> open "taskmgr" --> OK (or right-click on an empty space on the taskbar and choose "Task Manager")
- Choose the "Applications" tab and you will see your current tasks and their status (i.e. "running", "not responding", etc)
  - You can end tasks that are "not responding" by highlighting the relevant task and choosing "End Task".
- Options available under the "Processes" tab will allow you to see a list of your current processes, monitor CPU usage, and end processes if you choose.
- By choosing the "Performance" tab in the Task Manager window you can see how much total memory and CPU are being used on that node (by all users).

MANAGING PROCESSES ON MULTIPLE NODES IN THE CISER RESEARCH DOMAIN:

Use Terminal Services Manager on any CISER Research node to identify and manage the applications you have running on all nodes in the CISER Research Domain:
- NOTE: This is an excellent way to locate and log off any disconnected sessions.
  - See Disconnecting vs Logging Off for information about why this is important!
- INSTRUCTIONS:
  - From the current node:
    - Start --> All Programs --> "Terminal Services Manager"
  - From the Terminal Services Manager window:
    - Click on the "+" in front of "All Listed Servers".
    - Double-click on "CISERRSCH".
    - Highlight the node of interest on the left hand side of the window and choose the "users" tab on the right. You will see a list of users with current active and disconnected sessions.
    - If you see disconnected sessions listed under your own userid, and you do not have jobs running there, you can right-click on that session and choose "log off".

MANAGING MULTIPLE SESSIONS ON ONE OR MORE NODES:
- You may have multiple sessions open on the same or different CISER Research nodes at any time. These sessions may be either "active" or "disconnected". Disconnected sessions are those for which you have closed your Terminal Services Window but have not logged off. You should log completely off when you close your Terminal Services Window unless you have have jobs running. It is up to the user to keep up with these sessions and completely log off sessions not in use.
- To check the status of your current sessions on any CISER Research node:
  - Go to "Start" -->"Programs" --> "Administrative Tools" --> "Terminal Services Manager".
  - Options available in the "Terminal Services Manager" window will allow you to list and manage your processes and sessions on all of the CISER Research nodes. You can log off from disconnected sessions on other nodes by selecting the node in the left-hand column, and then right-clicking on the session id with your netid on the right-hand column and choosing "log off".

NEED ACCESS TO MORE RESOURCES?

If you need access to more resources than the CISER Research nodes currently have to offer (to do parallel processing, for example, or run Fortran or C++ code, etc) you may want to access to the Cornell Theory Center's Computing Resources.

Using the CISERResearch Nodes:� Ending Sessions

HOW TO PROPERLY END YOUR SESSION ON A CISER RESEARCH NODE:

TO LOG OFF:

Go to "Start --> Log off"
IMPORTANT!!
- This is the proper way to end your session on an CISER Research node whenever you do not have an active job running*. This conserves system resources and helps to prevent account lockouts!
- *If you have an active job, then see the instructions below for "disconnecting".

TO DISCONNECT:
- Left-click on the "X" in the right corner of the Terminal Services bar at the top of the screen.
- IMPORTANT!!
  - When you disconnect (rather than Log Off) your active jobs will continue to run. When you next attempt to connect to that node you will automatically be returned to that session. You should check periodically to see if your programs have completed, and then save your output and go to "Start --> Log off".
  - Choose the "disconnect" option only when you have active programs running.
    - Disconnected sessions leave processes running on the Athena nodes (thereby using unnecessary resources) and can cause account lockouts when you change your password on another node.

CISER Computing Basics