Frequently Asked Questions

Want to find out more about Data Archive?
Personalise
Female student at the UNSW campus Kensington

  • The UNSW Data Archive is a storage facility for all UNSW researchers (staff and HDR candidates).

    The Data Archive provides UNSW researchers a free, safe and secure, large-scale storage service to archive research data.

    The store complies with the UNSW Research Code of Conduct and the UNSW Procedure for Handling Research Material & Data by providing a solution that allows researchers to keep full, accurate and legible records of research methods, data and materials in a durable, organised and accessible manner.

    The UNSW Data Archive can also be used to store data that is hard to regenerate e.g. computational heavy data or based on a one off event.

  • The UNSW Data Archive is available to all UNSW researchers (staff and HDR candidates).

    UNSW appointed researchers, within the institutes, may access and store their data in the Data Archive. The university is working on a solution for non UNSW appointed researchers within institutes.

  • The UNSW Data Archive is FREE to all UNSW researchers (Staff and HDR candidates).
    • It is a UNSW owned and managed facility that is free of charge for all UNSW researchers (staff and High Degree Research (HDR) candidates).
    • It is safe and secure. All data will only be stored at a UNSW datacentre with an additional back-up of data stored in a secure site off campus, so your data will always remain safe and accessible. 
    • It provides a secure space to view and share data.
    • There is no quota limit.
    • HDR candidates can store data in Private or Shared (with supervisor and others) folders, making it easy for associated research groups to access data in one secure location.

  • All UNSW researchers have access to ResToolkit to create and register a Research Data Management Plan (RDMP). The RDMP is integrated with the UNSW Data Archive - you must have a RDMP to obtain a storage allocation in the UNSW Data Archive.

    Researchers are also strongly encouraged to plan for their project data to be deposited in discipline-specific repositories where these are available. 

    So as a minimum, you can include statements such as:

    • “UNSW has implemented a data storage solution for every stage in the life cycle of a research project.”
    • "The UNSW Data Archive will be used to store the data for this project for at least 7 years"
    • “The data management plan for the project will be established using UNSW’s ResData portal. “
    • “Data will be archived using UNSW’s Data Archive (or other archive mechanism as applicable).”
    • “Data will made discoverable by registration on Research Data Australia (and/or discipline-specific registries where applicable).”

     An example of a full statement on using the Data Archive could be:

    "Access to data files will be password protected, with access restricted to project personnel. The UNSW servers are located in a secure data-centre, whereby physical access requires a swipe card or specially keyed master code. Swipe access is restricted to IT staff who have a need to access these rooms, and are encoded for access by security personnel. The room is protected by double-door airlock system, with both sets of doors independently secured. Console access to servers is password protected and requires VPN software with 2 factor authentication. Passwords for remote access to servers are required to be highly complex, and are expire every 6 months. Offsite tape storage is managed by reputable tape management companies."
    Read about what are the ARC requirements?

  • The ARC (Australian Research Council) requires grant applicants to include information on the management of data which will be produced as a result of the proposed research. The requirement includes elements such as storage, access and re-use arrangements.

    Applicants could outline:

    • How the project’s research materials and data will be stored and managed in accordance with the Australian Code for the Responsible Conduct of Research (as implemented in UNSW policy and procedure). In most cases, this means that electronic research data will be held on secure networked servers which are backed-up on a daily basis.
    • Whether internal (i.e. UNSW researchers) access to electronic data will be facilitated through the UNSW Data Archive interface.
    • Whether large and significant data sets will be shared with researchers outside of UNSW, including through infrastructure such as the RDSI facility (or in specific ANDS and NECTAR projects).

      • What arrangements will be in place to deal with any specific requirements of the research data (privacy, confidentiality, commercial sensitivity)

    Aside from needing to fulfil the requirements of the Australian Code for the Responsible Code of Conduct, it is likely that projects which enable significant data to be shared with other researchers will be well received by assessors, so careful consideration of the plan to store, access and re-use the project’s data is required.

    Researchers unsure about UNSW requirements for the management and storage of Research Data should consult the UNSW Research Code of Conduct and UNSW Procedure for Handling Research Material and Data.
    Read about what to put on my grant application

  • ResToolkit allows you to set up and document a Research Data Management Plan (RDMP) for your project – for grant-funded projects this will be linked to the record in InfoEd. A RDMP is required to obtain a storage allocation in the Data Archive.
    Read about the research data management plan

  • Changes to access; i.e. add a new team member, update a team member from Reader to Contributor, or remove an existing team member within the Data Archive is achieved through your Research Data Management Plan (RDMP).

    Note: you will need the role of Lead Chief Investigator (LCI) or Research Project Manager to make changes to the role (status) of project team members.

    For more information, see the How do I know what access level I have in the Data Archive?, How can I share my data with other researchers? FAQs and the Research team member identification section of the RDMP and the Data Archive page.

  • A valid and active zID and zPass are necessary to access and use the Data Archive. If you have left UNSW and lost access to your zID and zPass you will no longer be able to access the Archive.

    When the Lead Chief Investigator (LCI) and the Research Project Manager, the roles able to update Data Archive access inside the Research Data Management Plan (RDMP), have left UNSW, access to their project/s can be gained through the Head of School.

    Please contact your local IT support or the UNSW IT Service Centre (9385 1333) to arrange access to data stored in the Data Archive in the circumstance described above.

    For more information on roles and access levels in the Data Archive, see the How do I know what access level I have in the Data Archive?, How can I share my data with other researchers?, How do I add / remove / update team member access in the Data Archive? FAQs and the Research team member identification section of the RDMP and the Data Archive page.

  • To obtain storage in the Data Archive you must have the following:

    Note: once you’ve uploaded your data into the Data Archive you can access it at any time just like any other data storage system. Your research team members (as identified in your RDMP) can also continue using it.

  • In alignment with existing research storage practice, HDR candidates, who have a Research Data Management Plan (RDMP) and who have selected storage in the Data Archive, have access to two folders (Private and Shared) inside the Data Archive.

    • Data in the Private folder is for the storage of data specific to yourself (e.g. data that is not yet in a state to be shared). Only the RDMP nominated HDR candidate (the plan owner) can access the content of their Private folder in the Data Archive.
    • Data in the Shared folder is for data to be shared with your supervisor and other UNSW personnel you have added to your plan. Personnel identified in your RDMP will have the access level (Reader or Contributor) you have selected.

    For more information, see the How do I add / remove / update team member access in the Data Archive?, How can I share my data with other researchers? FAQs and the Research team member identification section of the RDMP and the Data Archive page.

  • The UNSW Data Archive is currently restricted to the UNSW network. You can use the UNSW VPN to access the Data Archive from off campus, but the speed will be restricted depending on the quality of your connection to the internet.

  • Researchers who frequently upload or download data, and/or generate datasets, may wish to schedule a regular upload or download of data rather than manually uploading and downloading data via the Web application.

    A script is available for command line access to the UNSW Data Archive, but it requires some technical knowledge to use. The script can be used for automated or large uploads of data to the store.

    To upload and download research data using the Command line script you will need:

    • To be using one of the operating systems below:
      • Window 7 Home Premium and Enterprise Editions
      • Mac OS X 10.6.8
      • Centos 5.9
    • The source and destination paths of the data you wish to upload and/or download

    Contact your local IT support or the UNSW IT Service Centre (9385 1333) to obtain the script and to discuss other operating system compatibility.

    See the Command line script guide for more information.
  • Glossary Definition
    Arcitecta Desktop The web-based user interface for the UNSW Data Archive.
    Arcitecta Archive (AAR) A proprietary archive format that supports files of any number or size.
    Asset An entity in the Data Archive that could consist of one or multiple files, each with associated metadata.
    Asset Finder A tool within the Data Archive web-based interface that allows users to browse the directory structure and drag data from local drives.
    Asset Map A tool within the Data Archive web-based interface that visually represents data with location metadata on a map.
    Collections/Sub-Collections Containers in the Data Archive that function like folders, holding assets and other collections (sub-collections).
    Data Archive The institutional data store at UNSW for archiving research data, available for UNSW researchers and HDR candidates.
    Deep Search A search function that includes all assets in all collections below the currently selected one. Toggle with the magnifying glass in the search box.
    Egest The process of downloading data from the Data Archive.
    Favourites Collections that users have dragged to the left-hand column of Asset Finder for easy access later.
    Filters Advanced search tools that refine searches based on metadata and other criteria.
    Ingest The process of uploading data to the Data Archive.
    MediaFlux A data management application developed by Arcitecta and used in the Data Archive.
    Metadata Data about data, such as document authorship, image size, or research subject names. Metadata can be added manually or automatically.
    Metadata Library A tool in the Data Archive interface for creating and updating metadata document definitions.
    Namespace (folder) A container in the Data Archive for assets, similar to a folder in a file system.
    Package The process of preparing research data for archiving before uploading it to the Data Archive.
    Quick Search A function in the Asset Finder search box that searches assets within the selected namespace.
    Research Data Management Plan (RDMP) A plan detailing data management for a research project, group, or equipment. Submitting an RDMP requesting storage is required for accessing space in the Data Archive.
    Shallow Search A search function that includes only the assets in the currently selected collection. Toggle with the magnifying glass in the search box.
    Views Controls how data is displayed within the Asset Finder for a given namespace.

  • There are numerous compound, asset, and metadata elements you can use to filter your data within the Data Archive application. A complete list of all available filters is set out below, followed by an explanation of some commonly used filters

    Filter options list

     

    Compound

     

     

     

    Asset

     

     

     

    Metadata

     

     

    And

    Asset Model

    --GLOBAL--

    CID contained by

    Content status

    UNSW_RDS.MD

    CID contains

    Created by

    arc.licence

    Collection containing

    Created by me

    arc.workspace

    In collection

    Created/Modified by

     

    In collection or subcollection

    Created/Modified by me

     

    Not

    Free AQL entry

     

    Or

    Has a licence

     

    Related is

    Has no licence

     

     

    Is a licence

     

     

    Metadata is invalid

     

     

    Metadata is valid

     

     

    Modified by

     

     

    Modified by me

     

     

    Point and radius

     

     

    Rectangle is wrapped

     

     

    Tag

    		  

     

    Asset:

    These filters relate to the attributes of an asset. Some examples are:

    • Created/Modified by Me: The asset was one you created or updated.
    • Point and Radius: Lets you search for assets containing location data within a specific area

    Metadata:

    These filters let you filter results based on the metadata associated with those assets. There is a large variety of possible metadata fields, check the right panel of the asset finder when selecting an asset to see all the metadata associated with that asset. For example there might be a Metadata type "UNSW_RDS:UNSW_Default" with element "ProjectName". You can browse to this element and drag it into the filter field, it will let you search for text inside this metadata element.

    Compound:

    These filters let you combine other filters using various logical operations. Dragging these into the filter box will create a special box that you can drag other filters into, how these are affected depends on the type of compound filter:

    • And: The filters inside must all be true for the asset to appear in the search
    • Not: The filter inside must be false for the asset to appear
    • Or: Only one of the filters inside need to be true for the asset to appear

  • The UNSW Data Archive Web application provides access to an interface enabling you to upload, download, locate, and review your research data.

    The Data Archive Web application is suitable for researchers who wish to search the Data Archive and to either upload or download less than 50 gigabytes (GB) of data and/or less then 1000 files (during a single session). See the Web application guide for more information.

    Researchers who frequently upload or download data, and/or generate datasets, may wish to schedule a regular upload or download of data rather than manually uploading and downloading data via the Web application.

    • Researchers who upload or download more than 50 GB of data and/or more than 1000 files, at a time, please see the SFTP client guide.

  • The access level (permissions) you have in each Collection (folder/file) in the Data Archive relates to the role you have been assigned in the projects RDMP and can be found by logging in to the ResToolkit site. The ResToolkit site will list all RDMPs and the roles you have for each.

    For more information on Data Archive roles see the How can I share my data with other researchers?, How do I add / remove / update team member access in the Data Archive? FAQs and the RDMP and the Data Archive page.

    You may use the graph below to quickly determine the role you have when inside the Data Archive. Right click on the folder or file inside the Data Archive, Asset Finder to display your access level.

  • It is possible to include empty folders in the data that you upload to and/or download from the Data Archive application.

    Upload:

    To ensure that empty folders are included in the data you are uploading, check the Import Empty Folders checkbox before you click on the Import Files button.

    For more information on uploading see the Web application guide.

    Download:

    To ensure that empty folders are include in the data you are downloading:

  • It it not possible to map the Data Archive in your local computer's drives.

    To upload and download data to and from the Data Archive use the:

  • To access and view previous versions of a file in the Data Archive application, undertake the following steps:

    1. Access the Data Archive Web application by opening a Chrome browser and entering the following URL: https://rds.unsw.edu.au. At the Data Archive login page, enter your UNSW zID (for User:) and zPass (for Password:) and click ‘Login'.

    2. Open the Asset Finder by double clicking on the Asset Finder icon located in the upper left of the Data Archive.
    UNSW

    3. Locate a file (Asset) in the third pane of Asset Finder.

    4. Right click on the required file and choose 'History' from the list of options.
    UNSW

    5. When the 'Versions for....' window opens, double click on the number adjacent to the required version of the file on the left hand side of the window.
    UNSW

  • To upload a compressed file to the Data Archive, using the Web application, undertake the following steps:

    1. Access the Data Archive Web application by opening a Chrome browser and entering the following URL: https://rds.unsw.edu.au. At the Data Archive login page, enter your UNSW zID (for User:) and zPass (for Password:) and click ‘Login'.

    On the upper left side of the screen, you’ll see the Asset Finder icon.

    2. Double click on the Asset Finder icon to open.

    3. In Asset Finder, navigate to the location where you wish to upload the compressed file.

    4. On your local computer, navigate to the location of the compressed file to be uploaded.

    5. Drag the compressed file from your local location.

    6. Drop the compressed file into the second or third pane of the selected Data Archive location in Asset Finder.

    7. A notification box will pop up on the screen. Click the ‘Import Files’ button on the bottom right hand side.

    Your compressed file is now being imported. You will see a progress bar on the screen in front of you that shows you how the import is progressing.

    8. Once the compressed file has been uploaded successfully, a ‘Dismiss’ button will appear on the notification box. Click the 'Dismiss' button to complete the upload process.

    2. Double click on the Asset Finder icon to open.

    3. In Asset Finder, navigate to the location where you wish to upload the compressed file.

    4. On your local computer, navigate to the location of the compressed file to be uploaded.

    5. Drag the compressed file from your local location.

    6. Drop the compressed file into the second or third pane of the selected Data Archive location in Asset Finder.

    7. A notification box will pop up on the screen. Click the ‘Import Files’ button on the bottom right hand side.

  • All files types can be uploaded to the Data Archive and testing has confirmed that a large array of file types can be uploaded.

    If you experience difficulties uploading a specific file type, please contact your local IT support or the UNSW IT Service Centre (9385 1333) to report the issue.

  • To select more than one file, within the Data Archive application, Asset Finder, for download; press the Shift key (rather than the Ctrl key) and click on each file (Asset) you wish to include in the grouping.

  • To download a compressed file from the Data Archive, undertake the following steps:

    1. Access the Data Archive Web application by opening a Chrome browser and entering the following URL: https://rds.unsw.edu.au. At the Data Archive login page, enter your UNSW zID (for User:) and zPass (for Password:) and click ‘Login'.

    On the upper left side of the screen, you’ll see the Asset Finder icon.
    UNSW

    2. Double click on the Asset Finder icon to open.

    3. In Asset Finder, navigate to the location of the compressed file you wish to download.

    4. Right click on the compressed file to be downloaded and select 'Open' from the list of options.
    UNSW

    5.The 'Save as' function will open allowing you to download the compressed file.

  • To open a file in the Data Archive, undertake the following steps:

    1. Access the Data Archive Web application by opening a Chrome browser and entering the following URL: https://rds.unsw.edu.au. At the Data Archive login page, enter your UNSW zID (for User:) and zPass (for Password:) and click ‘Login'.

    On the upper left side of the screen, you’ll see the Asset Finder icon.
    UNSW

    2. Double click on the Asset Finder icon to open.

    3. In Asset Finder, navigate via the folder structure, in the second pane, to the location of the file/s you wish to open.

     

    4. To open a file double click or right click and select either 'Open' or 'Open With..' on the required file, in the third pane of asset finder.

    Note: image files (jpeg, gif, png) will offer the option to open in either 'Image Viewer' or 'External viewer' if you double click on an image file. Selection of the 'Image Viewer' option will open the image inside the application.

    Note: selection of the 'External Viewer' will present your browser's default display option for that file type.

  • To logout / logoff from the Data Archive application, click ‘Desktop’ on the top left hand corner of the dashboard screen, and then click ‘Logout’.

  • To attach an item to an existing file in the Data Archive (i.e. you may want to add an image, or a group of images, to a word document that is a report), undertake the following steps:

    1. Access the Data Archive Web application by opening a Chrome browser and entering the following URL: https://rds.unsw.edu.au. At the Data Archive login page, enter your UNSW zID (for User:) and zPass (for Password:) and click ‘Login'.

    On the upper left side of the screen, you’ll see the Asset Finder icon.
    UNSW

    2. Double click on the Asset Finder icon to open.

    3. In Asset Finder, navigate to the location of the file you wish to attach an item.

    4. On your local computer, drag the item to be attached into the third pane of Asset Finder and drop on top of the file to receive the attachment.

    5. A notification box will pop up on the screen. Click the ‘Import Files’ button on the bottom right hand side.

    You will see a progress bar on the screen in front of you that shows you how the import is progressing.

    6. Once the file has been uploaded successfully, a ‘Dismiss’ button will appear on the notification box. Click the 'Dismiss' button to complete the upload process.

    7. To confirm that the item has been attached to the selected file, select the file in the third pane, and scroll to the bottom of the information in the fourth pane of Asset Finder.
    UNSW

  • Testing with mobile devices and the Data Archive Web application has shown limited functionality. You will be able to login, browse, and search when using a mobile device.

    Note: file and folder download is possible with OS (Apple) devices.

  • Once uploaded to The Archive you cannot delete your data. However you can overwrite, move, and rename files and folders to better organise your data if desired. You will need to use the Web Application to do this, files and folders can be dragged to new locations in the asset finder, and you can right-click to rename items. 

    To update a file with new or changed contents simply upload the new version with any interface into the same location and a new version of the file will be created, with the old versions retained. To access the old versions you need to the the Web Application, right-click on the file and choose "History".

  • The data is owned by the researcher who has ownership of the Research Data Management Plan associated with that data. Access to the data is controlled by the Lead Chief Investigator and any delegated Research Project Managers.

    At the end of a research project, which has been hosted by UNSW, research data and materials remain the property of UNSW, unless subject to a third party agreement.

  • The Data Archive is suitable for research data which is no longer required for active use. Examples of data that is suitable for archiving includes:

    • Data that belongs to a completed project needs to be stored for reference and must comply with the funding agencies guidelines.
    • Data that may be considered difficult to reproduce (raw data).
    • Reference data that will be used multiple times.
    • Data from computations and final output.
    • Research data you need to remove from your local data stores in order to free up space for current research.

    Do not upload documentation;

    • Not directly related to UNSW research; including personal documents and photos, music, or personal emails.
    • Teaching and administrative materials.
    • Back-ups of portable or networked computers.

    See also our Preparing data for upload page.

  • Data in the UNSW Data Archive is stored on Amazon Web Services (AWS) S3 storage using the Glacier Deep Archive storage class, in the AWS Sydney/ap-southeast-2 region. This storage provides 99.999999999% ('eleven nines') durability, with copies of data redundantly distributed among at least three geographically distinct availability zones/locations.

    See also Where can I say my data is stored on a grant or ethics application? 

  • Access permissions are managed through the Research Data Management Plan (RDMP). In the RDMP different roles can be assigned and, based on this, different access levels will be provided to that project's section of the store.

    • Users with the Reader role will have read only access.
    • Users assigned Contributor, Research Project Manager or Lead Chief Investigator will have read and write access.

    Only UNSW staff can be granted access to the UNSW Data Archive.

    The ResToolkit site will list all RDMPs and the roles you have for each plan. See the How do I know what access level I have in the Data Archive?, How do I add / remove / update team member access in the Data Archive? FAQs and the RDMP and the Data Archive page for more information on Data Archive roles.

  • There is no set maximum file size for the UNSW Data Archive. For very large datasets, and individual files, the speed of your network connection matters most. Please contact your local IT support or the UNSW IT Service Centre (9385 1333) if you have special needs in this area.

    The size of your data and frequency of data creation will influence how you interact with the Data Archive. Please use the table below to determine which method aligns with your needs:
    Data size
    Number of Files
    Best solution

    Under 50 gigabytes (GB)

    Under 1000

    Web application.
    See the Web application guide.

    Under 50 gigabytes (GB)

    Over 1000

    Web application.
    See the Web application guide
    Note: consider compressing your dataset before uploading or using SFTP (see the SFTP client guide).

    Over 50 gigabytes (GB)

     

    SFTP Client.
    See the SFTP client guide.

    Regular creation of data sets

     

    SFTP Client or Command line script.
    See the SFTP client guide and the Command line script guide.

  • The UNSW Data Archive has been set up as the University's institutional storage for archival purposes. It is a secure, long term archive that could be used for auditing purposes if necessary. As such, there is no delete function within the store; as specifically requested by the research community who were consulted before the Data Archive was established. 

    If you have mistakenly uploaded inappropriate data to The Archive, please log a servicedesk call on 9385 1333 with details of which files or folders you need to delete, and your justification for the deletion. This will need to be logged or approved by the LCI for this RDMP.

    Note: if you attempt to upload a file with an identical name, at the same location, to an existing file on the Data Archive, the files will be compared, and, if different, the new file will be uploaded as a new version, maintaining the existing file as another version (see the How do I access/view previous versions of a file? FAQ).

  • Data in the UNSW Data Archive is automatically encrypted at rest using AES-256.

    This applies even if you separately encrypt some data before uploading it to the Data Archive.

  • You can share your data with other UNSW staff and research students (HDR candidates) by assigning them a role in your Research Data Management Plan (RDMP). For example, assigning a staff member the Reader role will allow them to view, search, and download your data from the UNSW Data Archive.

    The ResToolkit site will list all RDMPs and the roles you have for each. See the How do I know what access level I have in the Data Archive?, How do I add / remove / update team member access in the Data Archive? FAQs and the RDMP and the Data Archive page for more information on Data Archive roles.

    Only UNSW staff can be granted access to the UNSW Data Archive.

  • Data uploaded to the UNSW Data Archive is retained for archival purposes; there are no current plans to delete data.

  • The UNSW Data Archive has been assessed as suitable for data classified as Sensitive or below using the UNSW Data Classification Standard. For more information on classifying your data please see the RDM@UNSW page on this topic. If your data is Highly Sensitive check the RDM@UNSW page on other data tools for storing this data, or contact RDM@UNSW.edu.au if you need assistance classifying your data or choosing a data storage location.

    If your data has other requirements outside those from the UNSW policies (for example a Data sharing agreement, funder's requirements, GDPR) these may not be compatible with the UNSW Data Archive. For example the Archive retains data permanently while some agreements require the destruction of data after a set period. In this case the Archive may not be a suitable location for your data, contact RDM@UNSW if you need help assessing this or finding another location to store your data.

  • UNSW staff are required to comply with the UNSW Record keeping Policy and the requirements for record retention as provided by the NSW State Records Authority.

    These requirements include those of GA45, Original or Source Records that have been copied.

    Before the destruction of digitised paper records, care should be taken to ensure that:

    • authentic, complete and accessible copies of the records are made
    • the copies become the official record of the business of the agency and are kept in accordance with authorised retention requirements, and
    • the original, or source records, are kept for quality control purposes for an appropriate length of time after copying.

    Once original data has been digitised and captured in accordance with these requirements, the scanned records become the ‘original’ and must be maintained as such.

    Further information on the retention requirements relating to records of research can be located here: https://www.recordkeeping.unsw.edu.au/documents/Retentionperiodsforrecordsrelatingtoresearch.pdf

    The UNSW Records and Archives Office can also be contacted for advice on any records related issues.

  • Some funders, ethics bodies and data owners may ask where your data is stored or located. Here are some statements and information you can use to respond to this kind of question:

    Service name: UNSW Data Archive

    Where service is hosted: Amazon Web Services (AWS) Sydney/ap-southeast-2 region. This region uses multiple discrete and geographically separated availability zones/hosting locations.

    Who has access:

    • User authentication to Data Archive is password protected; user access is managed through UNSW ResData
    • Administrator access to Data Archive application is password protected
    • Remote access to Data Archive servers is password protected and requires VPN using multi-factor authentication
    • Physical access to hosting data centres and hardware is managed by AWS

  • There are no quotas on the Data Archive. The system has four Petabytes of storage (around four million gigabytes). If you have datasets at the petabyte level contact us via the UNSW IT Service Centre (9385 1333), but otherwise we have not set limits on the amount of research data you can upload to the Archive.

    If you are uploading over 1000 files or over 10 gigabytes we recommend using the SFTP interface (see the SFTP client guide)
  •  
    Web application

    To access the UNSW Data Archive Web application you will need:

    Note: contact your local IT support or the UNSW IT Service Centre (9385 1333) to get Chrome installed on your workstation, when using a SOE (Standard Operating Environment), or, if you have administrator rights, you can download and install the browser from the Chrome website yourself.

    See the Web application guide for more information.

    SFTP Client

    To upload and download research data with SFTP (Secure File Transfer Protocol) you will need to have a SFTP client on your PC. Instructions are provided below for FileZilla, which is available for Mac OS, Windows and Linux. Please contact your local IT support or the UNSW IT Service Centre (9385 1333) to get this application installed, or download from the FileZilla website if you are able to install software on your PC.

    Note: You can use any software that supports secure FTP connections, the settings you need are below:

    • Host: rds.unsw.edu.au
    • Port: 8022
    • Protocol: SFTP
    • Username: UNSW_RDS:zID eg: (e.g. UNSW_RDS:z1234567)
    • Password: [your zPass]

    For further information on SFTP, see;

    Command line script

    To upload and download research data using the Command line script you will need: 

    • To be using one of the operating systems below:
    1. Window 7 Home Premium and Enterprise Editions
    2. Mac OS X 10.6.8
    3. Centos 5.9

  • The Data Archive uses zID and zPass to log in to the web-based user interface using the Web application. An "Authentication Failure" error indicates there may be a problem with your username or password.

    To verify your zID/zPass visit the UNSW Identity management page.

    Please contact the UNSW IT Service Centre (9385 1333) for further assistance with your zID and zPass.

    Note: this error could also indicate that your browser session needs to be refreshed. If you are sure that the zID and zPass you are entering are valid and correct, please close and reopen the browser (refreshing the session) and connect to the Data Archive again.

  • By default the Chrome browser will save downloaded content to your computers Downloads folder (e.g. C:\Downloads)

    You may like to decide where you will save the content that you download from the Data Archive (rather than allowing the Chrome browser to decide for you). To configure your Chrome browser so that you may decide where to download folders and files:

    1.Go to the Chrome browser settings.

    2.In the new, Settings, browser tab which opens, scroll down to Show advanced settings...

    3.Click on Show advanced settings..., scroll down to the Downloads section and check the option 'Ask where to save each file before downloading' check box.
    • Close the Settings browser tab and your changes will be saved.

  • Factors that can affect the speed of your uploads are:

    • Size of the data - larger files will obviously be slower to upload
    • Number of files - more files are significantly slower as the archive has to analyze each file
    • Location of the data - files on a network drive or external drive will take longer to download
    • Speed of your network connection

    So to speed your uploads there are a few things you can do:

    Compress your files before uploading

    Putting your files into an archive such as a Zip or Tar.gz file will help by reducing both the number of files uploaded and the total size of the files. Uploading an archive will be faster but to retrieve any of the files you will need to download the whole archive and extract them after downloading.

    Copy your files to your computer before uploading 

    Uploading files from your local computer, or an external drive, is significantly faster than from a network drive, so if possible copy your files to your local computer before uploading, especially for data sets with large numbers of files.

    Use a better network connection

    On-campus connections come in a few speeds, the fastest being a cabled network connection to a Gigabit network port, then a cabled connection to a 100megabit port, followed by wireless connections. If possible always use a cabled connection, and for very large uploads try to use a computer with a gigabit network connection. Network connections can be upgraded to gigabit speed, but this may incur a cost for some areas, please contact your local IT support or the UNSW IT Service Centre (9385 1333) for further information.

  • Please use the search box at the top of each page of the Data Archive website for information about the Data Archive. If your search does not provide any assistance, please use the most appropriate contact as set out below.

    UNSW IT

    Please contact your local IT support or the UNSW IT Service Centre (9385 1333) to receive support for the Data Archive service or to provide feedback as to content found on this site.

    Office of the Deputy Vice Chancellor Research

    For information regarding the UNSW Procedure for Handling Research Material and Data and research data retention periods, please contact Data Governance

  • The Web application works in most modern web browsers, but only the Chrome browser supports uploading of folders of data with drag and drop. If the Web application reports 0 files when you drag files from your computer into the Data Archive, you may not be using Chrome.

    For further information on using the Web application see the Web application guide.

  • Should your upload of data to the Data Archive be interrupted by network failure, or some other issue, the next attempt to upload the same file, group of files, or folder, to the same location on the Data Archive, will resume from the last successful upload to the Data Archive; i.e. if 5 files were sent for upload and 2 succeed before the interruption, the Data Archive will resume the upload from the 3rd file.

    Note: the above information is correct for SFTP, and when using the Command Line Script. Should your upload fail when using the Web application; upload will start from the first file.

  • When using the Java applet web-based user interface you may receive the 'Application Blocked by Java Security' message:

  • Use ZIP format with file paths longer than 256 characters.

    If you use the Download as Archive function and TAR format with file paths longer than 256 characters you may experience a problem where the download finishes early and is not complete. If you encounter this issue, please use the ZIP format option with the Download as Archive function.


    Note: EndNote users are particularly vulnerable to this issue (long file names). See here for more information.

    Use the Web application for less than 50 GB and 1000 files.

    The Data Archive Web application is suitable for researchers who wish to search the Data Archive and to either upload or download less than 50 gigabytes (GB) of data and/or less then 1000 files (during a single session). See the Web application guide for more information.

    Researchers who frequently upload or download data, and/or generate datasets, may wish to schedule a regular upload or download of data rather than manually uploading and downloading data via the Web application.

    • Researchers who upload or download more than 50 GB of data and/or more than 1000 files, at a time, please see the SFTP client guide.
    • Researchers who wish to schedule a regular upload or download of data, please see the Command line script guide.