Data Store Manual¶
Welcome to The Data Store!¶
Who to contact if this manual needs fixing. You can also email learning@CyVerse.org
CyVerse / UA
- Data Store Manual Home
- Downloading and Uploading Data
- Data Allocations
- Want to know about downloading data without an account?
- Want to find out how to access data in the Data Store and data connection settings?
- Want to learn about data sharing?
- Wondering how fast your connection is to the CyVerse Data Store?
- Want to know about CyVerse Home, Data Commons and shared data collections?
- Downloading Data Files without an Account
- About Anonymous Access
- Using the Community Contributed Data and CyVerse Curated Data sites
- Using iCommands
- Using Cyberduck
- Using Cyberduck for Uploading and Downloading to the Data Store
- About Cyberduck for bulk transfers for Mac OS and Windows
- Using Cyberduck
- Using WebDAV
- Using FUSE to Mount the CyVerse Data Store
- Step 1: Install FUSE and the Data Store FUSE client
- Step 2: Configure your Data Store environment and log in
- Step 3: Select where to mount your home directory
- Step 3a (OPTIONAL): Select the Data Store directory to mount
- Step 4: Mount the Data Store directory
- Step 5: Unmount the directory when finished
- Transfer data between AWS and CyVerse
- File Lists
- Adding Metadata to a File Using iRODS imeta (Metadata) Commands
- Using Metadata with the CyVerse Data Store
- Sharing Data with the Public in Community Contributed Data and CyVerse Curated Data
Data Store Intro¶
Each user has access to 100 GB of data storage, with the ability to request more allocation http://user.cyverse.org/. Learn all about our data allocation policy here. http://www.cyverse.org/service-level-agreement#Atmo
When you are granted access to a CyVerse service, you are automatically added to the service’s mailing list. Default CyVerse mailing lists include the Data Store, Discovery Environment, and Atmosphere, as well as community developers and Foundation API developers. Once subscribed, you receive emails about maintenance periods and outages. You also can post messages to other list users, opt to receive list messages in batch or single emails, change your subscription email and password and other options, browse the list archives, unsubscribe from the list, and more. For information on subscribing to CyVerse mailing lists, see Subscribing to CyVerse Mailing Lists. https://wiki.cyverse.org/wiki/display/start/Subscribing+to+iPlant+Mailing+Lists
Want to download data but don’t have a CyVerse account?¶
We offer several ways to access some data that has been made public with all users—even if you don’t have an account. For instructions on how to use each access method, see Downloading Data Files Without a User Account. https://cyverse.atlassian.net/wiki/spaces/DS/pages/241869821/Downloading+Data+Files+Without+a+User+Account
Want to know what access methods you can use?¶
Access Methods include:
CyVerse Data Commons (formerly Mirrors) repositories: Web-based access for downloading community released data and CyVerse curated data. No installation or setup required. See Data Commons Overview and Status. https://cyverse.atlassian.net/wiki/spaces/DC/pages/241867459/Data+Commons+Overview+and+Status
Cyberduck: GUI-based application that is good for downloading files very large files or bulk downloads (>10 GB) to Mac OS and Windows (not for LINUX). Requires installation and configuration to connect to the Data Store. See Using Cyberduck for Uploading and Downloading to the Data Store. https://cyverse.atlassian.net/wiki/spaces/DS/pages/241869843/Using+Cyberduck+for+Uploading+and+Downloading+to+the+Data+Store
iCommands: Command-line access for files 2-100 GB files. Best choice for large files (2-100 GB each) and for bulk file transfers (many small files). Requires setup and configuration. See Using iCommands https://cyverse.atlassian.net/wiki/spaces/DS/pages/241869855/Using+iCommands
Click here http://ps.iplantcollaborative.org:7123/ to check your upload and download speeds.
Want to know about how to connect to the Data Store?¶
See Manage Data https://www.cyverse.org/learning-center/manage-data on the CyVerse website
Configuring Your Firewall to the Data Store¶
Transfers to the Data Store require firewalls to allow TCP port 1247 and TCP and UDP ports 20000-20399 to be open.
Required Open TCP Ports
Required Open UDP Ports
Most users should not need to configure their firewalls, but some institutions may have more restrictive policies for security reasons. CyVerse staff will be happy to discuss any technical requirements with your networking administrators. For more information, contact CyVerse Support at firstname.lastname@example.org.
Fix or improve this documentation
Search for an answer: CyVerse Learning Center
Report an issue or submit a change: Github Repo Link
Send feedback: learning@CyVerse.org