CoEPP RC
 

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

cloud:ideas [2013/03/01 17:24]
neilds created
cloud:ideas [2013/03/01 17:24] (current)
neilds
Line 1: Line 1:
 +===== Things we could do =====
 +
   - Make the examples (eg. in [[cloud:​a_walk_in_the_cloud]]) more closely match a realistic workflow: compilation of the script/tool we want to use, testing on the interactive nodes, followed by finally getting the thing to run in the cloud.   - Make the examples (eg. in [[cloud:​a_walk_in_the_cloud]]) more closely match a realistic workflow: compilation of the script/tool we want to use, testing on the interactive nodes, followed by finally getting the thing to run in the cloud.
   - Lazy staging: copy-on-write unionfs mount over a caching read-only network filesystem of some kind. Remote files only retrieved when first accessed, otherwise reads/​writes local. Thus big compiles can be executed without having to copy the entire directory tree if not all the source files are required. Intermediate files are written to the local filesystem (presumably a temporary directory), and the final output can be staged out as normal.   - Lazy staging: copy-on-write unionfs mount over a caching read-only network filesystem of some kind. Remote files only retrieved when first accessed, otherwise reads/​writes local. Thus big compiles can be executed without having to copy the entire directory tree if not all the source files are required. Intermediate files are written to the local filesystem (presumably a temporary directory), and the final output can be staged out as normal.
cloud/ideas.txt · Last modified: 2013/03/01 17:24 by neilds
 
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
Recent changes RSS feed Donate Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki