sbsv2/raptor/notes/localresourcecopying.txt
branchfix
changeset 533 408bfff46ad7
child 547 9fe7d0ab0f8f
equal deleted inserted replaced
532:1083c9a3a7cf 533:408bfff46ad7
       
     1 Resources were copied using make rules.  This is sensible in local
       
     2 machine builds but non-optimal in cluster builds.  It is entirely IO
       
     3 bound and the cluster aspect simply creates more IO as files need to
       
     4 be transferred over the network, possibly multiple times.  This change
       
     5 introduces the <copy> tag to the log which the frontend reads in a new
       
     6 "default" filter called FilterCopyFile.  Thus the python frontend does
       
     7 the copying rather than the cluster build engine.
       
     8 
       
     9 This happens at the end of the build and since resources are built in
       
    10 their own "stage" it's is all completed before any other build tasks
       
    11 are invoked.  The copied files are not needed in the resource stage 
       
    12 itself so it is ok that it happens at the end of that.
       
    13 
       
    14 
       
    15 The format of the tag is:
       
    16 <copy source="sourcefilename">dest_filename1 dest_filename2 ...</copy>
       
    17 
       
    18 Spaces may not be used in filenames. The sequence "%20" may be used instead.