equal
deleted
inserted
replaced
|
1 Resources were copied using make rules. This is sensible in local |
|
2 machine builds but non-optimal in cluster builds. It is entirely IO |
|
3 bound and the cluster aspect simply creates more IO as files need to |
|
4 be transferred over the network, possibly multiple times. This change |
|
5 introduces the <copy> tag to the log which the frontend reads in a new |
|
6 "default" filter called FilterCopyFile. Thus the python frontend does |
|
7 the copying rather than the cluster build engine. |
|
8 |
|
9 This happens at the end of the build and since resources are built in |
|
10 their own "stage" it's is all completed before any other build tasks |
|
11 are invoked. The copied files are not needed in the resource stage |
|
12 itself so it is ok that it happens at the end of that. |
|
13 |
|
14 |
|
15 The format of the tag is: |
|
16 <copy source="sourcefilename">dest_filename1 dest_filename2 ...</copy> |
|
17 |
|
18 Spaces may not be used in filenames. The sequence "%20" may be used instead. |