| author | timothy.murphy@nokia.com |
| Mon, 26 Apr 2010 17:33:17 +0100 | |
| branch | fix |
| changeset 533 | 408bfff46ad7 |
| child 547 | 9fe7d0ab0f8f |
| permissions | -rw-r--r-- |
|
533
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
1 |
Resources were copied using make rules. This is sensible in local |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
2 |
machine builds but non-optimal in cluster builds. It is entirely IO |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
3 |
bound and the cluster aspect simply creates more IO as files need to |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
4 |
be transferred over the network, possibly multiple times. This change |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
5 |
introduces the <copy> tag to the log which the frontend reads in a new |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
6 |
"default" filter called FilterCopyFile. Thus the python frontend does |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
7 |
the copying rather than the cluster build engine. |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
8 |
|
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
9 |
This happens at the end of the build and since resources are built in |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
10 |
their own "stage" it's is all completed before any other build tasks |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
11 |
are invoked. The copied files are not needed in the resource stage |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
12 |
itself so it is ok that it happens at the end of that. |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
13 |
|
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
14 |
|
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
15 |
The format of the tag is: |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
16 |
<copy source="sourcefilename">dest_filename1 dest_filename2 ...</copy> |
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
17 |
|
|
408bfff46ad7
fix performance: copy resources in the frontend. Helps cluster builds since remote copying is inefficient.
timothy.murphy@nokia.com
parents:
diff
changeset
|
18 |
Spaces may not be used in filenames. The sequence "%20" may be used instead. |