Added tag PDK_4.0.a for changeset 28c70cc5e86f

Added tag PDK_3.0.3 for changeset 28c70cc5e86f

add id for s^4 kits

Add --norev option to ignore the revision information in packagelists (mostly for the default hg pull behaviour) Improve the csv file parsing to allow spaces in the comma-separated information Remove the export_control_special_case in line with the main website practice Add a distinct hostname for the pushurl, so we pull from "developer.symbian.org" and push to "developer-secure.symbian.org"

Add naviengine.nec and codecs.aricent to the package lists

Added tag PDK_2.0.3 for changeset 2b7e66ca13ba

Fix for total releasables count not appearing

Add sf/mw/qtmobility package

Update to reflect new packages

Add one more debug line and a possible fix for the total releasables number not displayed problem

Add more high-density subtrees It might be worth scanning for epoc32\build\*\udeb and deleting those, as they tend to have a high density

Add debug lines to help understanding why total releasables are not displayed correctly during the builds

modify clone_all_packages.pl for new web site url to fix issue with cloning sfl repos

Simple hg hook to apply a local tag to a list of repos specified in a csv file (following format of fbf sources.csv file used in PDK builds). Used to create movable tags such as "S3_LATESTGOOD".

Rename missing_source_file category to could_not_export_file

Add number of releasables (by package) in the missing column

Merge

Add 'adapt' to the list of layers to match for heuristical pacakge attribution and for truclean

Bug 3643: Add another regular expression to match new perl version output.

Fix handling of directories of builds

Add delete_builds.pl - a utility for making space quickly on build machines This Perl script deletes some directories known to contain very large files first, before deleting the rest of the build which contains millions of small files. Given multiple builds, it will do this breadth first, so that lost of space is released quickly.

v0.20 - change to developer-secure.symbian.org, to fix Bug 3627 Also move the point at which downloadpage.html is saved, in order to get all of it for debugging

v0.19 of downloadkit.py - removed the "-p" short form of --password, to avoid confusion with "--progress" if the first minus is omitted - add support for "Do You Feel Lucky?" downloads, which included changing the version check - added report_to_symbian() which logs the way that downloadkit is used and the success or failure - added --nopublicity to turn off report_to_symbian()

Updated scripts for filtering BC reports

Added tag PDK_3.0.0 for changeset c1b745b16f58

Add support for .7z file extensions.

version 0.18 - detect the login redirections on the new-look developer site Added additional debug information for incomplete transfers and login failures.

Extend packagelist parsing to read "sources.csv" files.

version 0.17 - use the size information in release_metadata.xml, treat checksum errors as failures Give a clear statement of success or failure after all the unzipping (if any) is completed This version will also resume any interrupted transfers (unless you say --noresume) based on the file sizes.

updated MCL & FCL package listings

Fix: Missing 'missing' info

Truclean to take account of new /sf/ directory level in the releaseables

Update help info

Allow shell wildcards in input file names

Comment out some debug info

Extend UH parser to cope with tools build

added ../sf/mw/webextensions package to list of repos

EPOCROOT should not be compared against baseline

Fix: when comparing to zipped baseline the temporary file is not removed

Fix: tools version comparison shows always less recent

Add EPOCROOT to the envinfo report

Restructure envinfo help

Allow better version reporting for gcc compiler

diffenv - Added some basic support for diffing with zipped builds over http (such as the internal foundation builds). for example: dbr diffenv 'http://builds.symbian.org/SF_builds/symbian3/builds/FCL/symbian3_FCL.single.555/'

DBRUtils - zipped baseline comparisons: Fixed so we only need the md5s.

Changed help so that summaries come from components. Added smoketest method to try to reduce regressions (when I write some tests). A few minor cleanups.

Restructure help text

Change default releaseablesdir to \build_info\logs\releaseables

Don't search for the tools under PDT_HOME\utilities but only under ..

Rename 'stubs' as 'bin' as this is more appropriate

Add stubs for the most commonly used tools

Improve/fix help info

Fix: wrong location for envinfo.txt in zip file. Add more locations to look for envinfo.txt

Changed envinfo slightly to have comparison of tools version with a baseline

Add envinfo.pl tool to dump environment info

Remove duplicate script, use uh_parser/truclean.pl instead

Raised to critical the categories: armcc_cannot_open_source_input_file, mwccsym2_file_cannot_be_opened, cpp_exe_no_such_file_or_directory

Added a very crude tool to check for existence of various tools in the system PATH.

moved socialmobilefw package from incubator to sf/mw

Add new categories: mwldsym2_undefined_symbol and makedef_frozen_export_missing for recipe failures

Added output of Heading above table, so the script generates all of the desired content for the wiki page, not just part of it. A --pdk option can be passed to be used as the PDK release number, if this is known.

Changed script to use CSV formatted input, rather than TSV. This means that the script can directly process the CSV downloaded from Bugzilla, without any need to use Excel to convert it.

removed sf/tools/homescreentools from package lists

updated MCL/sf and FCL/sf package lists

Raise level of severity for 'make: no rule to make target' errors to major as they are root causes

Added tag PDK_3.0.i for changeset d01a4084d621

[maven-scm] copy for tag symbian3_symbian3.001

Extended to put the preferred column headings into the table. Also made a few other simplifications.

Revert to version 236 as 237 breaks the parser

Update uh_parser to understand sftools/dev packages

Add author information. Reviewed descriptions

Ren 'general failures' title into more appropriate 'floating failures'

Do not display the unknown/unknown package unless there are associated failures

Move PARSED FILES section to the bottom. Minor cosmetic changes

Add parsed logs and built configs at the top of the main page

Fix: package unknown/unknown appears twice

Fix: some heuristically determined components are wrong. Fix: recipe failures without bldinf attribute are lost

Minor improvements to the output: a typo fix and hiding of tip tags.

Merge

Make UH parse the latest file under \epoc32\build by default

Added new S^4 packages to clone packages list

Adding initial BC Headers Grey List xml and corresponding xls

Fixed saving compilationerror element in headers reports

DBRTools - Filtering Logic fix for doing both include and exclude. This should be a bit better.

Fixed issue in la_filter.pl of saving comments as separate elements in xml file

Implemented update of Known Issues file based on libraries reports in update_knownissues.pl

DBRTools - Added filtering support. It's currently implmented in checkenv and diffenv, but adding it to other commands is pretty easy.

Added 'help' for ha_filter.pl

Implemented feature to generate sub-reports for missing libraries in la_filter.pl

Updated release notes generation: Added copyright message Proper command line parsing Usage message if inputs are not right Added explanatory preamble to output "NEW" FCLs are marked as such Merge changesets are included in output

Remove redundant category no_rule_to_make_target for Raptor unreciped text

Added fbf/project tools repo Fixed file paths in sftools_oss_mc_packages

Fix heuristic matches tool path instead of file path

Add new variant_file_does_not_exist category for Raptor errors

Added tools for filtering bc reports and updating known issues file

Add heuristic determination of package for Raptor unreciped text

Add heuristic determination of package for Raptor errors and warnings

Rename missing_bld_inf_file category to cpp_exe_no_such_file_or_directory

Add new failed_to_parse_xml_file category for Raptor errors

Add new exportunfrozen_present category for Raptor warnings

Use the bldinf attribute to assign Raptor errors and warnings to the related package

New script for generating release note content. List of FCLs used, and the changesets that make them necessary.

added FCL entries for mw/qtextensions and incubator/multimediaadaptation

Fix '0' as number of missing is not shown if there are errors but no missing

Updated references for fbf & utilities move to /sftools/fbf/*:wq Added references for more incubator projects

Minor adjustments to UH parser

Catchup merge

Typo fix in MCL version of DBRTools to force a good default head.

Merged DBRTools development onto DBRToolsDev branch

Creating DBRToolsDev branch

catchup merge

DBRTools - did some fixes to the nasty path appending I'd done for patches. This fixes some of the problems with doing 'diffenv' on patched databases with UNC paths.

Uh parser to report on list of missing releaseables

Uh parser to report on list of missing releaseables

Catchup merge

DBRTools - minor nasty hack to get cleanenv working better

DBRTools - Added filter support to checkenv

DBRTools - added support for filtering using raw rombuild log

removed EUserHL reference

Catchup merge

Embryonic support for filtering. Can now use a file list with diffenv to filter the results.

v0.16 - generate correct URL for downloading a specific version, and enable "Latest Symbian^X" functionality. Specify just "2" or "3" to get the latest version of Symbian^2 or Symbian^3 respectively

DBRTools - initial version of cleanenv using new structure. Works ok apart from cleaning patches, which isn't in this version.

DBRTools - checkenv fix for previous submission typo.

Catchup merge

Initial version of code cleanup. Now have classes for the environments. checkenv and diffenv updated to use it (although there are minor changes to the paths).

Catchup merge.

DBRTools - Need to restore the current working directory.

DBRTools - initial version that will diff against a packed release. Also did minor cleanup. Probably caused some regressions.

version 0.15 - add --noarmv5 option to avoid armv5 binaries. using this with --nowinscw also avoids binaries_epoc.zip and binaries_epoc_sdk.zip.

v0.14 - handle the version checking in the "(Public)" download page as well

v0.13 - Avoid Python exception if the version test doesn't match

remove ../incubator/podcatcher ref

Added tag PDK_3.0.h for changeset 2c9e0f9990c0

version 0.12 - add checking for click-through licenses and make sure we get the version we asked for! Added --webhost option and HTTP authentication for Symbian Foundation testing purposes

wikify_bom_fcl_changes.pl - Added some basic tags displaying.

added ../app/podcatcher to MCL and FCL repo lists

Recipes with exit=retry and forcesuccess=FORCESUCCESS must be considered as failed

Catchup merge

DBRTools - piped the unzip output to null so that cleanenv isn't as noisy.

Match both make: and make.exe: in some unreciped regexp

HTML escape failures so that they can be viewed correctly

Don't dump failures which aren't reported

Add more categories for unreciped and raptor error failures

Add more categories for recipe failures

Add while_searching_for_deffile_file_not_found category for warning failures

Add more categories for unreciped failures

Can't find mmp file should be severity Major

Catchup Merge

Pulled the DBRTools from their own repo and popped them into this one. Still very much a 'work in progress'.

Add README file for uh parser

Add Raptor uh parser

Remove the old /sf/tool/homescreentools package

v0.11 - added quick_networking_check(), to confirm that we can talk to https://developer.symbian.org

Change the default packagelist names to be sf_oss_mcl_packages.txt and sftool_oss_mcl_packages.txt

v0.3 of comvert_to_epl.py - writes a zip file containing the updated files, unless --nozip is specified Assumes that "zip.exe" is in the path.

version 0.10 - add --nowinscw option to avoid winscw binaries, add version to the user-agent string

version 0.9 - added --debug option to enable urllib2 HTTP debugging

Removed more SFL references to packages that have never been SFL ("platform" packages this time).

Switched from https to http for OSS repos, as they don't need secure access

Removed SFL references to packages that have never been SFL

Updated lists of sftools repos, to cover all combinations of oss/sfl and MCL/FCL

Updated lists of repos, to cover all combinations of oss/sfl and MCL/FCL This should ensure that nothing is missed, and it also removes the complications of trying to link the lists to branches within repos (eg RCL_1) or platforms (eg S^2).

fix typo on podcatcher repo

Added tag PDK_3.0.g for changeset 44e403e0f4cd

check_sources_csv.pl - utility for updating the sources.csv files in fbf/projects/packages trees

Improve the parsing of the script location to determine the location of .txt files using File::Basename. Should be platform safe as $program_path will include trailing path separator.

version 0.8 - added command line options for username and password. Revised the exception handling Also removed the saving of the cookies, as it never seemed to help

added fcl enteries for qt, docscontent, doctools and correct desktopsw url

Catchup Merge

Made the '-mirror' switch optional

version 0.7 - add parsing of release_metadata.xml and checking of the MD5 checksums (based on suggested code from ChrisD) The script will always download release_metadata,xml, even in --dryrun mode, so that it can check the validity of any zip files you've already downloaded.

Switch convert_to_epl from Perl to Python, adding unicode file support and a "--check" option

v0.6.1 - fix "NameError: global name 'downloadurl' is not defined" when there's an HTTP timeout

version 0.6 - avoid problem if Content-Length not supplied, add --nodelete option, check 7z works before starting

updated auxiliary_tools links in other_packages

Added tag PDK_3.0.f for changeset 6e81c130aa29

Creation of TAGS branch. The TAGS branch should be used for *all* tags, including PDK release tags and package release tags. Do not merge this branch with any "code" branches.

updated other repos list

updated sfl_fcl list to include all oss entries and removed sf

updated sfl_fcl list to include all oss entries and removed sfl

updated sfl_mcl list to include all oss entries and remove sfl

Merge

Merge

Add initial version of blacklist mercurial extension for use to exclude and manage known bad changesets from mercurial repositories.

Tweaked text used when reporting files churned, so it's not likely to confuse people who know of churn in the QWG sense.

version 0.5.1 - improve the progress reporting, getting the file size from the HTTP message header

version 0.5 - fix unzipping bug, add "--progress" option for info on long downloads

version 0.4 - added --nounzip option to suppress the unzipping and deletion

version 0.3 - add command line processing, --dryrun option, --nosrc option Make sure that outstanding unzip commands are completed before unpacking "patch" files Refactor the unzipping, to implement dryrun and give scope for throttling the number of unzips in progress

Add Python version of convert_to_eula, which also handles license notices in Unicode text files

sf/adaptation/stubs now oss. Also fixed type on sftools/depl/doctools

added entry for smoketest fcl

updated sftools_mcl_packages.txt

added entry for gsteamer in sf_fcl_packages.txt

added entry for wrttools to sfttools_fcl_packages.txt

added enteris for qt and gstreamer

merge tags

Added tag PDK_3.0.e for changeset c63eca238256

Changes to control the order of downloading, and hopefully the resulting unzipping (for patches in particular)

Make sure that tools_epoc.zip gets unpacked

Added User Agent info to another urllib2.Request call which was missed in the previous commit

Mark all requests with the "downloadkit.py script" User Agent string, so that we can spot them in the HTTP logs

Added downloadkit.py - script to download and unpack a PDK

Catchup Merge

Added wikify_bom_fcl_changes.pl - a quick script to wikify the FCL changes in the changes.txt that is generated in the BOM dir during a platform build.

Added tag PDK_3.0.d for changeset c5817fd289ec

Added tag PDK_2.0.2 for changeset 61b66a9de915

removed deprecated packages from sf_fcl_packages.txt

Remove deprecated FBF repositories from other_packages.txt

Merge

Added tag PDK_3.0.a for changeset 62971d19bb33

add exit code for clone_all_packages.pl to make easier to integrate to automated jobs

Speed up execution, by skipping over the /epoc32/build directory (which isn't released so doesn't need to be processed).

Merge tags

Added tag PDK_2.0.1 for changeset 718b119bed63

Added tag PDK_3.0.c for changeset 718b119bed63

Merge

Enabled script to accept multiple system_definition inputs, to cope with the split build situation.

Tweak to avoid an abort if the system definition cannot be opened to obtain the package names. Fixed a hard-coded "PDK_2.0.0".

Script no longer used.

Removed attempts to identify new and relicensed packages, as this is already covered by another script and another part of the release notes.

Updated to parse options in a more standard way, added new options to allow a different path to the sources/sysdef in the earlier release, and to provide a usage message.

Alternative script for generating release note information about package changes and FCL usage. Uses the sources.csv and sysdef, so doesn't need to access the release archive to access previous package lists or names, and can work concurrently with other build analysis steps.

Added the links to the website for each package (may need some improvements).

Corrected new argument checking.

Changed the hard-coded default for the releases location, so at least tonight's candidate build will work OK.

Count the number of bugs and print on the default ouptut to update the Release Notes with that value. Need to be added automatically.

changed paths for sftools/dev/build and sf/os/kernelhwsrv from sfl to oss (for mcl and fcl lists, left unchanged in rcl1 list)

Bug 881: "Automatic creation of release note content broken by config change" Added a new option to allow the caller to specify where the publish location is. Minor improvements to formatting of output. Turned on warnings, and fixed most of those that appeared. Greatly simplified the checking of the script arguments. Removed code which was noted to be unnecessary, and was. Declared some variables more closely to the code that uses them.

Removed commented code, code which had no effect on the output, some unnecessary \s, and a couple of other basic simplifications.

clone_all_packages.pl - Added optional '-webhost' parameter.

Added tag PDK_3.0.b for changeset 219325363815

Fix Bug 489 by moving the "--rev xxx" options to the correct place in the command line

Added tag PDK_2.0.0 for changeset bd0e6fdb18f4

Add new location of qemu repo to list of OSS MCLs that the tools should process.

Add Beagleaboard baseport to the list of packages to clone.

Improve the script fcls4releasenotes.pl.

Correct problem with the name entered as parameter because it was exiting if 2 PDKs starting with the same name (ex: PDK_2.0.e &PDK_2.0.e_candidate_FCL_27.78)

Catchup merge

Fixed "white-spaces" in licence text issue in convert_to_eula.pl

merge

catchup merge.

Merge

Removed output from perl script that is now dealt with by the ant script.

Updated wiki markup output so that lines don't run together (now a list).

Synchronised the output filename to match the other parts of the system generating release note content. Adjusted line spacing to avoid big gaps. A few spelling fixes.

Arnaudl. Final version of the script before testing live by doing a test build.

Perl script for the releases notes automation with fcl!

Update release automation scripts * Merge

remove spurious white space

merging updates for sf_fcl_packages.txt

added entries for new and moved symbian^3 packages

Version of convert_to_eula.pl which converts SFL to EPL - takes the directories to be processed as arguments

Move the "already converted notice" line check to a more efficient place, report files with multiple notices, repair formatting.

merge recent changes

added entry of os/osrndtools in sf_mcl_packages

Modified convert_to_eula.pl to parse multiple instances of the SFL licence.

added missing eol on sftools_mcl_packages.txt

gettd.pl version 0.6a

gettd.p version 0.6

updated sf_mcl_packages to reflect platformtools move from /tools to /mw

Added srvdiscovery package to list

update sf_mcl_packages to reflect symbian^3. Created sf_rcl_1_packages for RCL_1 list of packages

added FCL list for sf and sftools

removed duplicate lines due to faulty merge

Clarify what sort of "members" are using the SFL

add utils to parse output of clone_all_packages.pl and to remove credentials from the local clone

Fix Bug 387 - full newline processing as per "perlport" guidance Removed clone_BOM.pl as the functionality is now all in clone_all_packages.pl Updated convert_to_eula.pl for revised license notice.

Simple utility to change perfectly-formed SFL copyright notices to something else

Added detection of packages that are new, or have changed from SFL -> EPL. This cannot distinguish such packages from those where we have reverted to using the MCL version after using an FCL version, but this is noted so the post-processing (by a real person) can take this into account.

Uncommented necessary line of code!

Made test for interesting packages consider % files churned. >30% is considered interesting. Adjusted the number of files added/removed that make a package interesting to offset the items added by the churn check.

Located clone_all_packages relative to the location of fbf_churn.

Removed buildlayout35 package as this is empty and causing errors when running clone all

Tool to automate conversion of Bugzilla CSV reports to MediaWiki text for inclusion in release notes.

catchup merge.

clone_all_packages.pl - Enabled 'dummyrun' to be set from the command line using '-d' (or -'dummyrun') to help with trying out --exec style commands.

Tool to help automate the "Mercurial Comparison" part of the Release Notes

Creating "code_churn" directory in utilities, and adding perl scripts for code chrun tool

Cope with PDK 2.0.c variation on build-info.xml format

Cope with build-info.xml format as supplied for PDK 2.0.e (changes "#:" to "#")

Change -mirror so that explicit package lists don't get the "implied FCLs" added.

Remove sfl/MCL/sf/os/security, as this prevents the correct cloning of the oss/MCL/sf/os/security repo repo

Added %HREPO% and %WHREPO%, to assist in cloning from network drives

gettd - adding sample filter for new UI

Added copyright header.

Add extra login to do "hg update" after "hg pull" if not mirroring - to match clone_BOM.pl

Add -packagelist option, which also supports build-info.xml to provide the equivalent of the clone_BOM.pl script Added better return code handling, to allow for "hg diff" which returns 0 = same, 1 = different Refactor the reading of the supplied text files to use -packagelist processing internally Added %REV% for -exec usage, which gives access to the revision identifies from build-info.xml

Improved robustness of package list location searching.

Updated script to use external lists of repositories managed dynamically by SCM people.

moved cloned_all_packages.pl to clone_packages dir

added files containg urls to Foundation Mercurial repositories

fixing pkgbacklog directory strucutre

Adding xls macro to migrate bug backlogs to mediawiki source

gettd.pl fix to bug that stopped tech roadmaps from being added up into the same file. Introduced in v0.5

gettd.pl version 0.5 support for format analysis and bash file executable

Add special case handling for export controlled OSS repositories (currently sf/os/security)

Add additional repositories sfl/MCL/sf/mw/helix and oss/FCL/interim/QEMU

Added new repositories sfl/MCL/sf/mw/helix and oss/FCL/interim/QEMU

gettd.pl v0.5, support for bklog compare and fix feature count

gettd.pl v0.04 - fix to delete empty lines

update to help in roadmap merger

update to roadmap merger to support package backlog analysis

remove authentication as default, added -a option for cookies

adding roadmap_merger script - first version

Added initial versions of filecheck and hg tags to bugzilla version hooks

Trivial script to convert a "copied" bugzilla bug listing into a Mediawiki table

Improve consistency checking for summarise_hg_status.pl

Add utility to remove releasable files from under the epoc32 tree

Add utility to summarise the hg status output across multiple packages

Updated now that sf/os/security package has moved from sfl to oss

Add the -exec and -filter options to clone_all_repositories, giving simple "iterator" functionality

Add "-sort" option to sort the recipes before printing, for comparing two logs

Add script to clone repositories and create workspace based on the BOM produced by the platform build

Fix mistake in -password and -username options, tweak the (doomed) sfl repository screen scraping

Add proper usage and more options (Bug 80). Add prototype screen-scraping to read repository list.

Prompt for username and password (Bug 80), support retries and repo mirroring

Add handling for "can't find mmp file" messages

Remove the "Public by precedent" analysis and the assumed Symbian^1 list

Clone from developer.symbian.org (Bug 79) and use https for SFL packages

sbs_findstr.pl inserts the target attribute into the status, for quick grepping. The sbs_quickstatus.pl does this for all <status> elements

Re-introduce the clone_all_packages.pl script

Adding some dependency analysis scripts

Update scan_antlogs.pl to use "No rule to make" lines to infer more missing things More wrestling with find_public_apis.pl

Add a utility to convert raptor timestamps back into localtime. Lots of change to the find_public_apis.pl script, trying to get more insight Add filename globbing to the sbs_findstr.pl script, so you can scan *compile*

Create "williamr" directory in utilities, and add an assortment of Perl scripts

Add EPL license text to the synch_hg* scripts

adding synch hg to p4 & create dummy foundation structure scripts