1Major changes between releases Automated Testing Framework 2=========================================================================== 3 4Changes in version 0.21 5*********************** 6 7Released on October 23rd, 2014. 8 9* Restored the atf(7) manual page to serve as a reference to all the other 10 manual pages shipped by ATF. 11 12* Added the -s flag to atf-sh to support specifying the shell interpreter 13 to be used. 14 15* Removed ATF_WORKDIR. The only remaining consumers have been converted to 16 use the standard TMPDIR environment variable. As a benefit, and because 17 Kyua forces the TMPDIR to live within the test case's work directory, 18 any stale files left behind by ATF will be automatically cleaned up. 19 20* Documented the environment variables recognized by each component in the 21 relevant manual pages. This information was lost with the atf-config(1) 22 removal. 23 24* Added a new "require.diskspace" metadata property to test cases so that 25 they can specify the minimum amount of disk space required for the test 26 to run. 27 28* Renamed the atf-{c,c++,sh}-api(3) manual pages to atf-{c,c++,sh}(3) for 29 discoverability purposes. Symbolic links are provided for the time 30 being to still make the old names visible. 31 32* Issue #5: Recommend the (expected, actual) idiom for calls to the test 33 macros in the manual pages. 34 35* Issue #7: Stopped catching unhandled exceptions in atf-c++ tests. This 36 propagates the crash to the caller, which in turn allows it to obtain 37 proper debugging information. In particular, Kyua should now be able to 38 extract a stacktrace pinpointing the problem. 39 40* Issue #8: Fixed atf-c/macros_test:use test failures spotted by the clang 41 that ships with FreeBSD 11.0-CURRENT. 42 43* Issue #12: Improved documentation of atf-sh(3) and atf-check(1) by better 44 explaining how they relate to each other. 45 46* Issue #14: Stopped setting 'set -e' in atf-sh. This setting was 47 initially added as a way to enable a "strict" mode in the library and to 48 make test cases fail fast when they run unprotected commands. However, 49 doing so in the library is surprising as the responsibility of enabling 50 'set -e' should be on the user's code. Also, 'set -e' introduces 51 inconsistent behavior on subshells and users do not expect that. 52 53* Issue #15: Fixed atf_utils_{fork,wait} to support nested calls. 54 55* Issue #16: Fixed test failures (by removing a long-standing hack) on 56 systems that lack \e support in printf(1). 57 58* Issue #19: Removed stale references to atf-config and atf-run. 59 60 61Changes in version 0.20 62*********************** 63 64Experimental version released on February 7th, 2014. 65 66This is the first release without the code for the deprecated tools. If 67you require such code, please fetch a copy of the 0.19 release and extract 68the 'tools' directory for your own consumption. 69 70* Removed the deprecated tools. This includes atf-config, atf-report, 71 atf-run and atf-version. 72 73* Issue #8: Fixed atf-c/macros_test:use test failures spotted by the clang 74 that ships with FreeBSD 11.0-CURRENT. 75 76 77Changes in version 0.19 78*********************** 79 80Experimental version released on February 7th, 2014. 81 82This is the last release to bundle the code for the deprecated tools. 83The next release will drop their code and will stop worrying about 84backwards compatibility between the ATF libraries and what the old tools 85may or may not support. 86 87If you still require the old tools for some reason, grab a copy of the 88'tools' directory now. The code in this directory is standalone and 89does not depend on any internal details of atf-c++ any longer. 90 91* Various fixes and improvements to support running as part of the FreeBSD 92 test suite. 93 94* Project hosting moved from Google Code (as a subproject of Kyua) to 95 GitHub (as a first-class project). The main reason for the change is 96 the suppression of binary downloads in Google Code on Jan 15th, 2014. 97 See https://github.com/jmmv/atf/ 98 99* Removed builtin help from atf-sh(1) and atf-check(1) for simplicity 100 reasons. In other words, their -h option is gone. 101 102* Moved the code of the deprecated tools into a 'tools' directory and 103 completely decoupled their code from the internals of atf-c++. The 104 reason for this is to painlessly allow a third-party to maintain a 105 copy of these tools after we delete them because upcoming changes to 106 atf-c++ would break the stale tools. 107 108 109Changes in version 0.18 110*********************** 111 112Experimental version released on November 16th, 2013. 113 114* Issue 45: Added require.memory support in atf-run for FreeBSD. 115 116* Fixed an issue with the handling of cin with libc++. 117 118* Issue 64: Fixed various mandoc formatting warnings. 119 120* NetBSD PR bin/48284: Made atf-check flush its progress message to 121 stdout so that an interrupted test case always shows the last message 122 being executed. 123 124* NetBSD PR bin/48285: Fixed atf_check examples in atf-sh-api(3). 125 126 127Changes in version 0.17 128*********************** 129 130Experimental version released on February 14th, 2013. 131 132* Added the atf_utils_cat_file, atf_utils_compare_file, 133 atf_utils_copy_file, atf_utils_create_file, atf_utils_file_exists, 134 atf_utils_fork, atf_utils_grep_file, atf_utils_grep_string, 135 atf_utils_readline, atf_utils_redirect and atf_utils_wait utility 136 functions to atf-c-api. Documented the already-public 137 atf_utils_free_charpp function. 138 139* Added the cat_file, compare_file, copy_file, create_file, file_exists, 140 fork, grep_collection, grep_file, grep_string, redirect and wait 141 functions to the atf::utils namespace of atf-c++-api. These are 142 wrappers around the same functions added to the atf-c-api library. 143 144* Added the ATF_CHECK_MATCH, ATF_CHECK_MATCH_MSG, ATF_REQUIRE_MATCH and 145 ATF_REQUIRE_MATCH_MSG macros to atf-c to simplify the validation of a 146 string against a regular expression. 147 148* Miscellaneous fixes for manpage typos and compilation problems with 149 clang. 150 151* Added caching of the results of those configure tests that rely on 152 executing a test program. This should help crossbuild systems by 153 providing a mechanism to pre-specify what the results should be. 154 155* PR bin/45690: Make atf-report convert any non-printable characters to 156 a plain-text representation (matching their corresponding hexadecimal 157 entities) in XML output files. This is to prevent the output of test 158 cases from breaking xsltproc later. 159 160 161Changes in version 0.16 162*********************** 163 164Experimental version released on July 10th, 2012. 165 166* Added a --enable-tools flag to configure to request the build of the 167 deprecated ATF tools, whose build is now disabled by default. In order 168 to continue running tests, you should migrate to Kyua instead of enabling 169 the build of the deprecated tools. The kyua-atf-compat package provides 170 transitional compatibility versions of atf-run and atf-report built on 171 top of Kyua. 172 173* Tweaked the ATF_TEST_CASE macro of atf-c++ so that the compiler can 174 detect defined but unused test cases. 175 176* PR bin/45859: Fixed some XSLT bugs that resulted in the tc-time and 177 tp-time XML tags leaking into the generated HTML file. Also improved 178 the CSS file slightly to correct alignment and color issues with the 179 timestamps column. 180 181* Optimized atf-c++/macros.hpp so that GNU G++ consumes less memory during 182 compilation with GNU G++. 183 184* Flipped the default to building shared libraries for atf-c and atf-c++, 185 and started versioning them. As a side-effect, this removes the 186 --enable-unstable-shared flag from configure that appears to not work any 187 more (under NetBSD). Additionally, some distributions require the use of 188 shared libraries for proper dependency tracking (e.g. Fedora), so it is 189 better if we do the right versioning upstream. 190 191* Project hosting moved from an adhoc solution (custom web site and 192 Monotone repository) to Google Code (standard wiki and Git). ATF now 193 lives in a subcomponent of the Kyua project. 194 195 196Changes in version 0.15 197*********************** 198 199Experimental version released on January 16th, 2012. 200 201* Respect stdin in atf-check. The previous release silenced stdin for any 202 processes spawned by atf, not only test programs, which caused breakage 203 in tests that pipe data through atf-check. 204 205* Performance improvements to atf-sh. 206 207* Enabled detection of unused parameters and variables in the code and 208 fixed all warnings. 209 210* Changed the behavior of "developer mode". Compiler warnings are now 211 enabled unconditionally regardless of whether we are in developer mode or 212 not; developer mode is now only used to perform strict warning checks and 213 to enable assertions. Additionally, developer mode is now only 214 automatically enabled when building from the repository, not for formal 215 releases. 216 217* Added new Autoconf M4 macros (ATF_ARG_WITH, ATF_CHECK_C and 218 ATF_CHECK_CXX) to provide a consistent way of defining a --with-arg flag 219 in configure scripts and detecting the presence of any of the ATF 220 bindings. Note that ATF_CHECK_SH was already introduced in 0.14, but it 221 has now been modified to also honor --with-atf if instantiated. 222 223* Added timing support to atf-run / atf-report. 224 225* Added support for a 'require.memory' property, to specify the minimum 226 amount of physical memory needed by the test case to yield valid results. 227 228* PR bin/45690: Force an ISO-8859-1 encoding in the XML files generated by 229 atf-report so that invalid data in the output of test cases does not 230 mangle our report. 231 232 233Changes in version 0.14 234*********************** 235 236Experimental version released on June 14th, 2011. 237 238* Added a pkg-config file for atf-sh and an aclocal file to ease the 239 detection of atf-sh from autoconf scripts. 240 241* Made the default test case body defined by atf_sh fail. This is to 242 ensure that test cases are properly defined in test programs and helps 243 in catching typos in the names of the body functions. 244 245* PR bin/44882: Made atf-run connect the stdin of test cases to /dev/zero. 246 This provides more consistent results with "normal" execution (in 247 particular, when tests are executed detached from a terminal). 248 249* Made atf-run hardcode TZ=UTC for test cases. It used to undefine TZ, but 250 that does not take into account that libc determines the current timezone 251 from a configuration file. 252 253* All test programs will now print a warning when they are not run through 254 atf-run(1) stating that this is unsupported and may deliver incorrect 255 results. 256 257* Added support for the 'require.files' test-case property. This allows 258 test cases to specify installed files that must be present for the test 259 case to run. 260 261 262Changes in version 0.13 263*********************** 264 265Experimental version released on March 31st, 2011. 266 267This is the first release after the creation of the Kyua project, a more 268modular and reliable replacement for ATF. From now on, ATF will change to 269accomodate the transition to this new codebase, but ATF will still continue 270to see development in the short/medium term. Check out the project page at 271http://code.google.com/p/kyua/ for more details. 272 273The changes in this release are: 274 275* Added support to run the tests with the Kyua runtime engine (kyua-cli), a 276 new package that aims to replace atf-run and atf-report. The ATF tests 277 can be run with the new system by issuing a 'make installcheck-kyua' from 278 the top-level directory of the project (assuming the 'kyua' binary is 279 available during the configuration stage of ATF). 280 281* atf-run and atf-report are now in maintenance mode (but *not* deprecated 282 yet!). Kyua already implements a new, much more reliable runtime engine 283 that provides similar features to these tools. That said, it is not 284 complete yet so all development efforts should go towards it. 285 286* If GDB is installed, atf-run dumps the stack trace of crashing test 287 programs in an attempt to aid debugging. Contributed by Antti Kantee. 288 289* Reverted default timeout change in previous release and reset its value 290 to 5 minutes. This was causing several issues, specially when running 291 the existing NetBSD test suite in qemu. 292 293* Fixed the 'match' output checker in atf-check to properly validate the 294 last line of a file even if it does not have a newline. 295 296* Added the ATF_REQUIRE_IN and ATF_REQUIRE_NOT_IN macros to atf-c++ to 297 check for the presence (or lack thereof) of an element in a collection. 298 299* PR bin/44176: Fixed a race condition in atf-run that would crash atf-run 300 when the cleanup of a test case triggered asynchronous modifications to 301 its work directory (e.g. killing a daemon process that cleans up a pid 302 file in the work directory). 303 304* PR bin/44301: Fixed the sample XSLT file to report bogus test programs 305 instead of just listing them as having 0 test cases. 306 307 308Changes in version 0.12 309*********************** 310 311Experimental version released on November 7th, 2010. 312 313* Added the ATF_REQUIRE_THROW_RE to atf-c++, which is the same as 314 ATF_REQUIRE_THROW but allows checking for the validity of the exception's 315 error message by means of a regular expression. 316 317* Added the ATF_REQUIRE_MATCH to atf-c++, which allows checking for a 318 regular expression match in a string. 319 320* Changed the default timeout for test cases from 5 minutes to 30 seconds. 321 30 seconds is long enough for virtually all tests to complete, and 5 322 minutes is a way too long pause in a test suite where a single test case 323 stalls. 324 325* Deprecated the use.fs property. While this seemed like a good idea in 326 the first place to impose more control on what test cases can do, it 327 turns out to be bad. First, use.fs=false prevents bogus test cases 328 from dumping core so after-the-fact debugging is harder. Second, 329 supporting use.fs adds a lot of unnecessary complexity. atf-run will 330 now ignore any value provided to use.fs and will allow test cases to 331 freely access the file system if they wish to. 332 333* Added the atf_tc_get_config_var_as_{bool,long}{,_wd} functions to the atf-c 334 library. The 'text' module became private in 0.11 but was being used 335 externally to simplify the parsing of configuration variables. 336 337* Made atf-run recognize the 'unprivileged-user' configuration variable 338 and automatically drop root privileges when a test case sets 339 require.user=unprivileged. Note that this is, by no means, done for 340 security purposes; this is just for user convenience; tests should, in 341 general, not be blindly run as root in the first place. 342 343 344Changes in version 0.11 345*********************** 346 347Experimental version released on October 20th, 2010. 348 349* The ATF_CHECK* macros in atf-c++ were renamed to ATF_REQUIRE* to match 350 their counterparts in atf-c. 351 352* Clearly separated the modules in atf-c that are supposed to be public 353 from those that are implementation details. The header files for the 354 internal modules are not installed any more. 355 356* Made the atf-check tool private. It is only required by atf-sh and being 357 public has the danger of causing confusion. Also, making it private 358 simplifies the public API of atf. 359 360* Changed atf-sh to enable per-command error checking (set -e) by default. 361 This catches many cases in which a test case is broken but it is not 362 reported as such because execution continues. 363 364* Fixed the XSTL and CSS stylesheets to support expected failures. 365 366 367Changes in version 0.10 368*********************** 369 370Experimental version released on July 2nd, 2010. 371 372Miscellaneous features 373 374* Added expected failures support to test cases and atf-run. These 375 include, for example, expected clean exits, expected reception of fatal 376 signals, expected timeouts and expected errors in condition checks. 377 These statuses can be used to denote test cases that are known to fail 378 due to a bug in the code they are testing. atf-report reports these 379 tests separately but they do not count towards the failed test cases 380 amount. 381 382* Added the ATF_CHECK_ERRNO and ATF_REQUIRE_ERRNO to the C library to 383 allow easy checking of call failures that update errno. 384 385* Added the has.cleanup meta-data property to test caes that specifies 386 whether the test case has a cleanup routine or not; its value is 387 automatically set. This property is read by atf-run to know if it has to 388 run the cleanup routine; skipping this run for every test case 389 significantly speeds up the run time of test suites. 390 391* Reversed the order of the ATF_CHECK_THROW macro in the C++ binding to 392 take the expected exception as the first argument and the statement to 393 execute as the second argument. 394 395Changes in atf-check 396 397* Changed atf-check to support negating the status and output checks by 398 prefixing them with not- and added support to specify multiple checkers 399 for stdout and stderr, not only one. 400 401* Added the match output checker to atf-check to look for regular 402 expressions in the stdout and stderr of commands. 403 404* Modified the exit checks in atf-check to support checking for the 405 reception of signals. 406 407Code simplifications and cleanups 408 409* Removed usage messages from test programs to simplify the 410 implementation of every binding by a significant amount. They just now 411 refer the user to the appropriate manual page and do not attempt to wrap 412 lines on terminal boundaries. Test programs are not supposed to be run 413 by users directly so this minor interface regression is not important. 414 415* Removed the atf-format internal utility, which is unused after the 416 change documented above. 417 418* Removed the atf-cleanup internal utility. It has been unused since the 419 test case isolation was moved to atf-run in 0.8 420 421* Splitted the Makefile.am into smaller files for easier maintenance and 422 dropped the use of M4. Only affects users building from the repository 423 sources. 424 425* Intermixed tests with the source files in the source tree to provide 426 them more visibility and easier access. The tests directory is gone from 427 the source tree and tests are now suffixed by _test, not prefixed by t_. 428 429* Simplifications to the atf-c library: removed the io, tcr and ui 430 modules as they had become unnecessary after all simplifications 431 introduced since the 0.8 release. 432 433* Removed the application/X-atf-tcr format introduced in 0.8 release. 434 Tests now print a much simplified format that is easy to parse and nicer 435 to read by end users. As a side effect, the default for test cases is 436 now to print their results to stdout unless otherwise stated by providing 437 the -r flag. 438 439* Removed XML distribution documents and replaced them with plain-text 440 documents. They provided little value and introduced a lot of complexity 441 to the build system. 442 443* Simplified the output of atf-version by not attempting to print a 444 revision number when building form a distfile. Makes the build system 445 easier to maintain. 446 447 448Changes in version 0.9 449********************** 450 451Experimental version released on June 3rd, 2010. 452 453* Added atf-sh, an interpreter to process test programs written using 454 the shell API. This is not really a shell interpreter by itself though: 455 it is just a wrapper around the system shell that eases the loading of 456 the necessary ATF libraries. 457 458* Removed atf-compile in favour of atf-sh. 459 460* Added the use.fs metadata property to test case, which is used to 461 specify which test cases require file system access. This is to 462 highlight dependencies on external resources more clearly and to speed up 463 the execution of test suites by skipping the creation of many unnecessary 464 work directories. 465 466* Fixed test programs to get a sane default value for their source 467 directory. This means that it should not be necessary any more to pass 468 -s when running test programs that do not live in the current directory. 469 470* Defining test case headers became optional. This is trivial to achieve 471 in shell-based tests but a bit ugly in C and C++. In C, use the new 472 ATF_TC_WITHOUT_HEAD macro to define the test case, and in C++ use 473 ATF_TEST_CASE_WITHOUT_HEAD. 474 475 476Changes in version 0.8 477********************** 478 479Experimental version released on May 7th, 2010. 480 481* Test programs no longer run several test cases in a row. The execution 482 of a test program now requires a test case name, and that single test 483 case is executed. To execute several test cases, use the atf-run utility 484 as usual. 485 486* Test programs no longer fork a subprocess to isolate the execution of 487 test cases. They run the test case code in-process, and a crash of the 488 test case will result in a crash of the test program. This is to ease 489 debugging of faulty test cases. 490 491* Test programs no longer isolate their test cases. This means that they 492 will not create temporary directories nor sanitize the environment any 493 more. Yes: running a test case that depends on system state by hand will 494 most likely yield different results depending on where (machine, 495 directory, user environment, etc.) it is run. Isolation has been moved 496 to atf-run. 497 498* Test programs no longer print a cryptic format (application/X-atf-tcs) 499 on a special file channel. They can now print whatever they want on the 500 screen. Because test programs can now only run one test case every time, 501 providing controlled output is not necessary any more. 502 503* Test programs no longer write their status into a special file 504 descriptor. Instead, they create a file with the results, which is later 505 parsed by atf-run. This changes the semantics of the -r flag. 506 507* atf-run has been adjusted to perform the test case isolation. As a 508 result, there is now a single canonical place that implements the 509 isolation of test caes. In previous releases, the three language 510 bindings (C, C++ and shell) had to be kept in sync with each other (read: 511 not a nice thing to do at all). As a side effect of this change, writing 512 bindings for other languages will be much, much easier from now on. 513 514* atf-run forks test programs on a test case basis, instead of on a test 515 program basis as it did before. This is to provide the test case 516 isolation that was before implemented by the test programs themselves. 517 518* Removed the atf-exec tool. This was used to implement test case 519 isolation in atf-sh, but it is now unnecessary. 520 521* It is now optional to define the descr meta-data property. It has been 522 proven to be mostly useless, because test cases often carry a descriptive 523 name of their own. 524 525 526Changes in version 0.7 527********************** 528 529Experimental version released on December 22nd, 2009. 530 531* Added build-time checks to atf-c and atf-c++. A binding for atf-sh 532 will come later. 533 534* Migrated all build-time checks for header files to proper ATF tests. 535 This demonstrates the use of the new feature described above. 536 537* Added an internal API for child process management. 538 539* Converted all plain-text distribution documents to a Docbook canonical 540 version, and include pre-generated plain text and HTML copies in the 541 distribution file. 542 543* Simplified the contents of the Makefile.am by regenerating it from a 544 canonical Makefile.am.m4 source. As a side-effect, some dependency 545 specifications were fixed. 546 547* Migrated all checks from the check target to installcheck, as these 548 require ATF to be installed. 549 550* Fixed sign comparison mismatches triggered by the now-enabled 551 -Wsign-compare. 552 553* Fixed many memory and object leaks. 554 555 556Changes in version 0.6 557********************** 558 559Experimental version released on January 18th, 2009. 560 561* Make atf-exec be able to kill its child process after a certain period 562 of time; this is controlled through the new -t option. 563 564* Change atf-sh to use atf-exec's -t option to control the test case's 565 timeouts, instead of doing it internally. Same behavior as before, but 566 noticeably faster. 567 568* atf-exec's -g option and atf-killpg are gone due to the previous 569 change. 570 571* Added the atf-check(1) tool, a program that executes a given command 572 and checks its exit code against a known value and allows the management 573 of stdout and stderr in multiple ways. This replaces the previous 574 atf_check function in the atf-sh library and exposes this functionality 575 to both atf-c and atf-c++. 576 577* Added the ATF_REQUIRE family of macros to the C interface. These help 578 in checking for fatal test conditions. The old ATF_CHECK macros now 579 perform non-fatal checks only. I.e. by using ATF_CHECK, the test case 580 can now continue its execution and the failures will not be reported 581 until the end of the whole run. 582 583* Extended the amount of ATF_CHECK_* C macros with new ones to provide 584 more features to the developer. These also have their corresponding 585 counterparts in the ATF_REQUIRE_* family. The new macros (listing the 586 suffixes only) are: _EQ (replaces _EQUAL), _EQ_MSG, _STREQ and 587 _STREQ_MSG. 588 589 590Changes in version 0.5 591********************** 592 593Experimental version released on May 1st, 2008. 594 595* Clauses 3 and 4 of the BSD license used by the project were dropped. 596 All the code is now under a 2-clause BSD license compatible with the GNU 597 General Public License (GPL). 598 599* Added a C-only binding so that binary test programs do not need to be 600 tied to C++ at all. This binding is now known as the atf-c library. 601 602* Renamed the C++ binding to atf-c++ for consistency with the new atf-c. 603 604* Renamed the POSIX shell binding to atf-sh for consistency with the new 605 atf-c and atf-c++. 606 607* Added a -w flag to test programs through which it is possible to 608 specify the work directory to be used. This was possible in prior 609 releases by defining the workdir configuration variable (-v workdir=...), 610 but was a conceptually incorrect mechanism. 611 612* Test programs now preserve the execution order of test cases when they 613 are given in the command line. Even those mentioned more than once are 614 executed multiple times to comply with the user's requests. 615 616 617Changes in version 0.4 618********************** 619 620Experimental version released on February 4th, 2008. 621 622* Added two new manual pages, atf-c++-api and atf-sh-api, describing the 623 C++ and POSIX shell interfaces used to write test programs. 624 625* Added a pkg-config file, useful to get the flags to build against the 626 C++ library or to easily detect the presence of ATF. 627 628* Added a way for test cases to require a specific architecture and/or 629 machine type through the new 'require.arch' and 'require.machine' 630 meta-data properties, respectively. 631 632* Added the 'timeout' property to test cases, useful to set an 633 upper-bound limit for the test's run time and thus prevent global test 634 program stalls due to the test case's misbehavior. 635 636* Added the atf-exec(1) internal utility, used to execute a command 637 after changing the process group it belongs to. 638 639* Added the atf-killpg(1) internal utility, used to kill process groups. 640 641* Multiple portability fixes. Of special interest, full support for 642 SunOS (Solaris Express Developer Edition 2007/09) using the Sun Studio 12 643 C++ compiler. 644 645* Fixed a serious bug that prevented atf-run(1) from working at all 646 under Fedora 8 x86_64. Due to the nature of the bug, other platforms 647 were likely affected too. 648 649 650Changes in version 0.3 651********************** 652 653Experimental version released on November 11th, 2007. 654 655* Added XML output support to atf-report. This is accompanied by a DTD 656 for the format's structure and sample XSLT/CSS files to post-process this 657 output and convert it to a plain HTML report. 658 659* Changed atf-run to add system information to the report it generates. 660 This is currently used by atf-report's XML output only, and is later 661 printed in the HTML reports in a nice and useful summary table. The user 662 and system administrator are allowed to tune this feature by means of 663 hooks. 664 665* Removed the test cases' 'isolated' property. This was intended to 666 avoid touching the file system at all when running the related test case, 667 but this has not been true for a long while: some control files are 668 unconditionally required for several purposes, and we cannot easily get 669 rid of them. This way we remove several critical and delicate pieces of 670 code. 671 672* Improved atf-report's CSV output format to include information about 673 test programs too. 674 675* Fixed the tests that used atf-compile to not require this tool as a 676 helper. Avoids systems without build-time utilities to skip many tests 677 that could otherwise be run. (E.g. NetBSD without the comp.tgz set 678 installed.) 679 680* Many general cleanups: Fixed many pieces of code marked as ugly and/or 681 incomplete. 682 683 684Changes in version 0.2 685********************** 686 687Experimental version released on September 20th, 2007. 688 689* Test cases now get a known umask on entry. 690 691* atf-run now detects many unexpected failures caused by test programs and 692 reports them as bogus tests. atf-report is able to handle these new 693 errors and nicely reports them to the user. 694 695* All the data formats read and written by the tools have been 696 documented and cleaned up. These include those grammars that define how 697 the different components communicate with each other as well as the 698 format of files written by the developers and users: the Atffiles and the 699 configuration files. 700 701* Added the atf-version tool, a utility that displays information about 702 the currently installed version of ATF. 703 704* Test cases can now define an optional cleanup routine to undo their 705 actions regardless of their exit status. 706 707* atf-report now summarizes the list of failed (bogus) test programs 708 when using the ticker output format. 709 710* Test programs now capture some termination signals and clean up any 711 temporary files before exiting the program. 712 713* Multiple bug fixes and improvements all around. 714 715 716Changes in version 0.1 717********************** 718 719Experimental version released on August 20th, 2007. 720 721* First public version. This was released coinciding with the end of the 722 Google Summer of Code 2007 program. 723 724 725=========================================================================== 726vim: filetype=text:textwidth=75:expandtab:shiftwidth=2:softtabstop=2 727