b7e7772169
Experimental version released on August 24th, 2011. The biggest change in this release is the ability for Kyua to run test programs implemented using different frameworks. What this means is that, now, a Kyua test suite can include not only ATF-based test programs, but also "legacy" (aka plain) test programs that do not use any framework. I.e. if you have tests that are simple programs that exit with 0 on success and 1 on failure, you can plug them in into a Kyua test suite. Other than this, there have been several user-visible changes. The most important are the addition of the new 'config' and 'debug' subcommands to the 'kyua' binary. The former can be used to inspect the runtime configuration of Kyua after parsing, and the latter is useful to interact with failing tests cases in order to get more data about the failure itself. Without further ado, here comes the itemized list of changes: * Generalized the run-time engine to support executing test programs that implement different interfaces. Test programs that use the ATF libraries are just a special case of this. (Issue 18.) * Added support to the engine to run "plain" test programs: i.e. test programs that do not use any framework and report their pass/fail status as an exit code. This is to simplify the integration of legacy test programs into a test suite, and also to demonstrate that the run-time engine is generic enough to support different test interfaces. (Issue 18.) * Added the 'debug' subcommand. This command allows end users to tweak the execution of a specific test case and to poke into the behavior of its execution. At the moment, all this command allows is to view the stdout and stderr of the command in real time (which the 'test' command currently completely hides). * Added the 'config' subcommand. This command allows the end user to inspect the current configuration variables after evaluation, without having to read through configuration files. (Issue 11.) * Removed the test_suites_var function from configuration files. This was used to set the value of test-suite-sepecific variables, but it was ugly-looking. It is now possible to use the more natural syntax 'test_suites.<test-suite-name>.<variable> = <value>'. (Issue 11.) * Added a mechanism to disable the loading of configuration files altogether. Needed for testing purposes and for scriptability. Available by passing the '--config=none' flag. * Enabled detection of unused parameters and variables in the code and fixed all warnings. (Issue 23.) * Changed the behavior of "developer mode". Compiler warnings are now enabled unconditionally regardless of whether we are in developer mode or not; developer mode is now only used to perform strict warning checks and to enable assertions. Additionally, developer mode is now only automatically enabled when building from the repository, not for formal releases. (Issue 22.) * Fixed many build and portability problems to Debian sid with GCC 4.6.3 and Ubuntu 10.04.1 LTS. (Issues 20, 21, 26.)
135 lines
5.1 KiB
Text
135 lines
5.1 KiB
Text
@comment $NetBSD: PLIST,v 1.2 2011/08/24 21:04:42 jmmv Exp $
|
|
bin/kyua
|
|
info/kyua-cli.info
|
|
man/man1/kyua.1
|
|
share/doc/kyua-cli/AUTHORS
|
|
share/doc/kyua-cli/COPYING
|
|
share/doc/kyua-cli/NEWS
|
|
share/doc/kyua-cli/README
|
|
share/kyua-cli/examples/Kyuafile.top
|
|
share/kyua-cli/examples/kyua.conf
|
|
share/kyua-cli/lua/config_1.lua
|
|
share/kyua-cli/lua/init.lua
|
|
share/kyua-cli/lua/kyuafile_1.lua
|
|
share/kyua-cli/misc/kyuaify.sh
|
|
tests/Kyuafile
|
|
tests/kyua-cli/Atffile
|
|
tests/kyua-cli/Kyuafile
|
|
tests/kyua-cli/bootstrap/Kyuafile
|
|
tests/kyua-cli/bootstrap/testsuite
|
|
tests/kyua-cli/cli/Atffile
|
|
tests/kyua-cli/cli/Kyuafile
|
|
tests/kyua-cli/cli/cmd_about_test
|
|
tests/kyua-cli/cli/cmd_config_test
|
|
tests/kyua-cli/cli/cmd_debug_test
|
|
tests/kyua-cli/cli/cmd_help_test
|
|
tests/kyua-cli/cli/cmd_list_helpers
|
|
tests/kyua-cli/cli/cmd_list_test
|
|
tests/kyua-cli/cli/cmd_test_test
|
|
tests/kyua-cli/cli/common_test
|
|
tests/kyua-cli/cli/config_test
|
|
tests/kyua-cli/cli/filters_test
|
|
tests/kyua-cli/cli/main_test
|
|
tests/kyua-cli/engine/Atffile
|
|
tests/kyua-cli/engine/Kyuafile
|
|
tests/kyua-cli/engine/atf_iface/Atffile
|
|
tests/kyua-cli/engine/atf_iface/Kyuafile
|
|
tests/kyua-cli/engine/atf_iface/results_test
|
|
tests/kyua-cli/engine/atf_iface/runner_helpers
|
|
tests/kyua-cli/engine/atf_iface/runner_test
|
|
tests/kyua-cli/engine/atf_iface/test_case_test
|
|
tests/kyua-cli/engine/atf_iface/test_program_atf_helpers
|
|
tests/kyua-cli/engine/atf_iface/test_program_plain_helpers
|
|
tests/kyua-cli/engine/atf_iface/test_program_test
|
|
tests/kyua-cli/engine/exceptions_test
|
|
tests/kyua-cli/engine/isolation_test
|
|
tests/kyua-cli/engine/plain_iface/Atffile
|
|
tests/kyua-cli/engine/plain_iface/Kyuafile
|
|
tests/kyua-cli/engine/plain_iface/test_case_helpers
|
|
tests/kyua-cli/engine/plain_iface/test_case_test
|
|
tests/kyua-cli/engine/plain_iface/test_program_test
|
|
tests/kyua-cli/engine/results_test
|
|
tests/kyua-cli/engine/test_case_test
|
|
tests/kyua-cli/engine/test_program_test
|
|
tests/kyua-cli/engine/user_files/Atffile
|
|
tests/kyua-cli/engine/user_files/Kyuafile
|
|
tests/kyua-cli/engine/user_files/common_test
|
|
tests/kyua-cli/engine/user_files/config_1_test
|
|
tests/kyua-cli/engine/user_files/config_test
|
|
tests/kyua-cli/engine/user_files/exceptions_test
|
|
tests/kyua-cli/engine/user_files/init_test
|
|
tests/kyua-cli/engine/user_files/kyuafile_1_test
|
|
tests/kyua-cli/engine/user_files/kyuafile_test
|
|
tests/kyua-cli/examples/Atffile
|
|
tests/kyua-cli/examples/Kyuafile
|
|
tests/kyua-cli/examples/syntax_test
|
|
tests/kyua-cli/integration/Atffile
|
|
tests/kyua-cli/integration/Kyuafile
|
|
tests/kyua-cli/integration/cmd_about_test
|
|
tests/kyua-cli/integration/cmd_config_test
|
|
tests/kyua-cli/integration/cmd_debug_test
|
|
tests/kyua-cli/integration/cmd_help_test
|
|
tests/kyua-cli/integration/cmd_list_test
|
|
tests/kyua-cli/integration/cmd_test_test
|
|
tests/kyua-cli/integration/global_test
|
|
tests/kyua-cli/integration/helpers/bad_test_program
|
|
tests/kyua-cli/integration/helpers/bogus_test_cases
|
|
tests/kyua-cli/integration/helpers/config
|
|
tests/kyua-cli/integration/helpers/expect_all_pass
|
|
tests/kyua-cli/integration/helpers/expect_some_fail
|
|
tests/kyua-cli/integration/helpers/interrupts
|
|
tests/kyua-cli/integration/helpers/metadata
|
|
tests/kyua-cli/integration/helpers/simple_all_pass
|
|
tests/kyua-cli/integration/helpers/simple_some_fail
|
|
tests/kyua-cli/utils/Atffile
|
|
tests/kyua-cli/utils/Kyuafile
|
|
tests/kyua-cli/utils/auto_array_test
|
|
tests/kyua-cli/utils/cmdline/Atffile
|
|
tests/kyua-cli/utils/cmdline/Kyuafile
|
|
tests/kyua-cli/utils/cmdline/base_command_test
|
|
tests/kyua-cli/utils/cmdline/commands_map_test
|
|
tests/kyua-cli/utils/cmdline/exceptions_test
|
|
tests/kyua-cli/utils/cmdline/globals_test
|
|
tests/kyua-cli/utils/cmdline/options_test
|
|
tests/kyua-cli/utils/cmdline/parser_test
|
|
tests/kyua-cli/utils/cmdline/ui_test
|
|
tests/kyua-cli/utils/datetime_test
|
|
tests/kyua-cli/utils/env_test
|
|
tests/kyua-cli/utils/format/Atffile
|
|
tests/kyua-cli/utils/format/Kyuafile
|
|
tests/kyua-cli/utils/format/exceptions_test
|
|
tests/kyua-cli/utils/format/formatter_test
|
|
tests/kyua-cli/utils/fs/Atffile
|
|
tests/kyua-cli/utils/fs/Kyuafile
|
|
tests/kyua-cli/utils/fs/auto_cleaners_test
|
|
tests/kyua-cli/utils/fs/exceptions_test
|
|
tests/kyua-cli/utils/fs/operations_test
|
|
tests/kyua-cli/utils/fs/path_test
|
|
tests/kyua-cli/utils/logging/Atffile
|
|
tests/kyua-cli/utils/logging/Kyuafile
|
|
tests/kyua-cli/utils/logging/macros_test
|
|
tests/kyua-cli/utils/logging/operations_test
|
|
tests/kyua-cli/utils/lua/Atffile
|
|
tests/kyua-cli/utils/lua/Kyuafile
|
|
tests/kyua-cli/utils/lua/exceptions_test
|
|
tests/kyua-cli/utils/lua/module_fs_test
|
|
tests/kyua-cli/utils/lua/module_logging_test
|
|
tests/kyua-cli/utils/lua/operations_test
|
|
tests/kyua-cli/utils/lua/wrap_test
|
|
tests/kyua-cli/utils/optional_test
|
|
tests/kyua-cli/utils/passwd_test
|
|
tests/kyua-cli/utils/process/Atffile
|
|
tests/kyua-cli/utils/process/Kyuafile
|
|
tests/kyua-cli/utils/process/children_test
|
|
tests/kyua-cli/utils/process/exceptions_test
|
|
tests/kyua-cli/utils/process/fdstream_test
|
|
tests/kyua-cli/utils/process/helpers
|
|
tests/kyua-cli/utils/process/status_test
|
|
tests/kyua-cli/utils/process/systembuf_test
|
|
tests/kyua-cli/utils/sanity_test
|
|
tests/kyua-cli/utils/signals/Atffile
|
|
tests/kyua-cli/utils/signals/Kyuafile
|
|
tests/kyua-cli/utils/signals/exceptions_test
|
|
tests/kyua-cli/utils/signals/misc_test
|
|
tests/kyua-cli/utils/signals/programmer_test
|
|
tests/kyua-cli/utils/signals/timer_test
|