196 Commits

Author SHA1 Message Date
Johan Holmberg
aa9d2c4f93 handle --help as any other option
earlier -h was recognized as a special case
in "argumentparser.rb"
2016-09-27 00:03:52 +02:00
Johan Holmberg
e76dd95bcb add test of -h and --help 2016-09-26 23:51:15 +02:00
Johan Holmberg
e6a9092783 add --stop-on-error option
to stop after first error. If running in parallel,
we don't know how to stop immediately, so that
option combination is disallowed.
2016-09-17 23:17:23 +02:00
Johan Holmberg
419ace2d58 avoid --help twice in help message 2016-09-17 22:50:40 +02:00
Johan Holmberg
c6cfae144c report finished time 2016-09-17 22:42:17 +02:00
Johan Holmberg
79bb49ed33 use Cmdtest.print_summary both with/without -j 2016-09-17 21:11:52 +02:00
Johan Holmberg
5f2d906ddf add test of ### vs. --- is summary line 2016-09-17 21:10:14 +02:00
Johan Holmberg
8124d2fcd6 at error, forget old "success" in .cmdtest-filter
with this changes a test will be re-run again even if
it is restored to an earlier content.
(all this is about the effect of the -i option)
2016-09-17 19:19:47 +02:00
Johan Holmberg
d477ccc24a gcc 5.x error messages changed
adapt expectations to work with both 4.x and 5.x
2016-06-28 09:36:48 +02:00
Johan Holmberg
502e242402 minimal test of --diff option 2016-06-28 09:06:34 +02:00
Johan Holmberg
19d55530f5 add 'cmd_cmdtest_diff' passing --diff option 2016-06-28 09:04:08 +02:00
Johan Holmberg
8943e46c44 --lines option to echo_stdout.rb/echo_stdout.rb
for new tests wanting several lines
2016-06-28 09:02:33 +02:00
Johan Holmberg
1b80605f49 --diff option (experimental)
using an LCS algorithm (like diff)
2016-06-28 00:33:39 +02:00
Johan Holmberg
deb6af6086 handle exception in setup/teardown
+ new test of this and exception in test_* methods
2016-06-26 21:12:53 +02:00
Johan Holmberg
966a98f4b1 remove obsolete parallel code
from before refactoring parallel handling
2016-06-05 12:56:22 +02:00
Johan Holmberg
166b0f310b reset current directory for "teardown"
and after processing each test method.
should pass resently added tests.
2016-06-04 21:16:12 +02:00
Johan Holmberg
4cbbac7ec1 test current directory in "teardown" method
even when current directory is changed within a test method
the "teardown" method should have same current directory
as "setup" and as the the original value in the test method.
2016-06-04 20:53:49 +02:00
Johan Holmberg
dc4ab527de test that readonly directory give error
ie. when cmdtest fails to remove the "work"
directory between test methods. Previously
cmdtest relied on FileUtils.rm_rf, but it could
fail silently, leading to weird consequences.
2016-06-04 20:49:59 +02:00
Johan Holmberg
75ea993a54 change FileUtils.rm_rf -> Util.rm_rf
since the one in FileUtils is broken, or at least does not
work like the command "rm -rf". A post condition should be that
the directory does not exist OR an exception is thrown at failure.
2016-06-03 21:03:12 +02:00
Johan Holmberg
43072aecec remove extra ORIG_CWD
just keep Cmdtest::ORIG_CWD
2016-06-03 20:29:02 +02:00
Johan Holmberg
3ea3d852aa chdir to ORIG_CWD after each test method
so current directory is outside the temporary tree
when it is cleaned between test methods.
2016-06-03 20:02:08 +02:00
Johan Holmberg
9117bc2e60 sort methods/files
for more deterministic behaviour
2016-06-03 11:17:18 +02:00
Johan Holmberg
122d2b3326 update copyright year -> 2016 2016-04-14 20:25:21 +02:00
Johan Holmberg
0ad8daec68 update HTML User Guide 2016-04-14 20:10:04 +02:00
Johan Holmberg
bbf4b92b1d introduce 'import_directory' 2016-04-14 19:56:38 +02:00
Johan Holmberg
393a92ae33 require file argument to 'import_file' + test 2016-04-14 19:54:50 +02:00
Johan Holmberg
3baa2c5133 minimal test of 'cmdtest.py' used as module 2016-01-07 19:22:28 +01:00
Johan Holmberg
a343141f30 set __file__ in CMDTEST_*.py files 2016-01-07 19:19:43 +01:00
Johan Holmberg
cdd38dd5a3 add rake file with 'test' task 2016-01-06 20:58:47 +01:00
Johan Holmberg
a65f019e51 add tests of 'cmdtest.py' in t/ subdir 2016-01-06 20:55:53 +01:00
Johan Holmberg
f0e6f5c281 add --quiet option
to make writing unit tests of 'cmdtest.py' itself easier
2016-01-06 20:54:53 +01:00
Johan Holmberg
2d37244714 add 'always_ignore_file' 2016-01-06 20:47:40 +01:00
Johan Holmberg
dad35dd311 accept directory command line argument
then all CMDTEST_*.py files in the directory will be added
2016-01-06 20:33:08 +01:00
Johan Holmberg
633b184c6a modify sys.path during exec() call
so a CMDTEST_*.py file can import files from the same directory
2016-01-06 20:29:43 +01:00
Johan Holmberg
07ac9b72ee flatten list argument to 'create_file' 2016-01-06 20:26:30 +01:00
Johan Holmberg
73d53c1f20 add .gitignore 2016-01-05 19:10:02 +01:00
Johan Holmberg
e9ff28c74a add idea for yaml based version of cmdtest 2016-01-05 19:10:02 +01:00
Johan Holmberg
71a74c00ef add CMDTEST file verifying doc example 2016-01-05 19:10:02 +01:00
Johan Holmberg
4cbba1cba1 add file used in tests of 'cmdtest' 2016-01-05 19:10:02 +01:00
Johan Holmberg
3ddfd85791 first attempt writing a Ruby "gemspec" 2016-01-05 19:10:02 +01:00
Johan Holmberg
d8379148e7 simple test usage of 'argumentparser.rb' 2016-01-05 19:10:02 +01:00
Johan Holmberg
c241d760a4 Merged in hth313/cmdtest (pull request #1)
Additions to Python version
2016-01-05 19:03:33 +01:00
Håkan Thörngren
5075c7b38b Combine class and method name when saving work dir
In the Python version when saving the work directory for a failed test
case, create a path based on both the class and method name.
2016-01-03 19:53:00 -08:00
Håkan Thörngren
af28746648 Preserve files for failed tests.
In the Python version, preserve the work directory in
work-save/class_name to make it possible to examine it
afterwards. Before running tests, remove the entire old work-save
directory hierarchy to ensure we only leave those behind that actually
are relevant.
2016-01-02 20:14:27 -08:00
Håkan Thörngren
f486a15f66 Allow Python cmdtest to be used as a library.
Added cmdtest_in_dir(path) to allow Python cmdtest to be used as part of
another Python script. Factored out most of the functionality from
main() to the common function test_files().
2015-12-09 20:49:13 -08:00
Håkan Thörngren
f4754a10fd Corrected name of program and spelling. 2015-11-19 14:52:26 -08:00
Johan Holmberg
53b4869de9 update documenation 2015-08-26 22:11:20 +02:00
Johan Holmberg
c025d22a14 move code to Runner subclasses 2015-08-17 23:53:49 +02:00
Johan Holmberg
2bb93b9536 add test with no errors; test exit code too 2015-08-17 23:37:50 +02:00
Johan Holmberg
5021972318 first version using parallel(1)
to implement -jN option to cmdtest.
may need some cleanup/refactoring.
2015-08-17 23:03:42 +02:00