Commit graph

28 commits

Author SHA1 Message Date
Christof Thalhofer
178ce9c26c Remove TestSetupTeardown in TestMe also 2020-05-02 15:28:30 +02:00
Christof Thalhofer
3cf670ef85 Test.PrintSummary: Result in the last line 2020-05-01 18:59:20 +02:00
Christof Thalhofer
7d480229e0 Rewrite TestSummary and TestMe
TestSummary.DoSomeAsserts, DoTodo and DoSkip succeed
2020-05-01 10:42:29 +02:00
Christof Thalhofer
098c5915a5 New Bug: Directives are never stored.
This must be fixed before Summary can be created.
2020-04-28 12:17:02 +02:00
Christof Thalhofer
0943f349eb taskell updated: Todo exists 2020-04-28 09:36:44 +02:00
Christof Thalhofer
c306e9a5fc Fix: Free Assert from non-assertions
Assert free from non-assertions. Also Assert and Test now are
modules.
2020-04-27 12:01:47 +02:00
Christof Thalhofer
750a6057d1 Taskell next task todo and skip
Both are not implemented well but necessary for summary
2020-04-26 12:49:06 +02:00
Christof Thalhofer
d7a478cc81 Fix: Test bails out if testmodule doesn't exist 2020-04-26 11:23:01 +02:00
Christof Thalhofer
d02c023e67 TestFailures and TestSummary updated 2020-04-26 11:03:53 +02:00
Christof Thalhofer
e5c9b3c1c2 gb.test and gbt3 some refactoring and future tasks 2020-04-25 21:28:51 +02:00
Christof Thalhofer
254251b2f7 refact 2020-04-10 11:15:17 +02:00
Christof Thalhofer
72c2c1e158 TestFailures report ok now, new TestCrashes
Tests in TestCrashes fail and must be reported as failed
2020-04-09 08:13:09 +02:00
Christof Thalhofer
815a1ddcf2 TestCommand parsing done, but system still buggy
Without "Debug oTest.Name" in TestSuite.class:39 it would silently crash anywhere
after TestNoMessage is done without printing any single character. Reason is
"Assert.BailOut" in TestSuite:51 which miraculously does nothing.

If the testsystem itself crashes, ist must print "BailOut ..."

But here also can be seen, why the system has to print every assertion immediately.
Any bufferíng is bad because if the testsystem crashes the buffered results are gone.

So we must get rid of the buffered stream thing and go back to Print scattered all over ;-)
2020-04-08 12:39:55 +02:00
Christof Thalhofer
33641cac1b TestCommand Parser
Parses the string that containes testmodules and -methods. The parser is tested in TestInternals.
2020-04-08 00:40:14 +02:00
Christof Thalhofer
728194b3da Rename Unittest to Test 2020-04-07 16:48:46 +02:00
Tobias Boege
84e9792043 gb.test: remove self-test concept
[GB.TEST]
* OPT: Remove the concept of self-tests. Since ".../.test" exists there is no need to distinguish their tests and ours anymore.
2020-04-07 15:08:54 +02:00
Tobias Boege
2489001ca4 gb.test: restore failing self-tests
[GB.TEST]
* NEW: Errors in tests are caught again.
* OPT: Shorten StringEquals diagnostics.
2020-04-07 15:08:46 +02:00
Tobias Boege
a4e233d4be Move gb.test.tap into gb.test
[GB.TEST]
* NEW: Merge gb.test.tap classes.

[DEVELOPMENT ENVIRONMENT]
* NEW: Remove mention of gb.test.tap.

[CONFIGURATION]
* NEW: Remove gb.test.tap.
2020-04-07 12:32:48 +02:00
Tobias Boege
350d61cd85 gb.test: Restore BailOut on uncaught errors
[GB.TEST.TAP]
* NEW: Assert.SubtestLevel is a new property that returns the number of nested subtests.
* NEW: Assert.BailOut always unwinds the subtest stack and bails out of the entire TAP session.
* BUG: Tests can bail out even if Finished was called.

[GB.TEST]
* NEW: Bail out again if errors from test methods are caught.
* BUG: Don't call Finish on a subtest when it was already finished.

After the Bail out message, we Quit with non-zero exit status to signal
an abnormal termination to the harness.
2020-02-27 20:38:55 +01:00
Tobias Boege
c9c99c0050 gb.test: Use gb.test.tap
[GB.TEST]
* NEW: Use gb.test.

This removes the Assert and Track classes and uses gb.test.tap instead.
Test methods are now executed inside subtests, plan lines are auto-
matically emitted by the harness.

Differences between gb.tests's and gb.test.tap's Assert module:

  - Instead of Assert.True and Assert.False, use Assert.Ok.
  - Instead of Assert.Equals* for every type, there is a generic
    Assert.Equals for Variants and a specific Assert.StringEquals
    for strings which prints diagnostics when the test fails.
  - Assert.BailOut does not terminate the entire program, just
    the TAP stream.
  - Assert.ErrorWithCode is called Assert.ErrorCode.

All TAP printing is done through Assert now. Errors happening in the
test code are not caught and spoofed in the TAP stream anymore, they
cause a test failure. The system would be more robust if the testee
would be in a different process from the tester.
2020-02-27 20:38:55 +01:00
Christof Thalhofer
06b405f22d gb.test: BailOut if a testmodule is empty
[GB.TEST]
* NEW: BailOut if a testmodule is empty
2020-02-23 22:31:28 +01:00
Christof Thalhofer
e4f06f6674 gb.test refactoring for use of test modules
[GB.TEST]
* NEW: Add support for test modules.
2020-02-23 12:38:53 +01:00
Christof Thalhofer
313ef71b0f gb.test Assert.Note complains about Null value
[GB.TEST]
    * NEW: Assert.Note complains about Null value
2020-02-01 23:54:01 +01:00
Christof Thalhofer
550c56b596 gb.test: Fix plan if just one testmethod called
[GB.TEST]
    * BUG: Fix plan that counted all testmethods in a container even if just one was called
2020-01-24 10:10:39 +01:00
Christof Thalhofer
386f76e9fe gb.test UnitTest now scans .../.gambas for testclasses 2020-01-04 14:48:51 +01:00
Christof Thalhofer
c0fcfe0e5b gb.test: Always report Track.Plan <> Track.Counter
[GB.TEST]
*FIX: Always report Track.Plan <> Track.Counter even if no success
2019-12-31 01:51:24 +01:00
Christof Thalhofer
f9495607cf gb.test: Refactoring and improvements
[GB.TEST]
* NEW: Assert some reworking, skip, todo and body removed
* NEW: in a testcontainer in _new the count of tests can be defined by Me.Plan and differences between assertions counted and planned lead to No success
* NEW: Unittest.Bailout
2019-12-30 22:10:37 +01:00
Christof Thalhofer
6beaefbe1c new component gb.test
[GB.TEST]
* NEW: component for unittesting
2019-11-15 21:33:54 +00:00