anne/lyx_mirror
1
0
Fork 0
mirror of https://git.lyx.org/repos/lyx.git synced 2024-12-22 05:16:21 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Start a log file to track benefit/costs of ctests

Browse Source 
The ctests are not convenient tests. In this file we can attempt to
log the benefits and costs to using them so we can periodically
evaluate which tests we should keep and which we should get rid of.
This commit is contained in:
Scott Kostyshak 2021-01-26 13:19:34 -05:00
parent bb8278e6ce
commit d3065ceeb3
1 changed files with 16 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
development/autotests/ctests-costs-benefits.txt Normal file
View File

@ -0,0 +1,16 @@
The ctests are not convenient tests. In this file we can attempt to log the
benefits and costs to using them so we can periodically evaluate which tests we
should keep and which we should get rid of.
Below are some objective costs:
- The time it takes to run the ctests.
- The email discussion back-and-forth.
There are also some non-objective costs. The ctests are annoying and not fun to
maintain, discuss, and fix. Although it's hard to measure this "annoyance"
cost, it should be taken into account when we review.
Below we can try to keep a log of which bugs are found with which ctests. This
way we can see which tests are the most useful. It is difficult to objectively
differentiate between minor bugs and important bugs.