Commit Graph

894 Commits

Author SHA1 Message Date
Kornel Benko
965b2cdc73 Findadv: Correct findadv-combined test
Replaced some 'CP' commands with 'CN' comments.
2022-04-15 17:18:40 +02:00
Kornel Benko
7d053393a5 Cmake key-tests: Adapted to changed shortcuts 2022-03-26 19:38:55 +01:00
Kornel Benko
8380034203 AdvFind: Adapt a testfile
Change [a-z]* to [a-z]+ . This omits finds of empty strings.
2022-03-25 23:00:59 +01:00
Scott Kostyshak
d01f1428be ctests: log a fixed issue 2022-03-12 07:43:54 -05:00
Scott Kostyshak
a175caf256 ctests: uninvert 2 LuaTeX tests fixed on TL21
These exports now pass, and a quick check of the output looks good.

These might have been fixed (although it is just a guess) due to the
following entry in the changelog of luaotfload v3.19:

  A new algorithm for selecting fonts based on font family names
  allows to more reliably load fonts based on their family name.

This commit reverts 2a665dcc.
2022-03-06 09:20:12 -05:00
Scott Kostyshak
23b7b95e68 ctests: log fixed upstream Polyglossia issues
Thanks to Jürgen for fixing the upstream issue.

Also add a row "ctest" to give the pattern of the ctests that
failed.
2022-02-16 22:07:05 -05:00
Scott Kostyshak
2e07736c17 Uninvert Hazard.*systemF tests
Our .lyx document was updated by Jürgen at e071d5fe.
2022-02-08 12:15:31 -05:00
Scott Kostyshak
52c4ff290b ctests: log a fixed issue 2022-02-07 22:13:37 -05:00
Scott Kostyshak
9185fb8ccc ctests: log a fixed issue 2022-02-06 08:13:12 -05:00
Scott Kostyshak
22cbc3b0cf ctests: uninvert a DocBook export
The export now succeeds, likely due to Jürgen's improvements at
2eaf30c5.
2021-12-27 11:17:29 -05:00
Scott Kostyshak
62993294f3 Invert two DocBook + LilyPond exports
This is due to an upstream issue:

  https://gitlab.com/lilypond/lilypond/-/issues/6187

For ML discussion, see here:

  https://www.mail-archive.com/search?l=mid&q=20211102011304.dmrcr7gjpxxwpd4o%40poole
2021-12-27 11:11:30 -05:00
Scott Kostyshak
faa404f063 Reg test for protect: xymatrix in figure caption
Use case from #6243.
2021-12-27 10:26:04 -05:00
Scott Kostyshak
9d64a2f2f6 ctests: invert a docbook test for a cprotect case
The strange example file does not make sense for Docbook, as
described by Thibaut on the ML here:

  https://www.mail-archive.com/search?l=mid&q=CAK0LPyiHCsUMo0ZCbFrRBRTCD7G-rhw-z8G1of2kFGebBLddtA%40mail.gmail.com
2021-12-23 21:37:31 -05:00
Scott Kostyshak
b461d07b5b ctests: log a fixed issue (fr Linguistics.lyx) 2021-12-08 23:04:24 -05:00
Scott Kostyshak
fb4a485c19 ctests: uninvert Seminar tests
These exports now succeed on an updated TL21 installation.
2021-12-07 13:25:39 -05:00
Scott Kostyshak
2713ea5189 ctests: log fixed upstream polyglossia issues
Thanks to Jürgen for fixing these upstream Polyglossia regressions.
2021-12-07 13:05:52 -05:00
Scott Kostyshak
d4678a734a ctests: log a fixed issue 2021-12-05 22:07:06 -05:00
Scott Kostyshak
2dd9e1a338 ctests-costs-benefits: add a "benefit" row
The "benefit" row gives the amount of days in-between when an issue
is found because of the ctests and when an issue is reported by
someone not using the ctests. In the example of the ps2pdf flag, the
issue was reported just a couple of weeks after we found it with the
ctests, indicating that the ctests were not that helpful in this
case.
2021-06-21 12:57:38 -04:00
Scott Kostyshak
ef05c951ca ctests: log a reported issue (the ps2pdf flag)
We are still not sure how to fix things to make them more easy for
the user.
2021-06-21 12:56:37 -04:00
Scott Kostyshak
37bce91a8b ctests: log a fixed LaTeX package issue (noweb) 2021-06-20 00:05:42 -04:00
Scott Kostyshak
88eff03860 ctests: uninvert two Hebrew LuaTeX tests
The issues seem to have been fixed upstream and the exports now
succeed on TeX Live 2021.
2021-05-29 00:22:35 -04:00
Scott Kostyshak
e0a12aa3a7 ctests: log a fixed issue 2021-05-28 10:35:47 -04:00
Scott Kostyshak
a2bdda5209 ctests: log a fixed issue 2021-05-26 01:21:09 -04:00
Scott Kostyshak
3ffd06fef4 ctests: log a fixed issue 2021-04-23 23:55:56 -04:00
Scott Kostyshak
4cc38f19ee ctests: log a fixed issue 2021-04-10 12:17:36 -04:00
Scott Kostyshak
e4fb24d052 ctests: invert failing tests for new ru file
The failing tests for the Russian Fancy_Colored_Boxes are likely
failing for the same reasons as the other Russian documents.
2021-03-06 20:33:53 -05:00
Scott Kostyshak
cf5f4c2061 ctests: for log, specify benefit is quick fixes
In the cost/benefit log, most of the bugs would have been discovered
eventually. The benefit of a test suite is to find bugs quickly.
2021-03-06 20:09:32 -05:00
Scott Kostyshak
cecbf5f096 ctests: log a fixed issue 2021-03-06 20:09:24 -05:00
Scott Kostyshak
279cfb9162 ctests: log a fixed issue 2021-02-19 19:19:53 -05:00
Kornel Benko
092410d88d Amend c21cd7dc: Ignore epub tests for now 2021-02-18 09:34:43 +01:00
Scott Kostyshak
783be115ff ctests: uninvert 2 docbook exports now succeeding 2021-02-18 00:58:38 -05:00
Scott Kostyshak
c21cd7dc2b Revert "Revert "Cmake export tests: Add epub-format to be tested""
Rather than revert the added epub tests, it makes more sense to
ignore them. That way it is easier to flip the switch to enable
them.

Thanks to Kornel.

This reverts commit 894977b62e.
2021-02-17 22:41:40 -05:00
Scott Kostyshak
894977b62e Revert "Cmake export tests: Add epub-format to be tested"
Revert the addition of epub tests for now since a lot of them are
failing (and are not regressions).

This reverts commit 983d327fe3.
2021-02-17 11:54:02 -05:00
Thibaut Cuvelier
5297862855 DocBook: mark dates to disallow fonts inside.
One more test passes.
2021-02-14 06:08:36 +01:00
Thibaut Cuvelier
7ee196adbf DocBook: some tests start passing with double inlines fixed. 2021-02-14 05:39:24 +01:00
Kornel Benko
983d327fe3 Cmake export tests: Add epub-format to be tested 2021-02-08 11:35:27 +01:00
Scott Kostyshak
3c16d627da ctests: log a fixed issue 2021-02-08 00:13:45 -05:00
Scott Kostyshak
7d2c80d0ef ctests: log a fixed issue 2021-02-05 22:45:14 -05:00
Scott Kostyshak
86e72d57a5 ctests: invert a few ru Embedded Objects tests
Consistent with the other Russian manuals.
2021-02-05 22:08:39 -05:00
Kornel Benko
ac5534827e Cmake key-tests: These are very touchy in respect to timings
Cmake key-tests: These are very touchy in respect to timings

1.) Try to use shortcuts instead of direct command
2.) use bigger pause where needed
2021-01-29 16:11:16 +01:00
Scott Kostyshak
e581e35be3 ctests: unignore tests thanks to lyx2lyx feature
The lyx2lyx roundtrip feature added at 364532a7 fixed the
convergence of some tests so we remove them from the ignored list.
2021-01-28 13:39:23 -05:00
Scott Kostyshak
ca6051d148 ctests: log found regression and fix 2021-01-28 13:38:17 -05:00
Scott Kostyshak
9d3dcdc1f7 ctests: add found regression and fix 2021-01-28 00:27:45 -05:00
Scott Kostyshak
a660ed24dc ctests-costs-benefits: define false positive
A false positive could either be "not a bug" or a bug that is not
worth the time or complexity to fix. For the purpose of evaluating
the tests, the distinction is not important.
2021-01-28 00:27:45 -05:00
Scott Kostyshak
157f2d02c8 ctests: ignore lyx2lyx fails due to no convergence
These exports knowingly do not pass the convergence tests because
of ERT export.
2021-01-27 20:32:44 -05:00
Scott Kostyshak
a3f591d61e ctests: log cost of recent false positive 2021-01-26 13:29:23 -05:00
Scott Kostyshak
d3065ceeb3 Start a log file to track benefit/costs of ctests
The ctests are not convenient tests. In this file we can attempt to
log the benefits and costs to using them so we can periodically
evaluate which tests we should keep and which we should get rid of.
2021-01-26 13:21:08 -05:00
Kornel Benko
8ec16f4020 Cmake tests: findadv-01 - findadv-21 working
Tests 07 and 09 corrected because of not working
shortcuts in cua env using sk/menus.bind.
2021-01-17 14:30:34 +01:00
Kornel Benko
fd5dbd61e7 Make some findadv-tests working again, more to follow
Some shortcuts in cua do not work anymore
so replacing them with virtual shortcus for tests only
seems a good way.
2021-01-15 17:13:07 +01:00
Scott Kostyshak
fdc4f047d6 ctests: invert old lyx2lyx tests for ar Beamer
This is consistent with the lyx2lyx tests for Beamer in other
languages.
2021-01-09 13:01:26 -05:00