Commit Graph

413 Commits

Author SHA1 Message Date
Scott Kostyshak
c7de1a4e2b ctests: mark failing LyXHTML tests as "lyxbugs"
For more information, see #10355.
2016-09-01 23:27:11 -04:00
Scott Kostyshak
584d123bc7 ctests: uninvert three tests
These exports now succeed, and manual inspection of the output
confirms there are no obvious problem.
2016-09-01 22:56:11 -04:00
Scott Kostyshak
95ba824283 ctests: update tests to reflect lualatex fixes
europeCV and modernCV examples can now be exported to PDF using
LuaTeX. For the specific output that was fixed, look at the diff and
see the description in suspiciousTests that was removed by this
commit. The output was checked manually and appears fine. These
tests are thus "uninverted".

Exporting those examples to DVI with LuaTeX does not exit with
error, but the output drops characters with accents. Thus, these
tests are now marked with the "wrong_output" label. I reported this
issue on the LuaTeX mailing list at [1], but since DVI export is not
given high priority, I don't expect much action.

Note that these changes reflect an updated TeX Live 2016
installation.

[1]
https://www.mail-archive.com/search?l=mid&q=20160831134006.4fewxothddqfeyw4%40steph
2016-09-01 17:21:06 -04:00
Kornel Benko
a9a45344b8 Cmake build: Add format V2.2 to export tests 2016-08-29 18:14:37 +02:00
Scott Kostyshak
591e584b7d Add a wrong_output ctest for mixing inTitle #10347
As of 0b1cf133 we now warn in the GUI of this issue, but there is a
discussion about whether we should change our LaTeX output and allow
for the workflow of mixing inTitle layouts. For more information,
see #10347.
2016-08-26 11:39:33 -04:00
Scott Kostyshak
2b6f822bad Add CMake flag for keytests and disable by default
The keytests were previously enabled by default if the necessary
dependencies were found. They require a GUI and mouse so can
sometimes be annoying. Further, they are not currently reliable.
They are thus now disabled by default.
2016-07-13 04:52:46 -04:00
Kornel Benko
582f225aca Testcase now OK after fixing #8022 2016-07-10 11:06:01 +02:00
Günter Milde
b170b6e40f fix #10199 Non-encodable characters with XeTeX and utf8-plain
XeTeX with TeX fonts is only safe with ASCII input encoding (see #9740)
and we therefore force "ascii" when exporting with XeTeX and 8-bit TeX-fonts.

However, "utf8-plain" is a "power-user" option, which allows to switch off LyX's 
encoding of the LaTeX file: 
keep this also for "XeTeX with TeX fonts".

The user is responsible to ensure all characters can be processed and are 
correctly shown in the output. The provided test sample shows the problems
with this encoding without special measures (like loading fontspec in the
user-preamble or a document class).
2016-06-11 13:57:24 +02:00
Kornel Benko
246d4bdf66 Cmake export tests: Added testcases for erroneous xhtml exports 2016-05-31 09:13:35 +02:00
Kornel Benko
30ef73ab66 Cmake xhtml export tests: Missing script for commit 4162424762 2016-05-30 10:22:59 +02:00
Kornel Benko
4162424762 Cmake xhtml export tests: Use command xmllint to test the export result 2016-05-30 09:50:22 +02:00
Kornel Benko
6823115d17 Cmake tests: Allow test of LongestLabelWithUnderscore_xhtml 2016-05-30 09:46:01 +02:00
Günter Milde
b4dcad83b2 New layout for aastex6.cls. Fixes #10027.
Some more work for new and improved styles optional.
2016-04-08 21:34:23 +02:00
Kornel Benko
454b83694a Cmake export tests: Allow also '_' char as part of ctest-label
Missed in previous commit
2016-03-26 13:16:46 +01:00
Kornel Benko
41447b1225 Cmake export tests: Label handling
In collaboration with Günter Milde:
1.) Allow char ':' be part of a ctest-label
2.) Eliminate redundant label naming and directory names
    (The testnames should not repeat the directory name)
2016-03-26 13:06:14 +01:00
Scott Kostyshak
a28178ba38 ctests: uninvert 3 tests that pass due to updates
When updating to the latest TeX Live revision, these exports now
succeed.

Inspecting the differences between the "good" PDF and the "bad" PDF
(where the test failed) there are three differences, which can be
found on the printed page numbers 81 and 82 (PDF page numbers 91 and
92). The accented i in "lím" was printed incorrectly (and the
missing glyph was correctly detected). After the update the
character is printed correctly and there is no longer an error.

The package that caused the change is likely babel or babel-spanish.
You can see the log from the TeX Live update that caused the fix by
seeing the attachment to the message here:

https://www.mail-archive.com/search?l=mid&q=20160313015902.lny3g5aujh4c4aps%40scott-Za1510
2016-03-17 11:34:15 -04:00
Günter Milde
d0ef6afac0 cmake autotests: label aastex tests as unreliable
document class aastex.cls replaced by aastex6.cls
(in CTAN and TL 2015-update around march 2016)
New layout required, see #10027
2016-03-17 08:13:45 +01:00
Kornel Benko
8e267a7315 Cmake export tests: Initalize the output variable 'inverted' in macro 'matetestname()'
It could happen that the variable was set in creating a previous test-case.
Some combinations in the controlling files (suspiciousTests, unrelibleTests, ...)
did not set this variable.
2016-03-17 00:36:02 +01:00
Günter Milde
fa75f57603 ctest export tests: document requirements.
Add suggestion for policy for "reuse" of documentation files.
2016-02-01 23:56:37 +01:00
Kornel Benko
6169e26ee6 Cmake export tests: ACM-siggraph tests added to unreliableTests
They use package acmsiggraph, which is not on CTAN.
2016-01-28 13:06:59 +01:00
Günter Milde
26ed48a542 Invert and document test for "longest labeling label" problem.
Fails for known reason.
2016-01-24 21:06:45 +01:00
Günter Milde
26a3f46388 Use \inputencoding auto for examples/aas_sample.lyx
Also sort and commen related ctest pattern.
2016-01-18 09:01:28 +01:00
Günter Milde
d23227782d ctests: label tests with not-on-CTAN requirements as "nonstandard". 2016-01-18 09:01:28 +01:00
Kornel Benko
cdc985d037 Cmake export tests: Improve font selection 2016-01-09 22:07:32 +01:00
Kornel Benko
92f46d7aaa Cmake export tests: Really supply own system fonts only if not specified in document. 2016-01-09 19:49:23 +01:00
Günter Milde
710f284f12 ctest: Fix an inversion filter-pattern. 2016-01-09 18:30:22 +01:00
Günter Milde
7318c167b8 ctests: Hebrew does not currently work with LuaTeX. 2016-01-09 11:10:23 +01:00
Günter Milde
24578ff6f0 ctests: sort "suspiciousTests" patterns, Math working again.
* sort and comment remaining unsorted filter patterns in suspiciousTests
  (mostly just move to TODO and state what needs to be done).

* comment the patterns for achemso and Math,
  (LuTeX incompatibility fixed in TeXLive 2016-01-07).
2016-01-08 22:52:28 +01:00
Günter Milde
3a70340a95 Use polyglossia also with DVI (LuaTeX).
Simplify the logic for language package selection and make it more consistent:

Use polyglossia with non-TeX fonts (system fonts/Unicode fonts) for all
export flavours (XeTeX, LuaTeX, DVI-LuaTeX), if the language package setting
is "auto" and there is no language not supported by Babel and no package
providing Babel.

This solves some Babel-related autotest cases and leads to some new failures
due to the polyglossia language nesting problem.
2016-01-08 22:52:28 +01:00
Günter Milde
d7ff8c6e18 ctests: address some test failures.
* missing characters in linguistics example with system fonts
* language nesting problem in fr/linguistics example
* 110f505b63 solved one failure (Basque example file)
2016-01-07 18:10:22 +01:00
Günter Milde
15ffc2b01c ctests: solve one todo item. 2016-01-06 14:59:20 +01:00
Günter Milde
1fdab5e038 ctests: next round of sorting. 2016-01-06 14:59:20 +01:00
Günter Milde
fb11ac511f ctests: hebrew PDF (LuaTeX) works.
Works with system-fonts due to font substitution in the test-script.
TODO: set system fonts that work in the lyx source(s) to allow compilation
"by hand".
2016-01-05 17:07:15 +01:00
Günter Milde
8cc9028b84 ctests: ignore docbook_article latex export. 2016-01-05 17:07:14 +01:00
Kornel Benko
1fbcd26d8f Cmake export tests: these cases will probably not be corrected in near future
testcases_speed_lyx21 added to suspiciousTests
	Handling unknown body token: `\begin_manifest'at line ...
Literate_lyx16 and noweb2lyx_lyx16 added to ignoredTests
	Plenty of warnings (~ 390)
2015-12-31 15:05:33 +01:00
Günter Milde
0e8121ca31 Moving a testcase that does not fail but has wrong output to unreliableTests. 2015-12-30 21:59:32 +01:00
Günter Milde
c9e01ec087 Review and sort inverted autotests. Still more. 2015-12-30 19:15:16 +01:00
Günter Milde
3ae1eafff3 Review and sort inverted autotests. Still more to do. 2015-12-30 14:49:52 +01:00
Günter Milde
dcab6c8749 Review and sort inverted autotests. Next lot.
New sublabels LyXBug, ERT.
Renamed sublabel TeXLimit to TeXissue.

More sorting and unification of regular expressions.
Removing double entries.
Fixes for some expressions (eu_UserGuide_pdf,  examples/ja/(knitr|lilypond|sweave))
2015-12-30 08:47:38 +01:00
Kornel Benko
c944215d53 Cmake export tests: doc/ja/EmbeddedObjects.lyx compilable again 2015-12-29 19:36:36 +01:00
Kornel Benko
9560941f9a Cmake tests: Handle windows line endings 2015-12-29 19:12:08 +01:00
Kornel Benko
ccace057b4 Cmake export tests: Invert also test mathmacros/testcases_speed_lyx16 2015-12-29 13:55:32 +01:00
Kornel Benko
315b9fcb2a Cmake tests: Simplify test logic for exporting to formats lyx[0-9][0-9]x
Since the stop condition is that the last two consecutive created
files are identical, we do not need to check the last file.
Also checking for load of the created files is not needed, because
exporting the previous file implicitly loads too.
2015-12-29 13:23:08 +01:00
Günter Milde
b0970a3540 Review and sort some more inverted autotests. 2015-12-28 21:29:58 +01:00
Kornel Benko
e17fdd1506 Thinko in commit a10b671317 2015-12-28 08:37:58 +01:00
Kornel Benko
b06b4095ca Cmake lyx2lyx tests: expanded ignoreTests
the entry export/templates/IEEEtran-Journal_lyx16
is added, because of (after the third roundtrip) endless loop inside "python -tt lyx2lyx ..."
2015-12-28 08:16:49 +01:00
Kornel Benko
a10b671317 Cmake lyx2lyx tests: Use a loop to execute roundtrips
Exporting to some previous lyx format:
Inside the loop
  Stop at export with errors/warnings
  Stop if exported file not loadable
  Stop if exported file identical to previous exported file (OK case)
    This is done through creating MD5SUM
2015-12-28 06:00:10 +01:00
Kornel Benko
8d1d46743b Cmake lyx2lyx tests: Add roundtrip to exported lyx-files
Until now we exported e.g. to lyx16x ans tested if the result is loadable.
Now we also test if export of the exported is loadable.
2015-12-27 20:05:37 +01:00
Kornel Benko
ddfd228dc3 Cmake check load tests: Allow tests to use the filter .*Tests
Now we can also select which lyx-file may or may not be loaded
in the same way as was for export tests.
2015-12-27 18:56:36 +01:00
Kornel Benko
91a8ae9050 Cmake export tests: Add labels 'lyx2lyx' and 'load' to tests exporting to a lyx format.
The test uses lyx2lyx and loads the exported file.
2015-12-27 18:03:54 +01:00
Kornel Benko
d0d45d4043 Cmake export tests: Add structue test for exported lyx files
We test here, if any \end_{somethig} matches \begin_{something}.
Exeptions are \end_index and \end_branch ATM, they should
match \index and \branch respectively.

Also added new testfile.
2015-12-27 14:33:11 +01:00
Kornel Benko
968f05d015 Cmake export tests: Handle some more warnings 2015-12-25 20:03:35 +01:00
Kornel Benko
ec32831cb0 Cmake export tests: Handle some lyx2lyx warnings 2015-12-25 19:02:06 +01:00
Kornel Benko
e3cd6db4a7 Cmake export tests: Check if exported lyx files are loadable
Also added tests for export to lyx21 format.
2015-12-25 10:28:40 +01:00
Kornel Benko
041bc943d7 Cmake export tests: Macro to interpret error/warning messages at loading lyx files 2015-12-25 10:26:38 +01:00
Günter Milde
f4699276b7 Specify missing character. Angström sign, not LATIN CAPITAL LETTER A WITH RING ABOVE. 2015-12-23 15:45:18 +01:00
Kornel Benko
63d9ae50ce Replace Ångström with \AA in suspiciousTests
This allows to load the file also for older cmake versions.
2015-12-23 08:05:21 +01:00
Günter Milde
1fe334f1d3 Inverted autests, sorting: some more TeX-Limitations.
Math manual with systemfonts fails because of missing characters.
PDF-forms and PDF-comments require pdflatex or lualatex.
2015-12-21 22:48:37 +01:00
Kornel Benko
7d2f4d965f Cmake export tests: Ignore some child documents 2015-12-21 11:52:00 +01:00
Kornel Benko
7ac770880d Cmake export tests: Simplify the testcase TableErr rIfSlovakTextInserted.lyx' 2015-12-21 11:42:32 +01:00
Kornel Benko
fd2995d36a Cmake export tests: Adapt the new TableErrorIfSlovakTextInserted.lyx to tests 2015-12-20 12:13:37 +01:00
Günter Milde
29e97ac38b inverted autotests: Sublabel TeXlimit
Sort test that fail due to LaTeX limitations under the new label TeXlimit.
Replaces the sublabels "chemgreek" and "assert-fail".
2015-12-19 16:49:53 +01:00
Günter Milde
a3aec58cf7 inapt autotests: update comments and labels. 2015-12-19 16:49:52 +01:00
Günter Milde
d501f76051 inverted autotests: update comments, label "attic", remove ignored tests.
Remove patterns matching tests now ignored (CJK/Korean, latex8).
Move patterns matching documents in the attic under new sublabel.
Add more verbose comments.
2015-12-19 16:49:52 +01:00
Günter Milde
b31fcb828b ignored autotests: Update comments and add Taiwanese (zh_CN) with TeX fonts. 2015-12-19 16:49:52 +01:00
Kornel Benko
e0dd541634 Cmake export tests: Adapt exports to changed mathmacros path.
Missed in last commit.
2015-12-18 10:29:55 +01:00
Kornel Benko
1a3b5a4ea7 Moved development/mathmacros dir to autotests dir 2015-12-18 07:56:20 +01:00
Kornel Benko
4e9fe808d7 Cmake export tests: Correct some quirks
1.) Label lyx2lyx was handled wrong (removed '2')
2.) tests were named '_lyx2lyx' instead of only 'lyx2lyx'
2015-12-17 12:57:34 +01:00
Kornel Benko
8876ad1035 Remove non-lyx file form tests. 2015-12-17 09:43:56 +01:00
Günter Milde
1d66b6432a Revert "autotests: Sort and review patterns for test categorization and labeling."
This reverts commit 1e06e83e30.
following the request in
http://permalink.gmane.org/gmane.editors.lyx.devel/159408
2015-12-17 07:37:07 +01:00
Günter Milde
1e06e83e30 autotests: Sort and review patterns for test categorization and labeling. 2015-12-17 00:33:44 +01:00
Kornel Benko
ffe376a647 Cmake export tests: Add missing failing tests 2015-12-16 09:56:38 +01:00
Günter Milde
2b39a82489 Cmake export tests: really *move* Spanish tests.
Deleting patterns moved to "unreliableTests" from "suspiciousTests".
Also some sorting of the patterns in suspiciousTests is done.
2015-12-15 15:40:49 +01:00
Kornel Benko
57e1320012 Cmake export tests: move spanish manuals tests for (xe|lua)latex and tex font to unreliableTests
Comment by Günter Milde:
Actually, *all* Spanish manuals either fail or have wrong output with
Unicode TeX engines and 8-bit fonts. The reason is known: a bug in Babel
that uses utf8 strings whenever Xe- or LuaTeX is detected.
2015-12-15 08:10:52 +01:00
Kornel Benko
6366b4a21b Cmake export tests: Disable inputencoding setting
It was used for the combination pdf4_texF, but since LyX should
nowadays set the correct encoding, this is not needed anymore.
2015-12-14 19:05:18 +01:00
Kornel Benko
2bd2ac1860 Cmake export tests: Lualatex does not like bahasa language 2015-12-14 18:56:00 +01:00
Kornel Benko
3ed174cc03 Cmake export tests: Handle default output format 'pdf2' in manuals like 'default'
This is, because almost all manuals are now having pdf2 as default.
2015-12-13 12:31:43 +01:00
Kornel Benko
de4d43e609 Cmake export tests: Add indonesian attic to suspended too 2015-12-13 12:30:44 +01:00
Kornel Benko
3ac20d7689 Cmake export tests: Correct handling of Indonesian Userguide
It was moved to attic in 98d7d8ba61
2015-12-13 11:49:31 +01:00
Kornel Benko
5b5b1a4515 Cmake export tests: Handle attic files with now missing references to png graphics 2015-12-10 15:20:07 +01:00
Kornel Benko
a9764cf191 Cmake build: Initialize some variables before use. 2015-12-09 15:37:58 +01:00
Kornel Benko
d4da5e9391 Wrong regex 2015-12-08 18:29:12 +01:00
Günter Milde
dd5c3900ba seminar.sty works also with non-TeX fonts but requires Babel.
Always-Babel now set in the example document.

Adapted the autotest categorization:
* fails for some developers (why?)
* wrong output with pdflatex/LuaTeX and DVI (missing landscape slides).
2015-12-08 17:46:50 +01:00
Kornel Benko
611c95bb79 Cmake export tests: Mark seminar dvi3 exports as creating wrong output 2015-12-07 19:32:07 +01:00
Günter Milde
f35861bd75 ctest automatic tests: small correcions to pattern files and documenation. 2015-12-06 21:21:46 +01:00
Georg Baum
691675ee0a Make languagenesting1.lyx less TeX dependent
The previous version did only fail because I did not have latin support for
polyglossia in my TeX installation, the LyX export was fine.
2015-12-06 20:48:48 +01:00
Georg Baum
6a165ecba2 This languagenesting1.lyx fails with 2.1
Add some stuff to languagenesting1.lyx that makes it fail with LyX 2.1 (and
2.2 as well)
2015-12-06 18:53:01 +01:00
Kornel Benko
4dd77996a1 Cmake export tests: Allow deeper label nesting.
Previously all labels got the depth '7' while processing 'suspiciousTestss'.
The depth is used to sort how our labels are used to build a test-label.

Say a test gets label a, b, and c, with depth 3, 8 and 2.
The constructed test-label will be "b🅰️c"
For new (to be implemented) 'reason-labels' it is more convenient to assign them higher values.
2015-12-05 19:37:17 +01:00
Kornel Benko
4ad2215060 Cmake export tests: Tutorial.lyx now compilable
suspiciousTests: Remove Tutorial from the regex
suspendedTests: Explicit list of languages needed
ignoredTests: Language-string is separated from other strings only by '/'. '|', '_', '(' and ')'
2015-12-04 19:33:39 +01:00
Kornel Benko
0008e36ff4 Typo 2015-12-04 19:32:09 +01:00
Kornel Benko
77dbfb0042 Cmake export tests: Some tests previously inverted pass now. 2015-12-03 14:05:20 +01:00
Kornel Benko
548a7ac364 Cmake tests: Rename label 'reverted' to 'inverted'. 2015-12-03 00:23:07 +01:00
Kornel Benko
cf3156d22d Cmake export tests: Create concatenated labels in the form 'export:reverted:examples:chemgreek' 2015-12-02 22:18:43 +01:00
Kornel Benko
e39025797e Cmake export tests: Remove label 'reverted' from suspended tests.
LyXMacros.cmake: Overseen the macro 'setmarkedtestlabel()' which added it automatically
  if the test was to invert the test result.
ExportTests.cmake: Correct label handling
2015-12-02 13:28:16 +01:00
Kornel Benko
037e9051f7 Cmake export tests: Remove assignement doing nothing 2015-11-30 13:12:30 +01:00
Kornel Benko
8f225ebdea Cmake autotests: Corrected suspiciousTests for new testfile 2015-11-30 00:42:48 +01:00
Kornel Benko
af18890ed6 Cmake export tests: Use build dir as source for _all_ latex output formats 2015-11-29 16:11:10 +01:00
Kornel Benko
2b9a9d97a6 Cmake lyx2lyx tests: Ignore warning about "no conversion needed" 2015-11-29 15:26:56 +01:00
Georg Baum
63bb24d385 Convert to 2.2 format and use TeX fonts
This works around a limitation of the test machinery, which never switches
TeX fonts on for format that need that, it only switches TeX fonts off for
formats needing it.
2015-11-29 13:16:46 +01:00
Georg Baum
2f3f82e75b Add test for language nesting regression
The new test shows a language nesting regression: With LyX 2.1 it exports fine
in all formats, with 2.2 it fails for dvi, pdf2 and pdf3.
2015-11-29 11:52:34 +01:00