Commit Graph

469 Commits

Author SHA1 Message Date
Günter Milde
d319976566 ctests: sort inverted unreliable tests.
We don't invert unreliable tests for the same reason they are
inverted but, e.g., a nonstandard test that fails for some reason even with the
additional requirements installed or a test that shows wrong output
but also an error.
2017-02-26 19:37:15 +01:00
Scott Kostyshak
0d33c78963 Add references for the inverted linguistics tests 2017-02-22 11:59:20 -05:00
Kornel Benko
b01dd12c72 ctests: linguistic files and spanish UserGuide now compile
Thanks to Jürgen's \texpipa changes for linguistic.
2017-02-22 11:48:51 +01:00
Kornel Benko
b04893be44 Cmake tests: Scheherezade font misses glyph '*'
Added "export/export/latex/arabic_simple_pdf4_systemF"
and "export/doc/ar/Intro_pdf4_systemF"
to the list of tests which ignore "missing glyph" error.

Thanks to Jürgen Spitzmüller.
2017-02-22 11:33:01 +01:00
Scott Kostyshak
9fbc73c4d2 ctests: it_Customization_pdf5_systemF now compiles
An update in TeX Live causes the test to pass (also for Kornel), so
now we uninvert the test.

I looked at the output file, and it seems fine to me (although it is
long, and I just checked briefly).
2017-02-19 16:53:39 -05:00
Günter Milde
b863fb0723 ctests: update inversion patterns.
The new TeXLive uses font encoding TU for Unicode fonts with Xe- and LuaTeX.
The command \textquotedbl for straight quotes is no longer supported,
\textipa no longer supported with LuaTeX.
Problems with Spanish Babel and Xe/LuaTeX with 8-bit fonts lead to new errors
in some cases.
2017-02-14 22:31:12 +01:00
Tommaso Cucinotta
7eb64211b0 Revert "Long time no use of the autotests machinery, needs an update."
Pushed by mistake ... not finished yet ... apologies.

This reverts commit be79d2cda8.
2017-01-25 03:13:14 +01:00
Tommaso Cucinotta
be79d2cda8 Long time no use of the autotests machinery, needs an update. 2017-01-25 03:10:56 +01:00
Kornel Benko
40e6035d94 Cmake tests: Use correct 'if' statement to handle language strings 2017-01-14 12:54:08 +01:00
Kornel Benko
b487e2b050 Cmake tests: Allow ignoring some latex error messages
New file: ignoreLatexErrorsTests
The sublabels in this list of export-testnames specify which error
messages should be ignored.
For each sublabel (for example "xxx") the lyx-command line is expanded with
  "--ignore-error-message xxx"
2017-01-11 10:15:13 +01:00
Kornel Benko
0da3824cf6 Cmake tests: Remove use of 'UNRELIABLE' label
Using this label in invertedTests expands the testname unnecessary, so that
we get e.g. labels like:
  SUSPENDED.UNRELIABLE.WRONG_OUTPUT.UNRELIABLE_export/doc/de/EmbeddedObjects_pdf4_texF
OTOH, if using label 'unreliable', we get a warning about label-names clash.
The best is to reset any previous label setting.
2016-12-20 16:26:07 +01:00
Scott Kostyshak
920f4eb50d ctests: invert two unreliable tests
Invert the following two tests:

  UNRELIABLE.WRONG_OUTPUT_export/doc/es/Math_dvi3_texF (Failed)
  UNRELIABLE.WRONG_OUTPUT_export/doc/es/Math_pdf5_texF (Failed)

For discussion, see:

https://www.mail-archive.com/search?l=mid&q=1482080739.2685.14.camel%40lyx.org
2016-12-18 12:43:20 -05:00
Günter Milde
418016bf79 Remove unsupported encoding "pt254".
This encoding (modified Mac Cyrillic for Asian languages) is rarely used and not supported by Gnu iconv.

Update comments in lib/encodings.

Update ctests: Gnu iconv only supports cp858, if configured with "--enable-extra-encodings".
2016-12-06 14:04:50 +01:00
Scott Kostyshak
67094dd6e6 ctests: require up-to-date TeX Live for reliable
The unreliable sublabel varying_versions is now defined to be about
versions other than TeX Live, because we require a full and
up-to-date TeX Live installation for reliable tests.

For discussion, see:
https://www.mail-archive.com/search?l=mid&q=o1ovd9%24479%241%40blaine.gmane.org
2016-12-03 00:39:01 -05:00
Scott Kostyshak
e8844b87ee ctests: invert ar/Tutorial_pdf4_texF
ar/Tutorial.lyx was recently added at f0bc4d43.

Inverting this test is consistent with ar/{Intro,Shortcuts}.
2016-12-01 23:49:05 -05:00
Scott Kostyshak
2d7fd45b90 ctests: uninvert mathmacro tests
These tests now pass (uninverted), likely due to b14e9d52 and
e8f480e7.
2016-12-01 23:37:36 -05:00
Günter Milde
a0ebae829c ctests: univert aas_sample with LuaTeX test.
The missing character problem is fixed upstream.

Also fix the scaling of the \sun-symbol-index by wrapping the symbol in \text.
(wasysym's \sun is valid in text and math mode. LyX  currently adds a spurious \ensuremath.)
2016-12-01 11:47:12 +01:00
Scott Kostyshak
795fa586a9 Invert failing unreliable tests
These tests are "unreliable" and thus their export status contains
less information than reliable tests. However, it contains some
information and could still be used to find regressions. This commit
helps keep the output of a vanilla "ctest" command clean.

See discussion here:
https://www.mail-archive.com/search?l=mid&q=20161127205800.epvjxkeri5yoeqwj%40steph
2016-11-30 09:45:11 -05:00
Kornel Benko
f09cc78a9c Cmake tests: make unreliable tests independent of inverted tests 2016-11-30 00:53:31 +01:00
Günter Milde
ffe4471700 ctests: update invertedTests. 2016-11-25 18:23:12 +01:00
Scott Kostyshak
7cbbf00eaf Improve ctesting of Arabic documents
- invert the currently failing tests
- add a new test document that shows LyX's support of pdf2

For more details, see the discussion here:
https://www.mail-archive.com/search?l=mid&q=20161114035123.s5lt4ib4x4obtptp%40steph
2016-11-24 23:10:16 -05:00
Günter Milde
5fba6aed21 ctests: correct inversion pattern for utf8-cjk tests. 2016-11-24 11:53:18 +01:00
Günter Milde
f174988b7f ctests: correct encoding tests
* Do not test encodings not supported by iconv (see #10502).
* uninvert export test that work.
2016-11-23 17:43:31 +01:00
Günter Milde
a5b5141c30 ctests: uninvert exports that work. 2016-11-22 11:47:12 +01:00
Günter Milde
15fd79201e lib/unicodesymbols tests and fixes.
Test unicodesymbols for most supported input encodings with Kornel's addition to ctests.

Add required "forces" to unicodesymbols:
* utf8x does not support all characters supported by LyX
* several 8-bit encodings map characters to math-mode commands - force replacement in text-mode so that LyX can wrap them in \\ensuremath.

Fix a misalignment (wrong replacements) in the Cyrillic Unicode block.

Use \\mathscr for Mathematical Script characters in Mathematical Alphanumeric Characters (in line with the characters in other unicode blocks.
2016-11-15 23:50:41 +01:00
Günter Milde
1ff4aeaf1f Complete the renaming of a ctest sample directory.
Rename the directory for test samples  "export/latex/Unicode-characters" to "export/latex/unicodesymbols". This matches the purpose to test the lib/unicodesymbols file.
2016-11-14 14:32:46 +01:00
Scott Kostyshak
b765d86692 ctests: mark 4 LuaTeX + poly tests as TeX issues
These tests were broken from the fix at 3374b854.

The bug was reported upstream:
https://github.com/reutenauer/polyglossia/issues/163

For more details, see ML discussion:
https://www.mail-archive.com/search?l=mid&q=1478004223.2367.5.camel%40lyx.org
2016-11-13 22:08:19 -05:00
Kornel Benko
3ade00683c Cmake export tests: Check exports also for different possible input encodigs
Affected are all lyx files in "autotests/export/latex/Unicode-characters" directory.
This completes the commit 6674a91573

Thanks Günter.
2016-11-10 00:56:49 +01:00
Günter Milde
6674a91573 lib/unicodesymbols test update and fixes.
First run of Kornels patch for tests with all input encodings in lib/encodings.

Remove redundant sample files - keep only one sample and change the input encoding in the test script.

Put remaining failing test in "unreliableTests" for later sorting...
2016-11-09 21:15:14 +01:00
Günter Milde
120e84af3a ctests: explore export failure of Math.lyx with Unicode fonts. 2016-10-17 10:36:45 +02:00
Kornel Benko
90adb4f314 Cmake export tests: Introduce 'LYX_DEBUG_LATEX' environment variable.
Setting this variable to '1' will include also latex messages in
ctest log file LastTest.log.
2016-10-12 14:35:23 +02:00
Günter Milde
971025b80d custom ctest sample: Accented Cyrillic characters fail if the input encoding is ASCII. 2016-10-11 00:38:17 +02:00
Günter Milde
16c26f909c seminar ctest fixes
* custom non-tex fonts with all required characters
* use 2.2 fileformat (easier backporting)
* test all export formats

Also, fix pattern for "mixing_inTitle_layouts" in unreliableTests.
2016-10-10 14:14:33 +02:00
Günter Milde
e9fcff1261 ctests: uninvert solved problems and make samples robust
Specify non-TeX fonts that work in the source for documents that
fail with "missing characters" if compiling with "non-TeX fonts"=true.
(This does not interfere with the default output in any way.)
2016-09-29 10:42:03 +02:00
Günter Milde
08f5fb1b2d ctests: move test cases with permanent problems to "ignored".
Also sort ignoredTests (even if the sublabels will normally not be shown).
2016-09-26 22:57:41 +02:00
Günter Milde
63f41711cb Fix #10394 Do not error on missing characters in "nullfont".
Add an exception to the conversion of "missing character" warnings into errors.

The PGF package deliberately uses the dummy font "nullfont" to suppress output.
Therefore, warnings about missing characters in "nullfont" are really only warnings.

Also updated the comment: "Missing character" warnigns are especially widespread
in XeTeX/LuaTeX but can also happen with "classical" 8-bit TeX.

Feel free to port this to branch.
2016-09-23 09:04:03 +02:00
Günter Milde
11a036b871 ctests: found reason for "seminar" failure. 2016-09-22 23:54:18 +02:00
Günter Milde
6b60e6811b ctests: update labeling patterns. 2016-09-22 12:09:39 +02:00
Scott Kostyshak
5997a2c151 ctests: invert 'id_UserGuide_dvi3_systemF'
This is consistent with the LuaTeX systemF test also being inverted.
The log notes that:

  Language bahasai not found in language.dat.lua
2016-09-18 16:26:20 -04:00
Scott Kostyshak
b61100d905 Fix ctest inversions of ja_wrong_auto_encoding.lyx
I think that when ja_wrong_auto_encoding.lyx was moved the inversion
regex did not match correctly.
2016-09-18 09:56:09 -04:00
Günter Milde
d7d23934bc ctests: rename pattern file "suspiciousTests" to "invertedTests". part 2 2016-09-16 21:02:18 +02:00
Günter Milde
27420e84ad ctests: rename pattern file "suspiciousTests" to "invertedTests". 2016-09-16 12:10:48 +02:00
Günter Milde
f957d32ed3 lib/unicodesymbols tests and fixes: Block Miscellaneous Symbols.
* add \Coffeecup and \Wheelchair

* add "force=utf8" where required

* uninvert tests: ctest works again after Kornel fixed the problem in 9f1b80a2af
2016-09-16 12:10:48 +02:00
Kornel Benko
9f1b80a2af Cmake tests: Use mkpath from module 'File::Path' to recursively
create the directory path.
2016-09-15 21:55:47 +02:00
Günter Milde
d1300ad1c6 Remove inversion of tests failing because of LuaTeX bug now solved upstream. 2016-09-15 21:05:31 +02:00
Günter Milde
d1a41a9bdc ctests: Test dedicated LaTeX test samples with LaTeX export only.
Move them to a subdir, ignore this subdir for other tests.

Dedicated test samples for LaTeX-specific problems don't give additional value if tested for loading, conversion, or other exports.
2016-09-15 17:18:47 +02:00
Günter Milde
827450200f Remove pattern for tests that failed due to stale config files. 2016-09-13 19:44:09 +02:00
Günter Milde
32b65a8ee5 ctests: samples for lib/unicodesymbols: only test export to 8-bit LaTeX. 2016-09-10 12:35:51 +02:00
Günter Milde
a6c6bbabe9 ctests: Move tests failing only with newest luatex to unreliableTests. 2016-09-10 12:35:51 +02:00
Günter Milde
dc378b523d ctests: More inversions
* Polyglossia + LuaTeX + \verb bug with Cyrillic and Greek
* PDF(LuaTeX) Intro.lyx (reports png without bounding box)
2016-09-07 23:27:16 +02:00
Günter Milde
ffd80caa18 ctests: one more languagenesting sample 2016-09-07 23:27:16 +02:00
Günter Milde
5fd56eb9ad fr/UserGuide: remove spurious language switch in an index inset.
This led to errors when compiling with polyglossia (and non-TeX fonts).
A minimal (currently non-compiling) test sample is kept in autotests/export/
and inverted in suspiciousTests.
2016-09-07 23:27:16 +02:00
Günter Milde
c74fbfbb68 ctests: "nonstandard" tests are now listed in unreliableTests
... under the sublabel "nonstandard".
2016-09-06 16:46:27 +02:00
Günter Milde
699cfea174 ctests: invert tests due to Polyglossia + LuaTeX + verb bug with Cyrillic 2016-09-06 16:43:41 +02:00
Scott Kostyshak
0c2f1310cb ctests: xy package has issue with newest LuaTeX
LuaTeX export of docs with xy package are now marked as having TeX
issues. Hopefully these will be fixed in a TL package update.
2016-09-02 21:21:36 -04:00
Scott Kostyshak
7fd60406df ctests: ignore obsolete aastex.cls
aastex.cls is obsolete and replaced by aastex6.cls.

This is consistent with how we treat the obsolete latex8.sty.
2016-09-02 11:25:35 -04:00
Scott Kostyshak
c7de1a4e2b ctests: mark failing LyXHTML tests as "lyxbugs"
For more information, see #10355.
2016-09-01 23:27:11 -04:00
Scott Kostyshak
584d123bc7 ctests: uninvert three tests
These exports now succeed, and manual inspection of the output
confirms there are no obvious problem.
2016-09-01 22:56:11 -04:00
Scott Kostyshak
95ba824283 ctests: update tests to reflect lualatex fixes
europeCV and modernCV examples can now be exported to PDF using
LuaTeX. For the specific output that was fixed, look at the diff and
see the description in suspiciousTests that was removed by this
commit. The output was checked manually and appears fine. These
tests are thus "uninverted".

Exporting those examples to DVI with LuaTeX does not exit with
error, but the output drops characters with accents. Thus, these
tests are now marked with the "wrong_output" label. I reported this
issue on the LuaTeX mailing list at [1], but since DVI export is not
given high priority, I don't expect much action.

Note that these changes reflect an updated TeX Live 2016
installation.

[1]
https://www.mail-archive.com/search?l=mid&q=20160831134006.4fewxothddqfeyw4%40steph
2016-09-01 17:21:06 -04:00
Kornel Benko
a9a45344b8 Cmake build: Add format V2.2 to export tests 2016-08-29 18:14:37 +02:00
Scott Kostyshak
591e584b7d Add a wrong_output ctest for mixing inTitle #10347
As of 0b1cf133 we now warn in the GUI of this issue, but there is a
discussion about whether we should change our LaTeX output and allow
for the workflow of mixing inTitle layouts. For more information,
see #10347.
2016-08-26 11:39:33 -04:00
Scott Kostyshak
2b6f822bad Add CMake flag for keytests and disable by default
The keytests were previously enabled by default if the necessary
dependencies were found. They require a GUI and mouse so can
sometimes be annoying. Further, they are not currently reliable.
They are thus now disabled by default.
2016-07-13 04:52:46 -04:00
Kornel Benko
582f225aca Testcase now OK after fixing #8022 2016-07-10 11:06:01 +02:00
Günter Milde
b170b6e40f fix #10199 Non-encodable characters with XeTeX and utf8-plain
XeTeX with TeX fonts is only safe with ASCII input encoding (see #9740)
and we therefore force "ascii" when exporting with XeTeX and 8-bit TeX-fonts.

However, "utf8-plain" is a "power-user" option, which allows to switch off LyX's 
encoding of the LaTeX file: 
keep this also for "XeTeX with TeX fonts".

The user is responsible to ensure all characters can be processed and are 
correctly shown in the output. The provided test sample shows the problems
with this encoding without special measures (like loading fontspec in the
user-preamble or a document class).
2016-06-11 13:57:24 +02:00
Kornel Benko
246d4bdf66 Cmake export tests: Added testcases for erroneous xhtml exports 2016-05-31 09:13:35 +02:00
Kornel Benko
30ef73ab66 Cmake xhtml export tests: Missing script for commit 4162424762 2016-05-30 10:22:59 +02:00
Kornel Benko
4162424762 Cmake xhtml export tests: Use command xmllint to test the export result 2016-05-30 09:50:22 +02:00
Kornel Benko
6823115d17 Cmake tests: Allow test of LongestLabelWithUnderscore_xhtml 2016-05-30 09:46:01 +02:00
Günter Milde
b4dcad83b2 New layout for aastex6.cls. Fixes #10027.
Some more work for new and improved styles optional.
2016-04-08 21:34:23 +02:00
Kornel Benko
454b83694a Cmake export tests: Allow also '_' char as part of ctest-label
Missed in previous commit
2016-03-26 13:16:46 +01:00
Kornel Benko
41447b1225 Cmake export tests: Label handling
In collaboration with Günter Milde:
1.) Allow char ':' be part of a ctest-label
2.) Eliminate redundant label naming and directory names
    (The testnames should not repeat the directory name)
2016-03-26 13:06:14 +01:00
Scott Kostyshak
a28178ba38 ctests: uninvert 3 tests that pass due to updates
When updating to the latest TeX Live revision, these exports now
succeed.

Inspecting the differences between the "good" PDF and the "bad" PDF
(where the test failed) there are three differences, which can be
found on the printed page numbers 81 and 82 (PDF page numbers 91 and
92). The accented i in "lím" was printed incorrectly (and the
missing glyph was correctly detected). After the update the
character is printed correctly and there is no longer an error.

The package that caused the change is likely babel or babel-spanish.
You can see the log from the TeX Live update that caused the fix by
seeing the attachment to the message here:

https://www.mail-archive.com/search?l=mid&q=20160313015902.lny3g5aujh4c4aps%40scott-Za1510
2016-03-17 11:34:15 -04:00
Günter Milde
d0ef6afac0 cmake autotests: label aastex tests as unreliable
document class aastex.cls replaced by aastex6.cls
(in CTAN and TL 2015-update around march 2016)
New layout required, see #10027
2016-03-17 08:13:45 +01:00
Kornel Benko
8e267a7315 Cmake export tests: Initalize the output variable 'inverted' in macro 'matetestname()'
It could happen that the variable was set in creating a previous test-case.
Some combinations in the controlling files (suspiciousTests, unrelibleTests, ...)
did not set this variable.
2016-03-17 00:36:02 +01:00
Günter Milde
fa75f57603 ctest export tests: document requirements.
Add suggestion for policy for "reuse" of documentation files.
2016-02-01 23:56:37 +01:00
Kornel Benko
6169e26ee6 Cmake export tests: ACM-siggraph tests added to unreliableTests
They use package acmsiggraph, which is not on CTAN.
2016-01-28 13:06:59 +01:00
Günter Milde
26ed48a542 Invert and document test for "longest labeling label" problem.
Fails for known reason.
2016-01-24 21:06:45 +01:00
Günter Milde
26a3f46388 Use \inputencoding auto for examples/aas_sample.lyx
Also sort and commen related ctest pattern.
2016-01-18 09:01:28 +01:00
Günter Milde
d23227782d ctests: label tests with not-on-CTAN requirements as "nonstandard". 2016-01-18 09:01:28 +01:00
Kornel Benko
cdc985d037 Cmake export tests: Improve font selection 2016-01-09 22:07:32 +01:00
Kornel Benko
92f46d7aaa Cmake export tests: Really supply own system fonts only if not specified in document. 2016-01-09 19:49:23 +01:00
Günter Milde
710f284f12 ctest: Fix an inversion filter-pattern. 2016-01-09 18:30:22 +01:00
Günter Milde
7318c167b8 ctests: Hebrew does not currently work with LuaTeX. 2016-01-09 11:10:23 +01:00
Günter Milde
24578ff6f0 ctests: sort "suspiciousTests" patterns, Math working again.
* sort and comment remaining unsorted filter patterns in suspiciousTests
  (mostly just move to TODO and state what needs to be done).

* comment the patterns for achemso and Math,
  (LuTeX incompatibility fixed in TeXLive 2016-01-07).
2016-01-08 22:52:28 +01:00
Günter Milde
3a70340a95 Use polyglossia also with DVI (LuaTeX).
Simplify the logic for language package selection and make it more consistent:

Use polyglossia with non-TeX fonts (system fonts/Unicode fonts) for all
export flavours (XeTeX, LuaTeX, DVI-LuaTeX), if the language package setting
is "auto" and there is no language not supported by Babel and no package
providing Babel.

This solves some Babel-related autotest cases and leads to some new failures
due to the polyglossia language nesting problem.
2016-01-08 22:52:28 +01:00
Günter Milde
d7ff8c6e18 ctests: address some test failures.
* missing characters in linguistics example with system fonts
* language nesting problem in fr/linguistics example
* 110f505b63 solved one failure (Basque example file)
2016-01-07 18:10:22 +01:00
Günter Milde
15ffc2b01c ctests: solve one todo item. 2016-01-06 14:59:20 +01:00
Günter Milde
1fdab5e038 ctests: next round of sorting. 2016-01-06 14:59:20 +01:00
Günter Milde
fb11ac511f ctests: hebrew PDF (LuaTeX) works.
Works with system-fonts due to font substitution in the test-script.
TODO: set system fonts that work in the lyx source(s) to allow compilation
"by hand".
2016-01-05 17:07:15 +01:00
Günter Milde
8cc9028b84 ctests: ignore docbook_article latex export. 2016-01-05 17:07:14 +01:00
Kornel Benko
1fbcd26d8f Cmake export tests: these cases will probably not be corrected in near future
testcases_speed_lyx21 added to suspiciousTests
	Handling unknown body token: `\begin_manifest'at line ...
Literate_lyx16 and noweb2lyx_lyx16 added to ignoredTests
	Plenty of warnings (~ 390)
2015-12-31 15:05:33 +01:00
Günter Milde
0e8121ca31 Moving a testcase that does not fail but has wrong output to unreliableTests. 2015-12-30 21:59:32 +01:00
Günter Milde
c9e01ec087 Review and sort inverted autotests. Still more. 2015-12-30 19:15:16 +01:00
Günter Milde
3ae1eafff3 Review and sort inverted autotests. Still more to do. 2015-12-30 14:49:52 +01:00
Günter Milde
dcab6c8749 Review and sort inverted autotests. Next lot.
New sublabels LyXBug, ERT.
Renamed sublabel TeXLimit to TeXissue.

More sorting and unification of regular expressions.
Removing double entries.
Fixes for some expressions (eu_UserGuide_pdf,  examples/ja/(knitr|lilypond|sweave))
2015-12-30 08:47:38 +01:00
Kornel Benko
c944215d53 Cmake export tests: doc/ja/EmbeddedObjects.lyx compilable again 2015-12-29 19:36:36 +01:00
Kornel Benko
9560941f9a Cmake tests: Handle windows line endings 2015-12-29 19:12:08 +01:00
Kornel Benko
ccace057b4 Cmake export tests: Invert also test mathmacros/testcases_speed_lyx16 2015-12-29 13:55:32 +01:00
Kornel Benko
315b9fcb2a Cmake tests: Simplify test logic for exporting to formats lyx[0-9][0-9]x
Since the stop condition is that the last two consecutive created
files are identical, we do not need to check the last file.
Also checking for load of the created files is not needed, because
exporting the previous file implicitly loads too.
2015-12-29 13:23:08 +01:00
Günter Milde
b0970a3540 Review and sort some more inverted autotests. 2015-12-28 21:29:58 +01:00