Commit Graph

516 Commits

Author SHA1 Message Date
Kornel Benko
7c72823061 keytests: Shorten the output of wrong matches to 10 lines 2017-05-19 12:58:32 +02:00
Kornel Benko
b8eecc2108 keytests: amend 8f74cac381 2017-05-19 12:56:43 +02:00
Kornel Benko
0abdc3dd59 keytests: Handle function-keys for xvkbd too
Function keys are sent to xvkbd as e.g. \[F15], so we should
not split a sequence like "\C\[F15]" into two text pieces.
(Do it like other keys not having a digit in their name (e.g. \[Return]) )
2017-05-19 12:52:59 +02:00
Kornel Benko
8f74cac381 keytests: Add more controls for the *-in.txt files
The controls are described in hello-world-in.txt as
Cr: not expected regex search pattern before next expected match
Cp: not expected search pattern before next expected match

See also findadv-re-04-in.txt for an example
In this test-case, searching for case sensitive and format considering
search is failing.
2017-05-18 13:05:36 +02:00
Kornel Benko
46e472dcf9 keytests: Allow controlfile (used by searchPatterns.pl) to be opened for 'append'
This allows collecting search strings of multiple tests in one file
2017-05-18 00:03:50 +02:00
Scott Kostyshak
8180b9f97c ctests: invert doc/fr/EmbeddedObjects_pdf4_texF
This test started failing after 8bf3d7bb. I did not look deeply into
why, because the corresponding de and es tests were already
inverted, and because in general we do not expect texF tests to work
well.
2017-05-17 15:18:29 -04:00
Kornel Benko
3bdffab7c8 keytests: Polishing 2017-05-17 13:52:54 +02:00
Kornel Benko
09e5acba11 keytests: Rewritten to use searchPatterns.pl instead of pcregrep
Also corrected output of keytest.py. Messages from called
programs were output to stdout wile own printed messages
were still cached.
2017-05-17 12:12:55 +02:00
Kornel Benko
80bc39ebc9 keytests: Extend the search algorithm to pattern with more as 2 lines 2017-05-16 16:45:18 +02:00
Kornel Benko
9b14eb16f5 keytests: Use flush stdout before exiting
Without the flush, often messages are lost at test-end
2017-05-16 13:01:43 +02:00
Kornel Benko
d870a0f2fd keytests: Added some new controls for the *-in.txt files
The controls are described in hello-world-in.txt as
CO: for control file open for write
CN: control notice
CP: simple search pattern
CR: regex search pattern
CC: close control file

The control-file will be used at the end of test by searchPatterns.pl
2017-05-16 09:16:18 +02:00
Kornel Benko
36a3cca3ea keytests: New script to replace 'pcregrep' in more complex cases.
Suppose, we want to test a key sequence which should produce
logs in defined sequence. ATM, we use pcregrep to see, if
a pattern occurs in the log-file. This is OK, if using only single
tests with only one message to care about.
But it is not OK for combined tests.
As an example, the file 'findadv-combine-in.txt' is combining
tests findadv-re-01-in.txt, findadv-re-02-in.txt and findadv-re-03-in.txt.
This test runns here about 25 seconds, while the time for the other three
is about 144 secs.
(Most time is with starting/stopping lyx)
2017-05-14 18:58:55 +02:00
Scott Kostyshak
00f7a95f62 ctests: invert acmart check_load test
The root issue is known and was reported to maintainer.
2017-05-14 04:30:14 -04:00
Scott Kostyshak
ce390c4e49 ctests: adapt patterns to file move
ACM-siggraph was moved to obsolete folder at 5608f6fd.
2017-05-14 04:24:17 -04:00
Kornel Benko
d06191c990 keytests: Polishing the shutdown of lyx at test-end 2017-05-12 22:32:49 +02:00
Kornel Benko
d9464bfcd6 keytests: Make reading of /proc for lyx-status more robust
Often the relevant entry (e.g. /proc/xxxx/status) exists,
but is empty. This led to many tests fail, mostly at
the first tests after the start of the OS.
2017-05-12 13:55:51 +02:00
Kornel Benko
c200e49d67 keytests: Print proc-info in case lyx_status() signals "dead" 2017-05-12 11:22:05 +02:00
Kornel Benko
6afd654bb6 keytests: more tweaking
Tested with QT5.7 QT5.8 (self compiled) and QT4.8
2017-05-11 00:00:42 +02:00
Kornel Benko
bfc0b09e0c keytests: Added debug 'key' to be able to analyse test results.
There still are keys which do not make it into the lyx logfile.
For instance repeated shortcuts.
2017-05-09 21:08:52 +02:00
Kornel Benko
afd32f7843 keytests: some tweaking 2017-05-09 21:07:35 +02:00
Scott Kostyshak
faea3bdb95 Rename powerdot-example.lyx to powerdot.lyx
The file is already in the examples folder.

Similarly, rename

  examples/fr/exemple-powerdot.lyx -> examples/fr/powerdot.lyx

Consistent with 2f44afcb.
2017-05-09 06:57:55 -04:00
Kornel Benko
cee272e030 Keytests: optimize for speed.
The culprit in keytest is the possibility to lose some keystrokes.
The idead here is that the keystokes are cached by QT until some
control character is entered forcing e.g. new dialog.
So, splitting input lines at these characters should be enough
to ensure that the next chars are not lost.
2017-05-07 14:48:06 +02:00
Kornel Benko
48ecf06d9b Cmake keytests: Don't care for lyx still not finished.
The called script keytest.py already takes care of that.
2017-05-07 13:49:10 +02:00
Kornel Benko
948020d9a3 Keytests: Make logfiles unique.
Each test created log-files, but since they were not uniq it was difficult
to check what went wrong for a failed test.
2017-05-07 13:45:48 +02:00
Günter Milde
275bb44158 ctests: move issue with nomenclature insets to a dedicated test case.
iconv fails, if a nomenclature inset contains an uncodable character
This led to failure of the indonesian UserGuide in the attic.
Fix it there and add a minimal, specific test sample instead.
2017-05-04 18:05:18 +02:00
Kornel Benko
d1271f80ec Keytests: improve handling of strings to be send to xvkbd
1.) Don't modify the line as it happened at start of sendKeystringLocal()
2.) Split lines on each keysym (e.g. \[Return])
3.) Beatify the debug output of the sent text
2017-05-04 13:53:09 +02:00
Kornel Benko
c4c989b9c8 Added testcase for crash with using function word-findadv 2017-05-02 12:22:09 +02:00
Kornel Benko
4436431ea5 Remove xvkbd from cmake build.
The directory still exists because automake build refers it.
2017-04-28 11:42:50 +02:00
Kornel Benko
4495481d97 Added a testcase for #8381 (advanced find & replace for lists) 2017-04-27 13:11:21 +02:00
Kornel Benko
514bcb9d93 Keytests: Make the wrapper sendKeystring() around sendKeystringLocal() be recursive
This makes the wrapper working smoothly even for more complicated
input lines.
Also we do not need the window- parameter in call to xvkbd.
Still, there _is_ something fishy. At first run it can happen that
some keytest fail. But not reproducible at subsequent calls.
It feels like QT would cache some data and therefore lyx reacts
later faster.
This work is a result of collaboration with Tommaso Cucinotta.
2017-04-26 16:03:24 +02:00
Kornel Benko
515ca69359 keytests: Speed up some tests
The idea is, that strings going to the lyx-command-field
can be sent at full speed.
2017-04-25 17:37:25 +02:00
Kornel Benko
39d3308721 make the message about ignoring errors clearer 2017-04-24 17:44:31 +02:00
Kornel Benko
54f2d0ee22 keytests: small improvements in test speed 2017-04-24 17:43:39 +02:00
Kornel Benko
0cda6808d7 keytests: Some improvements to keytest.py
Changes are:
1.) make it python3 compatible
2.) rewritten the lyx_status() routine
3.) routines lyx_sleeping(), lyx_zombie(), lyx_dead() now depend on lyx_status()
4.) dont send keystring "\Afn" at start as it is language dependent
5.) handling of TestEnd uses now lyx-commands to stop the lyx-session.
   Use 'kill -9' only if unsuccessful
2017-04-24 17:42:24 +02:00
Tommaso Cucinotta
9824926b4c findadv: using \w instead of [[:word:]] makes test-case std::regex compatible; also, fixed UI shortcuts changes that made test fail. 2017-04-17 00:15:26 +02:00
Tommaso Cucinotta
664798128a findadv: almost all test cases, including \regex[{}, back to working with std::regex. 2017-04-17 00:15:26 +02:00
Tommaso Cucinotta
a1024781bc autotests: skip overly long export-in.sh test by default. 2017-04-16 11:26:29 +02:00
Tommaso Cucinotta
a8bb3171f1 Recovered working autotests for findadv on Linux/Ubuntu (after a long no-use time).
- from specific dependency on wish8.5, to just wish
- from checking the 2nd line of /proc/*/status, to grep-ing on sleeping (old system was failing on newer kernels)
- mode debugging and python output during tests
2017-04-15 23:38:41 +02:00
Günter Milde
ddacfc0581 ctests: test unicodesymbols also with utf8.
The the default input encoding (utf8) whas somehow dropped from
the list. Restore it with explicit naming.
2017-04-12 12:42:26 +02:00
Kornel Benko
c99e2f1fad Add label 'defaultoutput' to export tests using document default output format 2017-03-10 14:35:11 +01:00
Kornel Benko
ef05496ce9 Cmake tests: Add visual indication if a test is ignoring some latex error messages 2017-03-02 15:53:34 +01:00
Kornel Benko
513bb5dad0 Remove regex which does mot mach any test 2017-03-01 18:49:22 +01:00
Günter Milde
42e9c448b0 ctests: Fix some "unreliable" patterns. 2017-03-01 18:31:44 +01:00
Kornel Benko
b8710d8e16 Amend 34d2f3c.
Regexes in *Tests have to be specified for the whole test-names.
2017-03-01 10:04:29 +01:00
Scott Kostyshak
34d2f3cf06 Ignore missing glyphs in a test after TL update
After a TL 2016 update, a test started to fail due to missing
glyphs. For more information, see the ML thread here:

  https://www.mail-archive.com/search?l=mid&q=20170225203955.nas2qopy4l4ukyqq%40steph
2017-02-28 18:31:02 -05:00
Scott Kostyshak
2298ae05f2 Invert a pdf4 test failing because of iconv
This is consistent with other tests failing for the same reason.
For more information, see #9871 and the discussion at

  https://www.mail-archive.com/search?l=mid&q=20170228190738.cgs3tl3ny2bxiegk%40steph
2017-02-28 18:21:23 -05:00
Günter Milde
443eb7bf79 ctests: invert failing Spanish docs, tag unreliable examples.
Babel-Spanish uses utf8-autostrings if it detects Xe/LuaTeX.
This leads to wrong output and/or failures with
8bit TeX-fonts and 8-bit input encoding.
2017-02-27 23:26:08 +01:00
Günter Milde
d319976566 ctests: sort inverted unreliable tests.
We don't invert unreliable tests for the same reason they are
inverted but, e.g., a nonstandard test that fails for some reason even with the
additional requirements installed or a test that shows wrong output
but also an error.
2017-02-26 19:37:15 +01:00
Scott Kostyshak
0d33c78963 Add references for the inverted linguistics tests 2017-02-22 11:59:20 -05:00
Kornel Benko
b01dd12c72 ctests: linguistic files and spanish UserGuide now compile
Thanks to Jürgen's \texpipa changes for linguistic.
2017-02-22 11:48:51 +01:00
Kornel Benko
b04893be44 Cmake tests: Scheherezade font misses glyph '*'
Added "export/export/latex/arabic_simple_pdf4_systemF"
and "export/doc/ar/Intro_pdf4_systemF"
to the list of tests which ignore "missing glyph" error.

Thanks to Jürgen Spitzmüller.
2017-02-22 11:33:01 +01:00
Scott Kostyshak
9fbc73c4d2 ctests: it_Customization_pdf5_systemF now compiles
An update in TeX Live causes the test to pass (also for Kornel), so
now we uninvert the test.

I looked at the output file, and it seems fine to me (although it is
long, and I just checked briefly).
2017-02-19 16:53:39 -05:00
Günter Milde
b863fb0723 ctests: update inversion patterns.
The new TeXLive uses font encoding TU for Unicode fonts with Xe- and LuaTeX.
The command \textquotedbl for straight quotes is no longer supported,
\textipa no longer supported with LuaTeX.
Problems with Spanish Babel and Xe/LuaTeX with 8-bit fonts lead to new errors
in some cases.
2017-02-14 22:31:12 +01:00
Tommaso Cucinotta
7eb64211b0 Revert "Long time no use of the autotests machinery, needs an update."
Pushed by mistake ... not finished yet ... apologies.

This reverts commit be79d2cda8.
2017-01-25 03:13:14 +01:00
Tommaso Cucinotta
be79d2cda8 Long time no use of the autotests machinery, needs an update. 2017-01-25 03:10:56 +01:00
Kornel Benko
40e6035d94 Cmake tests: Use correct 'if' statement to handle language strings 2017-01-14 12:54:08 +01:00
Kornel Benko
b487e2b050 Cmake tests: Allow ignoring some latex error messages
New file: ignoreLatexErrorsTests
The sublabels in this list of export-testnames specify which error
messages should be ignored.
For each sublabel (for example "xxx") the lyx-command line is expanded with
  "--ignore-error-message xxx"
2017-01-11 10:15:13 +01:00
Kornel Benko
0da3824cf6 Cmake tests: Remove use of 'UNRELIABLE' label
Using this label in invertedTests expands the testname unnecessary, so that
we get e.g. labels like:
  SUSPENDED.UNRELIABLE.WRONG_OUTPUT.UNRELIABLE_export/doc/de/EmbeddedObjects_pdf4_texF
OTOH, if using label 'unreliable', we get a warning about label-names clash.
The best is to reset any previous label setting.
2016-12-20 16:26:07 +01:00
Scott Kostyshak
920f4eb50d ctests: invert two unreliable tests
Invert the following two tests:

  UNRELIABLE.WRONG_OUTPUT_export/doc/es/Math_dvi3_texF (Failed)
  UNRELIABLE.WRONG_OUTPUT_export/doc/es/Math_pdf5_texF (Failed)

For discussion, see:

https://www.mail-archive.com/search?l=mid&q=1482080739.2685.14.camel%40lyx.org
2016-12-18 12:43:20 -05:00
Günter Milde
418016bf79 Remove unsupported encoding "pt254".
This encoding (modified Mac Cyrillic for Asian languages) is rarely used and not supported by Gnu iconv.

Update comments in lib/encodings.

Update ctests: Gnu iconv only supports cp858, if configured with "--enable-extra-encodings".
2016-12-06 14:04:50 +01:00
Scott Kostyshak
67094dd6e6 ctests: require up-to-date TeX Live for reliable
The unreliable sublabel varying_versions is now defined to be about
versions other than TeX Live, because we require a full and
up-to-date TeX Live installation for reliable tests.

For discussion, see:
https://www.mail-archive.com/search?l=mid&q=o1ovd9%24479%241%40blaine.gmane.org
2016-12-03 00:39:01 -05:00
Scott Kostyshak
e8844b87ee ctests: invert ar/Tutorial_pdf4_texF
ar/Tutorial.lyx was recently added at f0bc4d43.

Inverting this test is consistent with ar/{Intro,Shortcuts}.
2016-12-01 23:49:05 -05:00
Scott Kostyshak
2d7fd45b90 ctests: uninvert mathmacro tests
These tests now pass (uninverted), likely due to b14e9d52 and
e8f480e7.
2016-12-01 23:37:36 -05:00
Günter Milde
a0ebae829c ctests: univert aas_sample with LuaTeX test.
The missing character problem is fixed upstream.

Also fix the scaling of the \sun-symbol-index by wrapping the symbol in \text.
(wasysym's \sun is valid in text and math mode. LyX  currently adds a spurious \ensuremath.)
2016-12-01 11:47:12 +01:00
Scott Kostyshak
795fa586a9 Invert failing unreliable tests
These tests are "unreliable" and thus their export status contains
less information than reliable tests. However, it contains some
information and could still be used to find regressions. This commit
helps keep the output of a vanilla "ctest" command clean.

See discussion here:
https://www.mail-archive.com/search?l=mid&q=20161127205800.epvjxkeri5yoeqwj%40steph
2016-11-30 09:45:11 -05:00
Kornel Benko
f09cc78a9c Cmake tests: make unreliable tests independent of inverted tests 2016-11-30 00:53:31 +01:00
Günter Milde
ffe4471700 ctests: update invertedTests. 2016-11-25 18:23:12 +01:00
Scott Kostyshak
7cbbf00eaf Improve ctesting of Arabic documents
- invert the currently failing tests
- add a new test document that shows LyX's support of pdf2

For more details, see the discussion here:
https://www.mail-archive.com/search?l=mid&q=20161114035123.s5lt4ib4x4obtptp%40steph
2016-11-24 23:10:16 -05:00
Günter Milde
5fba6aed21 ctests: correct inversion pattern for utf8-cjk tests. 2016-11-24 11:53:18 +01:00
Günter Milde
f174988b7f ctests: correct encoding tests
* Do not test encodings not supported by iconv (see #10502).
* uninvert export test that work.
2016-11-23 17:43:31 +01:00
Günter Milde
a5b5141c30 ctests: uninvert exports that work. 2016-11-22 11:47:12 +01:00
Günter Milde
15fd79201e lib/unicodesymbols tests and fixes.
Test unicodesymbols for most supported input encodings with Kornel's addition to ctests.

Add required "forces" to unicodesymbols:
* utf8x does not support all characters supported by LyX
* several 8-bit encodings map characters to math-mode commands - force replacement in text-mode so that LyX can wrap them in \\ensuremath.

Fix a misalignment (wrong replacements) in the Cyrillic Unicode block.

Use \\mathscr for Mathematical Script characters in Mathematical Alphanumeric Characters (in line with the characters in other unicode blocks.
2016-11-15 23:50:41 +01:00
Günter Milde
1ff4aeaf1f Complete the renaming of a ctest sample directory.
Rename the directory for test samples  "export/latex/Unicode-characters" to "export/latex/unicodesymbols". This matches the purpose to test the lib/unicodesymbols file.
2016-11-14 14:32:46 +01:00
Scott Kostyshak
b765d86692 ctests: mark 4 LuaTeX + poly tests as TeX issues
These tests were broken from the fix at 3374b854.

The bug was reported upstream:
https://github.com/reutenauer/polyglossia/issues/163

For more details, see ML discussion:
https://www.mail-archive.com/search?l=mid&q=1478004223.2367.5.camel%40lyx.org
2016-11-13 22:08:19 -05:00
Kornel Benko
3ade00683c Cmake export tests: Check exports also for different possible input encodigs
Affected are all lyx files in "autotests/export/latex/Unicode-characters" directory.
This completes the commit 6674a91573

Thanks Günter.
2016-11-10 00:56:49 +01:00
Günter Milde
6674a91573 lib/unicodesymbols test update and fixes.
First run of Kornels patch for tests with all input encodings in lib/encodings.

Remove redundant sample files - keep only one sample and change the input encoding in the test script.

Put remaining failing test in "unreliableTests" for later sorting...
2016-11-09 21:15:14 +01:00
Günter Milde
120e84af3a ctests: explore export failure of Math.lyx with Unicode fonts. 2016-10-17 10:36:45 +02:00
Kornel Benko
90adb4f314 Cmake export tests: Introduce 'LYX_DEBUG_LATEX' environment variable.
Setting this variable to '1' will include also latex messages in
ctest log file LastTest.log.
2016-10-12 14:35:23 +02:00
Günter Milde
971025b80d custom ctest sample: Accented Cyrillic characters fail if the input encoding is ASCII. 2016-10-11 00:38:17 +02:00
Günter Milde
16c26f909c seminar ctest fixes
* custom non-tex fonts with all required characters
* use 2.2 fileformat (easier backporting)
* test all export formats

Also, fix pattern for "mixing_inTitle_layouts" in unreliableTests.
2016-10-10 14:14:33 +02:00
Günter Milde
e9fcff1261 ctests: uninvert solved problems and make samples robust
Specify non-TeX fonts that work in the source for documents that
fail with "missing characters" if compiling with "non-TeX fonts"=true.
(This does not interfere with the default output in any way.)
2016-09-29 10:42:03 +02:00
Günter Milde
08f5fb1b2d ctests: move test cases with permanent problems to "ignored".
Also sort ignoredTests (even if the sublabels will normally not be shown).
2016-09-26 22:57:41 +02:00
Günter Milde
63f41711cb Fix #10394 Do not error on missing characters in "nullfont".
Add an exception to the conversion of "missing character" warnings into errors.

The PGF package deliberately uses the dummy font "nullfont" to suppress output.
Therefore, warnings about missing characters in "nullfont" are really only warnings.

Also updated the comment: "Missing character" warnigns are especially widespread
in XeTeX/LuaTeX but can also happen with "classical" 8-bit TeX.

Feel free to port this to branch.
2016-09-23 09:04:03 +02:00
Günter Milde
11a036b871 ctests: found reason for "seminar" failure. 2016-09-22 23:54:18 +02:00
Günter Milde
6b60e6811b ctests: update labeling patterns. 2016-09-22 12:09:39 +02:00
Scott Kostyshak
5997a2c151 ctests: invert 'id_UserGuide_dvi3_systemF'
This is consistent with the LuaTeX systemF test also being inverted.
The log notes that:

  Language bahasai not found in language.dat.lua
2016-09-18 16:26:20 -04:00
Scott Kostyshak
b61100d905 Fix ctest inversions of ja_wrong_auto_encoding.lyx
I think that when ja_wrong_auto_encoding.lyx was moved the inversion
regex did not match correctly.
2016-09-18 09:56:09 -04:00
Günter Milde
d7d23934bc ctests: rename pattern file "suspiciousTests" to "invertedTests". part 2 2016-09-16 21:02:18 +02:00
Günter Milde
27420e84ad ctests: rename pattern file "suspiciousTests" to "invertedTests". 2016-09-16 12:10:48 +02:00
Günter Milde
f957d32ed3 lib/unicodesymbols tests and fixes: Block Miscellaneous Symbols.
* add \Coffeecup and \Wheelchair

* add "force=utf8" where required

* uninvert tests: ctest works again after Kornel fixed the problem in 9f1b80a2af
2016-09-16 12:10:48 +02:00
Kornel Benko
9f1b80a2af Cmake tests: Use mkpath from module 'File::Path' to recursively
create the directory path.
2016-09-15 21:55:47 +02:00
Günter Milde
d1300ad1c6 Remove inversion of tests failing because of LuaTeX bug now solved upstream. 2016-09-15 21:05:31 +02:00
Günter Milde
d1a41a9bdc ctests: Test dedicated LaTeX test samples with LaTeX export only.
Move them to a subdir, ignore this subdir for other tests.

Dedicated test samples for LaTeX-specific problems don't give additional value if tested for loading, conversion, or other exports.
2016-09-15 17:18:47 +02:00
Günter Milde
827450200f Remove pattern for tests that failed due to stale config files. 2016-09-13 19:44:09 +02:00
Günter Milde
32b65a8ee5 ctests: samples for lib/unicodesymbols: only test export to 8-bit LaTeX. 2016-09-10 12:35:51 +02:00
Günter Milde
a6c6bbabe9 ctests: Move tests failing only with newest luatex to unreliableTests. 2016-09-10 12:35:51 +02:00
Günter Milde
dc378b523d ctests: More inversions
* Polyglossia + LuaTeX + \verb bug with Cyrillic and Greek
* PDF(LuaTeX) Intro.lyx (reports png without bounding box)
2016-09-07 23:27:16 +02:00
Günter Milde
ffd80caa18 ctests: one more languagenesting sample 2016-09-07 23:27:16 +02:00
Günter Milde
5fd56eb9ad fr/UserGuide: remove spurious language switch in an index inset.
This led to errors when compiling with polyglossia (and non-TeX fonts).
A minimal (currently non-compiling) test sample is kept in autotests/export/
and inverted in suspiciousTests.
2016-09-07 23:27:16 +02:00
Günter Milde
c74fbfbb68 ctests: "nonstandard" tests are now listed in unreliableTests
... under the sublabel "nonstandard".
2016-09-06 16:46:27 +02:00