Commit Graph

236 Commits

Author SHA1 Message Date
Kornel Benko
2df6340c1c Cmake tests: Set also correct sequence of tests again. 2014-09-03 12:35:40 +02:00
Kornel Benko
d97c34f4fe Cmake tests: Disable keytests if missing needed input files
The files first-time-in.txt and hello-world-in.txt are used
as first tests to initialize the test environment for the other
keytests.
2014-09-03 12:25:28 +02:00
Kornel Benko
6767052bba keytest.py: Allow for LyX window to appear without timeout
Timeout for lyx-process to appear may be significantly smaler.
5 sec. looks sufficient, while lyx-window may take some time
due to configure.py.
2014-08-25 14:28:18 +02:00
Kornel Benko
e4772c103e keytests: add a timeout for LyX process to start
If the LyX window does not appear after a certain (conservative)
time, the keytest now fails. One reason that caused the LyX window
to never show up was when DISPLAY was not set. This particular case
has been fixed in <commit1hash>. This commit is meant for the more general
scenario.
(Collaboration with Scott Kostyshak)
2014-08-25 13:49:12 +02:00
Kornel Benko
f2937e676a Fix stalling of keytests when invalid DISPLAY
Before, the keytests would run infinitely if the
tests were run, e.g. through SSH without X forwarding.
To reproduce that problem, run

  DISPLAY='' ctest -R hello

This commit causes the test to correctly fail in such situations.
(Collaboration with Scott Kostyshak)
2014-08-25 13:45:32 +02:00
Scott Kostyshak
0ce8bee57f ctests: un-invert some tests after updates
David Carlisle fixed some EuropeCV issues and other updates
on TeX Live 2014 fixed a few more exports.
2014-07-01 21:18:14 -04:00
Scott Kostyshak
78b7045ed8 CMake: full path of an include needed for ver <3.0 2014-06-21 20:43:06 -04:00
Kornel Benko
7bc0a6f388 Cmake tests: Optimizing the cmake configuration time
The configuration time suffers mostly on checking, which of the export tests
is to be reverted.
1.) There is a new configuration flag now, "LYX_ENABLE_EXOPRT_TESTS.
   If not set (default) no export tests are created.
2.) If set, then the optimization halves the time needed for creation of tests.

The effect on my side:
        a.) Until now the time was:        ~ 26 seconds
        b.) The optimized time is now:     ~ 16 seconds
        c.) With not enabled export tests: ~  5 seconds
2014-06-21 21:15:54 +02:00
Kornel Benko
c9a6939ebb ctests: Use regular expressions 2014-06-19 21:04:18 +02:00
Scott Kostyshak
e11ae599ea Update ctests to reflect inputenc changes
There were changes to inputenc and luainputenc that are now
released in Tex Live 2014 that affect several exports. Some
exports that produced good PDFs now fail. Others that produced
incorrect PDFs (with gibberish) now correctly fail. Several
IEEEtran-* exports failed before and now export correct PDFs.

For more information, see

  http://tug.org/pipermail/tex-live/2014-May/035338.html
  https://www.mail-archive.com/lyx-devel@lists.lyx.org/msg184435.html
2014-06-19 10:26:15 -04:00
Scott Kostyshak
7ae0700c7e Fix a comment 2014-06-19 10:26:01 -04:00
Kornel Benko
1b3e4c73f8 Cmake tests: Added parser_tools test to the lyx2lyx group tests 2014-06-12 09:07:57 +02:00
Kornel Benko
046001e571 Make: improve detection of X11 with Qt 5
In collaboration with Scott Kostyshak:
With Qt 4 we could use Q_WS_X11, defined by FindQt4.cmake. In Qt 5,
there is no FindQt5.cmake. Instead we now define our own variable,
QT_USES_X11 by using class QX11Info available only on X11.
(http://qt-project.org/doc/qt-5/QX11Info.html)

The main consequence of this improved support is that now the keytests
can be run (ctest -R "keytest") when LyX is compiled with Qt 5.
Before, with Qt 5 we did not know if X11 was available, which is
needed by xvkbd, so the tests were not enabled. Note, however, that
many tests fail with Qt version 5.2.1 because there was a change in
the event handling mechanism in Qt that causes xvkbd to be unable to
pass capital letters (so case sensitive greps in the tests fail). This
needs to be investigated and reported.
2014-05-25 13:50:18 +02:00
Kornel Benko
b178770ce3 Cmake export tests: Parse also for nameless layouts in lyx-files 2014-05-23 11:32:19 +02:00
Scott Kostyshak
f4adfca65a ctests: reinvert a test
This test was inverted before but got lost
in the transition to regular expressions.
2014-05-10 22:29:38 -04:00
Kornel Benko
2cab2c9f72 Cmake tests: Added more regular expressions 2 2014-04-25 13:53:29 +02:00
Scott Kostyshak
f887efedf1 ctests: regex to revert two instant_preview tests
These effectively revert the following:

    export/examples/instant_preview_dvi3_systemF
    export/examples/instant_preview_pdf2
2014-04-24 10:00:36 -04:00
Kornel Benko
970d31b044 Cmake tests: Added more regular expressions 2014-04-23 13:04:37 +02:00
Kornel Benko
ae33fa9e39 Cmake tests: simplify part of the set of reverted tests using regex 2014-04-21 19:20:40 +02:00
Kornel Benko
dae08c371f Cmake tests: Allow regular expressions to select for reverted tests. 2014-04-21 19:18:42 +02:00
Scott Kostyshak
06f12532d1 Invert new tests failing outside of default format
These started failing after we implemented tests for formats
that are in the complement set to the default format (7ecbb068).
It might be worth it in the future to take a look at each individually
and see whether they are supposed to fail or if there is something LyX
can do to add support for exporting them.
2014-04-21 02:58:11 -04:00
Scott Kostyshak
55b3341fba Fix the ignored path of the JASA files
This follows a860d18b which moved the JASA file back from
being an example to a template.
2014-04-21 02:57:45 -04:00
Kornel Benko
7ecbb06888 cmake export tests.
Define new policy of what export formats to check.
Depending on default_output_format
default or unset           xhtml, dvi*, pdf*
xhtml                      xhtml
any of pfd variants        xhtml, pdf*
any of dvi variants        xhtml, dvi*
each other (like eps3)     as specified
2014-03-16 09:57:31 +01:00
Kornel Benko
59f4d0d753 ctest export: smal improvements
1.) Use of regex to ignore group of tests
2.) If default output format is pdf2(pdflatex), the try to check also
  for xelatex and lualatex
2014-03-12 17:15:07 +01:00
Kornel Benko
aea5e80f45 Typo 2014-03-10 13:39:31 +01:00
Kornel Benko
39c79a72be ctests: pdf export for korean documents
Use Nanum-font for tests to get a readable pdf with luatatex/xelatex
2014-03-10 13:33:46 +01:00
Kornel Benko
2127cde4ee Export test for french EmbeddedObjects with dvi3 and system fonts working now 2014-02-27 08:55:38 +01:00
Scott Kostyshak
7409b5e18a Fix a broken autotest
This test was broken after wrap-around search was implemented. From
what I understand, the point of the test is that search should _not_
match in this case because "ignore format" is checked by default.
Thus, a new way of testing that there was no match is to check whether
the wrap around message shows up, because the cursor is initially at
the beginning so that would mean that the entire buffer was checked.

I confirmed that the test now works by checking that it passes and
checking that it fails if "ignore format" is unchecked. Although this
test is still fragile, it is fragile in a conservative way (i.e. it
will give false failures rather than false passes). It will fail if
the Italian translation changes, if "ignore format" is unchecked by
default, or if the wrap-around mechanism changes (e.g. does not ask if
the cursor started at the beginning of the buffer).
2014-02-24 08:10:34 -05:00
Kornel Benko
f36ea42b5e Cmake build: Prepare lyx2lyx tests to use the python executable found at configure time 2014-01-31 19:10:23 +01:00
Kornel Benko
83071a2392 Ctests perl scripts: Added use of prototypes 2014-01-10 12:34:40 +01:00
Kornel Benko
10ffbd787a Cmake build: White space + simplification 2014-01-05 10:02:29 +01:00
Kornel Benko
90cb7c1492 Cmake tests for check load of lyx-files
Do not interpret reconfigure output of lyx as test-error.
2013-12-26 10:29:34 +01:00
Scott Kostyshak
6f41779f5d JASATeX: add note that it fails with system fonts
The JASATeX class is currently unmaintained. Also, this
commit moves the system font tests from inverted to ignored
(otherwise lualatex and xelatex run in infinite loops).
2013-12-25 23:28:48 -05:00
Scott Kostyshak
149cc66e69 ctests: invert the ctex TeX font test
They are not supposed to work yet.
2013-12-25 23:28:48 -05:00
Scott Kostyshak
df77b2db0e ctests: invert tests that are expected to fail
For many of these XeTeX or LuaTeX does not yet support
using TeX fonts for certain languages. The others fail
because, as Jürgen explains, they have excessive preamble
code that is only targeted at (pdf)latex.
2013-12-17 01:52:22 -05:00
Kornel Benko
997035fe66 Cmake tests: Expand export tests for luatex and xetex
Citing Scott:
In our current set up, we are currently testing XeTeX and LuaTeX
either with system fonts or with TeX fonts but never both. We should
test with both in my opinion. We will have to ignore/invert many tests
but it still seems useful. For example Günter fixed babel-greek so
that it works now with TeX fonts; and Jürgen found some errors in LyX
that were causing some of the English docs to fail with system fonts.
Currently we only test greek documents with system fonts and we only
test English documents with TeX fonts.

This change adds the missing test-cases.
2013-12-16 11:36:36 +01:00
Scott Kostyshak
e27ba681ac ctests: use Chinese roman font for zh docs 2013-12-12 23:44:41 -05:00
Scott Kostyshak
1bbf126b94 ctests: non-TeX Ukrainian+LuaTeX is not supported
https://www.mail-archive.com/lyx-devel@lists.lyx.org/msg181690.html

Thanks to Günter Milde for the advice.
2013-12-12 23:44:39 -05:00
Scott Kostyshak
a3f0ed3bc4 ctests: LuaTeX does not support Farsi yet
See (thanks to Uwe for the link):
ccb0e9e2c6

We thus invert the LuaTeX Farsi tests.

All inverted tests now have explanations for why they are not
currently expected to work.
2013-12-07 12:25:51 -05:00
Scott Kostyshak
09a5d195dc ctests: babel-greek was fixed
We can now test for regressions in the Greek docs for
XeTeX and LuaTeX export with FreeSans.

(Also some Indonesian tests were missing from revertedTests.)
2013-12-07 12:17:52 -05:00
Kornel Benko
9422053f49 Cmake test environment.
Expanded search for an image to \ecvpicture{} in the preamble.
2013-12-07 13:06:27 +01:00
Scott Kostyshak
8a4c9b60e2 ctests: invert ectaart tests
As Kornel has explained:

There is an incompatibility between luainputenc.sty and ectaart.cls.
luainputenc.sty loads luatex.sty. Both files (luatex.sty and
ectaart.cls) define the latex-command \setattribute.

These tests should be inverted because the conflict may one day be
resolved at which point we can begin testing for regressions.

(This commit also rearranges the europeCV lines to below the
corresponding explanation comment.)
2013-12-07 01:56:00 -05:00
Scott Kostyshak
033b49df13 Add note to es/europeCV.lyx and invert Xe and Lua
Export with XeTeX and LuaTeX (with either non-tex fonts or 8-bit
compatibility mode) does not work because the loading of inputenc with
utf8x is hardcoded in europecv.cls at this time.

This commit adds a note to es/europeCV.lyx explaining the problem and
inverts the XeTeX and LuaTeX tests.

See
http://comments.gmane.org/gmane.editors.lyx.devel/145896

Thanks to Günter Milde for the advice and to Ignacio García
for the translation of the note.
2013-12-06 12:13:14 -05:00
Kornel Benko
b1862cda44 Cmake test environment.
Expanded search for an image to "layout Photo".
2013-12-06 10:42:26 +01:00
Scott Kostyshak
fb034884ac Fix noweb2lyx, Literate, and listerrors examples
This is a manual lyx2lyx fix. Some of the problematic chunks
are not correctly converted with lyx2lyx so this commit manually
converts them to ERT.

For more details, see:
  http://marc.info/?t=137702744100010&r=1&w=2
2013-12-03 02:18:07 -05:00
Scott Kostyshak
8da5bccb6d ctests: ignore latex8 tests
latex8.sty is obsolete and replaced by IEEEconf.

(consistent with a6372da7)
2013-12-03 02:15:37 -05:00
Scott Kostyshak
cc89ef1c1b ctests: invert Hungarian LuaTeX tests
Similar to Indonesian LuaTeX support (see 7d705438),
"magyar" is not supported. After 2.1 is released,
the babel name of "magyar" should be changed to
"hungarian" (if others disagree then these tests
still should stay inverted).
2013-12-03 02:15:36 -05:00
Scott Kostyshak
7d70543809 ctests: invert Indonesian LuaTeX tests
The babel name of Indonesian should be changed from "bahasa"
to "indonesian". This should be done after 2.1 is released so as
to minimize potential problems such as Jürgen's example of
\addto\captionsbahasa{\renewcommand\chaptername{Foo}}

For more info, see:
http://www.mail-archive.com/lyx-devel@lists.lyx.org/msg181595.html
2013-11-29 03:10:35 -05:00
Scott Kostyshak
b9a3e2e9ce ctests: invert Greek LuaTeX tests
From Jürgen:

  LuaTeX support in polyglossia is still very new and experimental.
  I have this enhancement on the agenda for 2.2, but not for 2.1.

For more details, see:
http://marc.info/?l=lyx-devel&m=138506346715339&w=2
2013-11-28 16:28:38 -05:00
Scott Kostyshak
a43a3e31d1 ctests: invert Hebrew LuaTeX tests 2013-11-28 02:56:47 -05:00
Scott Kostyshak
0a4bb51a26 ctests: add dviluatex as a format that needs fonts
Documents in certain languages will only work with dviluatex
if fonts that support those languages are used.

This commit continues e690cfc4.
2013-11-27 07:57:31 -05:00
Kornel Benko
5f7102d2bc Cmake test build (perl): Use File::Spec->rel2abs instead of abs_path()
Problem arises on fresh build, where the destination file is not yet defined.
In that case Cwd::abs_path() returns empty string, which fatal later on.
2013-11-18 12:25:18 +01:00
Kornel Benko
e690cfc47c make test environment. Exports with luatex and xetex.
In successful cooperation with Scott Kostyshak.
We provide many lyx-documents which are not compilable with luatex or xetex.
But some of them compile, if we change the font use to non_tex_fonts.
Since this would change the appropriate source, we have to convert
it first into a save location. To make it there compilable,
we have to convert also all file references.
languages     used font
he|el|ru|uk  'FreeSans'
fa           'FreeFarsi'
zh_CN        'WenQuanYi Micro Hei'
The whole job is done with a perl script.
2013-11-17 23:17:27 +01:00
Scott Kostyshak
00fb0a3e10 ctests: invert tests failing because of #8823 2013-11-14 01:48:08 -05:00
Tommaso Cucinotta
36b6296791 Fixing previous mess with git stash (apologies). 2013-11-13 20:07:53 +00:00
Tommaso Cucinotta
a2291edac6 Now run-tests.sh captures PROGRAM_SUFFIX from config.h, in order to use the correct .lyx folder name. 2013-11-13 02:41:38 +00:00
Tommaso Cucinotta
777156e0ff Added self-sanity-check for presence of pcregrep, otherwise many (almost all) tests will fail. 2013-11-13 02:13:32 +00:00
Scott Kostyshak
1e807d5183 Add XeTeX tests
Testing with XeTeX uncovered a few bugs (e.g. Math export
was failing) and thus should be a part of the ctesting.
2013-10-09 11:31:40 -04:00
Vincent van Ravesteijn
7583a8ce25 Fix EOLs 2013-10-06 05:57:53 +02:00
Scott Kostyshak
a6372da715 Ignore latex8 PDF export tests
latex8.sty is obsolete and replaced by IEEEconf.
2013-10-01 17:30:37 -04:00
Kornel Benko
f2553ebf6c Cmake build tests: Threadsafety and test-labeling
The tests are now more robust if ctest uses '-j' (number of threads) parameter.
a.) keytests are running in sequence and in one thread only, no other thread running
b.) tex2lyx tests are locking in respect to each other
c.) Test gets one or more labels, so that we can select
        ctest -L url
  to run tests labeled url
d.) New macro settestlabel() to add labels to a test
2013-09-07 09:25:02 +02:00
Scott Kostyshak
dbd3e5a0f8 Remove diagnostic code that slipped in
I did not intend to commit this piece of diagnostic code
in a0f6b09a.
2013-09-06 22:22:23 -04:00
Kornel Benko
b94d0e35d3 Replaced some invalid urls 2013-08-28 16:50:23 +02:00
Kornel Benko
1a1ee97758 Cmake build tests: Create directory neede for testing
While testing exports, we need a directory for created mess,
which we use then as working directory.
2013-08-26 22:02:20 +02:00
Kornel Benko
acdfceac71 Cmake build tests: update comments
ignoredTests: add comment
expectedTestFailures: update the set of bad tests
2013-08-25 18:18:19 +02:00
Kornel Benko
788e2b1ac8 Cmake build tests: Unify use of userdir
While some test runns lyx-exe, we need userdir be
different from default. All relevant tests should use the same directory.
2013-08-25 11:41:10 +02:00
Scott Kostyshak
889182eb1a ctests: ignore check_load/templates/attic/latex8
latex8.sty is obsolete and replaced by IEEEconf.
2013-08-23 15:34:31 -04:00
Scott Kostyshak
a0f6b09a82 ctests: macro now deals with reverted and ignored
A single macro determines if a test should be ignored
(by returning an empty test name), and if not,
whether to revert it.

This was Kornel's idea.
2013-08-23 14:45:54 -04:00
Kornel Benko
036a78e990 Cmake tests: Allow for comments in control files
Files, which contain names of ctest-tests controling
whether they should be inverted, or ignored.
We have two such files ATM: revertedTests + ignoredTests
2013-08-23 20:25:24 +02:00
Scott Kostyshak
7affdd5764 New ctests to check for parsing and other errors
These tests load the .lyx files to see if there are
any parsing errors or other LyX errors/warnings. The
tests fail if LyX writes a line to STDERR that does not
match any of the regexes stored in filterCheckWarnings.

Thanks to Kornel for the CMake expertise and corrections.
This patch was written jointly with him.
2013-08-22 19:01:23 -04:00
Kornel Benko
48e8f93d9a Cmake build tests: be more verbose in displaying running commands 2013-08-23 00:50:42 +02:00
Kornel Benko
f416d9156e Cmake build tests: make lyx2lyx tests threadsafe 2013-08-23 00:48:58 +02:00
Kornel Benko
fc33092fd8 Cmake build: modify some tests
a) test export/templates/ectaart_pdf5 removed, because
    of incompatibility between ectart.cls and luatex.sty
b) renamed some tests to reflect their purpose
    tex2lyx2lyx/roundtrip/ => tex2lyx/cmplyx/
          # the tests are comparing files written by lyx (not by tex2lyx)
    autotests/ => keytest/
          # we are testing reactions of lyx to some key strokes
c) add tests for lyx2lyx. This is rather rudimental, in that it only
    checks for created output, error codes and error output.
d) use correct environment variable to set up the userdir for testing
2013-08-21 13:34:26 +02:00
Kornel Benko
66f1991b24 The cmake-test 'export/examples/sterrors_pdf' is now expected to pass
iff 'noweb.sty' is installed.
2013-08-16 18:23:46 +02:00
Kornel Benko
7e89a2d5b1 Make more tests compilable
revertedTestst: aa_samply.lyx compiles without change
*_Additional.lyx: bad include path after moved to attic
2013-08-14 14:24:20 +02:00
Scott Kostyshak
1d3e77b515 tests: 'default' 'default_output_format' if none
When deciding which output formats to test, if we do not find a
'default_output_format' we assume it is set to 'default'.

For discussion, see:
http://www.mail-archive.com/lyx-devel@lists.lyx.org/msg180536.html
2013-08-05 19:24:11 -04:00
Scott Kostyshak
1052732e66 Japanese docs: translations from Koji 2013-08-05 19:15:56 -04:00
Scott Kostyshak
005cc9097c revertedTests: take out some Hebrew, add Russian
The Hebrew files export fine with pdf and pdf2 when Hebrew fonts
are installed. Russian LuaTeX is not known to work.
2013-08-05 04:58:55 -04:00
Vincent van Ravesteijn
9235e82558 Fix typo 2013-08-04 16:37:24 +02:00
Kornel Benko
8ac070afb0 Cmake export tests
Some export test are known to fail. Checking them every time is cumbersome.
Now, the tests marked in file revertedTests will invert the success condition
and mark the test as INVERTED_SEE-README.ctest.

If some of the tests in revertedTests fails, this is good, and the testname
can be removed from it.
2013-08-04 14:31:47 +02:00
Kornel Benko
db3afda749 typo 2013-07-23 22:39:03 +02:00
Kornel Benko
33f23ae8e5 Export tests in cmake build: Do not use the default userdir while
running lyx.
2013-07-23 21:42:44 +02:00
Vincent van Ravesteijn
f43e38fa9f CMake: xvkbd: Check whether the list exists
Instead of adding an empty element to the list, just check properly whether the list exists.
2013-07-23 20:42:53 +02:00
Vincent van Ravesteijn
d3634b6cd5 CMake: xvkbd: Fix spelling 2013-07-23 19:05:06 +02:00
Vincent van Ravesteijn
33aef1befe CMake: xvkbd: Compile fix if none of the libraries is found
If no libraries are found, XVFBDLIBS is not initialized and the command "list(REMOVE_DUPLICATES XVFBDLIBS)" fails. So, initialize XVFBDLIBS beforehand.
2013-07-23 19:04:56 +02:00
Tommaso Cucinotta
cf973b2f3a I seem to need this to let the 'Lang' keyword work, within *-in.txt files. 2013-07-23 02:10:48 +01:00
Kornel Benko
f4bc391925 Cmake build xvkbd: add xmu to the list of libraries to bind with.
This is needed (because of DSO) on ubuntu 13.04.
2013-07-13 22:45:05 +02:00
Kornel Benko
5431b41d22 Cmake build key tests: Omit the tests and creation of xvkbd command,
if not all needed libs or programs are available.
This error is now not fatal.
2013-07-13 22:44:56 +02:00
Kornel Benko
fda7721e4a Cmake tests: use multiple log files for multiple test-cases 2013-05-21 19:54:20 +02:00
Kornel Benko
82bca55a1f Typo 2013-05-21 13:26:26 +02:00
Scott Kostyshak
060bac3401 Add autotests for #8684
(these should currently fail)
2013-05-20 18:52:16 -04:00
Tommaso Cucinotta
712e1871ca Added regression test for simple use-case documented in Advanced F&R manual.
findadv-re-05 with ignore format fails, whilst findadv-re-06 not ignoring format succeeds, as of now.
2013-04-29 00:48:43 +01:00
Scott Kostyshak
60ed90f0ae Add another test for #7673 (currently fails) 2013-04-04 06:58:42 -04:00
Scott Kostyshak
36da271b74 Add test for #8370 (not yet fixed) 2013-04-04 06:31:00 -04:00
Scott Kostyshak
9ff4dc4258 Clean up CMake testing code
Thanks to Kornel for the advice.
2013-03-04 11:39:12 -05:00
Scott Kostyshak
e4a72659b0 Re-add MergedManual test
Now that the default format is set to xhtml, there will correctly
be no LaTeX test.
2013-03-04 07:18:11 -05:00
Scott Kostyshak
cc30e79c32 Tests: take into account a default format of xhtml
The xhtml format is always tested, regardless of the default format.
Without this, if the default format is xhtml, CMake gives an error
when trying to add the xhtml test because it was already added.
2013-03-04 07:15:52 -05:00
Kornel Benko
f520df382d Remove MergedManuals.lyx from export tests 2013-03-01 17:13:29 +01:00
Scott Kostyshak
6c15b944b1 Remove keytest.py code from export.cmake
Export tests do not need keytest.py.
2013-03-01 07:15:37 -05:00
Scott Kostyshak
28104a7496 Add templates to export tests (CMake & autotools) 2013-02-21 08:25:13 -05:00