anne/lyx_mirror
1
0
Fork 0
mirror of https://git.lyx.org/repos/lyx.git synced 2024-11-14 06:57:01 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
53b60462ac
lyx_mirror/development/autotests/CMakeLists.txt

279 lines
9.2 KiB
CMake
Raw Normal View History

Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
# This file is part of LyX, the document processor.
# Licence details can be found in the file COPYING.
#
# Copyright (c) 2012 Kornel Benko kornel@lyx.org
#
New ctests to check for parsing and other errors These tests load the .lyx files to see if there are any parsing errors or other LyX errors/warnings. The tests fail if LyX writes a line to STDERR that does not match any of the regexes stored in filterCheckWarnings. Thanks to Kornel for the CMake expertise and corrections. This patch was written jointly with him.
2013-08-22 22:31:54 +00:00
set(LYX_HOME "out-home")
set(LOCALE_DIR "${CMAKE_CURRENT_BINARY_DIR}/locale")
Cmake build tests: Create directory neede for testing While testing exports, we need a directory for created mess, which we use then as working directory.
2013-08-26 20:02:20 +00:00
file(MAKE_DIRECTORY "${LOCALE_DIR}" "${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}")
New ctests to check for parsing and other errors These tests load the .lyx files to see if there are any parsing errors or other LyX errors/warnings. The tests fail if LyX writes a line to STDERR that does not match any of the regexes stored in filterCheckWarnings. Thanks to Kornel for the CMake expertise and corrections. This patch was written jointly with him.
2013-08-22 22:31:54 +00:00
Cmake build: autotests Make the export test available to all, since it is independent of X11
2012-12-12 17:23:25 +00:00
if(Q_WS_X11)
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
set(Missing)
CMake: xvkbd: Check whether the list exists Instead of adding an empty element to the list, just check properly whether the list exists.
2013-07-23 18:42:31 +00:00
set(XVFBDLIBS)
Cmake build: autotests Make the export test available to all, since it is independent of X11
2012-12-12 17:23:25 +00:00
# Make sure, the needed programs are in PATH
find_program(PCREGREP_EXE "pcregrep")
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
if (NOT PCREGREP_EXE)
list(APPEND Missing "pcregrep")
endif()
Cmake build: autotests Make the export test available to all, since it is independent of X11
2012-12-12 17:23:25 +00:00
find_program(WMCTRL_EXE "wmctrl")
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
if(NOT WMCTRL_EXE)
list(APPEND Missing "wmctrl")
endif()
Cmake build: autotests Make the export test available to all, since it is independent of X11
2012-12-12 17:23:25 +00:00
# This is needed to build xvkbd
# Programs pcregrep wmctrl and xvkbd are used in subsequent scripts
# while testing
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
# Check for needed libraries for xvkbd
# do not add autotests, if any of them is lacking
Cmake build, autotests Removed if no X11. Because X11 is needed for xvkbd but not available on some platforms (even if UNIX)
2012-12-11 15:00:59 +00:00
find_package(X11)
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
if(NOT X11_FOUND)
list(APPEND Missing "X11")
endif()
find_package(PkgConfig)
if(PKG_CONFIG_FOUND)
Cmake build xvkbd: add xmu to the list of libraries to bind with. This is needed (because of DSO) on ubuntu 13.04.
2013-07-12 09:21:13 +00:00
foreach(_lb "xaw7" "xmu" "xtst")
pkg_check_modules(${_lb}LIB ${_lb})
if(${_lb}LIB_LIBRARIES)
list(APPEND XVFBDLIBS ${${_lb}LIB_LIBRARIES})
else()
list(APPEND Missing ${_lb})
endif()
endforeach()
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
else()
Cmake build xvkbd: add xmu to the list of libraries to bind with. This is needed (because of DSO) on ubuntu 13.04.
2013-07-12 09:21:13 +00:00
foreach(_lb "Xaw7" "Xmu")
find_library(${_lb}LIB ${_lb})
if(${_lb}LIB)
list(APPEND XVFBDLIBS ${${_lb}LIB})
else()
list(APPEND Missing ${_lb})
endif()
endforeach()
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
foreach(_lb Xt XTest X11)
if(X11_${_lb}_LIB)
Cmake build xvkbd: add xmu to the list of libraries to bind with. This is needed (because of DSO) on ubuntu 13.04.
2013-07-12 09:21:13 +00:00
list(APPEND XVFBDLIBS ${X11_${_lb}_LIB})
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
else()
Cmake build xvkbd: add xmu to the list of libraries to bind with. This is needed (because of DSO) on ubuntu 13.04.
2013-07-12 09:21:13 +00:00
list(APPEND Missing ${_lb})
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
endif()
endforeach()
endif()
CMake: xvkbd: Check whether the list exists Instead of adding an empty element to the list, just check properly whether the list exists.
2013-07-23 18:42:31 +00:00
if (XVFBDLIBS)
list(REMOVE_DUPLICATES XVFBDLIBS)
endif()
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
if(Missing)
typo
2013-07-23 20:39:03 +00:00
message(STATUS "Missing Libraries or programs to create xvkbd: ${Missing}")
Cmake build: modify some tests a) test export/templates/ectaart_pdf5 removed, because of incompatibility between ectart.cls and luatex.sty b) renamed some tests to reflect their purpose tex2lyx2lyx/roundtrip/ => tex2lyx/cmplyx/ # the tests are comparing files written by lyx (not by tex2lyx) autotests/ => keytest/ # we are testing reactions of lyx to some key strokes c) add tests for lyx2lyx. This is rather rudimental, in that it only checks for created output, error codes and error output. d) use correct environment variable to set up the userdir for testing
2013-08-21 11:34:26 +00:00
message(STATUS "cmake build is therefore omitting keytests")
Cmake build key tests: Omit the tests and creation of xvkbd command, if not all needed libs or programs are available. This error is now not fatal.
2013-07-04 17:01:51 +00:00
endif()
if(NOT Missing)
Cmake build: modify some tests a) test export/templates/ectaart_pdf5 removed, because of incompatibility between ectart.cls and luatex.sty b) renamed some tests to reflect their purpose tex2lyx2lyx/roundtrip/ => tex2lyx/cmplyx/ # the tests are comparing files written by lyx (not by tex2lyx) autotests/ => keytest/ # we are testing reactions of lyx to some key strokes c) add tests for lyx2lyx. This is rather rudimental, in that it only checks for created output, error codes and error output. d) use correct environment variable to set up the userdir for testing
2013-08-21 11:34:26 +00:00
project(keytest)
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
Cmake build, autotests Removed if no X11. Because X11 is needed for xvkbd but not available on some platforms (even if UNIX)
2012-12-11 15:00:59 +00:00
add_subdirectory(xvkbd)
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
Cmake build, autotests Removed if no X11. Because X11 is needed for xvkbd but not available on some platforms (even if UNIX)
2012-12-11 15:00:59 +00:00
set(KEYTEST "${CMAKE_CURRENT_SOURCE_DIR}/keytest.py")
file(GLOB TESTST RELATIVE "${CMAKE_CURRENT_SOURCE_DIR}" "*-in.txt")
file(GLOB TESTSS RELATIVE "${CMAKE_CURRENT_SOURCE_DIR}" "*-in.sh")
list(REMOVE_ITEM TESTST hello-world-in.txt first-time-in.txt)
list(SORT TESTST)
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
Cmake build, autotests Removed if no X11. Because X11 is needed for xvkbd but not available on some platforms (even if UNIX)
2012-12-11 15:00:59 +00:00
foreach(_tf first-time-in.txt hello-world-in.txt ${TESTST})
string(REGEX REPLACE "-in\\.(txt|sh)" "" _t ${_tf})
Cmake build: modify some tests a) test export/templates/ectaart_pdf5 removed, because of incompatibility between ectart.cls and luatex.sty b) renamed some tests to reflect their purpose tex2lyx2lyx/roundtrip/ => tex2lyx/cmplyx/ # the tests are comparing files written by lyx (not by tex2lyx) autotests/ => keytest/ # we are testing reactions of lyx to some key strokes c) add tests for lyx2lyx. This is rather rudimental, in that it only checks for created output, error codes and error output. d) use correct environment variable to set up the userdir for testing
2013-08-21 11:34:26 +00:00
add_test(NAME keytest/${_t}
Export tests in cmake build: Do not use the default userdir while running lyx.
2013-07-23 19:42:44 +00:00
WORKING_DIRECTORY "${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}"
COMMAND ${CMAKE_COMMAND}
Cmake build tests: Unify use of userdir While some test runns lyx-exe, we need userdir be different from default. All relevant tests should use the same directory.
2013-08-25 09:41:10 +00:00
-DLYX_TESTS_USERDIR=${LYX_TESTS_USERDIR}
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
-DAUTOTEST_ROOT=${TOP_SRC_DIR}/development/autotests
Cmake build: autotests Adapt to use local .gmo files
2012-12-12 13:54:38 +00:00
-DPO_BUILD_DIR=${TOP_BINARY_DIR}/po
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
-DKEYTEST_INFILE=${_tf}
Cmake build: Move definitions of target ${_lyx} and ${_tex2lyx} to top-most directory, to make them overall available
2012-12-14 11:23:17 +00:00
-DBINDIR=$<TARGET_FILE_DIR:${_lyx}>
Export tests in cmake build: Do not use the default userdir while running lyx.
2013-07-23 19:42:44 +00:00
-DLYX=${_lyx}
-DWORKDIR=${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}
Cmake build: modify some tests a) test export/templates/ectaart_pdf5 removed, because of incompatibility between ectart.cls and luatex.sty b) renamed some tests to reflect their purpose tex2lyx2lyx/roundtrip/ => tex2lyx/cmplyx/ # the tests are comparing files written by lyx (not by tex2lyx) autotests/ => keytest/ # we are testing reactions of lyx to some key strokes c) add tests for lyx2lyx. This is rather rudimental, in that it only checks for created output, error codes and error output. d) use correct environment variable to set up the userdir for testing
2013-08-21 11:34:26 +00:00
-DLYX_USERDIR_VER=${LYX_USERDIR_VER}
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
-DKEYTEST_OUTFILE=${_t}-out.txt
Cmake build: autotests Adapt to use local .gmo files
2012-12-12 13:54:38 +00:00
-DPACKAGE=${PACKAGE}
-DLOCALE_DIR=${LOCALE_DIR}
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
-P ${TOP_SRC_DIR}/development/autotests/single-test.cmake)
Cmake build tests: Threadsafety and test-labeling The tests are now more robust if ctest uses '-j' (number of threads) parameter. a.) keytests are running in sequence and in one thread only, no other thread running b.) tex2lyx tests are locking in respect to each other c.) Test gets one or more labels, so that we can select ctest -L url to run tests labeled url d.) New macro settestlabel() to add labels to a test
2013-09-07 06:58:21 +00:00
settestlabel(keytest/${_t} "key")
set_tests_properties(keytest/${_t} PROPERTIES RUN_SERIAL ON)
Cmake build, autotests Removed if no X11. Because X11 is needed for xvkbd but not available on some platforms (even if UNIX)
2012-12-11 15:00:59 +00:00
endforeach()
endif()
Cmake build: First try to use autotests. Many test are not running, but if changed the '-dbg xxx' to '-dbg any' then all of sudden they pass ... (The buffered output of lyx is often disrupted too early with 'kill -9', so the expected data are not available for the appropriate test)
2012-12-11 14:17:04 +00:00
endif()
Cmake build autotests: Split export test to test on each format and each input file One can still check all exports with one commend ctest -R "export.*"
2012-12-13 11:38:38 +00:00
make test environment. Exports with luatex and xetex. In successful cooperation with Scott Kostyshak. We provide many lyx-documents which are not compilable with luatex or xetex. But some of them compile, if we change the font use to non_tex_fonts. Since this would change the appropriate source, we have to convert it first into a save location. To make it there compilable, we have to convert also all file references. languages used font he|el|ru|uk 'FreeSans' fa 'FreeFarsi' zh_CN 'WenQuanYi Micro Hei' The whole job is done with a perl script.
2013-11-17 22:17:27 +00:00
find_package(Perl)
cmake export tests. Define new policy of what export formats to check. Depending on default_output_format default or unset xhtml, dvi*, pdf* xhtml xhtml any of pfd variants xhtml, pdf* any of dvi variants xhtml, dvi* each other (like eps3) as specified
2014-03-16 08:57:31 +00:00
if(PERL_FOUND)
set(DVI_FORMATS "dvi" "dvi3")
set(PDF_FORMATS "pdf" "pdf2" "pdf3" "pdf4" "pdf5")
else()
set(DVI_FORMATS "dvi")
set(PDF_FORMATS "pdf" "pdf2" "pdf3")
endif()
Clean up CMake testing code Thanks to Kornel for the advice.
2013-03-04 16:35:07 +00:00
macro(getoutputformats filepath varname)
Cmake build: Add pdf, pdf2 and pdf5 formats to export testcases
2013-01-24 16:58:44 +00:00
file(STRINGS "${filepath}" lines)
cmake export tests. Define new policy of what export formats to check. Depending on default_output_format default or unset xhtml, dvi*, pdf* xhtml xhtml any of pfd variants xhtml, pdf* any of dvi variants xhtml, dvi* each other (like eps3) as specified
2014-03-16 08:57:31 +00:00
# What should we test, if default_output_format is not defined?
# For now we test everything ...
set(out_formats "xhtml" ${DVI_FORMATS} ${PDF_FORMATS})
Cmake build: Add pdf, pdf2 and pdf5 formats to export testcases
2013-01-24 16:58:44 +00:00
foreach(_l ${lines})
if(_l MATCHES "^\\\\default_output_format +\([^ ]+\)")
cmake export tests. Define new policy of what export formats to check. Depending on default_output_format default or unset xhtml, dvi*, pdf* xhtml xhtml any of pfd variants xhtml, pdf* any of dvi variants xhtml, dvi* each other (like eps3) as specified
2014-03-16 08:57:31 +00:00
set(_format ${CMAKE_MATCH_1})
if(_format STREQUAL "default")
set(out_formats "xhtml" ${DVI_FORMATS} ${PDF_FORMATS})
elseif(_format MATCHES "pdf")
set(found "xhtml" ${PDF_FORMATS})
elseif(_format MATCHES "dvi")
set(out_formats "xhtml" ${DVI_FORMATS})
Clean up CMake testing code Thanks to Kornel for the advice.
2013-03-04 16:35:07 +00:00
else()
cmake export tests. Define new policy of what export formats to check. Depending on default_output_format default or unset xhtml, dvi*, pdf* xhtml xhtml any of pfd variants xhtml, pdf* any of dvi variants xhtml, dvi* each other (like eps3) as specified
2014-03-16 08:57:31 +00:00
# Respect all other output formats
# like "eps3", "xhtml"
set(out_formats ${_format})
Cmake build: Add pdf, pdf2 and pdf5 formats to export testcases
2013-01-24 16:58:44 +00:00
endif()
break()
endif()
endforeach()
cmake export tests. Define new policy of what export formats to check. Depending on default_output_format default or unset xhtml, dvi*, pdf* xhtml xhtml any of pfd variants xhtml, pdf* any of dvi variants xhtml, dvi* each other (like eps3) as specified
2014-03-16 08:57:31 +00:00
set(${varname} ${out_formats})
Cmake build: Add pdf, pdf2 and pdf5 formats to export testcases
2013-01-24 16:58:44 +00:00
endmacro()
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
macro(maketestname testname reverted listreverted listignored)
ctest export: smal improvements 1.) Use of regex to ignore group of tests 2.) If default output format is pdf2(pdflatex), the try to check also for xelatex and lualatex
2014-03-12 16:15:07 +00:00
set(_idx -1)
foreach(_itrx ${${listignored}})
set(_itr "^${_itrx}$")
if(${testname} MATCHES ${_itr})
set(_idx 0)
break()
endif()
endforeach()
#list(FIND ${listignored} ${${testname}} _idx)
Cmake export tests Some export test are known to fail. Checking them every time is cumbersome. Now, the tests marked in file revertedTests will invert the success condition and mark the test as INVERTED_SEE-README.ctest. If some of the tests in revertedTests fails, this is good, and the testname can be removed from it.
2013-08-04 12:31:47 +00:00
if (${_idx} LESS 0)
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
list(FIND ${listreverted} ${${testname}} _idx)
if (${_idx} LESS 0)
set(${reverted} 0)
else()
set(${reverted} 1)
set(${testname} "INVERTED_SEE-README.ctest_${${testname}}")
endif()
Cmake export tests Some export test are known to fail. Checking them every time is cumbersome. Now, the tests marked in file revertedTests will invert the success condition and mark the test as INVERTED_SEE-README.ctest. If some of the tests in revertedTests fails, this is good, and the testname can be removed from it.
2013-08-04 12:31:47 +00:00
else()
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
set(${testname} "")
Cmake export tests Some export test are known to fail. Checking them every time is cumbersome. Now, the tests marked in file revertedTests will invert the success condition and mark the test as INVERTED_SEE-README.ctest. If some of the tests in revertedTests fails, this is good, and the testname can be removed from it.
2013-08-04 12:31:47 +00:00
endif()
endmacro()
Cmake tests: Allow for comments in control files Files, which contain names of ctest-tests controling whether they should be inverted, or ignored. We have two such files ATM: revertedTests + ignoredTests
2013-08-23 18:25:24 +00:00
macro(loadTestList filename resList)
# Create list of strings from a file without comments
file(STRINGS ${filename} tempList)
set(${resList})
foreach(_l ${tempList})
string(REGEX REPLACE "[ \t]*#.*" "" _newl "${_l}")
if(_newl)
list(APPEND ${resList} "${_newl}")
endif()
endforeach()
endmacro()
loadTestList(revertedTests revertedTests)
loadTestList(ignoredTests ignoredTests)
Add templates to export tests (CMake & autotools)
2013-02-21 13:25:13 +00:00
foreach(libsubfolder doc examples templates)
Make export tests more extendable For both CMake and autotools. Now we can easily add the examples to the export tests.
2013-02-16 08:02:38 +00:00
set(LIBSUB_SRC_DIR "${TOP_SRC_DIR}/lib/${libsubfolder}")
Cmake tests: Add lyx-files for export testing recursively.
2013-02-18 15:34:19 +00:00
file(GLOB_RECURSE lyx_files RELATIVE "${LIBSUB_SRC_DIR}" "${LIBSUB_SRC_DIR}/*.lyx")
Sort export tests in cmake build according to language
2013-02-20 12:26:01 +00:00
list(SORT lyx_files)
# Now create 2 lists. One for files in a language dir, one without
set(lang_lyx_files)
set(nolang_lyx_files)
Make export tests more extendable For both CMake and autotools. Now we can easily add the examples to the export tests.
2013-02-16 08:02:38 +00:00
foreach(f ${lyx_files})
Sort export tests in cmake build according to language
2013-02-20 12:26:01 +00:00
string(REGEX MATCHALL "^[a-z][a-z](_[A-Z][A-Z])?\\/" _v ${f})
if(_v)
list(APPEND lang_lyx_files ${f})
else()
list(APPEND nolang_lyx_files ${f})
endif()
endforeach()
foreach(f ${nolang_lyx_files} ${lang_lyx_files})
Re-add MergedManual test Now that the default format is set to xhtml, there will correctly be no LaTeX test.
2013-03-04 11:27:44 +00:00
# Strip extension
string(REGEX REPLACE "\\.lyx$" "" f ${f})
Cmake export tests Some export test are known to fail. Checking them every time is cumbersome. Now, the tests marked in file revertedTests will invert the success condition and mark the test as INVERTED_SEE-README.ctest. If some of the tests in revertedTests fails, this is good, and the testname can be removed from it.
2013-08-04 12:31:47 +00:00
set(TestName "export/${libsubfolder}/${f}_lyx16")
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
maketestname(TestName reverted revertedTests ignoredTests)
if(TestName)
add_test(NAME ${TestName}
WORKING_DIRECTORY "${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}"
COMMAND ${CMAKE_COMMAND} -DLYX_ROOT=${LIBSUB_SRC_DIR}
Cmake build tests: Unify use of userdir While some test runns lyx-exe, we need userdir be different from default. All relevant tests should use the same directory.
2013-08-25 09:41:10 +00:00
-DLYX_TESTS_USERDIR=${LYX_TESTS_USERDIR}
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
-Dlyx=$<TARGET_FILE:${_lyx}>
-DWORKDIR=${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}
-DLYX_USERDIR_VER=${LYX_USERDIR_VER}
-Dformat=lyx16x
-Dextension=16.lyx
-Dfile=${f}
-Dreverted=${reverted}
make test environment. Exports with luatex and xetex. In successful cooperation with Scott Kostyshak. We provide many lyx-documents which are not compilable with luatex or xetex. But some of them compile, if we change the font use to non_tex_fonts. Since this would change the appropriate source, we have to convert it first into a save location. To make it there compilable, we have to convert also all file references. languages used font he|el|ru|uk 'FreeSans' fa 'FreeFarsi' zh_CN 'WenQuanYi Micro Hei' The whole job is done with a perl script.
2013-11-17 22:17:27 +00:00
-DTOP_SRC_DIR=${TOP_SRC_DIR}
-DPERL_EXECUTABLE=${PERL_EXECUTABLE}
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
-P "${TOP_SRC_DIR}/development/autotests/export.cmake")
Cmake build tests: Threadsafety and test-labeling The tests are now more robust if ctest uses '-j' (number of threads) parameter. a.) keytests are running in sequence and in one thread only, no other thread running b.) tex2lyx tests are locking in respect to each other c.) Test gets one or more labels, so that we can select ctest -L url to run tests labeled url d.) New macro settestlabel() to add labels to a test
2013-09-07 06:58:21 +00:00
setmarkedtestlabel(${TestName} ${reverted} "export")
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
endif()
Cmake build: Prepare lyx2lyx tests to use the python executable found at configure time
2014-01-31 18:10:23 +00:00
if(LYX_PYTHON_EXECUTABLE)
# For use of lyx2lyx we need the python executable
set(TestName "lyx2lyx/${libsubfolder}/${f}")
maketestname(TestName reverted revertedTests ignoredTests)
if(TestName)
add_test(NAME ${TestName}
WORKING_DIRECTORY "${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}"
COMMAND ${CMAKE_COMMAND}
"-DLYX_PYTHON_EXECUTABLE=${LYX_PYTHON_EXECUTABLE}"
"-DLYX2LYX=${TOP_SRC_DIR}/lib/lyx2lyx/lyx2lyx"
"-DLYX_TESTS_USERDIR=${LYX_TESTS_USERDIR}"
"-DLYXFILE=${LIBSUB_SRC_DIR}/${f}.lyx"
-P "${TOP_SRC_DIR}/development/autotests/lyx2lyxtest.cmake")
setmarkedtestlabel(${TestName} ${reverted} "export")
endif()
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
endif()
New ctests to check for parsing and other errors These tests load the .lyx files to see if there are any parsing errors or other LyX errors/warnings. The tests fail if LyX writes a line to STDERR that does not match any of the regexes stored in filterCheckWarnings. Thanks to Kornel for the CMake expertise and corrections. This patch was written jointly with him.
2013-08-22 22:31:54 +00:00
set(TestName "check_load/${libsubfolder}/${f}")
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
maketestname(TestName reverted revertedTests ignoredTests)
if(TestName)
add_test(NAME ${TestName}
WORKING_DIRECTORY "${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}"
COMMAND ${CMAKE_COMMAND} -DLYXFILE=${LIBSUB_SRC_DIR}/${f}.lyx
Cmake build tests: Unify use of userdir While some test runns lyx-exe, we need userdir be different from default. All relevant tests should use the same directory.
2013-08-25 09:41:10 +00:00
-DLYX_TESTS_USERDIR=${LYX_TESTS_USERDIR}
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
-Dlyx=$<TARGET_FILE:${_lyx}>
-DPARAMS_DIR=${TOP_SRC_DIR}/development/autotests
-DWORKDIR=${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}
-P "${TOP_SRC_DIR}/development/autotests/check_load.cmake")
Cmake build tests: Threadsafety and test-labeling The tests are now more robust if ctest uses '-j' (number of threads) parameter. a.) keytests are running in sequence and in one thread only, no other thread running b.) tex2lyx tests are locking in respect to each other c.) Test gets one or more labels, so that we can select ctest -L url to run tests labeled url d.) New macro settestlabel() to add labels to a test
2013-09-07 06:58:21 +00:00
setmarkedtestlabel(${TestName} ${reverted} "load")
ctests: macro now deals with reverted and ignored A single macro determines if a test should be ignored (by returning an empty test name), and if not, whether to revert it. This was Kornel's idea.
2013-08-23 04:03:29 +00:00
endif()
Clean up CMake testing code Thanks to Kornel for the advice.
2013-03-04 16:35:07 +00:00
getoutputformats("${LIBSUB_SRC_DIR}/${f}.lyx" formatlist)
foreach(format ${formatlist})
Cmake tests: Expand export tests for luatex and xetex Citing Scott: In our current set up, we are currently testing XeTeX and LuaTeX either with system fonts or with TeX fonts but never both. We should test with both in my opinion. We will have to ignore/invert many tests but it still seems useful. For example Günter fixed babel-greek so that it works now with TeX fonts; and Jürgen found some errors in LyX that were causing some of the English docs to fail with system fonts. Currently we only test greek documents with system fonts and we only test English documents with TeX fonts. This change adds the missing test-cases.
2013-12-16 10:36:36 +00:00
if(format MATCHES "dvi3|pdf4|pdf5")
set(fonttypes "texF" "systemF")
else()
set(fonttypes "defaultF")
endif()
foreach(fonttype ${fonttypes})
if(fonttype MATCHES "defaultF")
set(TestName "export/${libsubfolder}/${f}_${format}")
else()
set(TestName "export/${libsubfolder}/${f}_${format}_${fonttype}")
endif()
maketestname(TestName reverted revertedTests ignoredTests)
if(TestName)
add_test(NAME ${TestName}
WORKING_DIRECTORY "${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}"
COMMAND ${CMAKE_COMMAND} -DLYX_ROOT=${LIBSUB_SRC_DIR}
Cmake build tests: Unify use of userdir While some test runns lyx-exe, we need userdir be different from default. All relevant tests should use the same directory.
2013-08-25 09:41:10 +00:00
-DLYX_TESTS_USERDIR=${LYX_TESTS_USERDIR}
Make export tests more extendable For both CMake and autotools. Now we can easily add the examples to the export tests.
2013-02-16 08:02:38 +00:00
-Dlyx=$<TARGET_FILE:${_lyx}>
Cmake export tests Some export test are known to fail. Checking them every time is cumbersome. Now, the tests marked in file revertedTests will invert the success condition and mark the test as INVERTED_SEE-README.ctest. If some of the tests in revertedTests fails, this is good, and the testname can be removed from it.
2013-08-04 12:31:47 +00:00
-DWORKDIR=${CMAKE_CURRENT_BINARY_DIR}/${LYX_HOME}
Re-add MergedManual test Now that the default format is set to xhtml, there will correctly be no LaTeX test.
2013-03-04 11:27:44 +00:00
-Dformat=${format}
Cmake tests: Expand export tests for luatex and xetex Citing Scott: In our current set up, we are currently testing XeTeX and LuaTeX either with system fonts or with TeX fonts but never both. We should test with both in my opinion. We will have to ignore/invert many tests but it still seems useful. For example Günter fixed babel-greek so that it works now with TeX fonts; and Jürgen found some errors in LyX that were causing some of the English docs to fail with system fonts. Currently we only test greek documents with system fonts and we only test English documents with TeX fonts. This change adds the missing test-cases.
2013-12-16 10:36:36 +00:00
-Dfonttype=${fonttype}
Re-add MergedManual test Now that the default format is set to xhtml, there will correctly be no LaTeX test.
2013-03-04 11:27:44 +00:00
-Dextension=${format}
Make export tests more extendable For both CMake and autotools. Now we can easily add the examples to the export tests.
2013-02-16 08:02:38 +00:00
-Dfile=${f}
Cmake export tests Some export test are known to fail. Checking them every time is cumbersome. Now, the tests marked in file revertedTests will invert the success condition and mark the test as INVERTED_SEE-README.ctest. If some of the tests in revertedTests fails, this is good, and the testname can be removed from it.
2013-08-04 12:31:47 +00:00
-Dreverted=${reverted}
make test environment. Exports with luatex and xetex. In successful cooperation with Scott Kostyshak. We provide many lyx-documents which are not compilable with luatex or xetex. But some of them compile, if we change the font use to non_tex_fonts. Since this would change the appropriate source, we have to convert it first into a save location. To make it there compilable, we have to convert also all file references. languages used font he|el|ru|uk 'FreeSans' fa 'FreeFarsi' zh_CN 'WenQuanYi Micro Hei' The whole job is done with a perl script.
2013-11-17 22:17:27 +00:00
-DTOP_SRC_DIR=${TOP_SRC_DIR}
-DPERL_EXECUTABLE=${PERL_EXECUTABLE}
Make export tests more extendable For both CMake and autotools. Now we can easily add the examples to the export tests.
2013-02-16 08:02:38 +00:00
-P "${TOP_SRC_DIR}/development/autotests/export.cmake")
Cmake tests: Expand export tests for luatex and xetex Citing Scott: In our current set up, we are currently testing XeTeX and LuaTeX either with system fonts or with TeX fonts but never both. We should test with both in my opinion. We will have to ignore/invert many tests but it still seems useful. For example Günter fixed babel-greek so that it works now with TeX fonts; and Jürgen found some errors in LyX that were causing some of the English docs to fail with system fonts. Currently we only test greek documents with system fonts and we only test English documents with TeX fonts. This change adds the missing test-cases.
2013-12-16 10:36:36 +00:00
setmarkedtestlabel(${TestName} ${reverted} "export")
endif()
endforeach()
Re-add MergedManual test Now that the default format is set to xhtml, there will correctly be no LaTeX test.
2013-03-04 11:27:44 +00:00
endforeach()
Cmake build: Add pdf, pdf2 and pdf5 formats to export testcases
2013-01-24 16:58:44 +00:00
endforeach()
Cmake build autotests: Split export test to test on each format and each input file One can still check all exports with one commend ctest -R "export.*"
2012-12-13 11:38:38 +00:00
endforeach()
Reference in New Issue Copy Permalink