lyx_mirror/development/autotests/unreliableTests
Scott Kostyshak 95ba824283 ctests: update tests to reflect lualatex fixes
europeCV and modernCV examples can now be exported to PDF using
LuaTeX. For the specific output that was fixed, look at the diff and
see the description in suspiciousTests that was removed by this
commit. The output was checked manually and appears fine. These
tests are thus "uninverted".

Exporting those examples to DVI with LuaTeX does not exit with
error, but the output drops characters with accents. Thus, these
tests are now marked with the "wrong_output" label. I reported this
issue on the LuaTeX mailing list at [1], but since DVI export is not
given high priority, I don't expect much action.

Note that these changes reflect an updated TeX Live 2016
installation.

[1]
https://www.mail-archive.com/search?l=mid&q=20160831134006.4fewxothddqfeyw4%40steph
2016-09-01 17:21:06 -04:00

110 lines
4.2 KiB
Plaintext

# Regular expressions for tests that should not be executed with
# ctest -L export or ctest -L inverted because they do not work as expected
# (either unreliable or invalid).
#
# Patterns will be automatically enclosed with '^' and '$'.
# Matching tests get the label "unreliable" and do not get the label "export".
#
# TODO: Name problem: *invalid* tests (wrong output) are not *unreliable*.
# Use "unfit" or "unapplicable" as better label and name of pattern file?
Sublabel: nonstandard
# ===================
# Documents with additional requirements,
# e.g. a class or package file not in TeXLive.
# TODO: rename to "extra"?
export/templates/IUCr-article_(dvi|pdf).*
# does not work with pdflatex, lualatex (PDF) or XeTeX (postscript specials?).
export/templates/(ja|es)_beamer-conference-ornate-20min_(pdf2|pdf[45]).*
export/templates/kluwer_.*_systemF
export/templates/ectaart_(dvi3|pdf5).*
# 1.) missing farsi package with lfeenc.def
# 2.) LuaTeX does not support Farsi yet. See:
# https://github.com/reutenauer/polyglossia/commit/ccb0e9e2c6411170ad779b05ff5076f1193cc323
export/examples/fa/splash_(dvi|pdf|pdf[23]|(dvi3|pdf4|pdf5)_(texF|systemF))
# requires knitr, requires rjournal.sty (not in TeXLive)
# incompatible with fontspec?
export/templates/RJournal_(dvi3|pdf[45])_systemF
# Requires aa.cls (not in TeXLive).
# Fails with XeTeX/LuaTeX
# Reported upstream (https://www.mail-archive.com/lyx-devel@lists.lyx.org/msg184435.html)
# Is there a new version fixing the problem?
export/examples/aa_sample_(dvi3|pdf[45])_.*
export/templates/aa_(dvi3|pdf[45])_.*
# Requires iucr.cls (not in TeXLive)
# Is there a new version fixing the problem?
# Does LuaTeX produce sensible results?
export/templates/IUCr-article_pdf4_systemF
# Requires acmsiggraph.cls (not in TeXLive)
# see http://wiki.lyx.org/Examples/AcmSiggraph
export/templates/ACM-siggraph_(dvi|pdf).*
Sublabel: erratic
# Tests depending on local configuration, or the phase of the moon.
# for unknonwn reasons, seminar fails at some places:
export/examples/(|fr/)seminar_.*
# Export fails the first time but works the second time. (Why?)
export/doc/es/Customization_pdf4_texF
Sublabel: varying_versions
# ========================
# Test depending on TeX distribution, package versions or OS
# document class aastex.cls replaced by aastex6.cls (v.1 2016/02/16)
# in CTAN and TeXLive in march 2016
# Template and sample use the new version via aastex6.layout (cf. #10027)
# -> fail if aastex6.cls is missing (TeXLive15 original)
export/templates/aastex_(dvi|pdf).*
export/examples/aas_sample_(dvi|pdf).*
Sublabel: wrong_output
# ====================
# Export does not fail but the resulting document has errors.
#
# These tests are actually not "unreliable" (different result for different
# runs) but *invalid* (not measuring what they should measure).
# seminar.sty uses Postscript specials
# -> wrong output with pdflatex/LuaTeX and DVI (missing landscape slides).
export/examples/(|fr/)seminar_pdf[25].*
export/examples/(|fr/)seminar_dvi.*
# Babel-Spanish uses Babel's "strings" feature to define
# separate auto-strings using UTF-8 literals.
# Babel uses the "unicode" strings if it detects XeTeX or LuaTeX.
# This is wrong for Xe/Lua with 8-bit TeX-fonts.
# set inputenc to utf8?
# (Changing the default in lib/languages requires more tests for utf8 first.)
export/examples/es/linguistics_pdf4_texF
export/doc/es/.*_(pdf[45]|dvi3)_texF
# Non-ASCII char in verbatim environment is dropped (with a warning when
# doing this interactively) with ASCII (and hence also with XeTeX).
export/doc/(|de/|es/|fr/)EmbeddedObjects_pdf4_texF
# inputencoding="utf8-plain" with 8-bit TeX: non-ASCII characters are passed
# as two 8-bit characters leading to garbage in the output
export/export/utf8-plain-with-tex-fonts_(dvi|pdf.?)
# The following document mixes inTitle layouts and leads to
# likely unintended output. See #10347
export/mixing_inTitle_layouts.lyx
# Characters with accents are not output
# Reported to LuaTeX mailing list here:
# https://www.mail-archive.com/search?l=mid&q=20160831134006.4fewxothddqfeyw4%40steph
# (not expecting much attention because DVI is not given high priority)
export/doc/es/Customization_dvi3_systemF
export/examples/(|es/)(europe|modern)CV_dvi3_systemF