lyx_mirror/development/autotests/suspiciousTests
Scott Kostyshak 95ba824283 ctests: update tests to reflect lualatex fixes
europeCV and modernCV examples can now be exported to PDF using
LuaTeX. For the specific output that was fixed, look at the diff and
see the description in suspiciousTests that was removed by this
commit. The output was checked manually and appears fine. These
tests are thus "uninverted".

Exporting those examples to DVI with LuaTeX does not exit with
error, but the output drops characters with accents. Thus, these
tests are now marked with the "wrong_output" label. I reported this
issue on the LuaTeX mailing list at [1], but since DVI export is not
given high priority, I don't expect much action.

Note that these changes reflect an updated TeX Live 2016
installation.

[1]
https://www.mail-archive.com/search?l=mid&q=20160831134006.4fewxothddqfeyw4%40steph
2016-09-01 17:21:06 -04:00

223 lines
8.5 KiB
Plaintext

# Regular expressions for tests that are known to fail
#
# Patterns will be automatically enclosed with '^' and '$'.
# Matching tests get the label "inverted"
# or (if also matching a pattern in "suspendedTests") "suspended".
# They get also the test-feature 'inverted', i.e.
# they are reported as failing if the export works without error.
Sublabel: todo
#
# LyX bugs and problems with the sample documents that require attention.
# * minor issues to explore and properly sort,
# * easyfix issues,
# * LyX bugs to report at trac (move pattern to section "lyxbugs" once done).
# the ukrainean splash has preamble code loading russian babel
# in the preamble (Why?)
# TODO: remove the LaTeX preamble code:
# fixes the inverted tests below,
# side-effects: Ukrainean instead of Russian date, different hyphenation.
export/examples/uk/splash_(dvi3|pdf[45])_texF
# missing commands (polyglossia?)
# Explore! (works with language_package==babel)
export/doc/fr/UserGuide_.*_systemF
# Missing characters (U+0361, U+1E61) in LM,
# set different system font in the source?
# + language nesting problem (may disappear after completed translation)
export/doc/(de/|es/|fr/)Customization_.*_systemF
# Probably language mess
export/export/ja/wrong_auto_encoding_(dvi|pdf(|3))
# Missing characters with Latin Modern Unicode:
# 0000 NULL (where does this come from?)
# 212B ANGSTROM SIGN (literal character in the source, replace with 00C5)
# The following are due to ERT commands for characters missing in LM
# in chapter 16.2 "Accents in Text":
# \t -> 0361 COMBINING DOUBLE INVERTED BREVE
# \c e -> 0229 LATIN SMALL LETTER E WITH CEDILLA
export/doc/(|de/|es/|fr/)Math.*systemF
# missing character: There is no ^^A in font [lmroman12-regular]
# and all the line down to ^^Z and beyond...
# XeTeX artifact? works with LuaTeX, explore:
export/doc/(|de/|es/|fr/)EmbeddedObjects_pdf4_systemF
# Changes in TeX Live 2014 (see git blame for info) fixed
# IEEEtran-CompSoc_pdf4_systemF but not others.
# TODO Investigate if others can be fixed?
# * IEEEtran-Journal_pdf4_systemF compiles here (GM)
# * All IEEEtran-TransMag.* exports fail here:
# missing commands \IEEEtitleabstractindextext, \IEEEdisplaynontitleabstractindextext
# -> adapt template and style (GM)
export/templates/IEEEtran-(Journal|TransMag)_pdf4_systemF
# Requires ctex (Chinese).
# Default output format is XeTeX. -> Only system fonts?
# Does (dvi|pdf3_texF|dvi3_texF) produce sensible results?
export/templates/ctex_(pdf[23]?|pdf4_texF)
# Example for lib/scripts/listerrors
# Requires noweb. Seems to be restricted to plain "latex".
# Find out why and whether the script could be improved.
export/examples/listerrors_(pdf[245]).*
# Requires CJK.
# Why does it fail with pdflatex and dvipdfm? CJK restriction? Workarounds?
# (Also fails with Xe/LuaTeX and TeX-fonts -- as expected, see ignoredTests)
export/examples/ko/splash_(dvi||pdf[23]?)
# Following mathmacros tests fail
# Why? -> sort and comment
export/mathmacros/testcases_speed_(lyx16|lyx21|dvi|pdf|pdf[23]|(dvi3|pdf[45])_(texF|systemF))
check_load/mathmacros/testcases_speed
# The "longest label" marker in a labeling must be valid LaTeX (just like ERT).
# What should we do:
# - document this,
# - escape special characters,
# - convert to LaTeXString,
# or just report this at Trac for now?
export/export/LongestLabelWithUnderscore_[^x].*
Sublabel: lyxbugs
#
# LyX bugs with a Trac number.
# Language nesting and polyglossia #9633
export/doc/(nb|sk)/Intro.*systemF
# language nesting (may disappear after completed translation)
export/examples/fr/linguistics_.*_systemF
export/doc/(de/|es/|fr/)Customization_.*_systemF
# use LuaTeX-compatible language names #9910
# Wrong language name for LuaTeX (with Babel, no error with Polyglossia)
# After LyX 2.1 is released, apply the patch and remove these
# See http://www.mail-archive.com/lyx-devel@lists.lyx.org/msg181595.html
# ! LuaTeX error ...e/2015/texmf-dist/tex/luatex/hyph-utf8/luatex-hyphen.lua:53: luatex-hyphen: no entry in language.dat.lua for this language: bahasa
export/doc/attic/id_UserGuide_dvi3.*
export/doc/attic/id_UserGuide_pdf5.*
export/(doc|examples)/id/.*_(dvi3|pdf5)_texF
export/.*/hu/.*(dvi3|pdf5)_texF
# documents requiring pre-processing fail with Japanese #8823
export/examples/ja/(knitr|lilypond|sweave)_(dvi|pdf3?)
Sublabel: ert
#
# Export failures due to "raw" LaTeX use in ERT or preamble code.
# "Wontfix" if demonstrating correct use and OK in the default output format.
# Non-ASCII in ERT, fails with inputenc==ASCII (e.g. XeTeX with tex-fonts)
export/doc/(de|es|fr)/Additional_pdf4_texF
# \ding{58} and \ding{171} not supported with XeTeX and system fonts:
export/examples/fr/ListesPuces_pdf4_systemF
# inputencoding="utf8-plain" with Xe/LuaTeX: characters with
# Unicode point > 256 lead to errors with 8-bit fonts
# (We keep this option for power users setting Unicode fonts in the preamble
# or document class file).
export/export/utf8-plain-with-tex-fonts_.*_texF
Sublabel: texissues
#
# Export fails due to LaTeX limitations,
# e.g. non-ASCII in verbatim or listings, incompatible packages, ...
# "Wontfix" if documents demonstrate correct use in the default output format.
# Non-ASCII char in verbatim environment.
# Fails with ASCII (and hence also with XeTeX).
export/doc/(|de/|es/|fr/)UserGuide_pdf4_texF
# chemgreek incompatible with LuaTeX and TeX fonts
# fixed in TeXLive 2016-01-07 (add to unreliable?)
#export/examples/achemso_(dvi3|pdf5)_texF
# Math depends on the mhchem package which loads chemgreek
#export/doc/(|de/|es/|fr/)Math_(dvi3|pdf5)_texF
# Inside these two files, we state that they should only be expected
# to work with pdflatex and possibly lualatex.
export/examples/PDF-form_(dvi.*|pdf[^25]*)
export/examples/(|de/|fr/)PDF-comment_dvi3_.*F
export/examples/(|de/|fr/)PDF-comment_pdf5_texF
# Hebrew docs do not currently work with LuaTeX (will be fixed in TeXLive-16)
# TODO: set working system fonts in the lyx sources
export/.*/he/.*(dvi3|pdf5).*
# ... nor with XeTeX and 8-bit TeX fonts (due to missing ASCII replacements)
export/.*/he/.*pdf4_texF
# Babel-Russian uses UTF-8 for auto-strings if it detects Xe/LuaTeX.
# This fails unless the inputencoding is set to utf-8, too.
export/doc/ru/(Intro|Tutorial)_(dvi3|pdf[45])_texF
export/examples/ru/splash_(dvi3|pdf[45])_texF
# Document uses Postscript specials
# Does not compile with pdflatex (see note in the document source).
export/examples/instant_preview_(dvi3|pdf4)_systemF
export/examples/instant_preview_pdf[25].*
export/examples/(chessgame|chess-article|powerdot-example)_pdf[25].*
export/examples/fr/exemple-powerdot_pdf[25].*
# Gives the following error:
# # ! Package hpstatement Error: H or P statement "H251"
# # (hpstatement) is not defined.
# seems to be polyglossia-related (dvi3 worked with babel)
export/examples/H-P-statements_.*_systemF
# requires jss.cls (not on CTAN)
# "All documents need to be processed by pdflatex" [jss.pdf]
export/templates/JSS-article_(dvi|dvi3_.*|pdf3?)
# tufte (partially) incompatible with latex and xelatex:
# \MakeTextUppercase requires microtype.
# http://tex.stackexchange.com/questions/202142/problems-compiling-tufte-title-page-in-xelatex
export/examples/(|de/|es/)tufte-(book|handout)_(dvi.*|pdf|pdf3|pdf4.*)
# Wasysym - LuaTeX incompatibility
# Missing character reported for $_\sun$
# (the sun-character is printed in \normalsize (i.e. not scaled)
# with any export format -- only LuaTeX reports a missing character).
export/examples/aas_sample_(dvi3|pdf5)_(texF|systemF)
Sublabel: multilingual
#
# Without the Czech or Slovak text it compiles
# No problem with inserted German (or other foreign language) text
# No problem if the table is Slovak too
# Seems to be a problem with Check and Slovak Babel support. File a bug there.
# All exports using babel fail:
export/export/TableErrorIfSlovakTextInserted_(dvi|pdf[23]?|.*_texF)
Sublabel: attic
#
# Documents in the attic.
# Kept for reference and format conversion test.
# However, most problems here are "wontfix".
# Fails because of missing .png graphic files.
# They were replaced by .svgz, but, as this file is in the attic, we do not
# convert to new lyx format. Plain latex and xetex create output (ignoring
# missing files) while (pdf|lua)latex exits with != 0
export/doc/attic/eu_UserGuide_pdf[25].*
# Files in the attic with non-default output
# (i.e. could be ERT, package incompatiblity, ...)
export/doc/attic/it_(Customization_pdf5|UserGuide_dvi3|UserGuide_pdf4)_systemF
export/doc/attic/sk_UserGuide_pdf4_texF
export/doc/attic/id_UserGuide_pdf[45]_systemF
Sublabel: xhtml
export/export/WrongDfnTagHandling_xhtml