# Regular expressions for tests that are known to fail # # Patterns will be automatically enclosed with '^' and '$'. # Matching tests get the label "inverted" # or (if also matching a pattern in "suspendedTests") "suspended". # They get also the test-property 'WILL_FAIL', i.e. # they are reported as failing if the export works without error. # https://cmake.org/cmake/help/v3.0/prop_test/WILL_FAIL.html # ====================================================================== Sublabel: todo # LyX bugs and problems with the sample documents that require attention # ====================================================================== # * minor issues to explore and properly sort, # * easyfix issues, # * LyX bugs to report at trac (move pattern to section "lyxbugs" once done). # missing glyphs: There is no ^^A in font [lmroman12-regular] # and all the line down to ^^Z and beyond... # XeTeX artifact? works with LuaTeX, explore: export/doc/(|de/|es/|fr/)EmbeddedObjects_pdf4_systemF # `acmart` document class: # (see also lyxbugs below and ignoredTests) # issues with listsof, reported to the maintainer # https://www.mail-archive.com/search?l=mid&q=of84gj%24l6b%241%40blaine.gmane.org # LyX gives the following terminal message: # # TextClass.cpp (1385): The layout does not provide a list command for # the float `sidebar'. LyX will not be able to produce a float list. # # which makes "check_load" and "lyx2lyx" fail (lyx2lyx for < 2.3 is ignored). check_load/templates/Articles/Association_for_Computing_Machinery_.* export/templates/Articles/Association_for_Computing_Machinery_.*_lyx23 # Failing LyX2LyX conversions for old versions: # # "beamer" lyx2lyx fails sometimes for versions < 2.1 # Back-conversion results in some layouts without name ("\begin_layout \n") # which trigger a warning message leading to test failure. export/examples/(|de/|fr/|ja/)Presentations/Beamer_lyx(16|20) export/examples/Presentations/Beamer_.*Complex.*_lyx(16|20) export/templates/(|de/|es/|fr/|ja/)Presentations/Beamer_lyx(16|20) # # modernCV fails for versions < 2.1 # * reversed order of \end_layout and \end_inset results in corrupt LyX file # * reversed order of command arguments results in incompilable LaTeX export/examples/(|es/)Curricula_Vitae/Modern_CV_(lyx(16|20)|dvi|dvi3.*F|pdf|pdf3) export/examples/(|es/)Curricula_Vitae/Europe_CV_(dvi|dvi3.*F|pdf|pdf3) # # Back-conversion fails for rotated float inset in a list: export/export/lyx2lyx/lyx_2_3_test_lyx(16|20|21|22) # Additional empty lines (vs. Separator latexpar) with every round-trip # before an ERT nested in a Description list: export/export/lyx2lyx/lyx_2_3_test2_lyx(16|20) # New problem with TL18: endless loop? # ! TeX capacity exceeded, sorry [input stack +size=5000]. # rsp.: # > ! Undefined control sequence. # > l.1 à export/export/latex/inputenc-luatex-utf8_pdf5_texF # nonstandard tests failing for unknown reason: export/templates/Obsolete/ACM_SIGGGRAPH.*_pdf5_(texF|systemF) export/templates/Articles/R_Journal_(dvi3|pdf[45])_systemF #export/templates/Articles/Kluwer_.*_systemF # Thai with CJK package requires the babel option "thaicjk" instead of "thai". # (see thaifont.txt in the CJK documentation for setup details). export/export/latex/unicodesymbols/031-thai_th_(euc-|gbk|jis|utf8-cjk).* # Package clashes when Japanese documents are compiled with non-TeX fonts, # export/doc/ja/(Additional|LaTeXConfig|Math|UserGuide).*_systemF export/doc/ja/(Formula-numbering|Customization|EmbeddedObjects|Intro)_pdf4_systemF # Test for command \pdfsave fails: # ! Package xypdf Error: pdfTeX version 1.40.0 or higher is needed for the xypdf export/examples/ja/Graphics_and_Insets/XY-Pic.*_systemF # Does this still fail in TL19? What is the error? export/.*/fa/Welcome_(dvi3|pdf5)_systemF export/.*/fa/Welcome_(dvi3|pdf5)_systemF # Bug (in LyX or LaTeX?): # If a language change happens in an environment, LyX does not write an # explicit \inputencoding{} when switching back to the "outer" # language. However, without explicit \inputencoding, the input encoding # “utf8” is not properly switched back and high-bit characters like "ä" produce # an "inputenc Error: Invalid UTF-8 byte "A0"". export/export/latex/languages/nested-inputenc_auto-legacy_pdf2 # - This test is usually inverted, but it works with the DocBook backend. !export/export/latex/lyxbugs/3059-language-in-tables_docbook5 # ================================================ Sublabel: lyxbugs # LyX bugs with a Trac number or 'wontfix' ML thread. # ================================================ # Dedicated tests in export/latex/lyxbugs start with the ticket number # (move to export/latex/lyxbugs-resolved when the problem is fixed). # catchall: export/export/latex/lyxbugs/[0-9].* # #10355 xmllint errors with LyX HTML export export/doc/ja/UserGuide_xhtml export/export/WrongDfnTagHandling_xhtml #8035 work around a Polyglossia bug: # An error is reported if the document font does not announce support for a # script (Cyrillic, Greek, ...) which Polyglossia thinks is required to # typeset the document language. This is not required with LyX's check for # missing glyphs and results in many false positives: # a) with fonts including the required characters but # not the tag tested by Polyglossia, # b) if the document language is "Serbian (Latin Script)", # the Cyrillic script is not required yet Polyglossia tests for support. # The document "sr/Braille.lyx" is an example of case b). # (For some reason, the false positive error is not thrown with PDF (luatex).) #export/examples/sr/Modules/Braille_(dvi3|pdf4)_systemF #11455 "Unable to process argument!" with multiple 1.6.x roundtrips export/templates/Articles/IEEE_Transactions_Journal_lyx16 #11522 Support specification of complementing non-TeX fonts # # More than one non-TeX font required for the character set in many documents # to prevent "missing glyph" errors with non-TeX fonts # #export/export/latex/inputenc-.*_systemF # problem remains but test now ignored export/doc/(|de/|es/|fr/)Math.*systemF # a minimal example for Math.lyx is in #export/export/latex/lyxbugs/11522-systemfonts-Math-missingchars.*systemF # # Farsi: missing glyphs (em space and "English" quotes) export/examples/fa/Welcome_pdf4_systemF # # CJK-quotes examples (missing in most Latin-script fonts) export/doc/(|de/|es/|fr/)UserGuide_(dvi3|pdf4|pdf5)_systemF # # Japanese export/examples/ja/Modules/Linguistics.*systemF # # Arabic (see also "texissues") # "! Extra \else" and missing glyph "no ␣ in font Scheherazade": # (the lyx2lyx test also tests compilation after round-trip) export/doc/ar/UserGuide_pdf4_systemF export/doc/ar/UserGuide_lyx(22|23) #11773 lyx2lyx: language reversion nesting problems with polyglossia export/export/lyx2lyx/11773-language-reversion-nesting-polyglossia_lyx2[23] export/examples/ko/Welcome_lyx2[23] # We decided not worth spending time to look into a fix # Warning: Malformed LyX document: Missing layout name on line 1876 # https://www.mail-archive.com/search?l=mid&q=20200915233446.atwbyulny5gsbtyi%40tallinn export/examples/ru/Presentations/Beamer_lyx(16|20) # ============================================================== Sublabel: ert # Export failures due to "raw" LaTeX use in ERT or preamble code # ============================================================== # # "Wontfix" if demonstrating correct use and OK in the default output format. # ============================================================== Sublabel: ertroundtrip # # Export failures due to exporting ERT (or preamble code) in backwards # conversion and not parsing that ERT in forwards conversion. Often, it is not # worth the time and is complicated to support roundtrips of this nature. # this might be an ertroundtrip issue, although it is not confirmed. In any # case, it doesn't seem worth the time to try to fix, considering that # the APA7 layout is not shipped with 2.2.x and 2.2.x is now quite old. # For more information, see the following ML thread: # https://www.mail-archive.com/search?l=mid&q=20200824050236.pjrlijcn2hxnrmrw%40tallinn export/templates/Articles/American_Psychological_Association_%28APA%29,_v\._7_lyx22 Sublabel: texissues # Export fails due to LaTeX limitations, # ================================================ # # e.g. non-ASCII in verbatim or listings, incompatible packages, ... # "Wontfix" if documents demonstrate correct use in the default output format. # Xe/LuaTeX ########### # Babel-Russian uses UTF-8 for auto-strings if it detects Xe/LuaTeX. # This fails unless the inputencoding is set to utf-8, too. export/export/latex/languages/ru_auto-legacy-luatex.*_texF # Babel-Ukrainian uses UTF-8 if it detects Xe/LuaTeX (for "\date"). # With 8-bit TeX fonts this results in: # * garbled output with PDF (LuaTeX) # * missing glyphs with XeTeX and DVI (LuaTeX) # New in TL18 -> cf. unreliableTests.varying_versions. # Workaround: suppressing auto-date, setting inputenc to "utf8", or using # date inset (new in LyX 2.4) in the source documents. export/export/latex/languages/uk-babel-date-missing-chars-with-ascii_dvi3_texF # Babel with non-TeX fonts fails for some supported languages # Lithuanian: L7x font encoding also set with LuaTeX and non-TeX fonts # (error but output OK) export/export/latex/languages/supported-languages_babel_non-tex_(dvi3|pdf5)_systemF # Babel-French fails with Xe/LuaTeX and TeX fonts # LaTeX Error: Command \at already defined. (and a lot more) export/export/latex/languages/supported-languages_(dvi|pdf).*_texF export/export/latex/languages/supported-languages_babel_(dvi|pdf).*_texF # Babel + XeTeX and system fonts fails due to a babel bug: # https://www.mail-archive.com/search?l=mid&q=20190831012945.zl76dbstyijfqgdh%40boogie # The error is the following, although remoing the referenced language just leads # to a different error: # # ! File ended while scanning use of \bbl@inireader. # # \par # l.3 \input{babel-german-switzerland} # I suspect you have forgotten a `}', causing me export/export/latex/languages/supported-languages_babel_non-tex_pdf4_systemF # Polyglossia + LuaTeX issue # Reported upstream here: # https://github.com/reutenauer/polyglossia/issues/163 # These tests were broken at 3374b854 # See discussion here: # https://www.mail-archive.com/search?l=mid&q=1478004223.2367.5.camel%40lyx.org #export/doc/(sk|nb)/Intro_(dvi3|pdf5)_systemF # some Polyglossia languages work only with XeTeX and fail with LuaTeX: # * The font "NotoSansEthiopic" cannot be found. # * sanskrit: ! Undefined control sequence. # l.53 \newXeTeXintercharclass # * RTL-languages: ! Undefined control sequence. # \setLR ->\@RTLfalse \luatexpardir export/export/latex/languages/supported-languages_polyglossia_XeTeX_(dvi3|pdf5)_systemF # Some packages fail with XeTeX/LuaTeX # Reported upstream (https://www.mail-archive.com/lyx-devel@lists.lyx.org/msg184435.html) # Is there a new version fixing the problem? export/examples/Articles/Astronomy_%26_Astrophysics_(dvi3|pdf5)_texF # Gives the following error: # # ! Package hpstatement Error: H or P statement "H251" # # (hpstatement) is not defined. # seems to be polyglossia-related (dvi3 worked with babel) export/examples/Modules/Hazard_and_Precautionary_Statements_.*_systemF # These files use packages that are not compatible with the newest LuaTeX. We # could potentially fix these by loading the luatex85 package early in the # LyX-generated preamble, but it seems it's better to wait until the packages # fix the root issue themselves. # xy package: export/examples/(|fr/|ru/)Graphics_and_Insets/XY-(Pic|Figure)_pdf5.* # fontspec errors with `slides` class: # LaTeX error: "kernel/command-already-defined" # Lines 2684 ... 2690 in fontspec-xetex.sty # Lines 2608 ... 2614 in fontspec-luatex.sty export/templates/Presentations/Slides_.*_systemF # expl3.sty: Compilation errors with XeTeX, TeX-fonts, inputenc utf8 # (TL 17 works). export/export/latex/inputenc-xetex-utf8-expl3-bug_pdf4_texF # Arabic # # Larger Arabic documents currently have non-TeX fonts and XeTeX # as default output. To fix pdfTeX export: # - set all non-Arab text parts to a different language (e.g. English) # - define alternatives for hyperref (e.g. with textorpdfstring) # for correct handling of hyperref. # - solve problem with ToC: # ! This can't happen (copying). # \AtBegShi@Output ...ipout \box \AtBeginShipoutBox # \fi \fi # l.62 \tableofcontents # {} # I'm broken. Please show this to someone who can fix # see discussion at https://www.mail-archive.com/search?l=mid&q=20161114035123.s5lt4ib4x4obtptp%40steph # Babel-Arabic loads "inputenc" which fails with LuaTeX export/.*/ar/.*_(dvi3|pdf5)_texF # no Arab charaters with luainputenc export/export/latex/languages/supported-languages_(dvi3|pdf5)_texF export/export/latex/languages/supported-languages_babel_auto-legacy_(dvi3|pdf5)_texF # Farsi # "invalid utf-8 sequence" with Babel-Farsi, LuaTeX, and TeX fonts. # (XeTeX works, if inputenc is set to "utf8") export/examples/fa/Welcome_(dvi3|pdf5)_texF # Hebrew # babel-hebrew loads "rlbabel.def" which fails with LuaTeX + TeX fonts: # "! Right-to-Left Support Error: use TeX--XeT or e-TeX engine." # (XeTeX works, if inputenc is set to "utf8") export/.*/he/.*(dvi3|pdf5)_texF export/export/latex/languages/he-.*(dvi3|pdf5)_texF export/export/latex/languages/supported-languages_(dvi3|pdf5)_texF export/export/latex/languages/supported-languages_babel_(dvi3|pdf5)_texF export/templates/Articles/Hebrew_Article_%28KOMA-Script%29_(dvi3|pdf5)_texF # # DavidCLM is not found. Comments from Jürgen: # luaotfload does not find "DavidCLM". In fact, at least on my system, # there is no such font, only "DavidCLM Medium" (and other shapes). This # one is found. Apparently, luaotfload cannot infer from the one to the # other. # As opposed to LuaTEX, XeTeX also queries TEXMF so maybe it just finds # its font there. # See ML thread: # https://www.mail-archive.com/search?l=mid&q=60ee3809d30056c191d4b2e8c57a7eda60b3e382.camel%40lyx.org export/templates/Articles/Hebrew_Article_%28KOMA-Script%29_(dvi3|pdf5)_systemF # # This error could probably be fixed with a small modification to the document, # but note that XeTeX exports without error (with the current document). # This assertion was reported on the LuaTeX ML here: # https://www.mail-archive.com/search?l=mid&q=20201030030430.4y4i6bdpwx633qs7%40vbox-VirtualBox # The assertion will be converted into the following error as of LuaTeX svn commit r7385: # ! the word doesn't start with a character export/doc/he/Tutorial_(dvi3|pdf5)_systemF # Ukrainian # See comment in unreliableTests export/export/latex/languages/uk-babel-date-missing-chars-with-ascii_pdf5_texF # These fail for perhaps a similar reason, but contrary to the unicodesymbols # case the maintainer of the seminar package is not planning to fix the core # issue since the package is old. Putting the following as the first line of # the LaTeX file is a workaround: \RequirePackage[2020-02-02]{latexrelease} export/examples/(fr/|)Presentations/Seminar.*(dvi|pdf|lyx22|lyx23).* # These fail for a similar reason and the same workaround works. export/templates/Articles/Journal_of_the_Acoustical_Society_of_America_%28JASA%29.*(dvi|pdf|lyx22|lyx23).* # The new jss.cls (version 3.1) seems to not work with an updated TL20 (for # either the template they provide or our LyX template). # I expect this to be fixed with an update of the .cls or TL update. # On an updated TL20, I (Scott) currently get the following error: # # ! Undefined control sequence. # \hyper@linkurl ...tionraw >>}\relax \Hy@colorlink # \@urlcolor #1\Hy@xspace@en... # export/templates/Articles/Journal_of_Statistical_Software_%28JSS%29_version_2_(lyx22|lyx23|pdf2) # ================================================ Sublabel: externalissues # Export fails due to non-LaTeX external tool, # ================================================ # # e.g. a bug or missing feature in ps2pdf # ps2pdf gives the following and exits with error: # Error: /invalidfileaccess in --file-- # ps2pdf succeeds if the -dNOSAFER flag is used. For discussion, see: # https://www.mail-archive.com/search?l=mid&q=1506851183.3130.15.camel%40lyx.org export/examples/ja/Modules/LilyPond_Book_pdf # ====================================================================== Sublabel: attic # Documents in the attic, kept for reference and format conversion test. # However, many problems here are "wontfix". # ====================================================================== # Fails because of missing .png graphic files. # They were replaced by .svgz, but, as this file is in the attic, we do not # convert to new lyx format. Plain latex and xetex create output (ignoring # missing files) while (pdf|lua)latex exits with != 0 #export/doc/attic/eu_UserGuide_pdf[25].* # Files in the attic with non-default output # (i.e. could be ERT, package incompatiblity, ...) export/doc/attic/it_(UserGuide_dvi3|UserGuide_pdf4)_systemF export/doc/attic/id_UserGuide_.*systemF # ================================================ Sublabel: dvips # Comment by Jürgen Spitzmüller # The document requests the dvips graphics driver, # and of course this fails with any other backend. # # The document compiles if one sets the graphics driver to "Automatic" # and remove the dvips class option. But then, the output is not correct # (rotation of foils does not work). export/examples/(|fr/)Presentations/Foils_pdf[45]_systemF export/examples/(|fr/)Presentations/Foils_pdf[25](_systemF|_texF)? # ================================================ Sublabel: varioref # Comment by Jürgen Spitzmüller # The problem, at least with the UserGuide, is that # varioref is not working with XeTeX/LuaTeX for Russian, as it uses some # char macros which are not defined for these engines. export/doc/ru/UserGuide_(dvi3|pdf[45])_(system|tex)F export/doc/ru/(Math|Additional)_(dvi3|pdf[45])_systemF # ================================================ # DocBook Sublabel: docbook # Don't work too hard on obsolete things. !export/templates/Obsolete/Latex8_Article_%28Obsolete%29_docbook5 export/templates/Obsolete/.*_docbook5 # Specific things that are not expected to work. # - No real content apart from metadata (forbidden in DocBook). export/export/mixing_inTitle_layouts_docbook5 # - Uses a book class, but has no chapters (forbidden in DocBook). export/doc(|/de|/es|/fr|/ja).*(Dummy|Postizo|Bidon).*_docbook5 export/export/MissingEndLayoutBetweenTables_docbook5 export/export/latex/languages/ja-listings-uncodable-error_docbook5 export/export/latex/lyxbugs-resolved/9633-languagenesting_enumerate_and_lyxcode_docbook5 export/export/xhtml/MissingEndTagDiv_docbook5 export/export/xhtml/zh_CN_Tutorial_docbook5 # - Formal groups do not work when there is (sample) text instead of real content. export/examples/Books/Tufte_Book_docbook5 # - No proper document title (should be fixable). !export/export/latex/inputenc-utf8-platex_docbook5 export/export/latex/inputenc-.*_docbook5 export/export/latex/textcyr-textgreek-test_docbook5 export/doc/ja/Formula-numbering_docbook5 # - Formula in tags. !export/examples/(fr|ru)/Graphics_and_Insets/XY-Figure_docbook5 export/examples/(de|es|fr|ja|ru)/Graphics_and_Insets/XY-(Pic|Figure)_docbook5 # - Math macros not implemented and other insets illegally nested. export/mathmacros/testcases_speed_docbook5 export/mathmacros/testcases_environments_docbook5 export/mathmacros/masterOfSpace_docbook5 export/doc/sl/Tutorial_docbook5 # - Sidebars can be nested in LyX (mostly with shapepar), but not in DocBook. export/doc(|/de|/es|/fr|/ja)/Additional_docbook5 # - Many templates are too complex for automatic conversion to work reliably. # The resulting documents should still be easy to fully convert into DocBook. # - AASTeX. export/export/docbook/bibliography_precooked_aastex_docbook5 export/examples/Articles/American_Astronomical_Society_%28AASTeX_v._6.2%29_docbook5 # - Springer. (The svmono_light should still pass.) export/templates/Books/Springer.*/.*_docbook5 !export/export/docbook/svmono_light_docbook5 export/export/docbook/sv.*_docbook5 # - scrbook with too many customisations. export/templates/Theses/PhD_Thesis/.*_docbook5 # - Hollywood, too much formatting in elements DocBook does not allow to be formatted (like address). export/(templates|examples)/Scripts/Hollywood_docbook5 export/export/docbook/Hollywood_docbook5 # - Lettre, formatting in elements DocBook does not allow to be formatted (like email). export/templates/Letters/French_Letter_%28lettre%29_docbook5 # - Letter, elements at the end of the document that should be in . export/templates/Letters/Letter_%28Standard_Class%29_docbook5 # - G-Brief: too far from the other classes. export/templates/Letters/G-Brief_%28V._2%29_docbook5 export/templates/Obsolete/G-Brief_%28V._1,_Obsolete%29/.*_docbook5 # - KOMA-Script Letter: too hard to output phone and fax numbers at the right place (need two levels of wrapping). export/templates/Letters/KOMA-Script_Letter_%28V._2%29_docbook5 export/examples(|/de)/Letters/Serial_Letter_.*_docbook5 # - DIN-Brief: order of paragraphs cannot match valid DocBook. export/templates/Letters/DIN-Brief_docbook5 # - AMS: order of elements is not compatible with DocBook (some parts must be in , others cannot, while # still being in the book's header). export/examples/.*/American_Mathematical_Society_%28AMS%29_docbook5 # - ACS: comments in the middle of the author info can wreak havoc (fixable). Some bibliography entries do not exist within the document. Floats are empty. export/examples/Articles/American_Chemical_Society_%28ACS%29_docbook5 # - A&A: formula with two references (only one xml:id allowed per tag). export/examples/Articles/Astronomy_%26_Astrophysics_docbook5 # - Branches may cause problems (especially when mixing with parts that must go in ). export/export/latex/languages/supported-languages_(|babel|babel_auto-legacy)_?docbook5 # - EmbeddedObjects: this document is too complex, with captions within tables, many LaTeX parameters when including # a file, uncaptioned tables in the same float, etc. export/doc(|/de|/es|/fr|/ja)/EmbeddedObjects_docbook5 # - Math: formula in inline tag, formula with two references (only one xml:id allowed per tag). export/doc(|/de|/es|/fr|/ja|/ru)/Math_docbook5 # - UserGuide: formula in inline tag, use of fancyhdr export/doc(|/de|/es|/fr|/ja|/ru)/UserGuide_docbook5 # - Double inlines (code within code, personname within personname, emphasis within date, etc.). export/doc/(es|fr|ja)/Customization_docbook5 export/doc/gl/Tutorial_docbook5 export/examples/Articles/Chess/Game_2_docbook5 # - Bicaption module would require some C++ implementation. export/examples(|/de|/fr|/ja)/Modules/Multilingual_Captions_docbook5 # - European CV: hard to mix items and bibliographies. export/examples(|/de|/es)/Curricula_Vitae/Europe_CV_docbook5 # - Modern CV: columns cause problems. export/examples(|/es)/Curricula_Vitae/Modern_CV_docbook5 # - Chess: multicol not supported. export/examples/Modules/Chessboard_docbook5 # - Empty figure and table (just a caption, while DocBook requires some content). export/examples/Localization_Test_docbook5 # - Inline equation in formatting. export/examples/Modules/Fancy_Colored_Boxes_docbook5 # - Waiting for a new version of DocBook to be tagged on https://github.com/docbook/docbook (anything over 5.2b10a3). export/export/docbook/Localization_Test_docbook5 export/examples/Graphics_and_Insets/Minted_Listings_docbook5 # - Sweave and other literate-programming tools cannot be implemented properly without the LaTeX tooling. export/examples/Modules/Sweave_docbook5 # - Figures without image, only an equation. export/examples/Modules/Variable-width_Minipages_docbook5 Sublabel: docbook poster # Posters cannot be properly exported, the LyX documents are too far from # DocBook expectations (but should have XML-valid output). export/.*Poster.*_docbook5 Sublabel: docbook beamer # Beamer is not yet implemented. export/(examples|templates)/(de|es|fr|ja|ru)/Presentations/.*_docbook5 export/(examples|templates)/Presentations/.*_docbook5