Commit Graph

88 Commits

Author SHA1 Message Date
Günter Milde
dae90c6161 Warn user, if input encodings of master and child document differ. 2019-03-18 18:17:39 +01:00
Günter Milde
bda8acee67 Amend d53a13a: Bug 11519 only manifests if inputenc != "auto". 2019-03-17 11:20:58 +01:00
Günter Milde
d53a13a475 ctest for bug #11519 2019-03-16 17:55:44 +01:00
Günter Milde
2b61033324 ctests: add tests for #10600 (forced inputenc "ascii" with XeTeX and TeX-fonts). 2019-03-16 13:39:56 +01:00
Günter Milde
ddf947b8fd ctests: dedicated test for problem with textgreek and textcyrillic. 2019-03-12 22:44:13 +01:00
Günter Milde
cc84fa6173 unicodesymbols: Use \r{A} instead of \AA for "Latin letter A with ring" and "Ångström sign".
Xe/LuaTeX convert \AA to the deprecated character u212B (which is missing
in the default LatinModern font) instead of the recommended u00C5.

Also fix some of the "missing character" errors in Math.lyx if compiled with
Xe/LuaTeX which were caused by the replacement of \AA with literal u212B characters
in math-insets due to the old definitions in unicodesymbols.

Update the minimal example for failures of Math.lyx with system fonts.
2019-03-08 18:36:56 +01:00
Günter Milde
f674f563da ctest update: compilation errors due to #6463 are fixed. 2019-03-05 10:00:46 +01:00
Günter Milde
ff8cec5ea5 ctests: Problem with auto-date for Ukrainian with Xe/LuaTeX and TeX fonts.
New bug in TeXLive 18.
Missing characters with XeTeX and wrong characters with LuaTeX.

Also:
* Remove spurious (Latin) characters from uk/Intro.lyx
* "wrong-output" tag for Cyrillic documents with XeTeX and TeX fonts.
2019-03-04 16:22:00 +01:00
Günter Milde
fd106637be ctest and documentation update
The special test "arabic_simple.lyx" is no longer required,
"examples/ar/splash.lyx" works with 8-bit fonts now.

Update tagging patterns and comments.
2019-03-04 00:04:04 +01:00
Günter Milde
7a17610a00 Load "textcomp" and "pmboxdraw" before "(lua)inputenc" to fix #11454.
Prevents wrong or missing characters with LuaTeX and 8-bit fonts.

Also "uninvert" the corresponding test case and two other
no longer failing "unicodesymbols" exports.
2019-02-12 09:22:55 +01:00
Günter Milde
f8d42aed39 ctests: update Korean tests, add "language default" test including Chinese.
Set suitable non-TeX fonts in the test document.
Use "kotex" language package.
2019-02-05 11:24:53 +01:00
Günter Milde
1c9d3da938 Force "unicodesymbols" conversion for legacy CJK encodings where required. 2019-01-31 18:29:04 +01:00
Günter Milde
7e120159fc ctests: Update Chinese report example. 2019-01-30 15:54:30 +01:00
Günter Milde
319a986fc0 Do not use \inputencoding when the buffer input encoding is one of the "legacy" CJK encodings.
If Document>Settings>Language>Encoding is set to any value except "auto" or "default", we
expect the whole document to use this encoding. Wiht encodings from the CJK package, this means
one big "CJK" environment and no encoding switches.

Characters that are not handled by the CJK package need to be "forced" in lib/unicodesymbols.
This is completed for "euc-cn", the others will follow.
2019-01-30 15:14:45 +01:00
Günter Milde
b01eb6c6a4 ctests: fix/update CJK tests. 2019-01-30 00:53:31 +01:00
Günter Milde
8060c8e488 ctests: Dedicated test and comments for "lyx2lyx.lyx_2_4.revert_fonts". 2019-01-29 15:11:21 +01:00
Günter Milde
34f5ba3c54 Fix for CJK-documents with input-encoding "utf8". 2019-01-28 17:49:58 +01:00
Günter Milde
964c15f80b ctests: update CJK export tests. 2019-01-28 17:24:39 +01:00
Günter Milde
5ebc0b3f43 Fix second part of #5386.
A \clearpage command issued right before \end{CJK} is recommended by the
package author to prevent any un-processed CJK chars outside the
\begin{CJK} and \end{CJK} scope. Otherwise, TOC, header, footer,
and may contain CJK chars but get processed outside the CJK environment scope.

Tha new dedicated export test fails without the fix.
2019-01-24 14:40:19 +01:00
Günter Milde
197735747e Support for documents in other scripts with parts in CJK scripts.
Fix CJK support for documents using input-encoding "utf8-cjk"
when the main language is not Chinese, Korean, or Japanese.
2019-01-24 00:40:51 +01:00
Günter Milde
e8c497e33e ctests: export tests for CJK in multilingual documents. 2019-01-23 00:57:20 +01:00
Günter Milde
968a3d06a4 Test for bug #6197.
With language Polish, "amssymb" must be loaded before "babel" to
avoid a name clash for command "\lll".
2019-01-22 23:59:11 +01:00
Günter Milde
f82030d211 Farsi document with custom font encoding OT1 fails.
Set font encoding in examples to "auto" and add minimal test sample.
2019-01-22 12:02:57 +01:00
Günter Milde
12c301d1ca update latex export tests, add test for bug #9871 2019-01-20 17:23:41 +01:00
Günter Milde
b9833f180a ctests: update inputenc tests.
Use \input in luainputenc-utf8 instead of copying the
content of test documents in latex/unicodesymbols/.
2019-01-20 17:23:41 +01:00
Günter Milde
b9041328a0 unicodesymbols Force substitution of NNBSP in utf8.
NNBSP (narrow no break space) is supported by LyX's unicodesymbols
but missing in LaTeX inputenc *.dfu definitions. (TeXLive 2017)
2019-01-16 18:34:35 +01:00
Günter Milde
cc0ef52a37 Update some special latex export tests. 2019-01-14 22:48:38 +01:00
Günter Milde
4ebb415773 Update unicodesymbols replacements
"textcomp" supports some more characters in its ts1enc.dfu Unicode definition file.
2019-01-14 22:48:38 +01:00
Günter Milde
0594a4fe72 ctests: update test tagging/categorization and export test for accents on Cyrillic letters. 2019-01-14 12:21:34 +01:00
Günter Milde
0f569e961d ctests: Update/clean up latex export tests after fix of #9681. 2019-01-10 17:21:01 +01:00
Günter Milde
251aaf102f unicodesymbols: support for LOW ASTERISK, use textcomp for (non-combining) Breve and Caron
The textcomp Unicode support file "ts1enc.dfu" defines 0x204E Low Asterisk
as \textasteriskcentered. LyX should follow suit.
The ASTERISK OPERATOR (correctly) maps to the same macro,
the "deprecated" tag marks the upstream mapping as preferred choice.
2019-01-09 14:59:22 +01:00
Günter Milde
23f7431cfa ctests: Dedicated LaTeX export tests for problematic input encodings. 2019-01-09 14:10:40 +01:00
Günter Milde
0cfc50883c Remove omikron from math tests.
The letter Omikron is not available in TeX math mode because
it looks like the latin O and hence not used as mathematical symbol.
2019-01-09 10:39:40 +01:00
Günter Milde
41055bab88 Fix handling of Thai tis620-0 input encoding.
The Thai tis620-0 input encoding is supported via the inputenc "plug in"
(data) file tis620.def from https://ctan.org/pkg/babel-thai.

We can handle it like the other contributed input encodings, e.g.,
Greek (ISO 8859-7) and the several Cyrillic encodings from
http://www.ctan.org/pkg/latex-cyrillic.

Under TeXLive 2018, the input encoding defaults to utf8, if there is no call to
inputenc. The added test file fails without the patch but compiles fine, if the
file "tis620.def" is present in the TEXPATH.
2019-01-09 09:23:16 +01:00
Günter Milde
81066e2894 ctests: utf8-plain now works with all export variants.
utf8-plain (Unicode (utf8 XeTeX)) is a power-user setting
for the input encoding with two use cases:

a) setup of system fonts or

b) setup of input encoding supportuser preamble

in the document class or user preamble.

The test file is an example for use case b.
2019-01-07 23:21:04 +01:00
Kornel Benko
620efb3540 Amend 88e5e5f: Wrap rotated cells with linebreaks in varwidth
Added testcase from #8085
2018-06-30 17:00:56 +02:00
Kornel Benko
0519a70297 Make the lyx2lyx test-file 'lyx_2_1_test.lyx' compilable.
Inserted short German text to provoke loading its language feature
to babel.
2018-04-27 19:58:25 +02:00
Kornel Benko
0add7120ba ctests: Test dedicated LaTeX test samples with LaTeX export only.
A fixed size table cell which contains multiple paragraphs in other language
2018-04-25 12:14:32 +02:00
Günter Milde
8f86b72cf4 lyx2lyx fixes and cleanup.
Don't insert empty line when translating QuoteInsets to literal
quotes.

Fix regexp pattern in re/convert_dashligatures.

Adjust logic in re/convert_dash(ligatur)es.
2018-02-09 16:49:23 +01:00
Günter Milde
fbfa82b313 ctests: Update dedicated lyx2lyx tests. 2018-02-07 18:49:21 +01:00
Günter Milde
2fce4d49ee lyx2lyx refactoring.
* use unicode.transform() instead of loop over replacements
* telling variable names
* remove trailing whitespace
* documentation update
* don't set use_ligature_dashes if both dash types are found
* remove spurious warning, normalize indentation, and use
  Python idioms in revert_baselineskip()
2018-01-31 21:13:43 +01:00
Günter Milde
62f32992ab Dedicated test samples for lyx2lyx ctests. 2018-01-24 17:36:53 +01:00
Günter Milde
275bb44158 ctests: move issue with nomenclature insets to a dedicated test case.
iconv fails, if a nomenclature inset contains an uncodable character
This led to failure of the indonesian UserGuide in the attic.
Fix it there and add a minimal, specific test sample instead.
2017-05-04 18:05:18 +02:00
Günter Milde
5637c9b321 ctests: Add test file for "exotic" inputencoding cp858.
Encoding cp858 is only supported by some iconv variants
Gnu iconv only supports it, if configured with "--enable-extra-encodings"
(see https://www.gnu.org/software/libiconv/)

Maybe drop support or add a configuration check?
2017-03-01 23:16:59 +01:00
Günter Milde
7b5de36a75 Use xfrac package for "fraction characters".
The xfrac package is the "state of the art" for "split-level" (nice) fractions.
Character replacements look consistent, scale properly and fit in the line.

Fixes #5220.
2016-12-18 23:42:15 +01:00
Scott Kostyshak
7cbbf00eaf Improve ctesting of Arabic documents
- invert the currently failing tests
- add a new test document that shows LyX's support of pdf2

For more details, see the discussion here:
https://www.mail-archive.com/search?l=mid&q=20161114035123.s5lt4ib4x4obtptp%40steph
2016-11-24 23:10:16 -05:00
Günter Milde
15fd79201e lib/unicodesymbols tests and fixes.
Test unicodesymbols for most supported input encodings with Kornel's addition to ctests.

Add required "forces" to unicodesymbols:
* utf8x does not support all characters supported by LyX
* several 8-bit encodings map characters to math-mode commands - force replacement in text-mode so that LyX can wrap them in \\ensuremath.

Fix a misalignment (wrong replacements) in the Cyrillic Unicode block.

Use \\mathscr for Mathematical Script characters in Mathematical Alphanumeric Characters (in line with the characters in other unicode blocks.
2016-11-15 23:50:41 +01:00
Günter Milde
1ff4aeaf1f Complete the renaming of a ctest sample directory.
Rename the directory for test samples  "export/latex/Unicode-characters" to "export/latex/unicodesymbols". This matches the purpose to test the lib/unicodesymbols file.
2016-11-14 14:32:46 +01:00
Günter Milde
6674a91573 lib/unicodesymbols test update and fixes.
First run of Kornels patch for tests with all input encodings in lib/encodings.

Remove redundant sample files - keep only one sample and change the input encoding in the test script.

Put remaining failing test in "unreliableTests" for later sorting...
2016-11-09 21:15:14 +01:00
Günter Milde
120e84af3a ctests: explore export failure of Math.lyx with Unicode fonts. 2016-10-17 10:36:45 +02:00