Commit Graph

126 Commits

Author SHA1 Message Date
Günter Milde
9fdae0d84c Use utf8 inputencoding for Russian documentation.
Solves errors with luatex and enables compilation with xetex.
Add dedicated test document for the errors with auto-legacy and xe/luatex.
2019-04-28 22:45:51 +02:00
Günter Milde
e8e3dafd8f ctests: Sort dedicated test documents for language support. 2019-04-28 19:34:37 +02:00
Günter Milde
7a87599a3e Load inputenc after babel with Thai.
"thai.ldf" breaks "inputenc" by changing catcodes.
Loading "inputenc" after "babel" allows a workaround.
2019-04-27 17:09:29 +02:00
Günter Milde
c6f64bc734 ctest update
invert tests failing in TL19,
fix sorting in "supported-languages.lyx".
2019-04-25 14:02:58 +02:00
Günter Milde
5c0ea92f80 ctests: add some dedicated test samples. 2019-04-20 21:53:16 +02:00
Günter Milde
15b7ea4828 ctest and documentation update
Thai works fine with LuaTeX, TeX-fonts and auto-legacy input encoding.

Remove obsolete preamble code,
we now load "fontenc" with Japanese documents by default.
2019-04-20 21:39:49 +02:00
Günter Milde
29265ce702 language support update (tests and workaround for Thai). 2019-04-16 22:05:58 +02:00
Günter Milde
62f8b4fac1 Document languages with new polyglossia support. 2019-04-12 18:34:06 +02:00
Günter Milde
e5435cd61e Update language support documentation and comments. 2019-04-12 18:08:17 +02:00
Günter Milde
9dd7ffff7b ctest update: Japanese documents (should) work with non-TeX fonts.
* do not ignore Japanese (platex) with system fonts.

* CJK can be used with XeTeX and TeX-fonts if the input encoding is utf8.
  do not ignore.

* TODO: set non-TeX fonts and uninvert where possible.
2019-04-12 18:08:17 +02:00
Günter Milde
da23637d7f Do not switch the input encoding inside documents using platex.
Fixes wrong and missing characters in text parts in other languages
(platex does not support "inputenc").

Fixes compilation errors due to desynchronized encoding switches.
2019-04-12 18:08:17 +02:00
Günter Milde
230cc9bc5b ctest: update tagging scripts. 2019-04-10 21:02:10 +02:00
Günter Milde
b32cf2a4c0 unicodesymbols: support Thai characters.
Also update the ctests.
2019-04-09 23:07:05 +02:00
Günter Milde
2efe99c33d Improve and document use of Thai language. 2019-04-09 17:13:44 +02:00
Günter Milde
f9486e8cf3 ctests: update names of included files in input encoding samples for Xe/LuaTeX. 2019-04-08 22:08:49 +02:00
Kornel Benko
db06c85611 Cmake tests: Converted to new format, to insert \use_non_tex_fonts variable set 2019-04-07 21:09:56 +02:00
Günter Milde
895fa9b3c6 ctest fixes.
Hebrew with "nikud" requires HE8 font encoding.
All tests requiring Hebrew 8-bit fonts are "nonstandard".
2019-04-03 08:36:46 +02:00
Günter Milde
2e854cd36c ctest update.
* some Japanese (platex) documents fail with inputenc "utf8-platex"
  (missing characters in non-Japanese text parts), because the
  Unicodechar definitions from "inputenc" are not used.

* some Japanes (platex) documents show wrong output with "auto",
  because platex ignores the encoding switch for text parts
  in other languages.

* Japanese Beamer documents must set default output to "pdf",
  because dvipdfm(x) produces wrong output with document class "Beamer".

* update tagging/inverting rules.

* use HE8 font encoding for Hebrew in language test.
2019-04-02 16:46:26 +02:00
Günter Milde
b724b4f32f Do not force the use of the HE8 font encoding for Hebrew.
While HE8 provides more characters and prevents use of bitmap fonts,
forcing its use may break older installations.

The dedicated test file 012_hebrew_he_HE8.lyx provides an
example for use of HE8 encoded fonts with babel-hebrew.
2019-04-02 13:21:38 +02:00
Günter Milde
d4ade2bc1c unicodesymbols: add Hebrew nikud symbols and presentation forms.
The "nikud" (vowel) signs, shindot, and shindot  are combining Unicode
characters. However, LaTeX-Hebrew expects them as postfix characters, not
accent macros (cf. www.cs.tau.ac.il/~stoledo/Bib/Pubs/vowels.pdf).
2019-04-01 19:12:36 +02:00
Günter Milde
e5567a1377 ctests: sample for Arabic as secondary language. 2019-03-29 10:44:21 +01:00
Günter Milde
ffc682424e Update ctest tagging and documentation/sample organisation. 2019-03-28 13:30:22 +01:00
Günter Milde
f0b326a9f4 Comprehensive language test document and some more fixes.
Work around or document language clashes and limitations.
2019-03-27 17:49:08 +01:00
Günter Milde
32b47e975e Fix settings for Hebrew with 8-bit TeX fonts. 2019-03-27 17:09:12 +01:00
Günter Milde
b1b8071168 ctest update.
#9681 is fixed in master.
Hebrew with 8-bit fonts fails with vanilla TeXLive.
Add link to ticket in dedicated test document.
2019-03-27 16:20:17 +01:00
Günter Milde
48b92cf63c Test for #11532 "inputencoding desynchronisation". 2019-03-27 15:57:38 +01:00
Günter Milde
f7fbd8c1ab Hebrew shindot and shindot but work fine as postfix. 2019-03-27 14:39:08 +01:00
Günter Milde
80b6a0038a Add lib/unicodesymbols support for Hebrew.
Hebrew language must be set (otherwise character macros are not defined)
but this is normally no problem because it is also neede for RTL support.
2019-03-22 23:55:00 +01:00
Günter Milde
1933102593 ctest update and small documentation fixes. 2019-03-19 22:17:52 +01:00
Günter Milde
dae90c6161 Warn user, if input encodings of master and child document differ. 2019-03-18 18:17:39 +01:00
Günter Milde
bda8acee67 Amend d53a13a: Bug 11519 only manifests if inputenc != "auto". 2019-03-17 11:20:58 +01:00
Günter Milde
d53a13a475 ctest for bug #11519 2019-03-16 17:55:44 +01:00
Günter Milde
2b61033324 ctests: add tests for #10600 (forced inputenc "ascii" with XeTeX and TeX-fonts). 2019-03-16 13:39:56 +01:00
Günter Milde
ddf947b8fd ctests: dedicated test for problem with textgreek and textcyrillic. 2019-03-12 22:44:13 +01:00
Günter Milde
cc84fa6173 unicodesymbols: Use \r{A} instead of \AA for "Latin letter A with ring" and "Ångström sign".
Xe/LuaTeX convert \AA to the deprecated character u212B (which is missing
in the default LatinModern font) instead of the recommended u00C5.

Also fix some of the "missing character" errors in Math.lyx if compiled with
Xe/LuaTeX which were caused by the replacement of \AA with literal u212B characters
in math-insets due to the old definitions in unicodesymbols.

Update the minimal example for failures of Math.lyx with system fonts.
2019-03-08 18:36:56 +01:00
Günter Milde
f674f563da ctest update: compilation errors due to #6463 are fixed. 2019-03-05 10:00:46 +01:00
Günter Milde
ff8cec5ea5 ctests: Problem with auto-date for Ukrainian with Xe/LuaTeX and TeX fonts.
New bug in TeXLive 18.
Missing characters with XeTeX and wrong characters with LuaTeX.

Also:
* Remove spurious (Latin) characters from uk/Intro.lyx
* "wrong-output" tag for Cyrillic documents with XeTeX and TeX fonts.
2019-03-04 16:22:00 +01:00
Günter Milde
fd106637be ctest and documentation update
The special test "arabic_simple.lyx" is no longer required,
"examples/ar/splash.lyx" works with 8-bit fonts now.

Update tagging patterns and comments.
2019-03-04 00:04:04 +01:00
Günter Milde
7a17610a00 Load "textcomp" and "pmboxdraw" before "(lua)inputenc" to fix #11454.
Prevents wrong or missing characters with LuaTeX and 8-bit fonts.

Also "uninvert" the corresponding test case and two other
no longer failing "unicodesymbols" exports.
2019-02-12 09:22:55 +01:00
Günter Milde
f8d42aed39 ctests: update Korean tests, add "language default" test including Chinese.
Set suitable non-TeX fonts in the test document.
Use "kotex" language package.
2019-02-05 11:24:53 +01:00
Günter Milde
1c9d3da938 Force "unicodesymbols" conversion for legacy CJK encodings where required. 2019-01-31 18:29:04 +01:00
Günter Milde
7e120159fc ctests: Update Chinese report example. 2019-01-30 15:54:30 +01:00
Günter Milde
319a986fc0 Do not use \inputencoding when the buffer input encoding is one of the "legacy" CJK encodings.
If Document>Settings>Language>Encoding is set to any value except "auto" or "default", we
expect the whole document to use this encoding. Wiht encodings from the CJK package, this means
one big "CJK" environment and no encoding switches.

Characters that are not handled by the CJK package need to be "forced" in lib/unicodesymbols.
This is completed for "euc-cn", the others will follow.
2019-01-30 15:14:45 +01:00
Günter Milde
b01eb6c6a4 ctests: fix/update CJK tests. 2019-01-30 00:53:31 +01:00
Günter Milde
8060c8e488 ctests: Dedicated test and comments for "lyx2lyx.lyx_2_4.revert_fonts". 2019-01-29 15:11:21 +01:00
Günter Milde
34f5ba3c54 Fix for CJK-documents with input-encoding "utf8". 2019-01-28 17:49:58 +01:00
Günter Milde
964c15f80b ctests: update CJK export tests. 2019-01-28 17:24:39 +01:00
Günter Milde
5ebc0b3f43 Fix second part of #5386.
A \clearpage command issued right before \end{CJK} is recommended by the
package author to prevent any un-processed CJK chars outside the
\begin{CJK} and \end{CJK} scope. Otherwise, TOC, header, footer,
and may contain CJK chars but get processed outside the CJK environment scope.

Tha new dedicated export test fails without the fix.
2019-01-24 14:40:19 +01:00
Günter Milde
197735747e Support for documents in other scripts with parts in CJK scripts.
Fix CJK support for documents using input-encoding "utf8-cjk"
when the main language is not Chinese, Korean, or Japanese.
2019-01-24 00:40:51 +01:00
Günter Milde
e8c497e33e ctests: export tests for CJK in multilingual documents. 2019-01-23 00:57:20 +01:00