- dev-luatex - NTG Mailing Lists

Potential race condition in makefiles
by Dmitry Kalinkin 08 May '21

08 May '21

Hi, We are observing a following build failure: ../../../texk/web2c/luatexdir/luamd5/md5lib.c:197:10: fatal error: 'utilsha.h' file not found #include "utilsha.h" ^~~~~~~~~~~ 1 error generated. For the full log, see https://hydra.nixos.org/build/142527628/nixlog/2 Best regards, Dmitry

2 3

\protrusionboundary
by Robert 06 May '21

06 May '21

Hi, the command \protrusionboundary could potentially be very useful, but I'm not sure I understand how it's supposed to work. The manual gives the example (p.43): | \protrusionboundary1\llap{!\quad}«Who needs protrusion?» However, with the following: \input luaotfload.sty \parindent=0pt \protrudechars=2 \directlua{ fonts.protrusions.setups['test'] = { [0x00AB] = { 1, 0 } % left guillemet } } \font\x=[lmroman10-regular.otf]:protrusion=test; \x Who\par «Who\par \protrusionboundary1\llap{!\quad}«Who \bye the guillemet on the last line is not protruded as I would have expected. Or am I missing something? Secondly, the documentation says that \protrusionboundary will ignore the next/previous node (singular). What would be much more practical in real life, I think, is to have a command that would simply say, "consider the current point as left/right/both margin(s)", because more often than not, you'd find a succession of hboxes, penalties etc. (plural) that you'd want to skip. Would that be feasible? Best, -- Robert

1 0

i686-mingw: texlua.exe FFI module not working
by Naveen M K 28 Apr '21

28 Apr '21

Hi, I had been trying to compile TexLive on MINGW compilers on Windows provided by MSYS2[0] project. See this PR[1]. It was only for i686-mingw. x86-64-mingw worked without any problems. I found that there was Segmentation Fault(or crash) when running the `runscript.exe` the launchers which TexLive provides on Windows and I could see it uses LuaTeX. You can find the source here[2]. What is essentially does is calls the `texlua.exe` with `runscript.tlu` passed it in. I initially thought it was a problem with compiled version of the launcher itself, but it wasn't it, it was a problem with `texlua.exe`. `runscript.exe` just returns the code returned from `texlua.exe` and the return code was a crash and there is a popup which say the program isn't working correctly and crashed at `ntdll.dll`. While just running `texlua.exe` on a normal hello world lua script[3] works without any crash or error. So, I thought something from the code in `runscript.tlu`[4] should be causing this issue. I don't know how to debug a lua script, so my plan was to randomly place print statements (you know that is the easiest and best way to debug something), and whether it printed or not. I first looked over the `runscript.tlu` to see if there are parts of code which could crash the interpreter and I found this block of code[5] which uses ffi module. Now I placed print statements before and after local runscripthandle = ffi.C.GetModuleHandleA("runscript.dll") and found that the one before was printed and `texlua.exe` crashed. So it is something related to ffi module. I tried the same with `texluajit.exe` and it seemed to work. What I did to make the launchers work was to patch this [6] and it worked without any problem. But that isn't the actual fix the Crash in `texlua.exe` on using ffi module in `i686-mingw`. I hope anybody will help me fix this. For the version, I am building TexLive with this `ccb6338507149edf2772bfccb9933b72761f4cc4` commit on GitHub or `svn://tug.org/texlive/trunk/Build/source@58686`. Best, Naveen [0]: https://www.msys2.org [1]: https://github.com/msys2/MINGW-packages/pull/8271 [2]: https://github.com/TeX-Live/texlive-source/blob/9bad8358d2f98a8bed86ecfa238… [3]: https://www.lua.org/pil/1.html [4]: https://github.com/TeX-Live/texlive-source/blob/9bad8358d2f98a8bed86ecfa238… [5]: https://github.com/TeX-Live/texlive-source/blob/9bad8358d2f98a8bed86ecfa238… [6]: https://github.com/msys2/MINGW-packages/blob/3e2204b3fa18cd967b7aa616dfef9e…

2 1

Uunderdelimiter & friends and mathstyles
by Marcel Fabian Krüger 20 Apr '21

20 Apr '21

Hi, I noticed some odd behavior about \U{under,over}delimiter/\Udelimiter{under,over} related to the applied mathstyles for the nucleus: Take the following example \input luaotfload.sty \font\lmmath"Latin Modern Math:script=math,mode=base" \font\scriptlmmath"Latin Modern Math:script=math,mode=base" at 7pt \font\scriptscriptlmmath"Latin Modern Math:script=math,mode=base" at 5pt \textfont42=\lmmath \scriptfont42=\scriptlmmath \scriptscriptfont42=\scriptscriptlmmath $$ \Udelimiterunder42 "2192{\mathstyle x^L} \Udelimiterover42 "2192{\mathstyle x^L} \Uunderdelimiter42 "2192{\mathstyle x^L} \Uoverdelimiter42 "2192{\mathstyle x^L} $$ \bye In all four situations \mathstyle shows 1, but neither of the four x^L are actually set in \mathstyle 1 (crampeddisplay): \Udelimiterunder sets it's argument in the outer mathstyle. IMO this is the expected behavior but should be reflected in \mathstyle. \Udelimiterover sets it's argument in the outer mathstyle. IMO it should be cramped instead. \Uoverdelimiter sets it's argument in subscript style (cramped and one size smaller) Since there's nothing printed on top of it' argument, I think that superscript style would be better. (aka not cramped) In any case it should be reflected in \mathstyle. \Uunderdelimiter sets it's argument in superscript style (one size smaller) Since the delimiter is printed on top of it I think that subscript style would be better (aka cramped). In any case it should be reflected in \mathstyle. The patch at the end adapts both \mathstyle and changes the actually used styles. Best regards, Marcel diff --git a/source/texk/web2c/luatexdir/tex/mlist.c b/source/texk/web2c/luatexdir/tex/mlist.c index 2ac631ea3..71e7c88ea 100644 --- a/source/texk/web2c/luatexdir/tex/mlist.c +++ b/source/texk/web2c/luatexdir/tex/mlist.c @@ -2385,7 +2385,7 @@ static void make_over_delimiter(pointer q, int cur_style) pointer x, y, v; scaled shift_up, shift_down, clr, delta, wd; boolean stack; - x = clean_box(nucleus(q), sub_style(cur_style), cur_style, math_nucleus_list); + x = clean_box(nucleus(q), sup_style(cur_style), cur_style, math_nucleus_list); check_widths(q,x); y = do_delimiter(q, left_delimiter(q), cur_size, wd, true, cur_style, true, &stack, NULL, NULL); left_delimiter(q) = null; @@ -2416,7 +2416,7 @@ static void make_under_delimiter(pointer q, int cur_style) pointer x, y, v; scaled shift_up, shift_down, clr, delta, wd; boolean stack; - y = clean_box(nucleus(q), sup_style(cur_style), cur_style, math_nucleus_list); + y = clean_box(nucleus(q), sub_style(cur_style), cur_style, math_nucleus_list); check_widths(q,y); x = do_delimiter(q, left_delimiter(q), cur_size, wd, true, cur_style, true, &stack, NULL, NULL); left_delimiter(q) = null; @@ -2447,7 +2447,7 @@ static void make_delimiter_over(pointer q, int cur_style) pointer x, y, v; scaled shift_up, shift_down, clr, actual, wd; boolean stack; - y = clean_box(nucleus(q), cur_style, cur_style, math_nucleus_list); + y = clean_box(nucleus(q), cramped_style(cur_style), cur_style, math_nucleus_list); check_widths(q,y); x = do_delimiter(q, left_delimiter(q), cur_size + (cur_size == script_script_size ? 0 : 1), wd, true, cur_style, true, &stack, NULL, NULL); left_delimiter(q) = null; diff --git a/source/texk/web2c/luatexdir/tex/texmath.c b/source/texk/web2c/luatexdir/tex/texmath.c index 461a51578..0c0e8a9cc 100644 --- a/source/texk/web2c/luatexdir/tex/texmath.c +++ b/source/texk/web2c/luatexdir/tex/texmath.c @@ -1580,6 +1580,7 @@ static void scan_delimiter(pointer p, int r) void math_radical(void) { halfword q; + int new_mstyle; int chr_code = cur_chr; halfword options = 0; tail_append(new_node(radical_noad, chr_code)); @@ -1600,28 +1601,35 @@ void math_radical(void) } } radicaloptions(tail) = options; - if (chr_code == 0) + if (chr_code == 0) { /*tex \.{\\radical} */ scan_delimiter(left_delimiter(tail), tex_mathcode); - else if (chr_code == 1) + new_mstyle = cramped_style(m_style); + } else if (chr_code == 1) { /*tex \.{\\Uradical} */ scan_delimiter(left_delimiter(tail), umath_mathcode); - else if (chr_code == 2) + new_mstyle = cramped_style(m_style); + } else if (chr_code == 2) { /*tex \.{\\Uroot} */ scan_delimiter(left_delimiter(tail), umath_mathcode); - else if (chr_code == 3) + new_mstyle = cramped_style(m_style); + } else if (chr_code == 3) { /*tex \.{\\Uunderdelimiter} */ scan_delimiter(left_delimiter(tail), umath_mathcode); - else if (chr_code == 4) + new_mstyle = sub_style(m_style); + } else if (chr_code == 4) { /*tex \.{\\Uoverdelimiter} */ scan_delimiter(left_delimiter(tail), umath_mathcode); - else if (chr_code == 5) + new_mstyle = sup_style(m_style); + } else if (chr_code == 5) { /*tex \.{\\Udelimiterunder} */ scan_delimiter(left_delimiter(tail), umath_mathcode); - else if (chr_code == 6) + new_mstyle = m_style; + } else if (chr_code == 6) { /*tex \.{\\Udelimiterover} */ scan_delimiter(left_delimiter(tail), umath_mathcode); - else if (chr_code == 7) + new_mstyle = cramped_style(m_style); + } else if (chr_code == 7) /*tex \.{\\Uhextensible} */ scan_delimiter(left_delimiter(tail), umath_mathcode); else @@ -1645,12 +1653,12 @@ void math_radical(void) vlink(degree(tail)) = null; q = new_node(math_char_node, 0); nucleus(tail) = q; - (void) scan_math(nucleus(tail), cramped_style(m_style)); + (void) scan_math(nucleus(tail), new_mstyle); } } else { q = new_node(math_char_node, 0); nucleus(tail) = q; - (void) scan_math(nucleus(tail), cramped_style(m_style)); + (void) scan_math(nucleus(tail), new_mstyle); } }

3 4

linkarea in rtl context
by Ulrike Fischer 19 Apr '21

19 Apr '21

In luatex 1.13.0 (texlive 2021) this here gives the wrong linkarea: it stretches to the left from the end of the link instead to the right. In texlive 2020 the behaviour is correct: \pardir TRT \textdir TRT \linedir TRT X \pdfextension startlink attr {/Border[0 0 1]} user{ /Subtype/Link% /A<<% /Type/Action% /S/URI% /URI(blub)% >>% } Linktext \pdfextension endlink y \bye -- Ulrike Fischer https://www.troubleshooting-tex.de/

2 4

What exactly means \suppressmathparerror=1 ?
by Petr Olsak 28 Mar '21

28 Mar '21

The \suppressmathparerror=1 should suppress \par errors in math mode. OK, this works: ----------------- \suppressmathparerror=1 $$ a b $$ \bye ------------------ but the following example gives error: Display math should end with \Ustopdisplaymath ------------------- \suppressmathparerror=1 $$ \halign{#\cr a\cr} $$ \bye ------------------- The LuaTeX manual does not exactly describes the behavior of this case. So, I don't know if this is feature or bug. Note that the second example is primitive meaning of something like this: -------------------- $$ \eqalignno{...} $$ -------------------- If a user know that "empty lines are allowed in math mode" then he/she could leave empty line after \eqalignno too. Best regards Petr Olsak

3 2

segfault in luatex, assert in pdftex
by Martin Budaj 16 Mar '21

16 Mar '21

Hi, there is a segfault produced by LuaTeX, Version 1.12.0 (TeX Live 2020/Debian) when processing the following: \ifdefined\directlua \protected\def\pdfmapfile {\pdfextension mapfile } \protected\def\pdfmapline {\pdfextension mapline } \edef\pdfgentounicode {\pdfvariable gentounicode} \protected\def\pdfglyphtounicode {\pdfextension glyphtounicode } \fi \pdfglyphtounicode{A}{0041} \pdfgentounicode=1 \pdfmapfile{} \pdfmapline{cmr10 CMR10 34} % no font embedding anything \end PdfTex, Version 3.14159265-2.6-1.40.21 (TeX Live 2020/Debian) gives the following assertion: pdftex: ../../../texk/web2c/pdftexdir/writefont.c:555: write_fontdictionary: Assertion `fo->fd->builtin_glyph_names != NULL' failed. Aborted If the combination of using \pdfgentounicode and not embedding any font is invalid, some reasonable error message should be produced. Best regards Martin

2 3

Wrong spacing for OpenType math subscripts
by Johannes Rosenberger 15 Mar '21

15 Mar '21

Hi LuaTeX developers, first of all, thank you very much for all your work on this and the great OpenType support and possibility of fixing internals using Lua code! In the following document, the math subscripts are so close to the following characters that they sometimes overlap: \documentclass{article} \usepackage{unicode-math} \def\supp{{\rm supp}} \begin{document} $$ I(P_X,P_{Y|X}) = \sum_{(X,Y) \in \supp P_{XY}} P_{XY}(X,Y) \log_2 \frac{P_{XY}(X,Y)}{P_X(X) P_Y(Y)}. $$ \end{document} The problem cannot be fixed by simply adding spacing, e.g. \Uordopenspacing, because the space is different per character. We need italics correction, in all circumstances where an italic symbol is last in the subscript and something follows the noad. By the manual, Section 7.6.4 this is not applied to subscripts, but only the base characters. Setting \mathitalicsmode=1 to force it changes nothing, because italics correction is then only applied in the subscript to the characters before the last one. Maybe luatex assumes the last character to be followed by nothing, because in the mlist of the subscript follows nothing even if after the whole noad follows something. Setting \mathitalicsmode=1 and adding manual 0-kerns (like \/) helps. This is implemented by the following lua code: \directlua{ ty = node.types() sub_addkern = function(sub) scan_sub_addkern(sub) local kern = node.new("kern") if ty[sub.id] == "math_char" or ty[sub.id] == "math_char_text" then local old = node.new("noad", 0) old.nucleus = sub sub = node.new("sub_mlist") sub.head = old node.insert_after(sub.head, old, kern) elseif ty[sub.id] == "sub_box" or ty[sub.id] == "sub_mlist" then local tail = node.tail(sub.head) if not (ty[tail.id] == "kern") then node.insert_after(sub.head, tail, kern) end end return sub end scan_sub_addkern = function(n) if n.head then n.head = scan_all_sub_addkern(n.head) end if n.sub then n.sub = sub_addkern(n.sub) end if n.nucleus then scan_sub_addkern(n.nucleus) end if n.num then scan_sub_addkern(n.num) end if n.denom then scan_sub_addkern(n.denom) end end scan_all_sub_addkern = function(head) for n in node.traverse(head) do scan_sub_addkern(n) end return head end luatexbase.add_to_callback("pre_mlist_to_hlist_filter", scan_all_sub_addkern, "default mlist_to_hlist + italics-corrected subscript") } XeTeX does this right out of the box. Best, Johannes

3 4

[fs]io.readinteger4 produces excessively small negative values
by Marcel Fabian Krüger 07 Mar '21

07 Mar '21

Hi, Look at the texlua script: print(sio.readinteger4(string.pack(">i", -1), 1)) It would be expected that this prints "-1", but at least is should print a number in the range of 4-byte signed integers (-2147483648 -- 2147483647). Instead it prints -4294967297. The same issue appears with fio.readinteger4 and [fs]readintegertable(..., 4): Whenever the value is negative, the returned value is 2^32 lower than expected. (Technically this only happens if Lua's integer type allows at least 64-bit integers and the native "int" type has at most 32-bit, but this is the case on basically any current platform. The cause is code like the following in the affected C implementations: int a = ...; int b = ...; int c = ...; int d = ...; if (a >= 0x80) lua_pushinteger(L, 0x1000000 * a + 0x10000 * b + 0x100 * c + d - 0x100000000); else ...; Here a, b, c, d are "int", so according to C language rules "0x1000000 * a + 0x10000 * b + 0x100 * c + d" is evaluated as a (signed) int. If a>=0x80 then 0x1000000*0x80 is bigger than 2^31 and can therefore not be represented in a (32-bit) int. Theoretically this triggers undefined behavior since LuaTeX does not compile with "-fwrapv" or similar, but on my system it does "the expected thing" and wraps. Therefore the value is already negative and the subtraction of 0x100000000, which is evaluated in 64bit since the literal can not be represented in 32bit, leads to the unexpected value. This can be fixed by making sure that the expression is completely evaluated with 64-bit integers (or whatever integer type Lua uses). A possible patch is attached. Best regards, Marcel

3 2

Including PDF images with page /Metadata streams
by Marcel Fabian Krüger 01 Mar '21

01 Mar '21

Hi, (corresponding bug report for LaTeX: https://tex.stackexchange.com/questions/585289/corrupt-pdf-with-includegrap… ) when LuaTeX includes a PDF file in which a Page object contains a Metadata stream, then the output is a invalid PDF file since LuaTeX adds the stream inline into the directory instead of adding a reference. plain LuaTeX example: Download page.pdf from https://bitbucket.org/longwayahead/latex-problem/src/master/ and then compile with plain LuaTeX: \saveimageresource{./page.pdf} \useimageresource\lastsavedimageresourceindex \bye The issue can be fixed by removing a single character: In pdftoepdf.c, line 875 a comment correctly mentions that indirection has to be preserved, but for this to work the previous ppdict_rget_obj has to be replaced with ppdict_get_obj to ensure that indirections are not already resolved. Best regards, Marcel diff --git a/source/texk/web2c/luatexdir/image/pdftoepdf.c b/source/texk/web2c/luatexdir/image/pdftoepdf.c index 78dab3a37..ca68ba8dc 100644 --- a/source/texk/web2c/luatexdir/image/pdftoepdf.c +++ b/source/texk/web2c/luatexdir/image/pdftoepdf.c @@ -864,15 +864,15 @@ void write_epdf(PDF pdf, image_dict * idict, int suppress_optional_info) if (obj != NULL && obj->type != PPREF) { formatted_warning("pdf inclusion","/Metadata must be indirect object"); } /* copy selected items in Page dictionary */ for (i = 0; pagedictkeys[i] != NULL; i++) { - obj = ppdict_rget_obj(pageDict, pagedictkeys[i]); + obj = ppdict_get_obj(pageDict, pagedictkeys[i]); if (obj != NULL) { pdf_add_name(pdf, pagedictkeys[i]); /* preserves indirection */ copyObject(pdf, pdf_doc, obj); }

2 1