- dev-context - NTG Mailing Lists

Luatex 0.50.0 announcement
by Taco Hoekwater 25 Dec '09

25 Dec '09

Hi, I have just uploaded the archives for a new luatex release, 0.50.0. This release starts a new chain of stable beta's. New features: * Fonts now listen also to the 'extend' key in the lua font metrics table, and the processing for this is done via de pdf text matrix instead of via the font matrix, which means it now works for all font types. * The embedded Metapost library is now at version 1.209. Dropped features: * It is no longer possible for fonts from embedded pdf files to be replaced by / merged with the document fonts of the enveloping pdf. This regression may be temporary, depending on how the rewritten font backend will look after beta 0.60. Bug fixes: * Use of \middle confused the \mathstyle operation. * \pdfcolorstack handling was broken. * node.unset_attribute() had a bug whereby it inverted the requested result in some cases (the node on which the unset was called was sometimes the only node at the current level that *kept* the attribute). * During font expansion, the internal font copy had one character information object less than the original, resulting in the disappearance of a glyph in some fonts when font expansion was active. * Placement of operator scripts of OT MATH fonts is adjusted to be conformant with Word's logic where the italic correction is only used to tuck in the subscript and for nothing else. * luafontloader.open() no longer writes directly to stderr in case of internal font errors. * Any <pdf_refobj_node>.objnum could not be assigned to. * The lua 'pdf' table could not be assigned to. * The lua 'md5' library was returning incorrect results on 64-bit architectures. * Luatex now compiles on GNU Hurd systems. * Fix segfault when embedding stream file object (these backend segfaults were a side-effect of the string pool patches). The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/gf/project/luatex/ You could also check out the sources via anonymous svn: svn co http://foundry.supelec.fr/svn/luatex/tags/beta-0.50.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

2 1

Luatex 0.47.0 announcement
by Taco Hoekwater 18 Dec '09

18 Dec '09

Hi, I have just uploaded the archives for a new luatex release, 0.47.0. This will be the last beta before the next major release (0.50), so please test this version as thoroughly as you can. New features: * New read-write lua variables pdf.pdfcatalog, pdf.pdfnames, pdf.pdfinfo, pdf.pdftrailer * The horizontal mode nodes that are added to lines during line breaking now inherit the attributes from the first and last node inside the created line. * The new function pdf.registerannot(<number>) registers an annotation object number to be included in the current page's /Annots list. * The variables <metrics>.Mathconstants.FractionDelimiterSize and <metrics>.Mathconstants.FractionDelimiterDisplayStyleSize are added to the font table. This allows proper setting of the size parameters for TeX's ...withdelims math primitives. * The internal representation of the string pool is reorganized (the pool of string characters is now allocated dynamically), and as a side-effect the lua variable status.init_pool_ptr is deprecated and will be removed in a later version. Also, status.pool_ptr now simply returns the current number of bytes in use for string characters. * There are new lua variables pdf.pdfmapline and pdf.pdfmapfile (write-only strings that mimic \pdfmapline and \pdfmapfile). * \pdfobj data and attribute are now stored as C strings instead of as token lists (this should speed up cases with a lot of data). * Artificially slanted fonts now work via the pdf text matrix (instead of adjusting the actual font) so that it now also works for non-Type1 fonts. The lua <metrics>.slant font key is now obeyed in all cases. * The lua function font.id(<string>) returns the internal font id number belonging to a control sequence name. * Pdf image inclusion is optimized such that objects from an external pdf will now be included only once even if they are referenced from multiple inclusions. Bug fixes: * Protrusion for non-TLT documents did not work properly for the hyphenation character. * \lastbox could not remove the paragraph indent box for non-TLT documents. * Pdf images (\pdfximage) are no longer kept open during the whole run, but closed and reopened. An error is raised if the file has changed between \pdfximage and \pdfrefximage. This prevents the 'too many open files' error when lots of images are included. * On Win32 Pdf image files are locked during the time that it is open, to prevent unnoticed file changes by external sources. * Compilation now again works on FreeBSD. * Format sharing between 32-bit and 64-bit architectures was broken. * Unsetting attributes from lua could sometimes result in the unset state persisting beyond the current group level. * If something went wrong in the scanning of pdf action items, the error message reported the current primitive name incorrectly. * Luatex would crash on non-existant pdfs that were referenced from map file entries. The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/gf/project/luatex/ You could also check out the sources via anonymous svn: svn co http://foundry.supelec.fr/svn/luatex/tags/beta-0.47.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

1 0

Luatex 0.46.0 announcement
by Taco Hoekwater 12 Dec '09

12 Dec '09

Hi, I have just uploaded the archives for a new luatex release, 0.46.0. There are two important reason for this release: * It fixes an xform bug that is quite serious as it produces invalid pdf files (see below) * There is now experimental support for loading external .dll/.so files for lua extension modules. Copied from a message I sent to the dev-luatex list a few days ago: > I have committed an experimental patch that > enables dynamic loading for external compiled libraries unless --safer > is given on the command-line. > > It is experimental because: > > * it assumes that all architectures except windows will be happy with > using dlopen (windows has its own code which does not need compile- > time support, but you have to have an installed lua51.dll from e.g. > http://luabinaries.luaforge.net ). > > * I made only minimal changes to kpathsea. > > * there may be lua libraries out there that fail horribly. > > As with pure lua require() files, luatex will only use kpathsea if the > library is initialized already. > > kpathsea changes in detail: > > I added the kpse_clua_format identifier that searches for files with > extension .dll and .so. The texmf.cnf setting for this variable is > CLUAINPUTS, and by default it has this value: > > CLUAINPUTS=.:$SELFAUTOLOC/lib/{$progname,$engine,}/lua// > > This is the best I could do on short notice: the architecture has to > be in the path somewhere, and the fastest way to do that is to search > below the binary directory only. > > One level up (lib parallel to bin) would have been nicer, as the > context minimals have arch and bin swapped (texmf-linux/bin as opposed > to bin/i386-linux) but that would not have worked in texlive. If you know how to compile dynamic libraries on your platform, a good library to play with is Lua BitOp, http://bitop.luajit.org/ (single C source file and comes with a nice test lua script). And here is the normal list of features and bugfixes in 0.46.0 -------------------------------------------------------------- New features: * The build.sh script now has better support for new MacOSX-es (patch from Mojca). * Luatex now has experimental support for dynamic loading of external compiled lua libraries. Building luatex and loading external .so/.dll files is reported to work on Windows, linux and osx, other platforms are still unknown. * pdf.obj{type="stream"} no longer converts its argument to and from a tokenlist. This allows the use of binary data in the "string" argument. Such data does still have to hidden from the normal file parser by putting the code in a dofile() or by using string.char(), though. Bug fixes: * Luatex 0.45.0 was not able to find truetype nor opentype fonts if there were no callbacks defined (patch from Pawel). * 0.45.0 printed the user input instead of the full pathname for \input-ed tex files. * The TFM reader now rejects fonts with tfm names that are longer than 255 characters because such font names cannot be stored in a DVI file. * The combination of \immediate\pdfxform followed by a later \pdfrefxform could cause broken pdf output files because the box used for the form could have been freed and even reused already at that moment in time, sometimes resulting in an invalid transformation matrix. * The placement of super- and subscripts for displaystyle \int's in CambriaMath is now better than before. It still needs a tweak to the metrics though: in the current version, the italic correction has to be substracted from the width of the integral sign to get correct placement (context mkiv does this). to be continued ... The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/gf/project/luatex/ You could also check out the sources via anonymous svn: svn co http://foundry.supelec.fr/svn/luatex/tags/beta-0.46.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

2 1

Liliypond
by Wolfgang Schuster 06 Dec '09

06 Dec '09

Hi, the lilypond module stores the files below the third directory in both doc and tex folders, can the files be moved in a subdirectory with the name lilypond like all other module do. Regards, Wolfgang

1 0

bib: space gobbled after \cite
by Sanjoy Mahajan 30 Nov '09

30 Nov '09

With recent versions of ConTeXt, spaces after \cite[Author:1977] are getting eaten. I'm pretty sure that did not happen with versions from a while ago, but the archives suggest that it happened a long while ago: <http://www.mail-archive.com/ntg-context@let.uu.nl/msg00062.html> The minimal test file: ============================================= \usemodule[bib] \setupbibtex[database=statement, sort=author] \starttext Polya said \cite[Polya:1966] in 1966: "finished mathematics consists of proofs, but mathematics in the making consists of guesses." \blank \placepublications \stoptext ============================================== The first line ends up "Polya said (Polya, 1966)in 1966..." with no space after the close paren. (This is with 2009.10.27 16:35 MKII on top of TL 2009 from Debian.) Here is statement.bib to complete the example: @Misc{Polya:1966, author = {George Polya}, title = {Let us teach guessing}, howpublished = {VHS}, year = {1966}, publisher = {Mathematical Association of America}, } -Sanjoy `Until lions have their historians, tales of the hunt shall always glorify the hunters.' --African Proverb

3 3

bib: triple dash in article title causes problems (minimal example)
by Sanjoy Mahajan 24 Nov '09

24 Nov '09

To continue my earlier message about "--" in bibtex titles: I replaced the "--" with a triple dash "---" but still had problems unless I used \enableregime[utf]. Even then I had problems if I was also using products and projects, where \enableregime[utf] seemed to have no effect for the bibliography. Attached is a minimal set of files as a .tgz. Unpack and do 'cd test'; then 'make'. The resulting PDF, at least on my system (TL 2009 Debian + context 2009.10.27) has the accent characters instead of the em-dash. A small-size png image of it is attached. -Sanjoy `Until lions have their historians, tales of the hunt shall always glorify the hunters.' --African Proverb

2 4

Mathdesign / MnSymbol
by Wolfgang Schuster 22 Nov '09

22 Nov '09

Hi, can the mathdesign [1] and mnsymbol [2] fonts be included in the minimals. [1] http://tug.ctan.org/cgi-bin/ctanPackageInformation.py?id=mathdesign [2] http://tug.ctan.org/cgi-bin/ctanPackageInformation.py?id=mnsymbol Wolfgang

2 3

bib: article title with -- comes out mangled
by Sanjoy Mahajan 22 Nov '09

22 Nov '09

This test file has a mangled article title where the "--" was located in the bibtex entry (a few accented characters show up). Commenting in the \enableregime removes the accented characters, but now there's a mix of different dashes almost joined together. % \enableregime[utf] \usemodule[bib] \setupbibtex[database=project] \starttext Look up the Shannon--Nyquist sampling theorem \cite[Jerri:1977]. \blank[3*big] \placepublications[criterium=all] \stoptext Here is the bibtex file @Article{Jerri:1977, author = {A. J. Jerri}, title = {The {S}hannon sampling theorem —- {I}ts various extensions and applications: A tutorial review}, journal = {Proceedings of the IEEE}, year = 1977, volume = 65, number = 11, pages = {1565--1596}} (A workaround is to make the " -- " into "---", which is what it should have been anyway.) This is with context 2009.10.27 16:35 MKII in the Debian TL2009 packages. I also see the problem with 2009.11.20 on top of vanilla TL2009 or vanilla TL2008. -Sanjoy

1 0

linebreak regression with TL2009 versus TL2008
by Sanjoy Mahajan 21 Nov '09

21 Nov '09

The following test file ============================================================= \usetypescript[palatino][ec] \setupbodyfont[palatino,10.5pt] \setuplayout[width=4.75in] \showframe \starttext knowledge. The diverse examples help separate the tool---the general principle---from the particular applications so that you can grasp and transfer the tool to problems of particular interest to you. \stoptext ============================================================= works fine with the a recent context (2009.11.21) on top of TL 2008. But the linebreak is terrible if I use the same context on top of TL2009. I cannot find the cause. >From the logfile: Overfull \hbox (25.72205pt too wide) in paragraph at lines 10--14 []\*palatino10.5ptmmnnrm*: knowledge. The di-verse ex-am-ples help sep-a-rate t he tool---the gen-eral principle--- \hbox(7.55998+2.96098)x343.28249, glue set - 1.0 .\hbox(0.0+0.0)x0.0 .\*palatino10.5ptmmnnrm*: k .\*palatino10.5ptmmnnrm*: n .\*palatino10.5ptmmnnrm*: o .\kern-0.2625 .etc. Below is the full log file. At first I thought the problem was in TeX Gyre versus the former Palatino, but both runs use TeX Gyre. The only other difference that I can see is the pdftex versions: TL2009: This is pdfTeX, Version 3.1415926-1.40.10 (TeX Live 2009) (format=cont-en 2009.11.20) 21 NOV 2009 15:18 Tl2008: This is pdfTeXk, Version 3.1415926-1.40.9 (Web2C 7.5.7) (format=cont-en 2009.6.12) 21 NOV 2009 15:16 Other than that, the runs with TL 2008 and TL 2009 produce exactly the same log file except for the overfull hbox message, and '2008' becoming '2009' in all the filenames, and write18 being enabled in one but not the other (I think with 2008). Any ideas whether this is a font problem, pdftex problem, or a context problem (probably unlikely given that both runs use the same context source files)? -Sanjoy This is pdfTeX, Version 3.1415926-1.40.10 (TeX Live 2009) (format=cont-en 2009.11.21) 21 NOV 2009 16:00 entering extended mode file:line:error style messages enabled. %&-line parsing enabled. (/home/sanjoy/texmf-ctx/tl2009-20091121/web2c/natural.tcx) **test.tex \emergencyend (./test.tex ConTeXt ver: 2009.11.21 11:45 MKII fmt: 2009.11.21 int: english/english system : cont-new loaded (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/cont-new.tex systems : beware: some patches loaded from cont-new.tex (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/cont-new.mkii)) system : cont-fil loaded (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/cont-fil.tex loading : ConTeXt File Synonyms ) system : cont-sys.rme loaded (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/user/cont-sys.rme (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/type-tmf.tex (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/type-tmf.mkii)) (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/type-siz.tex (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/type-siz.mkii)) (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/type-one.tex (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/type-one.mkii))) system : test.top loaded (./test.top ) bodyfont : 12pt rm is loaded language : patterns nl->texnansi:texnansi->1->2:2 nl->ec:ec->2->2:2 us-> ec:ec->3->2:3 de->texnansi:texnansi->4->3:3 de->ec:ec->5->3:3 da->ec:ec->6->2:2 sv->ec:ec->7->2:2 gb->ec:ec->8->2:2 fr->texnansi:texnansi->9->2:2 fr->ec:ec->1 0->2:2 es->ec:ec->11->2:2 ca->ec:ec->12->2:2 it->texnansi:texnansi->13->2:2 it- >ec:ec->14->2:2 la->ec:ec->15->2:2 pt->texnansi:texnansi->16->2:2 pt->ec:ec->17 ->2:2 ro->ec:ec->18->2:2 pl->pl0:pl0->19->2:2 pl->ec:ec->20->2:2 pl->qx:qx->21- >2:2 cs->il2:il2->22->2:2 cs->ec:ec->23->2:2 sk->il2:il2->24->2:2 sk->ec:ec->25 ->2:2 hr->ec:ec->26->2:2 sl->ec:ec->27->2:2 tr->ec:ec->28->2:2 agr->agr:agr->30 ->2:2 fi->ec:ec->31->2:2 hu->ec:ec->32->2:2 ru->t2a:t2a->34->2:2 uk->t2a:t2a->3 5->3:3 loaded specials : dvips loaded \openout3 = `test.tui'. \openout0 = `test-mpgraph.mp'. \openout0 = `mpgraph.mp'. systems : system commands are disabled language : language en is active specials : loading definition file tpd (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/spec-tpd.mkii specials : loading definition file fdf (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/spec-fdf.mkii)) (/home /sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/page-run.mkii loading : ConTeXt Page Macros / Runtime Macros ) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) (./test.tuo) publications : file test.bbl not found, waiting for bibtex (./test.tuo) systems : begin file test at line 8 Overfull \hbox (25.72205pt too wide) in paragraph at lines 10--14 []\*palatino10.5ptmmnnrm*: knowledge. The di-verse ex-am-ples help sep-a-rate t he tool---the gen-eral principle--- \hbox(7.55998+2.96098)x343.28249, glue set - 1.0 .\hbox(0.0+0.0)x0.0 .\*palatino10.5ptmmnnrm*: k .\*palatino10.5ptmmnnrm*: n .\*palatino10.5ptmmnnrm*: o .\kern-0.2625 .etc. fonts : resetting map file list {/home/sanjoy/texmf-ctx/tl2009-20091121/fonts/map/pdftex/context/original-empty .map} fonts : using map file: original-base {/home/sanjoy/texmf-ctx/tl2009-20091121/fonts/map/pdftex/context/original-base. map} fonts : using map file: original-ams-base {/home/sanjoy/texmf-ctx/tl2009-20091121/fonts/map/pdftex/context/original-ams-b ase.map} fonts : using map file: original-public-lm {/home/sanjoy/texmf-ctx/tl2009-20091121/fonts/map/pdftex/context/original-publi c-lm.map} fonts : using map file: lm-ec {/usr/local/texlive/2009/texmf-dist/fonts/map/dvips/lm/lm-ec.map} fonts : using map file: lm-math {/usr/local/texlive/2009/texmf-dist/fonts/map/dvips/lm/lm-math.map} fonts : using map file: lm-rm {/usr/local/texlive/2009/texmf-dist/fonts/map/dvips/lm/lm-rm.map} fonts : using map file: original-ams-euler {/home/sanjoy/texmf-ctx/tl2009-20091121/fonts/map/pdftex/context/original-ams-e uler.map} fonts : using map file: qpl-ec {/usr/local/texlive/2009/texmf-dist/fonts/map/dvips/tex-gyre/qpl-ec.map} fonts : using map file: original-youngryu-px {/home/sanjoy/texmf-ctx/tl2009-20091121/fonts/map/pdftex/context/original-young ryu-px.map} (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/sort-def.m kii) (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/sort-lan.mkii) [1 .1] systems : end file test at line 15 system : cont-err loaded (/home/sanjoy/texmf-ctx/tl2009-20091121/tex/context/base/cont-err.tex systems : no file 'cont-sys.tex', using 'cont-sys.rme' instead ) ) Here is how much of TeX's memory you used: 2697 strings out of 456429 49119 string characters out of 2525280 4775366 words of memory out of 7192449 43186 multiletter control sequences out of 15000+200000 178380 words of font info for 99 fonts, out of 3000000 for 9000 396 hyphenation exceptions out of 8191 51i,17n,77p,259b,542s stack positions out of 5000i,500n,10000p,200000b,50000s {/usr/local/texlive/2009/texmf-dist/fonts/enc/dvips/tex-gyre/q-ec.enc}</usr/ local/texlive/2009/texmf-dist/fonts/type1/public/tex-gyre/qplr.pfb> pdfTeX warning: pdftex: no GlyphToUnicode entry has been inserted yet! Output written on test.pdf (1 page, 25868 bytes). PDF statistics: 13 PDF objects out of 1000 (max. 8388607) 8 compressed objects within 1 object stream 0 named destinations out of 1000 (max. 500000) 1 words of extra memory for PDF output out of 10000 (max. 10000000)

1 0

Luatex 0.45.0 announcement
by Taco Hoekwater 19 Nov '09

19 Nov '09

Hi, I have just uploaded the archives for a new luatex release, 0.45.0. New features: * Loading big OTF fonts via lua is now much faster than before, at the expense of a bit of precision loss in the calculated bounding boxes. * Two new token lists are provided: \pdfxformresources and \pdfxformattr, as an alternative to \pdfxform keywords. * \input and \openin now accept braced filenames. * The \endlinechar can now be set to any value between 0 and 127. * Luatex can now optionally use kpathsea to find lua require() files. * The new primitives \aligntab and \alignmark are aliases for the use of & and # in alignments. * \pdfrefximage [width <dimen>] [height <dimen>] [depth <dimen>] <imageref> overrules settings from \pdfximage for this \pdfrefximage call only * The print precision for small numbers in lua code (tostring) has been improved. * Akira Kakuto suppled a patch that restricts writing to files with names such as latex.bat etc. (on windows only) * (un-feature): from now on luatex now only handles 4 direction specifiers: TLT (latin), TRT (arabic), RTT (cjk), and LTL (mongolian). The other directions now generate an error. * (un-feature): xpdf's automatic lower- and uppercasing retry attempts for nonfound image pdf files has been removed. * The callbacks hpack_filter, vpack_filter and pre_output_filter pass on an extra string argument for the direction, when known (nil == use default). * The lua functions node.hpack(), node.vpack() and node.dimensions() now accept an optional direction argument (not given == use default). * \pdfrefxform [width <dimen>] [height <dimen>] [depth <dimen>] <formref> scales a form object; similar principle as with \pdfximage: depth alone doesn't scale, it shifts vertically. * A change to the relative ordering inside font name discovery for use by the backend: now it tries <f>.psname first, as that is much less likely to contain spaces. * For ttc fonts, now the used subfont name and its index id are printed to the terminal, and if the backend cannot find a ttc subfont, the run is aborted. Bug fixes: * Prevent crashes for lua-loaded fonts without a (tfm) name. * Remove spurious newlines in the output pdf that could be the result of using \pdfximage for an included pdf figure too early. * Full font embedding for wide otf and ttf fonts now really works (older versions only pretended that it did work). * node.dimensions() sometimes continued past the 'stop' node. * Images inside virtual fonts were broken. * The processing of \language=-1 was wrong, resulting in hyphenation attempts even though there was no proper language set up. * Fix for finding files in --output-directory. * Fix for handling of --file-line-error. * tex.box[] assignments are now checked to make sure the assigned node has the right id (hlist or vlist). * show_node_list (as in \showbox) produced spurious local_par whatsit prints in the output after direction nodes. * The handling of pdf literals has been sped up. The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/gf/project/luatex/ You could also check out the sources via anonymous svn: svn co http://foundry.supelec.fr/svn/luatex/tags/beta-0.45.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

2 1