- dev-context - NTG Mailing Lists

luatex beta 0.39.0
by Taco Hoekwater 15 Apr '09

15 Apr '09

Hi, I have just uploaded luatex 0.39.0. This is the last beta before 0.40.0, and we consider it to be feature complete now. The difference between 0.39.0 and 0.40.0 will be nothing more than a newer version of MPlib, improvements to the manual, and (probably) a few bugfixes. What's new: * iniluatex will from now on start up with only the TeX82 primitives and \directlua, everything else has to be bootstrapped via tex.enableprimitives(). This change was planned for 0.40.0, but *now* is the time to test it. * A bugfix for \primitive in various expandable contexts, and \primitive now generates an error message when the argument is not actually a primitive's name. * There was a bug found in the math accent handling. * Large math operators are now treated like extensible characters in the sense that they can be composed of segments. * The extra assign- and restore tracing information from eTeX had a massive bug because of a dangling else in the pascal web. As a side-effect of fixing this bugs, all such potential errors in the pascal web have been fixed (for now). * The math parameters can now be set and queried from lua code via the new tex.setmath() and tex.getmath() functions. * Reflection in a \hbox was broken. * There was a leak of direction nodes in the paragraph builder. * The font backend now does a small peek to differentiate truetype and postscript style opentype fonts. This fixes the "Can't find CFF table" bug for otf's with truetype outlines. * Parameters and registers can now also be assinged to globally from lua (see the manual for details). * It is now possible to query the current math style while a formula is still being constructed by using the new read-only value \mathstyle. Associated is the new command \Ustack that is to be used as a prefix for {.. \over ..} and friends. See the manual for more information. * The embedded MPLib is brought up to date with the current metapost repository (version 1.110 and a few small patches). * Luatex can now handle two breakpoints inside a single ligature (like for the functional word of-f-ice). The solution is not perfect yet, but the chance of missed hyphenation points in actual documents should now be negligible. * Some speedups in the font loading code, and in the handling of pdf_literal nodes that are set from within Lua code. * Some source code and manual cleanup, as usual. The archives can be downloaded from supelec as usual: http://foundry.supelec.fr/projects/luatex/ You could also check out the sources via anonymous svn: svn co svn://scm.foundry.supelec.fr/svn/luatex/tags/beta-0.39.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

1 0

luatex beta 0.38.0
by Taco Hoekwater 10 Apr '09

10 Apr '09

Hi, I have just uploaded luatex 0.38.0. This is a beta in the process towards 0.40.0, the version that will be included in texlive 2009. This beta will be shortlived, the plan is to release the next (hopefully last) intermediate beta within a week. What's new: * tex.enableprimitives() had a bug were previously defined (but currently undefined) control sequences prevented the creation of the new csname. * The special calling format callback.register('name', false) not only disables the callback, but also the builtin code it is supposed to replace. * Empty \localleftbox and \localrightbox -es are now suppressed. * Support for <f>.MathConstants.SubscriptShiftDownWithSuperscript was added, to solve the lack of "sub2" in OpenType math. * Luatex now supports horizontal super- and subscript placement corrections via the OpenType MATH mathkern table. See the manual for details. * node.write() no longer copies its argument node list before appending it. * There are six new primitives that are verbose forms of one and two byte special tokens: \Usuperscript \Usubscript \Ustartmath \Ustopmath \Ustartdisplaymath \Ustopdisplaymath * The attribute node leaks in math mode and alignmetns have been fixed. * The 11 simple math noads are now combined into a single "noad" node type. * Static linking against libstdc++ is working once again. * There is a small fix in the keyword scanner to solve the problem of 'Runaway ... while scanning ???' that could happen for some primitives. * Lua now also has the "architecture independent bytecode" patch applied. * Lua is updated to version 5.1.4 with coco patches 1.1.5, and lpeg is now 0.9. * Some TRT/TLT backend bugs are fixed. * Various manual updates. The archives (now including source again) can be downloaded from supelec as usual: http://foundry.supelec.fr/projects/luatex/ You could also check out the sources via anonymous svn: svn co svn://scm.foundry.supelec.fr/svn/luatex/tags/beta-0.38.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

1 0

luatex format portability
by Taco Hoekwater 07 Apr '09

07 Apr '09

Hi, This is a question for people that have powerpc/arm as well as intel/amd machines and know how to compile the luatex repository trunk: Can you please try the latest and see if the luatex formats are now platform-independent? As of commit 2207 it should be possible to copy the generated formats from one machine to the other, even (and especially) the context mkiv format with its internal lua bytecodes. I already know that i386 <-> amd64 works, but I am interested in endianness tests. Best wishes, Taco

1 0

luatex beta 0.37.0
by Taco Hoekwater 31 Mar '09

31 Mar '09

Hi, I have just uploaded luatex 0.37.0. This is a beta in the process towards 0.40.0, the version that will be included in texlive 2009. This beta will be shortlived, the plan is to release the next one in about a week. This release is mainly intended to allow testing of two new things: * The new build process, which is based on the one that will be used for texlive 2009. Lots of build-time stuff is overhauled, and that means that the binary itself as well as the build process needs testing. Please try on your system and let us know if something goes amiss. * The new shell_escape = 'p' functionality invented by Karl and Akira. Karl wrote about that: > As I've mentioned to some of you, Akira and I have been implemented a > restricted version of \write18: only commands which are explicitly > listed in texmf.cnf can be executed. Along with sufficient quoting, I > think that this is secure enough that it can be enabled by default, and > I plan to do this for TeX Live 2009. The texmf.cnf variable for 'acceptable commands' is named shell_escape_commands. In luatex, the variables shell_escape and shell_escape_commands will be fetched from the texconfig table in case of a disabled kpathsea (as context mkiv does). The important thing to note is that if you are typesetting a document with luatex (as opposed to executing a texlua script), these variables now also effect the os.execute(), io.popen(), os.exec() and os.spawn() functions. Unless a non-false value of shell_escape has been read from either texmf.cnf or the texconfig table, these functions will not do anything anymore. Nothing has changed for the case where luatex is used as a script interpreter. ============================================================== Luatex beta-0.37.0 was released 20090331 (commit #2194) ============================================================== * Luatex now implements shell_escape = 'p', a new feature in web2c that intends to make \write18 more secure. * Attributes can now have negative values. The special value for 'unset' is lowered to -0x7FFFFFFF (it used to be -1). * The lua 'kpse' library now has an object-oriented interface as companion to the procedural interface. This is useful for e.g. controlling the discovery of mplib files. * The new internal integer parameter \outputbox allows setting of the output box number (default: 255, max: 65535) * The new primitives \Udelimiterunder and \Udelimiterover complete the set of 'StretchStacks' for OpenType Math. * Fixed a bug in font string conversions on the Macintosh that resulted in warnings about 'unaligned pointers being freed'. * Khaled Hosny spotted a bunch of manual errors. * There was bug in the width of math_accent objects when there were super- or subscripts attached to the accentee. * In PDF mode, TRT \leaders were bugged. * The source tree now uses the new texlive build system that Peter Breitenlohner created. * There is now a single build.sh instead of four separate ones. It has a few options: --make : only make, no make distclean; configure --parallel : make -j 2 -l 3.0 --nostrip : do not strip binary --mingw : crosscompile for mingw32 from i386-linux --ppc : crosscompile for ppc osx on intel osx Note: --parallel still sometimes causes crashes due to timing errors, so use that option with care. * Many compiler warnings have been removed (but not all yet). The archives (now including source again) can be downloaded from supelec as usual: http://foundry.supelec.fr/projects/luatex/ You could also check out the sources via anonymous svn: svn co svn://scm.foundry.supelec.fr/svn/luatex/tags/beta-0.37.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

1 0

luatex beta 0.36.0
by Taco Hoekwater 23 Mar '09

23 Mar '09

Hi, I have just uploaded luatex 0.36.0. This is a beta in the process towards 0.40.0, the version that will be included in texlive 2009. This beta will be shortlived, the plan is to release the next one in about a week. The main reason for a release now is to prepare for a bunch of important user-visible changes: * The lua code for tex.enableprimitives() etc. is now there, but for this beta all the new primitives are still provided to the user. In next week's beta, these will be gone indeed, and only \directlua will remain present by default. See the mailing list archive: http://tug.org/pipermail/luatex/2009-March/000360.html for more information, the final syntax is explained in the manual. * Multiple lua states have been removed and the old syntax now produces a (rather annoying) informational message. * The fontforge table is renamed to fontloader. The old name is still there for the moment, but also produces a warning message. A more detailed 'what's new': * The included fontforge code is stripped considerably, and the lua table to access the code is renamed to 'fontloader'. The old name ('fontforge') will remain present for a while, but will eventually go away. * New lua functions: tex.primitives(), tex.extraprimitives, tex.enableprimitives(). This is a prelude to a big change in the next beta: iniluatex will from now on start up with only the TeX82 primitives and \directlua, everything else has to be bootstrapped via tex.enableprimitives(). See the manual for more details. * Support for multiple lua states has been removed, and at the same time support for adding name ids to lua chunks has been added, and \closelua has been removed. See the manual for more details. * More changes to the PDF backend to make it support non-latin directions (form and image placement, vertical typesetting, synctex). * The kpathsea library is updated. Highlights: cleaner build process (thanks to Peter Breitenlohner), cleaner mingw32 (cross)compilation support, and a new reentrant API. * Some possible endless loops within extended delimiters in math mode are now trapped. * Movements inside VF font characters were considerably off due to a wrong conversion routine. * Error handling for \outer has been reinstated, but can be suppressed via the new primitive \suppressoutererror. * The new primitives: \suppresslongerror and \suppressifcsnameerror that can be used to suppress errors for \par in non-long macros and for non-expandable objects inside \ifcsname ... \endcsname, respectively. * New lua function: node.vpack() via a patch from Khaled Hosny that also improves error handling in node.hpack(). * Fix the typo that caused \charic (instead of \charit) to be defined as a primitive. * Suppression of hyphenation via \hyphenchar\font=-1 now works again. * The lua functions tex.print(), tex.sprint(), tex.write() now accept an array of strings as well as vararg list of strings to print. * A change to be build process: luatex.p is no longer split int smaller pieces before running the C compiler. * Melissa O'Neill contributed a bugfix to the Type1 font subsetting code. * A bunch of smaller bugfixes and cleanups (as usual). The archives (now including source again) can be downloaded from supelec as usual: http://foundry.supelec.fr/projects/luatex/ You could also check out the sources via anonymous svn: svn co svn://scm.foundry.supelec.fr/svn/luatex/tags/beta-0.36.0 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

6 8

luatex beta 0.35.0
by Taco Hoekwater 10 Mar '09

10 Mar '09

Hi, I have just uploaded luatex 0.35.0. This is a beta in the process towards 0.40.0, the version that will be included in texlive 2009. We have two big developments underway right now: * Hartmut is working on the DVI and PDF output, aiming for full support of all direction specifiers in both modes. * Taco is working on extending the math engine, aiming for complete support of the OpenType and MathML concepts. Both developments are well under way, but neither is perfect yet. The main goal of this release is to give Hans' ConTeXt mkiv code and its users a chance to catch up and test the progress so far. What's new: * The math handling portions of LuaTeX are converted to C code, and extended to support Unicode math. There are a great many related changes, see the new Math chapter in the manual for details. * A nasty bug in the paragraph breaking routine was fixed. (All lines except the first one were believed to be wider then they really were. This affected which nodes were considered as active breakpoints) * Various changes to the PDF backend to make it support non-latin directions. * Fixed the behaviour of the page offsets. Placement of the output on the physical page should now work correctly in all directions, both in DVI and PDF. There now are \pageleftoffset and \pagetopoffset primitives. * fontforge.apply_featurefile() was broken since 0.31.0 * The lua profiler library is added. * The included lua filesystem library is now 1.4.1. * Reading of pk files fixed. * An optional space afer a <direction specifier> for \textdir c.s. is ignored from now on. * \bodydir and \pagedir can now be (re)set even after the first page has been output. * The new callback mlist_to_hlist can be used to intercept the normal conversion of math lists to horizontal lists. * The programs ttf2afm and pdftosrc are removed from the luatex distribution (these belong to pdftex). * fontforge.open() now uses much less memory when opening large (CJK) fonts. * The included libpng is now 1.2.35. * Quite a lot of smaller bugfixes and cleanups (as usual). The archives (just binaries at this time, hopefully there will be a source package later) can be downloaded from supelec as usual: http://foundry.supelec.fr/projects/luatex/ If you need the sources, please check out via anonymous svn: svn co svn://scm.foundry.supelec.fr/svn/luatex/tags/beta-0.31.3 Bugs and feature requests can be added to the issue tracker at http://tracker.luatex.org Have fun, Taco

2 1

Packaging modules
by Wolfgang Schuster 21 Feb '09

21 Feb '09

Hi, has anybody of you a nice script to create a zip for a ConTeXt with subfolder for doc, xml and tex files. I have for my letter module now 40+ files and use two different directories, one for changes with all files at one place and another one to create a zip with a tds compliant file structure and a tpm to create the zip with textools. I'm looking now for a script to work with my working dir only and a single file where I list the files which should go in the zip and in which directory they should end (e.g. doc/context/third/...). Something in ruby or better lua, which could be included in context would be nice. Wolfgang

2 2

How to ignore specific tree when extracting version from SVN?
by Mojca Miklavec 15 Feb '09

15 Feb '09

Hello, When building the binaries for minimals I decided to use the latest SVN version of XeTeX. On the server I use: cd TRUNK && svn info | grep "Last Changed Rev:" | sed 's/^Last Changed Rev: $.*$$/\1/' && cd .. to determine version of XeTeX and whenever the version changes it triggers rebuilding the binaries. But I just figured out that since Jonathan's last commit about two months ago there have been 71 SVN commits into polyglossia (8) and xepersian (all the rest). This means that any fluent binary builder had to compile XeTeX 71 times (and SVN had to store changes) in the last two months for nothing as texmf tree doesn't influence the binaries. On the contrary, ignoring any changes in texmf tree would mean compiling it just twice or so since August. Any volunteer to send me one-liner to fix that? I'm able to write a ruby script to filter that out, but I'm sure that there must be some extremely simple one-liner (or three-liner) in bash to solve that. Thanks a lot for any hints, Mojca

2 1

this is a mail delivery test
by taco 13 Feb '09

13 Feb '09

taco

1 0

Re: [dev-context] [NTG-context] new experimental
by Taco Hoekwater 30 Jan '09

30 Jan '09

Hi, An note about the math stuff wrt. luatex itself: there is no released beta yet, but current luatex trunk matches Hans' experimental version. It labels itself version 0.33.0, the revision is #1847, and it seems to be rather stable, despite massive math code changes. There are two big user-visible changes so far (this information is especially for Mojca & Aditya ). * I have added xetex-compatible primitives for the setting of math- and delcodes (and derivates). The names start with \U... instead of \XeTeX..., though. * Many of the math parameters are now separated out; some three dozen math parameters are definable in the eight math styles (\displaystyle, \textstyle, \scriptstyle, \scriptscriptstyle and \cramped versions thereof) using explicit TeX primitives or (easier, automatically) via loading of math fonts. Math fonts can now have a "MathConstants" lua subtable, this is simply the math data generated by fontforge, scaled to size. If this table is present in a font that is assigned to a math family slot, this data will be used instead of the traditional font parameters from \fam2 and \fam3. The manual is updated but not quite up to speed yet, I will fix that over the weekend (mostly explanations missing). Nothing new in OpenType MATH is really supported yet except these MathConstants (and Hans maps the traditional things like verticals extenders and italic corrections to their tfm equivalents), but there is definate progress. Still to do/planned (in planned/proposed implementation order): * Separate out the math spacing rules into parameters * Allow \mathchardef-ed control sequences in text mode * Support for automatic large operator size choosing * Full support for Math-Style extensibles (with overlaps) * Horizontal extensibles (\arrowfill, \bracefill) * Stetch Stacks (for \overbrace cs.) * Stacks (like \atop, but with more than two items) * One-click full font&param switching (for \boldmath) * Prescripts * Flattened accents * Bottom accents * ?? (that list is open for discussion). Have fun, Taco

2 1