Re: [NTG-context] t-vim module: no highlighting for custom filetypes

On 2021-05-27, Aditya Mahajan wrote:

On Thu, 27 May 2021, Nicola wrote:

...

On 2021-05-24, Aditya Mahajan wrote:

...

On Fri, 21 May 2021, Nicola wrote:

...

I have only a minor annoyance: I have just noticed that -- is typeset as an en-dash in LMTX (but not in MKIV, as documented). Could you look into that?

Fixed in the new release.

Thanks. I have updated to version 2021.05.23 and run `mtxrun --generate`. Syntax highlighting is fine, but with LMTX I'm still getting an en-dash. Below, a MWE.

Can you test if the file tests/vim/21-en-dash.tex works fine at your end:

https://github.com/adityam/filter/blob/dev/tests/vim/21-en-dash.tex

No, I get an en-dash with that, too. Log included below. Nicola fonts > beware: no fonts are loaded yet, using 'lm mono' in box system > system > ConTeXt ver: 2021.05.27 14:15 LMTX fmt: 2021.5.27 int: english/english system > system > 'cont-new.mkxl' loaded open source > level 1, order 1, name '/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkxl/cont-new.mkxl' system > beware: some patches loaded from cont-new.mkiv close source > level 1, order 1, name '/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkxl/cont-new.mkxl' system > files > jobname 'en-dash', input './en-dash', result 'en-dash' fonts > latin modern fonts are not preloaded languages > language 'en' is active open source > level 1, order 2, name './en-dash.tex' modules > 'vim' is loaded open source > level 2, order 3, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-vim.tex' loading > Vim syntax highlighting (ver: 2021.05.23) modules > 'filter' is loaded open source > level 3, order 4, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-filter.mkiv' loading > Filter (ver: 2020.06.29) modules > 'module-catcodes' is loaded open source > level 4, order 5, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-module-catcodes.mkiv' loading > Module Catcodes (ver: 2018.04.16) close source > level 4, order 5, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-module-catcodes.mkiv' close source > level 3, order 5, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-filter.mkiv' modules > 'syntax-highlight' is loaded open source > level 3, order 6, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-highlight.mkxl' loading > Code syntax highlighting (ver: 2021.05.24) modules > 'syntax-groups' is loaded open source > level 4, order 7, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-groups.mkiv' loading > Syntax highlighting groups (ver: 2021.05.23) modules > 'module-catcodes' is already loaded close source > level 4, order 7, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-groups.mkiv' modules > 'filter' is already loaded close source > level 3, order 7, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-highlight.mkxl' suggestion > use \withcedilla instead of \c close source > level 2, order 7, name '/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-vim.tex' fonts > preloading latin modern fonts (second stage) fonts > 'fallback modern-designsize rm 12pt' is loaded open source > level 2, order 8, name 'en-dash-temp-LUA-0.vimout' close source > level 2, order 8, name 'en-dash-temp-LUA-0.vimout' backend > xmp > using file '/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/lpdf-pdx.xml' pages > flushing realpage 1, userpage 1, subpage 1 close source > level 1, order 8, name './en-dash.tex' system > start used files system > text: en-dash system > stop used files system > start used files system > 1: filename=char-prv.lua filetype=tex format=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/char-prv.lua fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/char-prv.lua usedmethod=database system > 2: filename=lmmono10-regular filetype=otf format=otf foundname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm/lmmono10-regular.otf fullname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm/lmmono10-regular.otf usedmethod=database system > 3: filename=publ-imp-default.lua filetype=lua foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/publ-imp-default.lua fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/publ-imp-default.lua usedmethod=database system > 4: filename=cont-new.mkxl filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkxl/cont-new.mkxl fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkxl/cont-new.mkxl usedmethod=database system > 5: filename=lang-exc.lua filetype=lua foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/lang-exc.lua fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/lang-exc.lua usedmethod=database system > 6: filename=lang-us.lua filetype=lua foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/patterns/mkiv/lang-us.lua fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/patterns/mkiv/lang-us.lua usedmethod=database system > 7: filename=/Users/me/Outbox/en-dash.tex format=tex foundname=/Users/me/Outbox/en-dash.tex fullname=/Users/me/Outbox/en-dash.tex usedmethod=direct system > 8: filename=t-vim.tex filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-vim.tex fullname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-vim.tex usedmethod=database system > 9: filename=t-filter.mkiv filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-filter.mkiv fullname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-filter.mkiv usedmethod=database system > 10: filename=t-module-catcodes.mkiv filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-module-catcodes.mkiv fullname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/filter/t-module-catcodes.mkiv usedmethod=database system > 11: filename=t-syntax-highlight.mkxl filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-highlight.mkxl fullname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-highlight.mkxl usedmethod=database system > 12: filename=t-syntax-groups.mkiv filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-groups.mkiv fullname=/Users/me/Applications/context-osx-64/tex/texmf-modules/tex/context/third/vim/t-syntax-groups.mkiv usedmethod=database system > 13: filename=lm.lfg filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/fonts/mkiv/lm.lfg fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/fonts/mkiv/lm.lfg usedmethod=database system > 14: filename=lmroman12-regular filetype=otf format=otf foundname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm/lmroman12-regular.otf fullname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm/lmroman12-regular.otf usedmethod=database system > 15: filename=latinmodern-math.otf filetype=opentypefonts foundname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm-math/latinmodern-math.otf fullname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm-math/latinmodern-math.otf usedmethod=database system > 16: filename=en-dash-temp-LUA-0.vimout foundname=en-dash-temp-LUA-0.vimout fullname=/Users/me/Outbox/en-dash-temp-LUA-0.vimout usedmethod=direct system > 17: filename=lmmono12-regular filetype=otf format=otf foundname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm/lmmono12-regular.otf fullname=/Users/me/Applications/context-osx-64/tex/texmf/fonts/opentype/public/lm/lmmono12-regular.otf usedmethod=database system > 18: filename=lpdf-pdx.xml filetype=tex foundname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/lpdf-pdx.xml fullname=/Users/me/Applications/context-osx-64/tex/texmf-context/tex/context/base/mkiv/lpdf-pdx.xml usedmethod=database system > stop used files system > start commandline options system > currentrun="3" system > fulljobname="./en-dash.tex" system > input="./en-dash.tex" system > kindofrun="2" system > maxnofruns="9" system > texmfbinpath="/Users/me/Applications/context-osx-64/tex/texmf-osx-64/bin" system > stop commandline options system > start commandline files system > 1: ./en-dash.tex system > stop commandline files modules > start used modules modules > loaded : *-filter modules > loaded : *-module-catcodes modules > loaded : *-syntax-groups modules > loaded : *-syntax-highlight modules > loaded : *-vim modules > stop used modules system > system > status after finishing run system > system > --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- system > string pool hash lookup node token extra sparse buffer input file nest parameter save font language mark insert system > --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- system > max 2097152 100000000 2097152 2097152 50000000 10000000 100000000 100000 2000 10000 100000 500000 100000 10000 10000 500 system > min 150000 10000000 150000 150000 1000000 1000000 1000000 10000 500 1000 20000 100000 250 250 50 10 system > set 500000 10000000 250000 250000 50000000 10000000 10000000 100000 2000 10000 100000 500000 100000 250 250 250 system > stp 100000 1000000 100000 100000 500000 250000 1000000 10000 250 1000 10000 10000 250 250 50 25 system > system > mem 150000 913961 150000 1000000 1000000 0 995280 1000000 10000 500 1000 20000 10000 4354816 96 1200 240 system > all 3600000 913961 2400000 9000000 8000000 0 995280 1000000 320000 16000 48000 80000 160000 4354816 96 28800 5760 system > system > ini 2141414 835843 0 44248 0 487381 0 system > ptr 46690 9236 46676 531215 0 0 0 0 0 0 0 9 0 0 0 system > top 46691 740032 131074 2948 546407 0 281 38 10 12 37 245 250 250 50 10 system > --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- system > system > current input type : initial system > system > approximate memory : 31922713 (30 MB) system > system > expansion depth : min: 10000, max: 1000000, set: 10000, top: 6 system > system > luabytecode registers : 990 system > luabytecode bytes : 15856 (0 MB) system > luastate bytes now : 55831816 (53 MB) system > luastate bytes max : 55831816 (53 MB) system > system > file callbacks : 1435 system > saved callbacks : 602 system > direct callbacks : 12 system > function callbacks : 1522 system > value callbacks : 1 system > message callbacks : 0 system > bytecode callbacks : 589 system > system > mp instances : 0 system > mp estimated memory : 0 (0 MB) system > mp file callbacks : 0 system > mp text callbacks : 0 system > mp script callbacks : 0 system > mp log callbacks : 0 system > system > total callbacks : 4161 system > mp total callbacks : 0 system > backend callbacks : 0 system > mkiv lua stats > used config file: selfautoparent:/texmf/web2c/texmfcnf.lua mkiv lua stats > used cache path: /Users/me/Applications/context-osx-64/tex/texmf-cache/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e mkiv lua stats > resource resolver: loadtime 0.007 seconds, 0 scans with scantime 0.000 seconds, 0 shared scans, 18 found files, scanned paths: <none> mkiv lua stats > stored bytecode data: 490 modules (0.278 sec), 99 tables (0.014 sec), 589 chunks (0.293 sec) mkiv lua stats > traced context: maxstack: 1549, freed: 0, unreachable: 1549 mkiv lua stats > cleaned up reserved nodes: 72 nodes, 9 lists of 434 mkiv lua stats > node memory usage: 8 attribute, 4 attribute_list, 1 glue, 58 glue_spec, 3 kern, 2 penalty, 2 temp mkiv lua stats > node list callback tasks: 9 unique task lists, 8 instances (re)created, 47 calls mkiv lua stats > used backend: pdf (backend for directly generating pdf output) mkiv lua stats > jobdata time: 0.001 seconds saving, 0.000 seconds loading mkiv lua stats > callbacks: internal: 0, file: 0, direct: 0, late: 0, function 0, total: 0 (0 per page) mkiv lua stats > randomizer: resumed with value 0.41693551017344 mkiv lua stats > loaded tex modules: 5 requested, all found (*-filter *-module-catcodes *-syntax-groups *-syntax-highlight *-vim) mkiv lua stats > loaded patterns: en::1, load time: 0.000 mkiv lua stats > loaded fonts: 4 files: latinmodern-math.otf, lmmono10-regular.otf, lmmono12-regular.otf, lmroman12-regular.otf mkiv lua stats > font engine: otf 3.116, afm 1.513, tfm 1.000, 9 instances, 3 shared in backend, 3 common vectors, 0 common hashes, load time 0.148 seconds mkiv lua stats > font embedding time: 0.002 seconds, 2 fonts mkiv lua stats > result saved in file: en-dash.pdf, compresslevel 1, objectcompresslevel 3 mkiv lua stats > used platform: osx-64, type: unix, binary subtree: texmf-osx-64 mkiv lua stats > used engine: luametatex version: 2.0911, functionality level: 20210527, format id: 575, compiler: clang mkiv lua stats > tex properties: 740032 hash slots used of 2097152, 46676 control sequences, approximate memory usage: 30 MB mkiv lua stats > lua properties: engine: lua 5.4, used memory: 55 MB, ctx: 53 MB, max: 53 MB, symbol mask: utf (τεχ) mkiv lua stats > runtime: 0.592 seconds, 1 processed pages, 1 shipped pages, 1.688 pages/second