suspect-devices/circuitpython/py/makeqstrdata.py, branch 5.0.0-alpha.1CircuitPython - a Python implementation for teaching coding with microcontrollershttps://git.suspectdevices.com/suspect-devices/circuitpython/atom?h=5.0.0-alpha.12019-08-06T12:39:09+00:00makeqstrdata: permit longer "compressed" outputs2019-08-06T12:39:09+00:00Jeff Eplerjepler@gmail.com2019-08-06T12:38:49+00:00urn:sha1:c4f3a02b3bd3709fd0e07ed07b372b3d5ec3815d
It is possible for this routine to expand some inputs, and in fact
it does for certan strings in the proposed Korean translation of
CircuitPython (#1858). I did not determine what the maximum
expansion is -- it's probably modest, like len()/7+2 bytes or
something -- so I tried to just make enc[] an adequate
over-allocation, and then ensured that all the strings in the
proposed ko.po now worked. The worst actual expansion seems to be a
string that goes from 65 UTF-8-encoded bytes to 68 compressed bytes
(+4.6%). Only a few out of all strings are reported as
non-compressed.
Fix output overflow and make help translatable2018-11-10T00:41:08+00:00Scott Shawcroftscott@tannewt.org2018-11-10T00:41:08+00:00urn:sha1:355abc835ea75715b4dea38604ef64f8c4eeaa0ffix mpy-cross2018-08-17T00:40:57+00:00Scott Shawcroftscott@tannewt.org2018-08-16T07:27:01+00:00urn:sha1:137a30ad75803255615a422c15ebcd35fbd31130Compress all translated strings with Huffman coding.2018-08-17T00:40:57+00:00Scott Shawcroftscott@tannewt.org2018-08-16T01:32:37+00:00urn:sha1:de5a9d72dcdaacdd5048195cd5bab007f4b2baef
This saves code space in builds which use link-time optimization.
The optimization drops the untranslated strings and replaces them
with a compressed_string_t struct. It can then be decompressed to
a c string.
Builds without LTO work as well but include both untranslated
strings and compressed strings.
This work could be expanded to include QSTRs and loaded strings if
a compress method is added to C. Its tracked in #531.
Fix translation newlines2018-08-10T23:17:03+00:00Scott Shawcroftscott@adafruit.com2018-08-10T23:17:03+00:00urn:sha1:4513bd6ea3773ebaae70bd2fa0a2b35c46eae2ff
Escape table was incorrectRework escaping and fix ESP build.2018-08-09T22:58:45+00:00Scott Shawcroftscott@tannewt.org2018-08-09T22:58:45+00:00urn:sha1:24e53ad5911f42efb6508b4a8dcf4a196a81494aTwo fixes and translate more strings.2018-08-09T20:29:30+00:00Scott Shawcroftscott@tannewt.org2018-08-09T01:24:49+00:00urn:sha1:96ebf5bc3fb455162286b9bc31e763f3c4f1c457
* Fix finding translations with escaped characters.
* Add back \r to translations since its needed by screen.
Support internationalisation.2018-08-07T21:58:57+00:00Scott Shawcroftscott@tannewt.org2018-07-31T23:53:54+00:00urn:sha1:933add6cd833bb6ba6682ad2b6eb478871415ff5py/modbuiltins: Make built-in dir support the __dir__ special method.2018-05-10T13:14:23+00:00Damien Georgedamien.p.george@gmail.com2018-05-10T13:10:46+00:00urn:sha1:3678a6bdc6a925f2bce6423c41f911229836f946
If MICROPY_PY_ALL_SPECIAL_METHODS is enabled then dir() will now delegate
to the special method __dir__ if the object it is listing has this method.
py/objtype: Fit qstrs for special methods in byte type.2017-10-21T08:06:32+00:00Paul Sokolovskypfalcon@users.sourceforge.net2017-10-21T08:06:32+00:00urn:sha1:9956fd0710c3866b9df37857c9aa62b8bb681403
Update makeqstrdata.py to sort strings starting with "__" to the beginning
of qstr list, so they get low qstr id's, guaranteedly fitting in 8 bits.
Then use this property to further compact op_id => qstr mapping arrays.