suspect-devices/circuitpython/py/qstr.c, branch esp-extra-scripts CircuitPython - a Python implementation for teaching coding with microcontrollers https://git.suspectdevices.com/suspect-devices/circuitpython/atom?h=esp-extra-scripts 2016-06-28T10:28:50+00:00 py: Don't use gc or qstr mutex when the GIL is enabled. 2016-06-28T10:28:50+00:00 Damien George damien.p.george@gmail.com 2016-05-26T10:53:34+00:00 urn:sha1:a1c93a62b1d1020c5ef3ce1744469a118433d0e5 There is no need since the GIL already makes gc and qstr operations atomic. py: Make interning of qstrs thread safe. 2016-06-28T10:28:50+00:00 Damien George damien.p.george@gmail.com 2016-05-26T09:06:46+00:00 urn:sha1:1f54ad2aed0dc8f2d868ccd89ccf639a475e8022 py: Rename __QSTR_EXTRACT flag to NO_QSTR. 2016-06-15T22:42:48+00:00 Paul Sokolovsky pfalcon@users.sourceforge.net 2016-06-15T22:40:31+00:00 urn:sha1:f469c764428230363a2b22fedf303d86eea82853 It has more usages than just qstr extraction, for example, embedding (where people don't care about efficient predefined qstrs). py: Rework QSTR extraction to work in simple and obvious way. 2016-04-19T08:37:56+00:00 Paul Sokolovsky pfalcon@users.sourceforge.net 2016-04-19T08:30:06+00:00 urn:sha1:c618f91e22613b2e530f7c21be0be789a7e8eed5 When there're C files to be (re)compiled, they're all passed first to preprocessor. QSTR references are extracted from preprocessed output and split per original C file. Then all available qstr files (including those generated previously) are catenated together. Only if the resulting content has changed, the output file is written (causing almost global rebuild to pick up potentially renumbered qstr's). Otherwise, it's not updated to not cause spurious rebuilds. Related make rules are split to minimize amount of commands executed in the interim case (when some C files were updated, but no qstrs were changed). py: Add ability to have frozen persistent bytecode from .mpy files. 2016-04-13T15:07:47+00:00 Damien George damien.p.george@gmail.com 2016-01-31T22:24:16+00:00 urn:sha1:0a2e9650f5383bc1190d6b27a3d923e313c3d879 The config variable MICROPY_MODULE_FROZEN is now made of two separate parts: MICROPY_MODULE_FROZEN_STR and MICROPY_MODULE_FROZEN_MPY. This allows to have none, either or both of frozen strings and frozen mpy files (aka frozen bytecode). py/qstr: Use size_t instead of mp_uint_t when counting allocated bytes. 2015-12-17T12:41:40+00:00 Damien George damien.p.george@gmail.com 2015-12-17T12:41:40+00:00 urn:sha1:257848587fb03879e145a34c8065927cf4d1532f py: Change qstr_* functions to use size_t as the type for str len arg. 2015-11-29T14:25:04+00:00 Damien George damien.p.george@gmail.com 2015-11-27T12:23:18+00:00 urn:sha1:c3f64d9799cdf8af88087eebe6628e83d658405c py/qstr: Fix calc of qstr memory usage, due to new qstr chunk allocation. 2015-10-13T14:52:06+00:00 Damien George damien.p.george@gmail.com 2015-10-13T14:52:06+00:00 urn:sha1:59a41e8fcdb80c1ee025ba782c69a8077b214602 py: Make qstr hash size configurable, defaults to 2 bytes. 2015-07-20T11:03:13+00:00 Damien George damien.p.george@gmail.com 2015-07-20T11:03:13+00:00 urn:sha1:c3bd9415cc8e6ba3619fe4b7a2bdac20260b0236 This patch makes configurable, via MICROPY_QSTR_BYTES_IN_HASH, the number of bytes used for a qstr hash. It was originally fixed at 2 bytes, and now defaults to 2 bytes. Setting it to 1 byte will save ROM and RAM at a small expense of hash collisions. py: Improve allocation policy of qstr data. 2015-07-14T21:56:32+00:00 Damien George damien.p.george@gmail.com 2015-06-13T20:53:22+00:00 urn:sha1:ade9a052365247be5ed4ce8b53c2164a576a4a05 Previous to this patch all interned strings lived in their own malloc'd chunk. On average this wastes N/2 bytes per interned string, where N is the number-of-bytes for a quanta of the memory allocator (16 bytes on 32 bit archs). With this patch interned strings are concatenated into the same malloc'd chunk when possible. Such chunks are enlarged inplace when possible, and shrunk to fit when a new chunk is needed. RAM savings with this patch are highly varied, but should always show an improvement (unless only 3 or 4 strings are interned). New version typically uses about 70% of previous memory for the qstr data, and can lead to savings of around 10% of total memory footprint of a running script. Costs about 120 bytes code size on Thumb2 archs (depends on how many calls to gc_realloc are made).