suspect-devices/circuitpython/py/lexer.h, branch v1.9.1 CircuitPython - a Python implementation for teaching coding with microcontrollers https://git.suspectdevices.com/suspect-devices/circuitpython/atom?h=v1.9.1 2017-02-17T01:44:24+00:00 py/lexer: Convert mp_uint_t to size_t where appropriate. 2017-02-17T01:44:24+00:00 Damien George damien.p.george@gmail.com 2017-02-17T01:44:24+00:00 urn:sha1:5124a940670dbb5c07f6681070b3d1580c71d697 py/lexer: Simplify handling of line-continuation error. 2017-02-17T00:30:14+00:00 Damien George damien.p.george@gmail.com 2017-02-17T00:30:14+00:00 urn:sha1:773278ec3030ea9ed809c5a248fde2278ce4b557 Previous to this patch there was an explicit check for errors with line continuation (where backslash was not immediately followed by a newline). But this check is not necessary: if there is an error then the remaining logic of the tokeniser will reject the backslash and correctly produce a syntax error. py/lexer: Use strcmp to make keyword searching more efficient. 2017-02-17T00:10:35+00:00 Damien George damien.p.george@gmail.com 2017-02-17T00:10:35+00:00 urn:sha1:ae436797927c3c9f7ccdc25dd78af3dd279ca7ff Since the table of keywords is sorted, we can use strcmp to do the search and stop part way through the search if the comparison is less-than. Because all tokens that are names are subject to this search, this optimisation will improve the overall speed of the lexer when processing a script. The change also decreases code size by a little bit because we now use strcmp instead of the custom str_strn_equal function. py/lexer: Permanently disable the mp_lexer_show_token function. 2016-12-21T23:49:54+00:00 Damien George damien.p.george@gmail.com 2016-12-21T23:49:54+00:00 urn:sha1:c305ae32436e37327d33df979d57d9ac1fb822c1 The lexer is very mature and this debug function is no longer used. If it's really needed one can uncomment it and recompile. py/lexer: Make lexer use an mp_reader as its source. 2016-11-16T07:35:01+00:00 Damien George damien.p.george@gmail.com 2016-11-16T07:27:20+00:00 urn:sha1:5bdf1650de782d766a648f992270306269cc985a py: add async/await/async for/async with syntax 2016-04-13T14:26:38+00:00 pohmelie multisosnooley@gmail.com 2016-01-27T20:23:11+00:00 urn:sha1:81ebba7e0236163b7594938201bf3a6b802ebfaa They are sugar for marking function as generator, "yield from" and pep492 python "semantically equivalents" respectively. @dpgeorge was the original author of this patch, but @pohmelie made changes to implement `async for` and `async with`. unix: Allow to cat a script into stdin from the command line. 2015-06-04T22:42:45+00:00 Damien George damien.p.george@gmail.com 2015-06-04T22:42:45+00:00 urn:sha1:031278f661e5d285c56359e355a96161bf6e1a9f See issue #1306. py: Allow to compile with extra warnings (sign-compare, unused-param). 2015-03-19T00:25:33+00:00 Damien George damien.p.george@gmail.com 2015-03-19T00:21:29+00:00 urn:sha1:2e2e404ff77e95dbe4fee0f19c91913a5888fb6f py: Parse big-int/float/imag constants directly in parser. 2015-02-08T01:57:40+00:00 Damien George damien.p.george@gmail.com 2015-02-08T01:57:40+00:00 urn:sha1:7d414a1b52d193bab2c94cf56932e1eba23ba542 Previous to this patch, a big-int, float or imag constant was interned (made into a qstr) and then parsed at runtime to create an object each time it was needed. This is wasteful in RAM and not efficient. Now, these constants are parsed straight away in the parser and turned into objects. This allows constants with large numbers of digits (so addresses issue #1103) and takes us a step closer to #722. py: Put all global state together in state structures. 2015-01-07T20:33:00+00:00 Damien George damien.p.george@gmail.com 2015-01-01T23:30:53+00:00 urn:sha1:b4b10fd350852e321624d74983cca286091b55a1 This patch consolidates all global variables in py/ core into one place, in a global structure. Root pointers are all located together to make GC tracing easier and more efficient.