Transforms tokens into original source code (while preserving whitespace).
Project Links
Meta
Author: Steven Myint
Classifiers
Intended Audience
- Developers
Environment
- Console
Programming Language
- Python :: 2.6
- Python :: 2.7
- Python :: 3
License
- OSI Approved :: MIT License
untokenize transforms tokens into source code. Unlike the standard library’s tokenize.untokenize(), it preserves the original whitespace between tokens.
Usage
import untokenize
source_code = untokenize.untokenize(tokens)
Tests
To run the unit tests:
$ ./test_untokenize.py
There is also an acid test. It tokenizes Python code and confirms that the code generated by untokenize exactly matches the original source code from before tokenization:
$ ./test_acid.py
Files in release
No dependencies