untokenize 0.1.1


pip install untokenize

  Latest version

Released: Feb 08, 2014

Project Links

Meta
Author: Steven Myint

Classifiers

Intended Audience
  • Developers

Environment
  • Console

Programming Language
  • Python :: 2.6
  • Python :: 2.7
  • Python :: 3

License
  • OSI Approved :: MIT License

untokenize transforms tokens into source code. Unlike the standard library’s tokenize.untokenize(), it preserves the original whitespace between tokens.

Build status

Usage

import untokenize
source_code = untokenize.untokenize(tokens)

Tests

To run the unit tests:

$ ./test_untokenize.py

There is also an acid test. It tokenizes Python code and confirms that the code generated by untokenize exactly matches the original source code from before tokenization:

$ ./test_acid.py
No dependencies