janome · Python Simple Repository Browser

Project Links

Meta

Author: Tomoko Uchida

Classifiers

Development Status

4 - Beta

License

OSI Approved :: Apache Software License

Natural Language

Japanese

Programming Language

Python :: 3.7
Python :: 3.8
Python :: 3.9
Python :: 3.10

https://coveralls.io/repos/github/mocobeta/janome/badge.svg?branch=master

https://img.shields.io/pypi/dm/Janome.svg

https://img.shields.io/conda/v/conda-forge/janome

Janome is a Japanese morphological analysis engine written in pure Python.

General documentation:

https://mocobeta.github.io/janome/en/ (English)

https://mocobeta.github.io/janome/ (Japanese)

Requirements

Python 3.7+ is required.

Install

[Note] This consumes about 500 MB memory for building.

(venv) $ pip install janome

Run

(venv) $ python
>>> from janome.tokenizer import Tokenizer
>>> t = Tokenizer()
>>> for token in t.tokenize('すもももももももものうち'):
...     print(token)
...
すもも 名詞,一般,*,*,*,*,すもも,スモモ,スモモ
も    助詞,係助詞,*,*,*,*,も,モ,モ
もも  名詞,一般,*,*,*,*,もも,モモ,モモ
も    助詞,係助詞,*,*,*,*,も,モ,モ
もも  名詞,一般,*,*,*,*,もも,モモ,モモ
の    助詞,連体化,*,*,*,*,の,ノ,ノ
うち  名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ