[NLP][Python] NLP tool for Chinese text: HanLP

Last Updated on 2021-04-01 by Clay

HanLp (Han Language Processing) is open-source project on Github, it provided many functions:

• Segmentation
• Part-of-Speech
• Named entity recognition
• Keyword extraction
• Text summarization
• Convert Traditional to Simplified
• Text recommendation
• Text classification
• Word2Vec
• …

If you want to read more document of it, you can refer here: https://github.com/hankcs/HanLP

Or you want to take a demo: http://hanlp.com/

Last Updated on 2021-03-31 by Clay

Chinese characters can be roughly divided info “Traditional” and “Simplified“. If you need to convert one to another, I think the most convenient tool is OpenCC in Python.

Last Updated on 2021-03-30 by Clay

If you want to use Python NLP toolkit to analyze Traditional Chinese text, CKIP is your first choice. CKIP is developed by Taiwan Institute of Information Science, Academia Sinica, And won rankings in many competitions.

Last Updated on 2021-03-29 by Clay

To segment words from sentence is very important in Chinese. In English you can segment words with space but Chinese cannot.

Let’s take an example.