RFTokenizer

Stats

⭐ Stars: 31

🍴 Forks: 8

📝 Language: Lex

📅 Created: 2018-03-05

🔄 Updated: 2026-02-07

🏷️ Latest Release: No releases

Description

A character-wise tokenizer for morphologically rich languages

Topics

None

Research Summary

Key Features

Architecture

Use Cases

Assessment

Maturity:

Documentation:

Community:

Recommendation:

README Excerpt

```

žée

```

---

*Researched: 2026-03-27*