I'm writing a bog-standard Unicode tokeniser to replace the crap one SQLite ships, and I'm wondering why I'm wasting my life writing C code again.
In the same vein of the old post I re-tooted, is there a Rust guru out there that can tell me if:
* Decent ICU bindings or equivalent Unicode normalisation, case folding and word-break analysis exists for Rust? (the latter being key)
* Decent SQLite FTS5 custom tokeniser bindings or equivalent exist for Rust?
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!