v0.3.0

   🚀 Features

• Support CJK languages  -  by @johannschopplich (11ec1)

    View changes on GitHub

v0.2.0

   🚀 Features

• Closer token estimations to GPT tokenizer  -  by @johannschopplich (a9cff)

    View changes on GitHub

v0.1.0

   🚀 Features

• Support accented characters  -  by @johannschopplich (c4133)

    View changes on GitHub