initial commit
update metadata (#4) - update metadata (4c435010bae81b0dac85a68ab8028b4ee9cd6e70) Co-authored-by: Leandro von Werra <lvwerra@users.noreply.huggingface.co>
.
Make _decode compatible with PreTrainedTokenizerBase (#8) - Make _decode compatible with PreTrainedTokenizerBase (1d07fb39189bd0bb45500bca7dfce4107eda74fb) Co-authored-by: Vincent Brouwers <Vinno97@users.noreply.huggingface.co>
