this a next token prediction work in persian dataset, we used unigram,bigram & trigram models to predict the next token.
generated sample: با تشکر از چوب گردو با زیره
This repository was archived by the owner on Aug 4, 2024. It is now read-only.
Mehrdadghassabi/ngram_next_token_prediction
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|