Let's implement concuccent translation for src/translators/LLMTranslators/LLMTranslator.ts
The idea is simple, we split request texts into few chunks and send N requests simultaneously.
The benefits is
- Translation runs faster in case the service will not queue our requests (any non free API)
- In case the error occurs in translation, only one batch will be re-tried instead of whole request
Let's implement concuccent translation for
src/translators/LLMTranslators/LLMTranslator.tsThe idea is simple, we split request texts into few chunks and send N requests simultaneously.
The benefits is