Aiphoria company has introduced artificial intelligence (AI) agents in Uzbekistan that can communicate naturally in the Uzbek language.

This solution not only overcame many complex language and linguistic barriers, but also became an important step in creating high-quality speech technology adapted to local requirements. The project was launched in 2024 by Aiphoria in partnership with one of the leading banks in Uzbekistan to create fully automated voice agents based on artificial intelligence. For this purpose, a team of bank specialists was formed and involved.

Within the framework of the project, a solution based on special voice recognition (ASR), voice synthesis (Ts), and large language models (LLM) was developed, taking into account real communication in the Uzbek language - a mix of regional dialects, accent, and Russian. When developing a clear speech comprehension system, the main focus was on real, anonymized audio data collected through the bank's call center. Special marking and normalization work was carried out on the basis of open sources and real surveys.

Linguists, editors, and call center staff participated in the marking process. With their help, a database of more than 7,000 normalization rules was formed. In the lexicon, special attention was paid to banking terms - such as "annuity payments," "CATM."

To achieve a realistic solution to communication, the actresses posted texts read in different styles for more than 100 hours, creating three different voice tones - friendly, neutral, and firm - for different communication situations. Then models of voice synthesis based on neural networks were prepared and evaluated by the "veterans" of the call center.

As a result, the bank introduced AI-employees such as the Collection Agent. This agent processes up to 40% of calls, operating 10 times more efficiently than humans. Such an agent doesn't demand wages, doesn't get sick, and is always ready to serve. Most importantly, he has the ability to communicate realistically with high efficiency.

This project can go down in history not only as a high-tech solution, but also as one of the first successful experiments on the localization of artificial intelligence in Uzbekistan.