Neural Network for Assessing English Language Proficiency Developed at HSE University
The AI Lingua Neural Network has been collaboratively developed by the HSE University’s AI Research Centre, School of Foreign Languages, and online campus. The model has been trained on thousands of expert assessments of both oral and written texts. The system evaluates an individual's ability to communicate in English verbally and in writing.
Individuals interested in assessing their speaking and writing proficiency are invited to complete a series of tasks, including writing an essay, answering interview questions, and composing a monologue. Completing the tasks takes no more than 60 minutes, and the test is accessible on any digital device. Results, along with brief comments, are available within 30 minutes.
This format enables a representative assessment of the range of skills most commonly used in oral and written communication. When evaluating responses, the neural network considers over 45 parameters developed by experts at the HSE School of Foreign Languages. The result is determined through a comprehensive assessment of lexical, grammatical, and phonetic/stylistic aspects of speech, as well as characteristics such as coherence, logical presentation of thoughts, and skills in description, reasoning, and narration.
Based on the results of the tasks, a final score is calculated, and a language proficiency level is assigned, ranging from elementary to upper-intermediate. The proficiency level scale developed at the HSE School of Foreign Languages and integrated into the neural network aligns with all international language testing systems.
'An AI model capable of evaluating oral and written tasks with open-ended responses remains a rarity in language education. It can be described as a cutting-edge category of AI-based assessment systems, as the neural network has been trained to identify a variety of complex indicators of speech behaviour to determine candidates' levels of communicative competence,' according to Ekaterina Kolesnikova, Head of the HSE School of Foreign Languages.
The model has been trained on thousands of expert assessments of oral and written texts produced by actual participants in academic communication. The process of ongoing training and refinement of the model continues. Currently, the neural network is in its beta stage, undergoing testing and calibration for further integration into the process of assessing student work as part of independent English proficiency examination. It is planned for the neural network to function as one of the experts.
'The project to develop AI Lingua is an example of adapting large foundational models for a specific applied field—education. We have come all the way from testing various scientific hypotheses to implementing models in the final product, which is available as an online service for self-assessing English proficiency. Our solution is distinguished by its ability to simultaneously evaluate not only text responses but also audio speech, producing a language proficiency level based on a comprehensive set of criteria. To achieve this, we studied a substantial number of open-source solutions and subsequently conducted additional training on works analysed by professional linguists,' explains Alexey Masyutin, Director of the AI Centre.
The HSE University's team also notes that there are plans to develop models for other foreign languages. This will assist foreign language learners in conducting self-assessments of their knowledge, receiving timely feedback with the necessary level of detail, and tracking their progress in language proficiency development.
'The integration of AI solutions into the language skills assessment process fundamentally transforms the approach to language learning, making it more convenient and user-friendly. We are developing a tool that not only records the current level of knowledge but also dynamically tracks progress, offering everyone the opportunity for regular and objective self-assessment,' emphasises Sergey Roshchin, Vice Rector of HSE University.
The beta version of the English proficiency self-assessment tool is available for free with a promo code sent via email upon registration.
See also:
‘HSE’s Industry Ties Are Invaluable’
Pan Zhengwu has spent the last seven years at HSE University—first as a student of the Bachelor’s in Software Engineering and now in the Master’s in System and Software Engineering at the Faculty of Computer Science. In addition to his busy academic schedule, he works as a mobile software engineer at Yandex and is an avid urban photographer. In his interview with the HSE News Service, Zhengwu talks about the challenges he faced when he first moved to Russia, shares his thoughts on ‘collaborating’ with AI, and reveals one of his top spots for taking photos in Moscow.
Scientists Present New Solution to Imbalanced Learning Problem
Specialists at the HSE Faculty of Computer Science and Sber AI Lab have developed a geometric oversampling technique known as Simplicial SMOTE. Tests on various datasets have shown that it significantly improves classification performance. This technique is particularly valuable in scenarios where rare cases are crucial, such as fraud detection or the diagnosis of rare diseases. The study's results are available on ArXiv.org, an open-access archive, and will be presented at the International Conference on Knowledge Discovery and Data Mining (KDD) in summer 2025 in Toronto, Canada.
Megascience, AI, and Supercomputers: HSE Expands Cooperation with JINR
Experts in computer technology from HSE University and the Joint Institute for Nuclear Research (JINR) discussed collaboration and joint projects at a meeting held at the Meshcheryakov Laboratory of Information Technologies (MLIT). HSE University was represented by Lev Shchur, Head of the Laboratory for Computational Physics at the HSE Tikhonov Moscow Institute of Electronics and Mathematics (HSE MIEM), as well as Denis Derkach and Fedor Ratnikov from the Laboratory of Methods for Big Data Analysis at the HSE Faculty of Computer Science.
AI vs AI: Scientists Develop Neural Networks to Detect Generated Text Insertions
A research team, including Alexander Shirnin from HSE University, has developed two models designed to detect AI-generated insertions in scientific texts. The AIpom system integrates two types of models: a decoder and an encoder. The Papilusion system is designed to detect modifications through synonyms and summarisation by neural networks, using one type of models: encoders. In the future, these models will assist in verifying the originality and credibility of scientific publications. Articles describing the Papilusion and AIpom systems have been published in the ACL Anthology Digital Archive.
HSE Researchers Develop Python Library for Analysing Eye Movements
A research team at HSE University has developed EyeFeatures, a Python library for analysing and modelling eye movement data. This tool is designed to simplify the work of scientists and developers by enabling them to efficiently process complex data and create predictive models.
‘Many Want to Create AI-Based Products and Become More Competitive’
In 2024, the online Russian-taught master’s programme ‘Artificial Intelligence,’ offered by the HSE Faculty of Computer Science, saw a record number of first-year students—over 300. What accounts for such a high interest in AI, how the curriculum is structured, and what new skills will graduates acquire? Elena Kantonistova, the programme’s academic director, shares more.
'I Would Like to Leave a Lasting Impact on Science'
Aibek Alanov pursues his own scientific research and leads two teams of scientists, one at HSE University and the other at AIRI. In this interview for the HSE Young Scientists project, he explores the parallels between today's AI researchers and early 20th-century physicists, discusses generative models, and shares his passion for bachata partner dancing.
HSE’S Achievements in AI Presented at AIJ
The AI Journey international conference hosted a session led by Deputy Prime Minister Dmitry Chernyshenko highlighting the achievements of Russian research centres in artificial intelligence. Alexey Masyutin, Head of the HSE AI Research Centre, showcased the centre’s key developments.
Drivers of Progress and Sources of Revenue: The Role of Universities in Technology Transfer
In the modern world, the effective transfer of socio-economic and humanities-based knowledge to the real economy and public administration is essential. Universities play a decisive role in this process. They have the capability to unite diverse teams and, in partnership with the state and businesses, develop and enhance advanced technologies.
AI on Guard of Ecology: Students from Russia and Belarus Propose New Solutions to Environmental Problems
An international online hackathon dedicated to solving environmental problems was held at HSE University in Nizhny Novgorod. Students employed artificial intelligence and computer vision to develop innovative solutions for image segmentation, predictive modelling (forecasting future events based on data from the past) of emissions and creating chatbots for nature reserves and national parks.