• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

AI to Enable Accurate Modelling of Data Storage System Performance

AI to Enable Accurate Modelling of Data Storage System Performance

© iStock

Researchers at the HSE Faculty of Computer Science have developed a new approach to modelling data storage systems based on generative machine learning models. This approach makes it possible to accurately predict the key performance characteristics of such systems under various conditions. Results have been published in the IEEE Access journal.

Data storage systems play an important role in today’s digital world, as they are responsible for the safety and prompt availability of vast amounts of information. These systems consist of many components, including controllers, HDD and SSD disks, as well as cache memory, which work together to ensure fast and efficient operation. To achieve optimal performance, it is essential to accurately predict how these systems will function in different scenarios, such as when the load on the system changes.

Researchers at the HSE Faculty of Computer Science developed a new approach to modelling data storage system performance, which relies on generative machine learning models. The authors proposed a method that provides high-precision predictions of the key performance characteristics of the systems: the number of input/output operations per second (IOPS) and latency.

The modelling includes two stages. First, the scientists collect data by measuring the system’s performance under various loads and configurations. This data is then fed to two special generative models: the CatBoost regression model and the normalizing flow model. CatBoost works well with tabular data and can accurately predict average values and performance deviations. The normalizing flow model produces a complete distribution of possible outcomes, taking into account data uncertainties and variability.

Mikhail Hushchyn

‘One of the main advantages of our method is that it does not require detailed knowledge of the internal structure of the system components. This is often impossible due to the manufacturers’ trade secrets. Instead, our generative models are trained directly on real-world data. For instance, in our study, we trained a model using 300,000 measurements. This makes our approach versatile and applicable to any type of data storage system,’ says study author Mikhail Hushchyn, a senior research fellow at the HSE Faculty of Computer Science.

The researchers tested the accuracy of the proposed approach using Little's law, a fundamental principle of queuing theory. According to test results, these predictions are highly consistent with real observations: prediction errors range from just 4–10% for IOPS and 3–16% for latency, while the correlation with the observed values reaches 0.99.

Aziz Temirkhanov

‘Our proposed approach opens up broad prospects for optimising and planning the operation of data centres. It makes it possible to predict the behaviour of the system amid load changes, identify potential performance issues, and optimise power consumption. Furthermore, expensive physical experiments are no longer required for accurate modelling,’ stated Aziz Temirkhanov, a junior research fellow at the Laboratory of Methods for Big Data Analysis.

The experimental code and measurements of the storage system performance are publicly available.

See also:

HSE University Becomes Absolute Leader in AI Alliance Ranking of Universities

TheAI Alliance Russia has announced a new ranking of Russian universities based on the quality of education in the field of AI. A total of 203 universities from 68 Russian regions participated in the ranking. HSE University was the first to join the highest A++ group.

Scientists Rank Russian Regions by Climate Risk Levels

Researchers from HSE University and the Russian Academy of Sciences have assessed the levels of climate risks across Russian regions. Using five key climate risks—heatwaves, water stress, wildfires, extreme precipitation, and permafrost degradation—the scientists ranked the country’s regions according to their need for adaptation to climate change. Krasnoyarsk Krai, Irkutsk Region, and Sverdlovsk Region rank among the highest for four of the five climate risks considered. The study has been published in Science of the Total Environment.

HSE University and MTS Join Forces to Combat Deepfakes and Train AI to Create Bespoke Video Content

HSE University and MTS Web Services (MWS) have announced the launch of a series of joint research initiatives in the field of artificial intelligence technologies. These efforts aim to develop innovative solutions in cybersecurity, multimodal content generation, and big data analysis. The project’s leading institution is the HSE Tikhonov Moscow Institute of Electronics and Mathematics (HSE MIEM), under the overall coordination of the HSE AI Research Centre.

'Samarkand—St Petersburg': HSE University–St Petersburg and Samarkand State University to Design Digital Future of Cultural Heritage

Samarkand State University named after Sharof Rashidov hosted the international research and educational seminar 'Branding Cultural Heritage: Digital Tools and Design Practices.' The event gathered researchers and students from Russia and Uzbekistan—participants of a large-scale project of the mirror laboratory 'Integrated Platform Solutions for the Preservation and Promotion of Cultural Heritage (Cases of Samarkand and St Petersburg)'.

HSE University Brings Together Researchers at International AI Summer Institute in Shanghai

In early July 2025, the International Summer Institute on Artificial Intelligence in Education took place in Shanghai. It was organised by the HSE Institute of Education in cooperation with East China Normal University (ECNU). More than 50 early-career researchers and keynote speakers from nine countries—ranging from Russia and China to Canada and Singapore—gathered to share the latest findings from their work and to forge new international partnerships.

HSE Researchers Teach Neural Network to Distinguish Origins from Genetically Similar Populations

Researchers from the AI and Digital Science Institute, HSE Faculty of Computer Science, have proposed a new approach based on advanced machine learning techniques to determine a person’s genetic origin with high accuracy. This method uses graph neural networks, which make it possible to distinguish even very closely related populations.

HSE Economists Reveal the Secret to Strong Families

Researchers from the HSE Faculty of Economic Sciences have examined the key factors behind lasting marriages. The findings show that having children is the primary factor contributing to marital stability, while for couples without children, a greater income gap between spouses is associated with a stronger union. This is the conclusion reported in Applied Econometrics.

Fifteen Minutes on Foot: How Post-Soviet Cities Manage Access to Essential Services

Researchers from HSE University and the Institute of Geography of the Russian Academy of Sciences analysed three major Russian cities to assess their alignment with the '15-minute city' concept—an urban design that ensures residents can easily access essential services and facilities within walking distance. Naberezhnye Chelny, where most residents live in Soviet-era microdistricts, demonstrated the highest levels of accessibility. In Krasnodar, fewer than half of residents can easily reach essential facilities on foot, and in Saratov, just over a third can. The article has been published in Regional Research of Russia.

HSE Researchers Find Counter-Strike Skins Outperform Bitcoin and Gold as Alternative Investments

Virtual knives, custom-painted machine guns, and gloves are common collectible items in videogames. A new study by scientists from HSE University suggests that digital skins from the popular video game Counter-Strike: Global Offensive (CS:GO) rank among the most profitable types of alternative investments, with average annual returns exceeding 40%. The study has been published in the Social Science Research Network (SSRN), a free-access online repository.

HSE Neurolinguists Reveal What Makes Apps Effective for Aphasia Rehabilitation

Scientists at the HSE Centre for Language and Brain have identified key factors that increase the effectiveness of mobile and computer-based applications for aphasia rehabilitation. These key factors include automated feedback, a variety of tasks within the application, extended treatment duration, and ongoing interaction between the user and the clinician. The article has been published in NeuroRehabilitation.