Informatics and Applications
2024, Volume 18, Issue 4, pp 44-51
OPTIMIZATION OF THE STRATEGY OF PASSING THE TIME-LIMITED TEST ACCORDING TO THE QUANTILE CRITERION
- Ya. G. Martyushova
- A. V. Naumov
- A. E. Stepanov
Abstract
The problemof constructing an optimal strategy for passing a time-limited test in the formof a stochastic
programming problem with probabilistic constraints is considered. The strategy is a set of test tasks that maximizes
the number of points scored for the test, the excess of which, while simultaneously fulfilling the limit on the time of
the test, is guaranteed with a preselected confidence level, acting as a task parameter. The randomparameters of the
task are the user’s response time to each test task and the correctness of the user’s response to the task modeled by
a random variable with a Bernoulli distribution. The resulting stochastic programming problem with probabilistic constraints is reduced to a deterministic integer mathematical programming problem. An algorithm to solve the
initial problem is presented.
[+] References (18)
- Rasch, G. 1980. Probabilistic models for some intelligence
and attainment tests. Chicago, IL: University of Chicago
Press. 199 p.
- Van der Linden, W. J., D. J. Scrams, and D. L. Schnipke.
1999. Using response-time constraints to control for
differential speededness in computerized adaptive testing.
Appl. Psych. Meas. 23(3):195–210. doi: 10.1177/
01466219922031329.
- Kuravsky, L. S., P.A. Marmalyuk, V. I. Alkhimov, and
G.A. Yuryev. 2013. Novyy podkhod k postroeniyu intellektual’nykh
i kompetentnostnykh testov [A new approach
to constructing intellectual and competence-based tests].
Modelirovanie i analiz dannykh [Modelling and Data Analysis]
1:4–28. EDN: PYOMRR.
- Kuravsky, L. S., A.A. Margolis, P.A. Marmalyuk,
A. S. Panfilova, G.A. Yuryev, and P.N. Dumin. 2016.
A probabilistic model of adaptive training. Applied
Mathematical Sciences 10(48):2369–2380. doi: 10.12988/ams.2016.65168.
- Naumov, A. V., and Ya. G. Martyushova. 2019. Adaptatsiya
sistemy distantsionnogo obucheniya na osnove statisticheskoy
obrabotki rezul’tatov raboty pol’zovateley [Distance
learning system adaptation based on statistical processing
of the results of users activities]. Trudy MAI [Proceedings
of MAI] 109(21). 13 p. doi: 10.34759/trd-2019-109-21.
EDN: DTEXUO.
- Bosov, A. V., Ya.G. Martyushova, A. V. Naumov, and
A. P. Sapunova. 2020. Bayesovskiy podkhod k postroeniyu
individual’noy traektorii pol’zovatelya v sisteme
distantsionnogo obucheniya [Bayesian approach to the
construction of an individual user trajectory in the system
of distance learning]. Informatika i ee Primeneniya — Inform.
Appl. 14(3):86–93. doi: 10.14357/19922264200313.
EDN: WAKFJR.
- Bosov, A. V. 2022. Primenenie samoorganizuyushchikhsya
neyronnykh setey k protsessu formirovaniya individual’-
noy traektorii obucheniya [Application of self-organizing
neural networks to the process of forming an individual
learning path]. Informatika i ee Primeneniya — Inform.
Appl. 16(3):7–15. doi: 10.14357/19922264220302. EDN: HJQANN.
- Bosov, A. V., and A. V. Ivanov. 2022. Tekhnologiya klassifikatsii
tipov kontenta elektronnogo uchebnika [Technology
for classification of content types of e-textbooks]. Informatika
i ee Primeneniya—Inform. Appl. 16(4):63–72. doi:
10.14357/19922264220410. EDN: YERCNH.
- Bosov, A. V., and A. V. Ivanov. 2023. Tekhnologiya mnogofaktornoy
klassifikatsii matematicheskogo kontenta elektronnoy
sistemy obucheniya [Multifactor classification
technology ofmathematical content of e-learning system].
Informatika i ee Primeneniya—Inform. Appl. 17(4):32–41.
doi: 10.14357/19922264230405. EDN: LISHHZ.
- Naumov, A. V., A. S. Dzhumurat, and A.O. Inozemtsev.
2014. Sistema distantsionnogo obucheniya matematicheskim
distsiplinam CLASS.NET [Distance learning
system for mathematical disciplines CLASS.NET].
Vestnik komp’yuternykh i informatsionnykh tekhnologiy
[Herald of Computer and Information Technologies]
10:36–44. doi: 10.14489/vkit.2014.010.pp.036-044.
EDN: SQIRWX.
- SDO MAI CLASS.NET [Distance learning system MAI
CLASS.NET]. Available at: https://distance.kaf804.ru
(accessed November 5, 2024).
- Martyushova, Ya.G., T.A. Mineyeva, and A. V. Naumov.
2023. Metody klassifikatsii pol’zovateley SDO v modeli
postroeniya ikh individual’noy traektorii [Methods of
classifying the distance learning system users in the model
of constructing their personalized learning strategies].
Sistemy i Sredstva Informatiki — Systems and Means of
Informatics 33(1):68–77. doi: 10.14357/08696527230107.
EDN: FHLWMC.
- Bosov, A. V., G.A. Mkhitaryan, A. V. Naumov, and
A. P. Sapunova. 2019. Ispol’zovanie modeli gamma raspredeleniya
v zadache formirovaniya ogranichennogo
po vremeni testa v sisteme distantsionnogo obucheniya
[Using themodel of gamma distribution in the problemof
forming a time-limited test in a distance learning system].
Informatika i ee Primeneniya—Inform. Appl. 13(4):11–17.
doi: 10.14357/19922264190402. EDN: XUBLZX.
- Naumov, A. V., G.A. Mkhitaryan, and E. E. Cherygova.
2019. Stokhasticheskaya postanovka zadachi formirovaniya
testa zadannogo urovnya slozhnosti s minimizatsiey
kvantili vremeni vypolneniya [Stochastic statement
of the problem of generating tests with defined complexity
with the minimization of quantile of test passing
time]. Vestnik komp’yuternykh i informatsionnykh tekhnologiy
[Herald of Computer and Information Technologies]
2(176):37–46. doi: 10.14489/vkit.2019.02.pp.037-
046. EDN: TGXYNG.
- Xiao, J., and O. Bulut. 2022. Item selection with collaborative
filtering in On-the-fly multistage adaptive testing. Appl. Psych. Meas. 46(8):690–704. doi: 10.1177/
0146621622112408.
- Naumov, A. V., A. E. Stepanov, and A. E. Ustinov. 2024.
On the problem of maximizing the probability of successful
passing of a time-limited test. Automat. Rem. Contr.
85(1):64–72. EDN: APEDND.
- Kan, Yu. S., and A. I. Kibzun. 2009. Zadachi stokhasticheskogo
programmirovaniya s veroyatnostnymi kriteriyami
[Stochastic programming problems with probabilistic criteria].
Moscow: Fizmatlit. 372 p.
- Kibzun, A. I., A. V. Naumov, and V. I. Norkin. 2013.
On reducing a quantile optimization problem with discrete
distribution to a mixed integer programming problem.
Automat. Rem. Contr. 74(6):951–967. doi: 10.1134/
S0005117913060064. EDN: RFIDPL.
[+] About this article
Title
OPTIMIZATION OF THE STRATEGY OF PASSING THE TIME-LIMITED TEST ACCORDING TO THE QUANTILE CRITERION
Journal
Informatics and Applications
2024, Volume 18, Issue 4, pp 44-51
Cover Date
2024-12-26
DOI
10.14357/19922264240406
Print ISSN
1992-2264
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
time-limited test; problem with probabilistic constraints; integer mathematical programming
Authors
Ya. G. Martyushova , A. V. Naumov , and A. E. Stepanov
Author Affiliations
Moscow Aviation Institute (National Research University), 4 Volokolamskoe Shosse, Moscow 125933, Russian
Federation
|