Advancing Preauthorization Task in Healthcare: An Application of Deep Active Incremental Learning for Medical Text Classification
Received: 27 August 2023 | Revised: 14 September 2023 | Accepted: 29 September 2023 | Online: 5 December 2023
Corresponding author: Aishat Salau
Abstract
This study presents a novel approach to medical text classification using a deep active incremental learning model, aiming to improve the automation of the preauthorization process in medical health insurance. By automating decision-making for request approval or denial through text classification techniques, the primary focus is on real-time prediction, utilization of limited labeled data, and continuous model improvement. The proposed approach combines a Bidirectional Long Short-Term Memory (Bi-LSTM) neural network with active learning, using uncertainty sampling to facilitate expert-based sample selection and online learning for continuous updates. The proposed model demonstrates improved predictive accuracy over a baseline Long Short-Term Memory (LSTM) model. Through active learning iterations, the proposed model achieved a 4% improvement in balanced accuracy over 100 iterations, underscoring its efficiency in continuous refinement using limited labeled data.
Keywords:
medical text classification, active learning, deep learning, incremental learning, medical preauthorizationDownloads
References
X. Li, M. Cui, J. Li, R. Bai, Z. Lu, and U. Aickelin, "A hybrid medical text classification framework: Integrating attentive rule construction and neural network," Neurocomputing, vol. 443, pp. 345–355, Jul. 2021. DOI: https://doi.org/10.1016/j.neucom.2021.02.069
Z. Shen and S. Zhang, "A Novel Deep-Learning-Based Model for Medical Text Classification," in Proceedings of the 2020 9th International Conference on Computing and Pattern Recognition, Xiamen, China, Jan. 2021, pp. 267–273. DOI: https://doi.org/10.1145/3436369.3436469
C. Y. Kesiku, A. Chaves-Villota, and B. Garcia-Zapirain, "Natural Language Processing Techniques for Text Classification of Biomedical Documents: A Systematic Review," Information, vol. 13, no. 10, Oct. 2022, Art. no. 499. DOI: https://doi.org/10.3390/info13100499
M. Naeem et al., "Trends and Future Perspective Challenges in Big Data," in Advances in Intelligent Data Analysis and Applications, Singapore, 2022, pp. 309–325. DOI: https://doi.org/10.1007/978-981-16-5036-9_30
M. Hughes, I. Li, S. Kotoulas, and T. Suzumura, "Medical Text Classification Using Convolutional Neural Networks," Studies in health technology and informatics, vol. 235, pp. 246–250, Jan. 2017.
B. He, Y. Guan, and R. Dai, "Classifying medical relations in clinical text via convolutional neural networks," Artificial Intelligence in Medicine, vol. 93, pp. 43–49, Jan. 2019. DOI: https://doi.org/10.1016/j.artmed.2018.05.001
Y. Wang et al., "A clinical text classification paradigm using weak supervision and deep representation," BMC Medical Informatics and Decision Making, vol. 19, no. 1, Jan. 2019, Art. no. 1. DOI: https://doi.org/10.1186/s12911-018-0723-6
L. Qing, W. Linhong, and D. Xuehai, "A Novel Neural Network-Based Method for Medical Text Classification," Future Internet, vol. 11, no. 12, Dec. 2019, Art. no. 255. DOI: https://doi.org/10.3390/fi11120255
B. Settles, "Active Learning Literature Survey," University of Wisconsin-Madison Department of Computer Sciences, Technical Report, 2009. [Online]. Available: https://minds.wisconsin.edu/handle/1793/60660.
R. L. Figueroa, Q. Zeng-Treitler, L. H. Ngo, S. Goryachev, and E. P. Wiechmann, "Active learning for clinical text classification: is it better than random sampling?," Journal of the American Medical Informatics Association, vol. 19, no. 5, pp. 809–816, Sep. 2012. DOI: https://doi.org/10.1136/amiajnl-2011-000648
N. Nissim et al., "An Active Learning Framework for Efficient Condition Severity Classification," in Artificial Intelligence in Medicine, Pavia, Italy, 2015, pp. 13–24. DOI: https://doi.org/10.1007/978-3-319-19551-3_3
D. H. M. Nguyen and J. D. Patrick, "Supervised machine learning and active learning in classification of radiology reports," Journal of the American Medical Informatics Association, vol. 21, no. 5, pp. 893–901, Sep. 2014. DOI: https://doi.org/10.1136/amiajnl-2013-002516
T. Kumar and R. Ponnusamy, "Robust Medical X-Ray Image Classification by Deep Learning with Multi-Versus Optimizer," Engineering, Technology & Applied Science Research, vol. 13, no. 4, pp. 111406–11411, Aug. 2023. DOI: https://doi.org/10.48084/etasr.6127
C. Schröder and A. Niekler, "A Survey of Active Learning for Text Classification using Deep Neural Networks." arXiv, Aug. 17, 2020.
K. De Angeli et al., "Deep active learning for classifying cancer pathology reports," BMC Bioinformatics, vol. 22, no. 1, Mar. 2021, Art. no. 113. DOI: https://doi.org/10.1186/s12859-021-04047-1
F. K. Khattak, S. Jeblee, C. Pou-Prom, M. Abdalla, C. Meaney, and F. Rudzicz, "A survey of word embeddings for clinical text," Journal of Biomedical Informatics, vol. 100, Jan. 2019, Art. no. 100057. DOI: https://doi.org/10.1016/j.yjbinx.2019.100057
B. Ahmed, G. Ali, A. Hussain, A. Baseer, and J. Ahmed, "Analysis of Text Feature Extractors using Deep Learning on Fake News," Engineering, Technology & Applied Science Research, vol. 11, no. 2, pp. 7001–7005, Apr. 2021. DOI: https://doi.org/10.48084/etasr.4069
R. M. Mathew and R. Gunasundari, "A Cluster-based Undersampling Technique for Multiclass Skewed Datasets," Engineering, Technology & Applied Science Research, vol. 13, no. 3, pp. 10785–10790, Jun. 2023. DOI: https://doi.org/10.48084/etasr.5844
S. Rodda and U. S. R. Erothi, "Class imbalance problem in the Network Intrusion Detection Systems," in 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT), Chennai, India, Mar. 2016, pp. 2685–2688. DOI: https://doi.org/10.1109/ICEEOT.2016.7755181
M. Reza, S. Miri, and R. Javidan, "A Hybrid Data Mining Approach for Intrusion Detection on Imbalanced NSL-KDD Dataset," International Journal of Advanced Computer Science and Applications, vol. 7, no. 6, pp. 20–25, 2016. DOI: https://doi.org/10.14569/IJACSA.2016.070603
N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic Minority Over-sampling Technique," Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, Jun. 2002. DOI: https://doi.org/10.1613/jair.953
S. Siami-Namini, N. Tavakoli, and A. S. Namin, "The Performance of LSTM and BiLSTM in Forecasting Time Series," in 2019 IEEE International Conference on Big Data (Big Data), Sep. 2019, pp. 3285–3292. DOI: https://doi.org/10.1109/BigData47090.2019.9005997
G. Liu and J. Guo, "Bidirectional LSTM with attention mechanism and convolutional layer for text classification," Neurocomputing, vol. 337, pp. 325–338, Apr. 2019. DOI: https://doi.org/10.1016/j.neucom.2019.01.078
R. R. Yager, "Entropy Measures Under Similarity Relations," International Journal of General Systems, vol. 20, no. 4, pp. 341–358, May 1992. DOI: https://doi.org/10.1080/03081079208945039
J. Gama, I. Žliobaitė, A. Bifet, M. Pechenizkiy, and A. Bouchachia, "A survey on concept drift adaptation," ACM Computing Surveys, vol. 46, no. 4, pp. 44:1-44:37, Nov. 2014. DOI: https://doi.org/10.1145/2523813
N. Cesa-Bianchi, C. Gentile, and L. Zaniboni, "Worst-Case Analysis of Selective Sampling for Linear Classification," Journal of Machine Learning Research, vol. 7, no. 44, pp. 1205–1230, 2006.
J. Lu, P. Zhao, and S. C. H. Hoi, "Online Passive-Aggressive Active learning," Machine Learning, vol. 103, no. 2, pp. 141–183, May 2016. DOI: https://doi.org/10.1007/s10994-016-5555-y
M. F. Jojoa Acosta, L. Y. Caballero Tovar, M. B. Garcia-Zapirain, and W. S. Percybrooks, "Melanoma diagnosis using deep learning techniques on dermatoscopic images," BMC Medical Imaging, vol. 21, no. 1, Jan. 2021, Art. no. 6. DOI: https://doi.org/10.1186/s12880-020-00534-8
M. Sokolova, N. Japkowicz, and S. Szpakowicz, "Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation," in AI 2006: Advances in Artificial Intelligence, Hobart, Australia, 2006, pp. 1015–1021. DOI: https://doi.org/10.1007/11941439_114
P. Thölke et al., "Class imbalance should not throw you off balance: Choosing the right classifiers and performance metrics for brain decoding with imbalanced data," NeuroImage, vol. 277, Art. no. 120253, Aug. 2023. DOI: https://doi.org/10.1016/j.neuroimage.2023.120253
K. Farias, P. Santos Neto, A. Santana, and R. Bezerra Neto, "Using Historical Information of Patients for Prior Authorization Learning," in 2019 8th Brazilian Conference on Intelligent Systems (BRACIS), Salvador, Brazil, Jul. 2019, pp. 598–603. DOI: https://doi.org/10.1109/BRACIS.2019.00110
G. Veras Magalhães Junior, J. P. Albuquerque Vieira, R. Lira de Sales Santos, J. L. Nascimento Barbosa, P. de Alcântara dos Santos Neto, and R. Santos Moura, "A Study of the Influence of Textual Features in Learning Medical Prior Authorization," in 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), Cordoba, Spain, Jun. 2019, pp. 56–61. DOI: https://doi.org/10.1109/CBMS.2019.00021
Downloads
How to Cite
License
Copyright (c) 2023 Aishat Salau, Nnanna Agwu Nwojo, Moussa Mahamat Boukar, Osasumwen Usen
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
