Yıl: 2022 Cilt: 30 Sayı: 7 Sayfa Aralığı: 2672 - 2687 Metin Dili: İngilizce DOI: 10.55730/1300-0632.3962 İndeks Tarihi: 14-12-2022

Asking the right questions to solve algebraic word problems

Öz:
Word algebra problems are among challenging AI tasks as they combine natural language understanding with a formal equation system. Traditional approaches to the problem work with equation templates and frame the task as a template selection and number assignment to the selected template. The recent deep learning-based solutions exploit contextual language models like BERT and encode the natural language text to decode the corresponding equation system. The proposed approach is similar to the template-based methods as it works with a template and fills in the number slots. Nevertheless, it has contextual understanding because it adopts a question generation and answering pipeline to create tuples of numbers, to finally perform the number assignment task by custom sets of rules. The inspiring idea is that by asking the right questions and answering them using a state-of-the-art language model-based system, one can learn the correct values for the number slots in an equation system. The empirical results show that the proposed approach outperforms the other methods significantly on the word algebra benchmark dataset alg514 and performs the second best on the AI2 corpus for arithmetic word problems. It also has superior performance on the challenging SVAMP dataset. Though it is a rule-based system, simple rule sets and relatively slight differences between rules for different templates indicate that it is highly probable to develop a system that can learn the patterns for the collection of all possible templates, and produce the correct equations for an example instance.
Anahtar Kelime: Math problem solver question generation and answering algebraic word problems

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Clark P, Etzioni O. My Computer Is an Honor Student - but How Intelligent Is It? Standardized Tests as a Measure of AI. AI Mag. 2016; 37 (1): 5-12. doi: 10.1609/aimag.v37i1.2636
  • [2] Wang Y, Liu X, Shi S. Deep Neural Solver for Math Word Problems. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing; Copenhagen, Denmark; 2017: 845-854. doi: 10.18653/v1/D17- 1088.
  • [3] Zaporojets K, Bekoulis G, Deleu J, Demeester T, Develder C. Solving arithmetic word problems by scor- ing equations with recursive neural networks. Expert Systems with Applications 2021; 174 (1): 114704. doi: 10.1016/j.eswa.2021.114704
  • [4] Wang L, Wang Y, Cai D, Zhang D, Liu X. Translating a Math Word Problem to a Expression Tree. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing; Brussels, Belgium; 2018: 1064-1069. doi: 10.18653/v1/D18-1132
  • [5] Chiang T, Chen Y. Semantically-Aligned Equation Generation for Solving and Reasoning Math Word Problems. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers); Minneapolis, Minnesota; 2019: 2656-2668. doi: 10.18653/v1/N19-1272
  • [6] Patel, A, Bhattamishra, S, Goyal, N. Are NLP Models really able to Solve Simple Math Word Problems? In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies; Virtual Event; 2021: 2080-2094.
  • [7] Kushman N, Artzi Y, Zettlemoyer L, Barzilay R. Learning to Automatically Solve Algebra Word Problems. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers); Baltimore, Maryland 2014: 271-281. doi: 10.3115/v1/P14-1026
  • [8] Zhou L, Dai S, Chen L. Learn to Solve Algebra Word Problems Using Quadratic Programming. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing; Lisbon, Portugal 2015: 817-822. doi: 10.18653/v1/D15-1096
  • [9] Devlin J, Chang M, Lee K, Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers); Minneapolis, Minnesota; 2019: 4171–4186. doi: 10.18653/v1/N19-1423
  • [10] Keklik O, Tuğlular T, Tekir S. Rule-Based Automatic Question Generation Using Semantic Role Labeling. IEICE TRANSACTIONS on Information and Systems 2019; E102-D (7): 1362-1373. doi: 10.1587/transinf.2018EDP7199
  • [11] Hosseini MJ, Hajishirzi H, Etzioni O, Kushman N. Learning to Solve Arithmetic Word Problems with Verb Categorization. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing; Doha, Qatar; 2014.pp. 523-533. doi: 10.3115/v1/d14-1058
  • [12] Zhang D, Wang L, Zhang L, Dai BT, Shen HT. The Gap of Semantic Parsing: A Survey on Auto- matic Math Word Problem Solvers. IEEE Trans. Pattern Anal. Mach. Intell. 2020; 42 (9): 2287-2305. doi: 10.1109/TPAMI.2019.2914054
  • [13] Huang D, Shi S, Lin C, Yin J. Learning Fine-Grained Expressions to Solve Math Word Problems. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017; Copenhagen, Denmark; 2017: 805–814.https://doi.org/10.18653/v1/d17-1084
  • [14] Upadhyay S, Chang M, Chang K, Yih W. Learning from Explicit and Implicit Supervision Jointly For Algebra Word Problems. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing; Austin, Texas; 2016. pp. 297-306. doi: 10.18653/v1/D16-1029.
  • [15] Luong T, Pham H, Manning C.D. Effective approaches to attention-based neural machine translation. In: Pro- ceedings of the 2015 Conference on Empirical Methods in Natural Language Processing; Lisbon, Portugal 2015: 1412–1421.
  • [16] Lee D, Ki K, Kim B, Gweon G. TM-generation model: a template-based method for automatically solving mathematical word problems. The Journal of Supercomputing 2021. doi: 10.1007/s11227-021-03855-9
  • [17] Mandal S, Naskar S. Classifying and Solving Arithmetic Math Word Problems—An Intelligent Math Solver. IEEE Transactions on Learning Technologies 2021. pp. 1-1. doi: 10.1109/TLT.2021.3057805
  • [18] Koncel-Kedziorski R, Roy S, Amini A, Kushman N, Hajishirzi H. MAWPS: A Math Word Problem Repository. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies; San Diego, California; 2016. pp. 1152-1157. doi: 10.18653/v1/N16-1136
  • [19] Lin X, Huang Z, Zhao H, Chen E, Liu Q, et al. HMS: A Hierarchical Solver with Dependency-Enhanced Under- standing for Math Word Problem. Proceedings of the AAAI Conference on Artificial Intelligence 2021; 35 (1): 4232-4240.
  • [20] Hong Y, Li Q, Ciao D, Huang S, Zhu S. Learning by Fixing: Solving Math Word Problems with Weak Supervision. In: Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event; 2021. pp. 4959-4967.
  • [21] Xie Z, Sun S. A Goal-Driven Tree-Structured Neural Model for Math Word Problems. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence; Macao, China; 2019. pp. 5299-5305. doi: 10.24963/ijcai.2019/736.
  • [22] Wu Q, Zhang Q, Wei Z, Huang X. Math Word Problem Solving with Explicit Numerical Values. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021; Virtual Event; 2021. pp. 5859-5869.
  • [23] Yu, W, Wen, Y, Zheng, F, Xiao, N. Improving Math Word Problems with Pre-trained Knowledge and Hierarchical Reasoning. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing; Virtual Event; 2021. pp. 3384-3394.
  • [24] Liang, Z, Zhang, J, Shao, J, Zhang, X. MWP-BERT: A Strong Baseline for Math Word Problems. 2021.
  • [25] Zhang J, Wang L, Lee RK, Bin Y, Wang Y et al. Graph-to-tree learning for solving math word problems. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; Online; 2020: 3928– 3937.
  • [26] Miao S, Liang C, Su K. A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; 2020:975-984. doi: 10.18653/v1/2020.acl-main.92
  • [27] Liu Y, Ott M, Goyal N, Du J, Joshi M et al. Roberta: A robustly optimized bert pretraining approach. 2019. doi: 10.48550/ARXIV.1907.11692.
  • [28] Sundaram SS, Khemani D. Natural Language Processing for Solving Simple Word Problems. In: Proceedings of the 12th International Conference on Natural Language Processing; Trivandrum, India; 2015. pp. 394-402.
  • [29] Huang D, Liu J, Lin C, Yin J. Neural Math Word Problem Solver with Reinforcement Learning. In: Proceedings of the 27th International Conference on Computational Linguistics; Santa Fe, New Mexico, USA; 2018. pp. 213-223.
  • [30] Mitra A, Baral C. Learning To Use Formulas To Solve Simple Arithmetic Problems. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2016; 1 (1): 2144-2153. doi: 10.18653/v1/P16-1202
  • [31] Wang L, Zhang D, Gao L, Song J, Guo L et al. MathDQN: Solving Arithmetic Word Problems via Deep Rein- forcement Learning. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18); New Orleans, Louisiana, USA; 2018. pp. 5545-5552.
  • [32] Colon-Hernandez P, Havasi C, Alonso JB, Huggins M, Breazeal C. Combining pre-trained language models and structured knowledge. CoRR 2021; Volume abs/2101.12294.
APA Orulluoğlu Z, mertoğlu R, Tekir S, Çelik E (2022). Asking the right questions to solve algebraic word problems. , 2672 - 2687. 10.55730/1300-0632.3962
Chicago Orulluoğlu Zeynel,mertoğlu Rıdvan,Tekir Selma,Çelik Ege Yiğit Asking the right questions to solve algebraic word problems. (2022): 2672 - 2687. 10.55730/1300-0632.3962
MLA Orulluoğlu Zeynel,mertoğlu Rıdvan,Tekir Selma,Çelik Ege Yiğit Asking the right questions to solve algebraic word problems. , 2022, ss.2672 - 2687. 10.55730/1300-0632.3962
AMA Orulluoğlu Z,mertoğlu R,Tekir S,Çelik E Asking the right questions to solve algebraic word problems. . 2022; 2672 - 2687. 10.55730/1300-0632.3962
Vancouver Orulluoğlu Z,mertoğlu R,Tekir S,Çelik E Asking the right questions to solve algebraic word problems. . 2022; 2672 - 2687. 10.55730/1300-0632.3962
IEEE Orulluoğlu Z,mertoğlu R,Tekir S,Çelik E "Asking the right questions to solve algebraic word problems." , ss.2672 - 2687, 2022. 10.55730/1300-0632.3962
ISNAD Orulluoğlu, Zeynel vd. "Asking the right questions to solve algebraic word problems". (2022), 2672-2687. https://doi.org/10.55730/1300-0632.3962
APA Orulluoğlu Z, mertoğlu R, Tekir S, Çelik E (2022). Asking the right questions to solve algebraic word problems. Turkish Journal of Electrical Engineering and Computer Sciences, 30(7), 2672 - 2687. 10.55730/1300-0632.3962
Chicago Orulluoğlu Zeynel,mertoğlu Rıdvan,Tekir Selma,Çelik Ege Yiğit Asking the right questions to solve algebraic word problems. Turkish Journal of Electrical Engineering and Computer Sciences 30, no.7 (2022): 2672 - 2687. 10.55730/1300-0632.3962
MLA Orulluoğlu Zeynel,mertoğlu Rıdvan,Tekir Selma,Çelik Ege Yiğit Asking the right questions to solve algebraic word problems. Turkish Journal of Electrical Engineering and Computer Sciences, vol.30, no.7, 2022, ss.2672 - 2687. 10.55730/1300-0632.3962
AMA Orulluoğlu Z,mertoğlu R,Tekir S,Çelik E Asking the right questions to solve algebraic word problems. Turkish Journal of Electrical Engineering and Computer Sciences. 2022; 30(7): 2672 - 2687. 10.55730/1300-0632.3962
Vancouver Orulluoğlu Z,mertoğlu R,Tekir S,Çelik E Asking the right questions to solve algebraic word problems. Turkish Journal of Electrical Engineering and Computer Sciences. 2022; 30(7): 2672 - 2687. 10.55730/1300-0632.3962
IEEE Orulluoğlu Z,mertoğlu R,Tekir S,Çelik E "Asking the right questions to solve algebraic word problems." Turkish Journal of Electrical Engineering and Computer Sciences, 30, ss.2672 - 2687, 2022. 10.55730/1300-0632.3962
ISNAD Orulluoğlu, Zeynel vd. "Asking the right questions to solve algebraic word problems". Turkish Journal of Electrical Engineering and Computer Sciences 30/7 (2022), 2672-2687. https://doi.org/10.55730/1300-0632.3962