Research Method Classification with Deep Transfer Learning for Semi-Automatic Meta-Analysis of Information Systems Papers

Anisienia, Anna
Mueller, Roland M.
Kupfer, Anna
Staake, Thorsten
Journal Title
Journal ISSN
Volume Title
This paper presents an artifact that uses deep transfer learning methods for the multi-label classification of research methods for an Information Systems corpus. The artifact can support researchers with frequently performed yet time-consuming classification and structure-seeking tasks that are often part of literature analyses. We use a corpus of 5,388 papers from AIS journals and conferences, of which 1,766 have been manually labelled with up to five research methods. The unlabelled papers are used for finetuning the language model, whereas the labelled data are used for training and testing. Our approach outperforms state of the art research method classification that deploy SVM. We show that deep transfer learning models can lead to a better recognition of research methods than shallower word embedding approaches like word2vec or GloVe. The results illustrate the potential of establishing semi-automated methods for meta-analysis.
Knowing What We Know: Where to Now?, deep learning, literature review, meta-analysis, natural language processing, research methods
Access Rights
Email if you need this content in ADA-compliant format.