Please use this identifier to cite or link to this item: http://hdl.handle.net/10125/63868

Prevent Low-Quality Analytics by Automatic Selection of the Best-Fitting Training Data

File Size Format  
0103.pdf 878.68 kB Adobe PDF View/Open

Item Summary

Title:Prevent Low-Quality Analytics by Automatic Selection of the Best-Fitting Training Data
Authors:Kiefer, Cornelia
Reimann, Peter
Mitschang, Bernhard
Keywords:Data, Text, and Web Mining for Business Analytics
data quality
domain-specific data analysis
text analysis
text similarity
show 1 moretraining data
show less
Date Issued:07 Jan 2020
Abstract:Data analysis pipelines consist of a sequence of various analysis tools. Most of these tools are based on supervised machine learning techniques and thus rely on labeled training data. Selecting appropriate training data has a crucial impact on analytics quality. Yet, most of the times, domain experts who construct analysis pipelines neglect the task of selecting appropriate training data. They rely on default training data sets, e.g., since they do not know which other training data sets exist and what they are used for. Yet, default training data sets may be very different from the domain-specific input data that is to be analyzed, leading to low-quality results. Moreover, these input data sets are usually unlabeled. Thus, information on analytics quality is not measurable with evaluation metrics. Our contribution comprises a method that (1) indicates the expected quality to the domain expert while constructing the analysis pipeline, without need for labels and (2) automatically selects the best-fitting training data. It is based on a measurement of the similarity between input and training data. In our evaluation, we consider the part-of-speech tagger tool and show that Latent Semantic Analysis (LSA) and Cosine Similarity are suited as indicators for the quality of analysis results and as basis for an automatic selection of the best-fitting training data.
Pages/Duration:10 pages
URI:http://hdl.handle.net/10125/63868
ISBN:978-0-9981331-3-3
DOI:10.24251/HICSS.2020.129
Rights:Attribution-NonCommercial-NoDerivatives 4.0 International
https://creativecommons.org/licenses/by-nc-nd/4.0/
Appears in Collections: Data, Text, and Web Mining for Business Analytics


Please email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.

This item is licensed under a Creative Commons License Creative Commons