Who Runs the World: Data

Abstract

The fact that any kind of user has the ability to generate data with great ease at any time causes an increase inthe importance of data mining. Considering the reality that the vast majority of the available data is composed ofunstructured data and that the data in the text type is outnumbering, it proves the increasing interest in text miningand the abundance of studies in this field. However, in order to be able to examine an unstructured data type like text,which is quite different from machine language, it is necessary to make this data more structured and make themachine work. At this point, the data pre-processing step, which covers a large part of the entire text mining process,is of great importance. In this chapter, it is aimed to explain the text pre-processing phase on a basic level bysupporting this using visuals. In doing so, it is primarily planned to focus on text mining and to explain in detail thecharacteristics of the data processed. In this context, it is aimed to explain the data pre-processing steps followed inorder to overcome these difficulties by examining the difficulties created by the data in question. As a result, thischapter is a descriptive review of the data pre-processing phase in text mining, which covers some of the studiespreviously conducted on this subject.