Big Data Feature Selection And Projection For Gender Prediction Based On User Web Behaviour

Gulsen E., Gunduz H., Çataltepe Z., Serinol L.

23nd Signal Processing and Communications Applications Conference (SIU), Malatya, Turkey, 16 - 19 May 2015, pp.1545-1548 identifier

  • Publication Type: Conference Paper / Full Text
  • City: Malatya
  • Country: Turkey
  • Page Numbers: pp.1545-1548
  • Istanbul Technical University Affiliated: Yes


Prediction of a visitors' gender and other demographic information helps with the presentation of the appropriate content to the user. In this paper, we perform gender prediction based on Turkish users' web log data. Our methods use three different sets of features, namely the URLs (Uniform Resource Locator), the textual contents and the DMOZ (from hierarchies of the pages visited by each user. Since we have a sparse high-dimensional input dataset, first we apply Information Gain and Chi-square based feature selection. We use a MapReduce based approach to compute these feature relevance measures. We also apply stochastic singular value decomposition (SSVD) feature projection method. We present gender classification results, based on these feature selection and projection methods, using the Logistic Regression classifier. Using the Logistic Regression classifier on the selected URL features results in the best performance.