The University of Southampton
University of Southampton Institutional Repository

Novel Significance Weighting Schemes for Collaborative Filtering: Generating Improved Recommendations in Sparse Environments

Ghazanfar, Mustansar and Prugel-Bennett, Adam (2010) Novel Significance Weighting Schemes for Collaborative Filtering: Generating Improved Recommendations in Sparse Environments At DMIN'10, the 2010 International Conference on Data Mining!, United States.

Record type: Conference or Workshop Item (Paper)

Abstract

Recommender systems apply machine learning and data mining techniques for filtering unseen information and can predict whether a user would like a given resource. To date, a number of recommender system algorithms have been proposed, where collaborative filtering is the most famous and adopted recommendation algorithm. Collaborative filtering recommender systems recommend items by identifying other similar users, in case of user-based collaborative filtering, or similar items, in case of item-based collaborative filtering. Significance weighting schemes assign different weights to neighbouring users/items found against an active user/item. Several significance weighting schemes have been proposed [1], [2], [3], [4]. In this paper, we claim that these proposed schemes are flawed by the fact that they can not be applied to general recommender system datasets. We provide the correct generalized significance weighting schemes using different novel heuristics, and by extensive experimental results on three different data sets, show how significance weighting schemes affect the performance of a recommender system. Furthermore, we claim that the conventional weighted sum prediction formula used in item-based [5] collaborative filtering is not correct for very sparse datasets. We provide the correct prediction formula and empirically evaluate it.

PDF Novel_Significance_Weighting_Worldcomp_MustanarAli.pdf - Other
Download (154kB)

More information

Published date: 12 July 2010
Additional Information: Event Dates: July 2010
Venue - Dates: DMIN'10, the 2010 International Conference on Data Mining!, United States, 2010-07-01
Organisations: Southampton Wireless Group

Identifiers

Local EPrints ID: 270846
URI: http://eprints.soton.ac.uk/id/eprint/270846
PURE UUID: fff8ed79-7d74-440a-bca3-011550e39aa8

Catalogue record

Date deposited: 16 Apr 2010 19:51
Last modified: 18 Jul 2017 06:50

Export record

Contributors

Author: Mustansar Ghazanfar
Author: Adam Prugel-Bennett

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×