skip to main content
research-article

Accurate and Novel Recommendations: An Algorithm Based on Popularity Forecasting

Published: 15 December 2014 Publication History

Abstract

Recommender systems are in the center of network science, and they are becoming increasingly important in individual businesses for providing efficient, personalized services and products to users. Previous research in the field of recommendation systems focused on improving the precision of the system through designing more accurate recommendation lists. Recently, the community has been paying attention to diversity and novelty of recommendation lists as key characteristics of modern recommender systems. In many cases, novelty and precision do not go hand in hand, and the accuracy--novelty dilemma is one of the challenging problems in recommender systems, which needs efforts in making a trade-off between them.
In this work, we propose an algorithm for providing novel and accurate recommendation to users. We consider the standard definition of accuracy and an effective self-information--based measure to assess novelty of the recommendation list. The proposed algorithm is based on item popularity, which is defined as the number of votes received in a certain time interval. Wavelet transform is used for analyzing popularity time series and forecasting their trend in future timesteps. We introduce two filtering algorithms based on the information extracted from analyzing popularity time series of the items. The popularity-based filtering algorithm gives a higher chance to items that are predicted to be popular in future timesteps. The other algorithm, denoted as a novelty and population-based filtering algorithm, is to move toward items with low popularity in past timesteps that are predicted to become popular in the future. The introduced filters can be applied as adds-on to any recommendation algorithm. In this article, we use the proposed algorithms to improve the performance of classic recommenders, including item-based collaborative filtering and Markov-based recommender systems. The experiments show that the algorithms could significantly improve both the accuracy and effective novelty of the classic recommenders.

References

[1]
G. Adomavicius and Y. Kwon. 2011. Maximizing aggregate recommendation diversity: A graph-theoretic approach. In Proceedings of the Workshop on Novelty and Diversity in Recommender Systems. 3--10.
[2]
G. Adomavicius and A. Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Audio Electroacoustics Knowledge and Data Engineering 17, 734--749.
[3]
G. Adomavicius and A. Tuzhilin. 2011. Context-aware recommender systems. In Recommender Systems Handbook. Springer, 217--253.
[4]
R. Agrawal, S. Gollapudi, A. Halverson, and S. Ieong. 2009. Diversifying search results. In Proceedings of the 2nd ACM International Conference on Web Search and Data Mining. ACM, New York, NY, 5--14.
[5]
M. Balabanović. 1997. Fab: Content-based, collaborative recommendation. Communications of the ACM 40, 66--72.
[6]
L. Baltrunas and F. Ricci. 2013. Experimental evaluation of context-dependent collaborative filtering using item splitting. User Modeling and User-Adapted Interaction, 24, 1--2, 1--28.
[7]
C. Basu, H. Hirsh, and W. Cohen. 1998. Recommendation as classification: Using social and content-based information in recommendation. In Proceedings of the 15th National/10th Conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence. 714--720.
[8]
J. Bennett, C. Elkan, B. Liu, P. Smyth, and D. Tikk. 2007. KDD Cup and workshop 2007. ACM SIGKDD Explorations Newsletter 9, 2, 51--52.
[9]
R. Burke. 2002. Hybrid recommender systems: Survey and experiments. User Modeling and User-Adaptive Interaction 12, 4, 331--370.
[10]
F. Cacheda, V. Carneiro, D. Fernández, and V. Formoso. 2011. Comparison of collaborative filtering algorithms: Limitations of current techniques and proposals for scalable, high-performance recommender systems. ACM Transactions on the Web 5, 1, Article No. 2.
[11]
P. G. Campos, F. Díez, and I. Cantador. 2013. Time-aware recommender systems: A comprehensive survey and analysis of existing evaluation protocols. User Modeling and User-Adapted Interaction 24, 1--2, 67--119.
[12]
C. Cattuto, V. Loreto, and L. Pietronero. 2007. Semiotic dynamics and collaborative tagging. Proceedings of the National Academy of Sciences of the United States of America 104, 1461--1464.
[13]
Ò. Celma and P. Herrera. 2008. A new approach to evaluating novel recommendations. In Proceedings of the 2008 ACM Conference on Recommendation Systems. 179--186.
[14]
C. L. A. Clarke, M. Kolla, G. V. Cormack, O. Vechtomova, A. Ashkan, S. Büttcher, and I. Mackinnon. 2008. Novelty and diversity in information retrieval evaluation. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 659--666.
[15]
M. Deshpande and G. Karypis. 2004. Item-based top-N recommendation algorithms. ACM Transactions on Information Systems 22, 1, 143--177.
[16]
Y. Ding and X. Li. 2005. Time weight collaborative filtering. In Proceedings of the 14th ACM International Conference on Information and Knowledge Management. ACM, New York, NY, 485--492.
[17]
M. Ge, C. Delgado-Battenfeld, and D. Jannach. 2010. Beyond accuracy: Evaluating recommender systems by coverage and serendipity. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, New York, NY, 257--260.
[18]
J. D. Hamilton. 1994. Time Series Analysis. Cambridge University Press.
[19]
T.-J. Hsieh, H.-F. Hsiao, and W.-C. Yeh. 2011. Forecasting stock markets using wavelet transforms and recurrent neural networks: An integrated system based on artificial bee colony algorithm. Applied Soft Computing 11, 2, 2510--2525.
[20]
A. Javari and M. Jalili. 2014. A probabilistic model to resolve diversity-accuracy challenge of recommendation systems. Knowledge and Information Systems. 1--19.
[21]
J. Konstan, B. Miller, D. Maltz, J. Herlocker, L. Gordon and J. Riedl. 1997. GroupLens: Applying collaborative filtering in usenet news. Communications of the ACM 40, 3, 77--87.
[22]
Y. Koren. 2010. Collaborative filtering with temporal dynamics. Communications of the ACM 53, 4, 89--97.
[23]
D. Liben-Nowelly and J. Kleinberg. 2003. The link prediction problem for social networks. In Proceedings of the 12th Annual ACM International Conference on Information and Knowledge Management. 556--559.
[24]
L. Lü and T. Zhou. 2011. Link prediction in complex networks: A survey. Physica A 390, 1150--1170.
[25]
S. Maslov and Y.-C. Zhang. 2001. Extracting hidden information from knowledge networks. Physical Review Letters 87, 24, 248701.
[26]
L. McGinty and B. Smyth. 2003. On the role of diversity in conversational recommender systems. In Case-Based Reasoning Research and Development. Lecture Notes in Computer Science, Vol. 2689. Springer, 276--290.
[27]
S. M. McNee, J. Riedl, and J. A. Konstan. 2006. Being accurate is not enough: How accuracy metrics have hurt recommender systems. In CHI’06 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 1097--1101.
[28]
M. E. J. Newman and J. Park. 2003. Why social networks are different from other types of networks. Physical Review E 68, 036122.
[29]
M. Papagelis and D. Plexousakis. 2005. Qualitative analysis of user-based and item-based prediction algorithms for recommendation agents. Engineering Applications of Artificial Intelligence 18, 7, 781--789.
[30]
M. J. Pazzani and D. Billsus. 2007. Content-based recommendation systems. In The Adaptive Web. Lecture Notes in Computer Science, Vol. 4321. Springer, 325--341.
[31]
P. Resnick and H. R. Varian. 1997. Recommender systems. Communications of the ACM 40, 3, 56--58.
[32]
F. Ricci and B. Shapira. 2011. Recommender Systems Handbook. Springer.
[33]
B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. ACM, New York, NY, 285--295.
[34]
J. Ben Schafer, D. Frankowski, Jon Herlocker, and Shilad Sen. 2007. Collaborative filtering recommender systems. In The Adaptive Web. Lecture Notes in Computer Science, Vol. 4321. Springer, 291--324.
[35]
M.-S. Shang, L. Lu, Y.-C. Zhang, and T. Zhou. 2010. Empirical analysis of Web-based user-object bipartite networks. Europhysics Letters 92, 48006.
[36]
G. Shani and A. Gunawardana. 2011. Evaluating recommendation systems. In Recommender Systems Handbook. Springer, 257--297.
[37]
G. Shani, R. I. Brafman, and D. Heckerman. 2002. An MDP-based recommender system. In Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence. 453--460.
[38]
G. Shani, D. Heckerman, and R. I. Brafman. 2006. An MDP-based recommender system. Journal of Machine Learning Research 6, 1265--1295.
[39]
D. Shin, J.-W. Lee, J. Yeon, and S.-G. Lee. 2009. Context-aware recommendation by aggregating user context. In Proceedings of the IEEE Conference on Commerce and Enterprise Computing, 2009. 423--430.
[40]
S. Soltani. 2002. On the use of the wavelet decomposition for time series prediction. Neurocomputing 48, 267--277.
[41]
P. G. C. Soto. 2011. Temporal models in recommender systems: An exploratory study on different evaluation dimensions. Universidad Autónoma de Madrid Escuela Politécnica Superior.
[42]
H. Steck. 2011. Item popularity and recommendation accuracy. In Proceedings of the 5th ACM Conference on Recommender Systems. ACM, New York, NY, 125--132.
[43]
S. Vargas and P. Castells. 2011. Rank and relevance in novelty and diversity metrics for recommender systems. In Proceedings of the 5th ACM Conference on Recommender Systems. ACM, New York, NY, 109--116.
[44]
L. Xiang and Q. Yang. 2009. Time-dependent models in collaborative filtering based recommender system. In Proceedings of the International Joint Conference on Web Intelligence and Intelligent Agent Technology. IEEE, Los Alamitos, CA, 450--457.
[45]
L. Xiong, X. Chen, T.-K. Huang, J. Schneider, and J. G. Carbonell. 2010. Temporal collaborative filtering with Bayesian probabilistic tensor factorization. In Proceedings of SIAM Data Mining.
[46]
S. Yousefi, I. Weinreich, and D. Reinarz. 2005. Wavelet-based prediction of oil prices. Chaos, Solitons, and Fractals 25, 2, 265--275.
[47]
T. Zhou, Z. Kuscsik, J.-G. Liu, M. Medo, J. R. Wakeling, and Y.-C. Zhang. 2010. Solving the apparent diversity-accuracy dilemma of recommender systems. In Proceedings of the National Academy of Sciences of the United States of America 107, 4511--4515.
[48]
T. Zhou, J. Ren, M. Medo, and Y.-C. Zhang. 2007. Bipartite network projection and personal recommendation. Physical Review E 76, 046115.
[49]
C.-N. Ziegle, S. M. McNee, J. A. Konstan, and G. Lausen. 2005. Improving recommendation lists through topic diversification. In Proceedings of the 14th International Conference on World Wide Web. ACM, New York, NY, 22--32.

Cited By

View all
  • (2023)A Review of Modern Fashion Recommender SystemsACM Computing Surveys10.1145/362473356:4(1-37)Online publication date: 21-Oct-2023
  • (2022)Model and Popularity Based Recommendation System- A Collaborative Filtering Approach2022 13th International Conference on Computing Communication and Networking Technologies (ICCCNT)10.1109/ICCCNT54827.2022.9984348(1-5)Online publication date: 3-Oct-2022
  • (2021)Adaptive time series prediction and recommendationInformation Processing & Management10.1016/j.ipm.2021.10249458:3(102494)Online publication date: May-2021
  • Show More Cited By

Index Terms

  1. Accurate and Novel Recommendations: An Algorithm Based on Popularity Forecasting

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Intelligent Systems and Technology
      ACM Transactions on Intelligent Systems and Technology  Volume 5, Issue 4
      Special Sections on Diversity and Discovery in Recommender Systems, Online Advertising and Regular Papers
      January 2015
      390 pages
      ISSN:2157-6904
      EISSN:2157-6912
      DOI:10.1145/2699158
      • Editor:
      • Huan Liu
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 15 December 2014
      Accepted: 01 February 2014
      Revised: 01 November 2013
      Received: 01 April 2013
      Published in TIST Volume 5, Issue 4

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Item popularity time series
      2. collaborative filtering
      3. item popularity forecasting
      4. time-aware recommendation systems

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)21
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 06 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)A Review of Modern Fashion Recommender SystemsACM Computing Surveys10.1145/362473356:4(1-37)Online publication date: 21-Oct-2023
      • (2022)Model and Popularity Based Recommendation System- A Collaborative Filtering Approach2022 13th International Conference on Computing Communication and Networking Technologies (ICCCNT)10.1109/ICCCNT54827.2022.9984348(1-5)Online publication date: 3-Oct-2022
      • (2021)Adaptive time series prediction and recommendationInformation Processing & Management10.1016/j.ipm.2021.10249458:3(102494)Online publication date: May-2021
      • (2020)Sign Prediction on Social Networks Based Nodal FeaturesComplexity10.1155/2020/43535672020Online publication date: 12-Jan-2020
      • (2020)ROSE: Role-based Signed Network EmbeddingProceedings of The Web Conference 202010.1145/3366423.3380038(2782-2788)Online publication date: 20-Apr-2020
      • (2020)Case-based Reasoning for Resolving the Diversity-accuracy Dilemma of Recommendation System through Subdivision2020 IEEE 3rd International Conference of Safe Production and Informatization (IICSPI)10.1109/IICSPI51290.2020.9332316(357-360)Online publication date: 28-Nov-2020
      • (2019)A survey on data mining techniques in recommender systemsSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-017-2918-723:2(627-654)Online publication date: 1-Jan-2019
      • (2018)A novel 2D-Graph clustering method based on trust and similarity measures to enhance accuracy and coverage in recommender systemsInformation Sciences10.1016/j.ins.2017.12.007432(210-230)Online publication date: Mar-2018
      • (2018)A novel prediction intervals method integrating an error & self-feedback extreme learning machine with particle swarm optimization for energy consumption robust predictionEnergy10.1016/j.energy.2018.08.180164(137-146)Online publication date: Dec-2018
      • (2017)Contents Recommendation Scheme Considering Trust and Collaborative Filtering in Online Social NetworksProceedings of the International Conference on Research in Adaptive and Convergent Systems10.1145/3129676.3130217(67-71)Online publication date: 20-Sep-2017
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media