News Recommendation with Gated Linear Attention and Simplified Gated Linear Units

Debiao Yan, Jian Sun, Jing Huang

Abstract


As a novel approach, the News Recommendation Algorithm Based on Gated Linear Attention and Simplified Gated Linear Units (NRAGLS) designed to enhance the precision and personalization of digital news dissemination is introduced. At the core of NRAGLS are two advanced techniques: Gated Linear Attention (GLA) and Simplified Gated Linear Units (SGLU), supplemented by tensor normalization to adeptly process and analyze the multifaceted nature of news content and user interactions. This research systematically outlines the development and implementation of the NRAGLS model, emphasizing its capacity to address prevalent challenges within the news recommendation domain, including data sparsity, the dynamic evolution of news content, and the absence of explicit user feedback. Through rigorous experimental validation on the Microsoft News Dataset (MIND) and its variant, MIND-small, the NRAGLS model's performance was benchmarked against four existing recommendation systems. Metrics such as Area Under the Curve (AUC), Mean Reciprocal Rank (MRR), and Normalized Discounted Cumulative Gain (nDCG) were employed to evaluate each model's ability to predict user engagement accurately and to rank news articles effectively. The NRAGLS model demonstrated superior performance across all metrics, highlighting its robustness in handling the complexities of real-world news recommendation scenarios. Furthermore, this paper explores the resilience of the NRAGLS model to data sparsity and its adaptability to the temporal dynamics of user preferences, key factors in sustaining the relevance and effectiveness of recommendation systems. The findings reveal that the NRAGLS model exhibits remarkable consistency in performance, even under varying levels of data omission, and maintains or improves its recommendation accuracy over time.

Full Text:

PDF

References


C. Feng, M. Khan, A. U. Rahman and A. Ahmad, News Recommendation Systems - Accomplishments, Challenges & Future Directions. IEEE Access, vol. 8, pp. 16702-16725, 2020.

S. Feng, J. Meng and J. Zhang, News Recommendation Systems in the Era of Information Overload. Journal of Web Engineering, vol. 20, no. 2, pp. 459-470, March 2021.

A. Darvishy, H. Ibrahim, F. Sidi and A. Mustapha, HYPNER: A Hybrid Approach for Personalized News Recommendation. IEEE Access, vol. 8, pp. 46877-46894, 2020

M. Li and L. Wang, A Survey on Personalized News Recommendation Technology. IEEE Access, vol. 7, pp. 145861-145879, 2019.

Z. Zhu, D. Li, J. Liang, G. Liu and H. Yu, A Dynamic Personalized News Recommendation System Based on BAP User Profiling Method. IEEE Access, vol. 6, pp. 41068-41078, 2018.

Z. Yang, L. Cui, X. Wang, T. Zhang and Y. Cheng, MIAR: Interest-Activated News Recommendation by Fusing Multichannel Information. IEEE Transactions on Computational Social Systems, vol. 10, no. 6, pp. 3433-3443, Dec. 2023.

H.-S. Sheu, Z. Chu, D. Qi and S. Li, Knowledge-Guided Article Embedding Refinement for Session-Based News Recommendation. IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 12, pp. 7921-7927, Dec. 2022.

B. Shi, G. Poghosyan, G. Ifrim and N. Hurley, Hashtagger+: Efficient High-Coverage Social Tagging of Streaming News. IEEE Transactions on Knowledge and Data Engineering, vol. 30, no. 1, pp. 43-58, 1 Jan. 2018.

C. Chen, X. Meng, Z. Xu and T. Lukasiewicz, Location-Aware Personalized News Recommendation with Deep Semantic Analysis. IEEE Access, vol. 5, pp. 1624-1638, 2017.

G. D. S. P. Moreira, D. Jannach and A. M. D. Cunha, Contextual Hybrid Session-Based News Recommendation with Recurrent Neural Networks. IEEE Access, vol. 7, pp. 169185-169203, 2019.

M. He, X. Wu, J. Zhang and R. Dong, UP-TreeRec: Building dynamic user profiles tree for news recommendation. China Communications, vol. 16, no. 4, pp. 219-233, April 2019.

Y. Zhou, J. Wu, T. H. Chan, S. -W. Ho, D. -M. Chiu and D. Wu, Interpreting Video Recommendation Mechanisms by Mining View Count Traces. IEEE Transactions on Multimedia, vol. 20, no. 8, pp. 2153-2165, Aug. 2018.

H. Aboutorab, O. K. Hussain, M. Saberi, F. K. Hussain and D. Prior, Reinforcement Learning-Based News Recommendation System. IEEE Transactions on Services Computing, vol. 16, no. 6, pp. 4493-4502, Nov.-Dec. 2023.

V. Kumar, D. Khattar, S. Gupta and V. Varma, Word Semantics Based 3-D Convolutional Neural Networks for News Recommendation. 2017 IEEE International Conference on Data Mining Workshops (ICDMW), New Orleans, LA, USA, 2017, pp. 761-764.

S. Yang, H. Wang, C. Zhang and Y. Gao, Contextual Bandits with Hidden Features to Online Recommendation via Sparse Interactions. IEEE Intelligent Systems, vol. 35, no. 5, pp. 62-72, 1 Sept.-Oct. 2020.

X. Xue, S. Huangfu, L. Zhang and S. Wang, Research on Escaping the Big-Data Traps in O2O Service Recommendation Strategy. IEEE Transactions on Big Data, vol. 7, no. 1, pp. 199-213, 1 March 2021.

S. Bangari, S. Nayak, L. Patel and K. T. Rashmi, A Review on Reinforcement Learning based News Recommendation Systems and its challenges. 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), Coimbatore, India, 2021, pp. 260-265.

B. Dellal-Hedjazi and Z. Alimazighi, Deep learning for recommendation systems. 2020 6th IEEE Congress on Information Science and Technology (CiSt), Agadir - Essaouira, Morocco, 2020, pp. 90-97.

S. Cui, Z. Yang, H. Wan and H. Liu, AGLGCN: Graph Convolution Recommendation Algorithm based on Multi-Head Attention and Gated Recurrent Unit. 2022 2nd International Conference on Algorithms, High Performance Computing and Artificial Intelligence (AHPCAI), Guangzhou, China, 2022, pp. 170-175.

S. Elfwing, E. Uchibe, K. Doy, Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Networks, 2018, 107:3-11.

X. Wu, Y. Fan, J. Zhang and Z. Gao, Federated Latent Dirichlet Allocation for User Preference Mining. Journal of Web Engineering, vol. 22, no. 4, pp. 639-677, June 2023.

W. Zhang, X. Zhang, H. Wang, D. Chen, A deep variational matrix factorization method for recommendation on large scale sparse dataset. Neurocomputing, 2019, 334:206-218.

L. Zhang, P. Liu and J. A. Gulla, Dynamic attention-integrated neural network for session-based news recommendation. Machine Learning, 2019, 108:1851-1875.

K. Cheng, X. Guo, X. Cui, and F. Shan, Dynamical Modeling, Analysis, and Control of Information Diffusion over Social Networks: A Deep Learning-Based Recommendation Algorithm in Social Network. Discrete Dynamics in Nature and Society, vol. 2020, Article ID 3273451, 8 pages, 2020.

C. Wu, J. Wang, J. Liu, W. Liu, Recurrent neural network-based recommendation for time heterogeneous feedback. Knowledge-Based Systems, 2016, 109:90-103.

S. Liu, Y. Dong and J. Chai, Research of personalized news recommendation system based on hybrid collaborative filtering algorithm. 2016 2nd IEEE International Conference on Computer and Communications (ICCC), Chengdu, 2016, pp. 865-869.

Y. Zhang et al., DCDN: Estimating Handover Parameter Adjusting Effect with Causal Inference. 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall), Hong Kong, Hong Kong, 2023, pp. 1-5.




DOI: https://doi.org/10.31449/inf.v48i16.6228

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.