Click-Through-Rate Prediction Using Deep Neural Networks and Efficient Channel Attention Mechanisms
Abstract
The progress of technology and the Internet has brought the development of online advertising into a developed period. To optimize the accuracy of advertisement, click-through-rate rate, the research proposed an advertisement click-through-rate prediction model based on deep neural network combined with efficient channel attention network. This model consists of four parts: embedding layer, interaction layer, efficient channel attention layer, and prediction layer. The embedding layer is responsible for passing the feature vectors to the interaction layer. higher-order feature interactions are learned through deep neural networks and efficient channel attention networks are introduced for lower-order feature interactions. higher-order feature interactions can capture the nonlinear and complex relationships between original features, while low-level feature interactions mainly focus on the relationships between a few features. The channel attention layer integrates the original features with the features that have already been interacted with by the interaction layer. The prediction layer uses perceptrons to predict click-through-rates. The proposed model is compared with logistic regression, deep feature crossover network, and deep factorization machine on Criteo, Avazu, KDD12, and MovieLens-1M datasets. The results showed that when the network depth was 1, the area under the curve of the proposed model was 0.8377, which was 10.4% higher than that of the logistic regression model. The average logarithmic loss was 0.1985, which was lower than that of the comparison model. The UC value of the model in the KDD12 dataset was 0.7879 and the logarithmic loss value was 0.4478. Taken together, the proposed model of the study is able to predict click-through-rates more accurately and has better model performance.References
Yang Y, Xu B, Shen S, Shen F, Zhao J. Operation-aware Neural Networks for user response prediction. Neural Networks, 2020, 121(8): 161-168.
Todri V, Ghose A, Singh P V. Trade-offs in online advertising: Advertising effectiveness and annoyance dynamics across the purchase funnel. Information Systems Research, 2020, 31(1): 102-125.
Aribarg A, Schwartz E M. Native advertising in online news: Trade-offs among clicks, brand recognition, and website trustworthiness. Journal of Marketing Research, 2020, 57(1): 20-34.
Lyu Z, Dong Y, Huo C, Ren W. Deep match to rank model for personalized click-through rate prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, 2020, 34(1): 156-163.
Yuan L, Pan Z, Sun P, Wei Y, Yu H. Deep context interaction network based on attention mechanism for click-through rate prediction. Journal of Intelligent & Fuzzy Systems, 2021, 41(6): 6899-6914.
Gai P J, Klesse A K. Making recommendations more effective through framings: Impacts of user-versus item-based framings on recommendation click-throughs. Journal of Marketing, 2019, 83(6): 61-75.
Ma B, Li D, Ma R, Zhou L. A deep neural network-based higher performance error prediction algorithm for reversible data hiding. In Proceedings of the 3rd International Symposium on Automation, Information and Computing (ISAIC 2022), 2023, 24(5): 788-794.
Cai Q, Yan B, Su B, Liu S, Xiang M, Wen Y, Feng N. Short‐term load forecasting method based on deep neural network with sample weights. International Transactions on Electrical Energy Systems, 2020, 30(5): 1-19.
Mahat S, Chaiyasarn K, Weesakul U. Improving monthly rainfall forecast model by input selection technique using deep neural network. Science & Technology Asia, 2020, 25(12): 30-44.
Liu Z, Hara R, Kita H. Hybrid forecasting system based on data area division and deep learning neural network for short-term wind speed forecasting. Energy Conversion and Management, 2021, 238(1): 1-16.
Khaki S, Wang L. Crop yield prediction using deep neural networks. Frontiers in Plant Science, 2019, 10(1): 139-147.
Xue H, Sun M, Liang Y. ECANet: Explicit cyclic attention-based network for video saliency prediction. Neurocomputing, 2022, 468(23): 233-244.
Zhou X, Pang C, Zeng X, Jiang L, Chen Y. A short-term power prediction method based on temporal convolutional network in virtual power plant photovoltaic system. IEEE Transactions on Instrumentation Measurement, 2023, 72(2): 1-10.
Yue J, Wu F, Wang X, Feng P, Zhuo J, Cui H, Peng X. A novel method for H2S concentration prediction under small sample based on ECA-1DCNN-XGBR. IEEE Sensors Journal, 2024, 24(12): 20167-20176.
Liang H, Wu J, Zhang H, Yang J. Two-stage short-term power load forecasting based on RFECV feature selection algorithm and a TCN–ECA–LSTM neural network. Energies, 2023, 16(4): 1925-1937.
Feng S, Zhou H, Dong H. Using deep neural network with small dataset to predict material defects. Materials & Design, 2019, 162(10): 300-310.
Srinivasan P A, Guastoni L, Azizpour H, Schlatter P H I L I P P, Vinuesa R. Predictions of turbulent shear flows using deep neural networks. Physical Review Fluids, 2019, 4(5): 603-614.
Su J, Vargas D V, Sakurai K. One pixel attack for fooling deep neural networks. IEEE Transactions on Evolutionary Computation, 2019, 23(5): 828-841.
Hua J, Li X, Liu J, Tang J, Rao, J, Deng H. A novel arrhythmia classification of electrocardiogram signal based on modified HRNet and ECA. Measurement Science and Technology, 2022, 33(6): 701-713.
Duan X, Sun Y, Wang J. ECA-UNet for coronary artery segmentation and three-dimensional reconstruction. Signal, Image and Video Processing, 2023, 17(3): 783-789.
DOI:
https://doi.org/10.31449/inf.v49i19.7947Downloads
Published
How to Cite
Issue
Section
License
I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.
I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.
In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.
I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal. The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.
Copyright © Slovenian Society Informatika
