ChatGPT Tweets Sentiment Analysis Using Machine Learning and Data Classification

Aliea Sabir, Huda Adil Ali, Maalim A. Aljabery

Abstract


Many things, such as goods, products, and websites are evaluated based on user's notes and comments. One popular research project is sentiment analysis, which aims to extract information from notes and comments as a natural language processing (NLP) to understand and express emotions. In this study we analyzed the sentiment of ChatGPT labeled tweet datasets sourced from the Kaggle community using five Machine Learning (ML) algorithms; decision tree, KNN, Naïve Bayes, Logistic Regression, and SVM. We applied three feature extraction techniques: positive/negative frequency, a bag of words (count vector), and TF IDF. For each classification algorithm. The results were assessed using accuracy measures. Our experiments achieved an accuracy of 96.41% with SVM classifier when using TF- IDF as a feature extraction technique.

Full Text:

PDF

References


N. J. SOBIA WASSANA, XI CHENB, TIAN SHENC*, MUHAMMAD WAQARD, “AMAZON PRODUCT SENTIMENT ANALYSIS USING MACHINE LEARNING TECHNIQUES,” REV. ARGENTINA CLÍNICA PSICOLÓGICA, NO. 1, PP. 695–703, 2021.

M. M. HAMED TAHERDOOST 1, “ARTIFICIAL INTELLIGENCE AND SENTIMENT ANALYSIS: A REVIEW IN,” COMPUT. 2023, 12, 37. HTTPS// DOI.ORG/10.3390/COMPUTERS12020037, NO. 0, 2023.

N. T. BHATT AND A. J. SAKET SWARNDEEP, “SENTIMENT ANALYSIS USING MACHINE LEARNING TECHNIQUE: A LITERATURE SURVEY,” INT. RES. J. ENG. TECHNOL., PP. 798–802, 2020.

R. PATEL, “SENTIMENT ANALYSIS ON TWITTER DATA USING MACHINE LEARNING BY RAVIKUMAR PATEL A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MSC COMPUTATIONAL SCIENCES THE FACULTY OF GRADUATE STUDIES,” 2017.

H. A. ALATABI AND A. R. ABBAS, “SENTIMENT ANALYSIS IN SOCIAL MEDIA USING MACHINE LEARNING TECHNIQUES,” IRAQI J. SCI., VOL. 61, NO. 1, PP. 193–201, 2020.

A. GOSWAMI ET AL., “SENTIMENT ANALYSIS OF STATEMENTS ON SOCIAL MEDIA AND ELECTRONIC MEDIA USING MACHINE AND DEEP LEARNING CLASSIFIERS,” COMPUT. INTELL. NEUROSCI., VOL. 2022, 2022.

P. CEN, K. ZHANG, AND D. ZHENG, “SENTIMENT ANALYSIS USING DEEP LEARNING APPROACH,” J. ARTIF. INTELL., VOL. 2, NO. 1, PP. 17–27, 2020.

S. HAMED, M. EZZAT, AND H. HEFNY, “A REVIEW OF SENTIMENT ANALYSIS TECHNIQUES,” INT. J. COMPUT. APPL., VOL. 176, NO. 37, PP. 20–24, 2020.

ANDREEA-MARIA COPACEANU, “SENTIMENT ANALYSIS USING MACHINE LEARNING APPROACH,” “OVIDIUS” UNIV. ANN. ECON. SCI. SER., NO. 1, PP. 261–270, 2021.

B. ONDARA, S. WAITHAKA, J. KANDIRI, AND L. MUCHEMI, “MACHINE LEARNING TECHNIQUES, FEATURES, DATASETS, AND ALGORITHM PERFORMANCE PARAMETERS FOR SENTIMENT ANALYSIS: A SYSTEMATIC REVIEW,” OPEN J. INF. TECHNOL., VOL. 5, NO. 1, PP. 1–16, 2022.

M. HU AND B. LIU, “MINING AND SUMMARIZING CUSTOMER REVIEWS,” KDD-2004 - PROC. TENTH ACM SIGKDD INT. CONF. KNOWL. DISCOV. DATA MIN., PP. 168–177, 2004.

S. MANSOUR, “SOCIAL MEDIA ANALYSIS OF USER’S RESPONSES TO TERRORISM USING SENTIMENT ANALYSIS AND TEXT MINING,” PROCEDIA COMPUT. SCI., VOL. 140, PP. 95–103, 2018.

M. EKLUND, “COMPARING FEATURE EXTRACTION METHODS AND EFFECTS OF PRE-PROCESSING METHODS FOR MULTI-LABEL CLASSIFICATION OF TEXTUAL DATA,” DEGREE PROJ. INCOMPUTER SCI. ENG. COMPUT. SCI. ENG., PP. 1–50, 2018.

A. TRIPATHY, A. AGRAWAL, AND S. K. RATH, “CLASSIFICATION OF SENTIMENTAL REVIEWS USING MACHINE LEARNING TECHNIQUES,” PROCEDIA COMPUT. SCI., VOL. 57, PP. 821–829, 2015.

T. MIKOLOV, K. CHEN, G. CORRADO, AND J. DEAN, “EFFICIENT ESTIMATION OF WORD REPRESENTATIONS IN VECTOR SPACE,” 1ST INT. CONF. LEARN. REPRESENT. ICLR 2013 - WORK. TRACK PROC., PP. 1–12, 2013.

D. AGGARWAL, V. BALI, A. AGARWAL, K. POSWAL, M. GUPTA, AND A. GUPTA, “SENTIMENT ANALYSIS OF TWEETS USING SUPERVISED MACHINE LEARNING TECHNIQUES BASED ON TERM FREQUENCY,” J. INF. TECHNOL. MANAG., VOL. 13, NO. 1, PP. 119–141, 2021.

M. HAMZA AND S. GUPTA, “A COMPARISON OF SENTIMENTAL ANALYSIS ALGORITHMS ON TWITTER DATA USING MACHINE LEARNING,” 2022.

A. BASHIR AND A. B. MUSA, “LOGISTIC REGRESSION CLASSIFICATION FOR UNCERTAIN DATA,” RES. J. MATH. STAT. SCI. ISSN, VOL. 2, NO. 2, PP. 1–6, 2014.

S. B. FATMA JEMAI, MOHAMED HAYOUNI, “SENTIMENT ANALYSIS USING MACHINE LEARNING ALGORITHMS,” IN 2021 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING (IWCMC).

S. D. ANJALI GUPTA, AMITA DHANKAR, “SENTIMENT ANALYSIS USING MACHINE LEARNING: A REVIEW,” J. EMERG. TECHNOL. INNOV. RES. WWW.JETIR.ORG, VOL. 5, NO. 2, PP. 935–937.

S. HOTA AND S. PATHAK, “KNN CLASSIFIER BASED APPROACH FOR MULTI-CLASS SENTIMENT ANALYSIS OF TWITTER DATA,” INT. J. ENG. TECHNOL., VOL. 7, NO. 3, PP. 1372–1375, 2018.

MEENU AND SUNILA GODARA, “SENTIMENT ANALYSIS USING DECISION TREE,” HTTP://WWW.CSJOURNALS.COM/IJEE/PDF11-1/154.%20SUNILA.PDF, VOL. 11, NO. 1, PP. 965–970, 2019.

S. KETHAVATH, “CLASSIFICATION OF SENTIMENT ANALYSIS ON TWEETS USING MACHINE LEARNING TECHNIQUES,” NATIONAL INSTITUTE OF TECHNOLOGY ROURKELA ROURKELA-769 008, ODISHA, INDIA, 2015.

I. HEMALATHA, D. G. P. S. VARMA, AND D. A. GOVARDHAN, “SENTIMENT ANALYSIS TOOL USING MACHINE LEARNING ALGORITHMS,” INT. J. EMERG. TRENDS TECHNOL. COMPUT. SCI., VOL. 2, NO. 2, PP. 105–109, 2013.

S. DREISEITL AND L. OHNO-MACHADO, “LOGISTIC REGRESSION AND ARTIFICIAL NEURAL NETWORK CLASSIFICATION MODELS: A METHODOLOGY REVIEW,” J. BIOMED. INFORM., VOL. 35, NO. 5–6, PP. 352–359, 2002.

S. B. KOTSIANTIS, “SUPERVISED MACHINE LEARNING: A REVIEW OF CLASSIFICATION TECHNIQUES,” INFORM. 31, VOL. 31, PP. 249–268.

S. KASTHURI AND D. A. N. JEBASEELI, “AN EFFICIENT DECISION TREE ALGORITHM FOR ANALYZING THE TWITTER SENTIMENT ANALYSIS,” J. CRIT. REV. , VOL. 7, NO. 4, PP. 1010–1018, 2020.

A. S. AND C. R. BHARATHI, “SENTIMENT CLASSIFICATION USING DECISION TREE BASED FEATURE SELECTION SENTIMENT CLASSIFICATION USING DECISION TREE BASED FEATURE SELECTION,” IJCTA, VOL. 9, NO. JANUARY, PP. 419–425, 2017.

P. A. GRANA, “SENTIMENT ANALYSIS OF TEXT USING MACHINE LEARNING MODELS,” INT. RES. J. MOD. ENG. TECHNOL. SCI., NO. 05, PP. 2582–5208, 2022.

C. A. A. KAESTNER, “SUPPORT VECTOR MACHINES AND KERNEL FUNCTIONS FOR TEXT PROCESSING,” REV. INFORMÁTICA TEÓRICA E APL., VOL. 20, NO. 3, P. 130, 2013.




DOI: https://doi.org/10.31449/inf.v48i7.5535

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.