Sentiment Analysis of User Reviews on Cryptocurrency Application: Evaluating the Impact of Dataset Split Scenarios Using Multinomial Naive Bayes

Abstract

The surge in cryptocurrency investors in Indonesia, reaching 18.83 million by January 2024, signifies an expanding interest in this market. This research conducts a sentiment analysis of user reviews on Indodax and Tokocrypto, the premier cryptocurrency trading platforms in Indonesia. Utilizing the Multinomial Naive Bayes method, the study examines the influence of various dataset split scenarios and random states on the model's performance. The findings reveal substantial variability in the model's accuracy based on different random states and test sizes. Notably, the Positive sentiment label consistently shows high-performance metrics, while the Neutral label underperforms. These insights are invaluable for developers aiming to improve user experience and for investors seeking to make informed decisions. This research underscores the significance of sentiment analysis in understanding user interactions and enhancing the credibility of cryptocurrency investment platforms.