top of page

Who is the winner in sentiment analysis? ChatGPT vs R Studio

Updated: Nov 14, 2023


The Sentiment Analysis capabilities of ChatGPT and R Studio - made by DALL-E
The Sentiment Analysis capabilities of ChatGPT and R Studio - made by DALL-E


The Evolution of AI Perception: From Threat to Tool for Progress

The debate surrounding the development and use of artificial intelligence (AI) is a polarizing one, with opinions ranging from enthusiastic adoption of the technology to concerns over its potential risks to society and humanity. More than 1,000 technology leaders and researchers, including Elon Musk, have called for a pause in the development of the most advanced AI systems, citing profound risks to society.


This open letter brings up a critical point that cannot be ignored: how can we ensure the safe and ethical use of AI? Over the years, we’ve seen Microsoft and other tech giants take significant strides in developing AI that benefits society. However, we must also acknowledge that with the rapid advancement of technology comes responsibility, and we need to ensure that the development and deployment of AI tools are done in a way that is safe, ethical, and beneficial to all.


As a result, the perception of AI has shifted over the years. At first, it was seen as a potential threat to jobs and even humanity itself. However, as we’ve seen AI in action, including in Microsoft’s developments, we’ve come to appreciate its potential to enhance and improve our lives. After all, AI helps only the repetitive and old-fashioned jobs, and there are still plenty of modern occupations like software development, data engineering, and such. Oh wait, chatGPT has started to write and correct the codes with errors, but at least it is not as good as an experienced developer, YET. Besides, there are many new fields related to big data, and you’d probably think that those fields are going to occupy future positions in top workplaces…

Well, it might not be like that; chatGPT may have started to learn things in the context of data science as well. Since it is a language model that has been trained on vast amounts of text data, enabling it to generate human-like responses to natural language input, it can actually process and analyze data as if someone uses R Studio to make a sentimental analysis.

First, it is better to hear what R Studio does for sentimental analysis, and what sentimental analysis is:

Comparing Sentiment Analysis: ChatGPT vs. R Studio on Microsoft's AI Evolution

R Studio’s sentimental analysis (done by MonkeyLearn package) is a tool that helps to analyze and understand the sentiment behind the written language. By analyzing text data for specific emotional and tonal cues, sentimental analysis can provide insight into the attitudes and opinions expressed in large volumes of text, which can be useful in monitoring social media sentiment, analyzing customer feedback, or any public opinion on an issue.

Since both ChatGPT and R Studio use natural language processing (NLP) techniques, it wouldn’t be surprising if we make chatGPT do sentimental analysis.


Bringing together those two concepts (NLP skills of R Studio and chatGPT), in the context of people’s changing perceptions towards AI, could be an interesting topic. Let’s take 2 different articles, both in the concept of Microsoft’s relation with AI in general terms. However, there are 7 years between their publications, so the reactions to those articles might be really different since one was generated in 2016 and the other is in 2023.

When the comments went through a sentimental analysis via chatGPT prompt and R set up to be analyzed within the same dimensions, would you be surprised if the results are similar?

Here are the comparable results:

Analyzing Public Sentiment on Microsoft's AI Integration: Insights from ChatGPT and R Studio

Overall, the text has a generally positive sentiment with a high engagement level. The article discusses earlier news about Microsoft’s plans to integrate ChatGPT into Bing search and implies it could improve its competitiveness with Google. While there are some potential concerns, such as racial biases and factuality issues, the overall tone is confident and optimistic about the potential benefits of the integration. The text also touches on Microsoft’s history with AI and its relationship with OpenAI.


When it comes to the graphs, it can be clearly observed that both chatGPT and R Studio have analogous patterns in general. Only the “disgust” and “anticipation” dimensions seemed to perform radically differently from each other, whereas “fear” and “surprise” are both dominated by R Studio with similar margins.


The comments contain a mix of positive and negative opinions about different search engines and AI technologies. Some comments express frustration or disappointment with certain aspects of the technology, such as racial biases, while others are more positive and express excitement about the potential of AI. However, overall the sentiment is neutral to slightly positive, with a focus on the potential benefits of these technologies. The words “exciting”, “amazed”, “astonished”, “polished”, “good”, “potential”, “interesting”, and “useful” suggest a generally positive sentiment. The negative comments are somewhat muted and do not express extreme anger or disgust.


Since the article was written after artificial intelligence became known among society, it is clear to say that people already had some background knowledge about AI while reading and commenting on the article. In other words, readers as well as commentators of the article were already aware of both possible side effects and also brilliant applications (like chatGPT) of AI.


It is critical to notice all those presumptions because perceptions are changeable with respect to time and the information available at that time. If the conjuncture can be explained well, we might jump into the comments.

2016 Sentimental Analysis on Microsoft's AI: Diverse Emotions in a Pre-AI Hype Era

Overall, the comments about the article show a mix of emotions. Anger is present in some of the comments that criticize Nadella’s past decisions regarding Nokia and Windows Mobile. Some comments express anticipation and joy for the potential success of Microsoft’s AI initiatives, particularly in AR and bots. However, some also express fear that Microsoft may be abandoning certain aspects of its business, such as mobile. There are also comments expressing surprise at the effectiveness of Microsoft’s AI tools, particularly compared to Google. Trust in Microsoft’s leadership and technological capabilities is present in some of the comments, particularly those praising Nadella’s passion and the quality of Microsoft’s AI technology. There is also some disgust and skepticism towards some of the commenters who appear to be making flippant remarks and belittling Google. Overall, the comments express a range of emotions, reflecting the complexity of the topic and the different perspectives of the commenters.


This article was generated in 2016, therefore the recent hype of AI was not recognized by the audience. In terms of the outcomes of the sentimental analysis, this time we are facing more independent assessments as can be seen from the remarkable differences in “anger”, “anticipation”, and “trust”. In addition, it is substantial to note that chatGPT generates similar but somewhat different results when it runs a few more times.

To sum up, it is still not easy to see people’s emotional attitude towards AI developments, but it is interesting that chatGPT’s abilities are not only covering jobs related to content but also more sophisticated and todayish topics like data science.


References

Follow Mutlu on;





228 views0 comments

Comments


bottom of page