Typographic Error Identification and Correction in Chatbot Using N-gram Overlapping Approach

摘要

The high demand in the business sector and Artificial Intelligence (AI) capability have led to the development of chat robots, or in short, chatbots. A chatbot interacts through instant messaging, artificially replicating the patterns of human interaction. It is a computer program or virtual agent that allows humans and machines to freely converse using Natural Language Processing (NLP). People may input their queries with various typographical errors when interacting with a chatbot. The typographical errors include misspelt words or using abbreviated words. The primary drawback of most existing chatbots is that they can only handle questions with correct sentences. Natural language processing alone is insufficient for detecting typographical problems in input queries. Although the typographical error checker has become one of the most commonly used features in many applications and programs, including web applications, crawlers, and web browsers, in chatbots, especially in "Manglish", it still does not exist. Therefore, this research aims to enable chatbots to respond to queries correctly even with typographical errors using an embedding model of the N-gram overlapping with a rule-based algorithm.