Automated Evaluation of the Virtual Assistant in Bleu and Rouge Scores
| dc.contributor.author | Chatoui, Hajar | |
| dc.contributor.author | Ata, Oguz | |
| dc.date.accessioned | 2025-02-06T18:01:20Z | |
| dc.date.available | 2025-02-06T18:01:20Z | |
| dc.date.issued | 2021 | |
| dc.department | Altınbaş Üniversitesi | en_US |
| dc.description | 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications, HORA 2021 -- 11 June 2021 through 13 June 2021 -- Ankara -- 171163 | en_US |
| dc.description.abstract | The advanced field of natural language processing refers to create an intelligent conversational agent. The main goal is to develop bot are capable of generating responses over the last measurements collected over the IoT network. The virtual assistant classifies the user utterance and extract the valuable information to predict the optimal response. The contribution of this paper was performed by the automatics metrics BLEU and ROUGE used in machine translation. However, these metrics were implemented in NLG system to perform the effectiveness of the system. In this work, we evaluated our model over others containing a large set of data in several languages along with the Paradise survey prompts the user satisfaction the results provide F1-score is 74%, the Precision is 85% and Accuracy 75%. Although, the BLEU 0.8 and ROUGE 0.7. The bot has a strong capability to understand dialog human judgments over various features structured based on qualitative and quantitative experiments. © 2021 IEEE. | en_US |
| dc.identifier.doi | 10.1109/HORA52670.2021.9461351 | |
| dc.identifier.isbn | 978-166544058-5 | |
| dc.identifier.scopus | 2-s2.0-85114467841 | |
| dc.identifier.uri | https://doi.org/10.1109/HORA52670.2021.9461351 | |
| dc.identifier.uri | https://hdl.handle.net/20.500.12939/5325 | |
| dc.indekslendigikaynak | Scopus | |
| dc.language.iso | en | en_US |
| dc.publisher | Institute of Electrical and Electronics Engineers Inc. | en_US |
| dc.relation.ispartof | HORA 2021 - 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications, Proceedings | en_US |
| dc.relation.publicationcategory | Konferans Öğesi - Uluslararası - Kurum Öğretim Elemanı | en_US |
| dc.rights | info:eu-repo/semantics/closedAccess | en_US |
| dc.snmz | KA_Scopus_20250206 | |
| dc.subject | BLEU | en_US |
| dc.subject | Chabot | en_US |
| dc.subject | Internet-of-Things (IoTs) | en_US |
| dc.subject | Paradise Survey | en_US |
| dc.subject | ROUGE | en_US |
| dc.title | Automated Evaluation of the Virtual Assistant in Bleu and Rouge Scores | en_US |
| dc.type | Conference Object | en_US |
