Arama Sonuçları

Listeleniyor 1 - 6 / 6
  • Yayın
    Application of ChatGPT in the tourism domain: potential structures and challenges
    (IEEE, 2023-12-23) Kılıçlıoğlu, Orkun Mehmet; Özçelik, Şuayb Talha; Yöndem, Meltem Turhan
    The tourism industry stands out as a sector where effective customer communication significantly influences sales and customer satisfaction. The recent shift from traditional natural language processing methodologies to state-of-The-Art deep learning and transformer-based models has revolutionized the development of Conversational AI tools. These tools can provide comprehensive information about a company's product portfolio, enhancing customer engagement and decision-making. One potential Conversational AI application can be developed with ChatGPT. In this study, we explore the potential of using ChatGPT, a cutting-edge Conversational AI, in the context of Setur's products and services, focusing on two distinct scenarios: intention recognition and response generation. We incorporate Setur-specific data, including hotel information and annual catalogs. Our research aims to present potential structures and strategies for utilizing Language Model-based systems, particularly ChatGPT, in the tourism domain. We investigate the advantages and disadvantages of three different architectures and evaluate whether a restrictive or more independent model would be suitable for our application. Despite the impressive performance of Large Language Models (LLMs) in generating human-like dialogues, their end-To-end application faces limitations, such as system prompt constraints, fine-Tuning challenges, and model unavailability. Moreover, semantic search fails to deliver satisfactory performance when searching filters that require clear answers. To address these issues, we propose a hybrid approach that employs external interventions, the assignment of different GPT agents according to intent analysis, and traditional methods at specific junctures, which will facilitate the integration of domain knowledge into these systems.
  • Yayın
    TUR2SQL: A cross-domain Turkish dataset for Text-to-SQL
    (IEEE, 2023-09-15) Kanburoğlu, Ali Buğra; Tek, Faik Boray
    The field of converting natural language into corresponding SQL queries using deep learning techniques has attracted significant attention in recent years. While existing Text-to-SQL datasets primarily focus on English and other languages such as Chinese, there is a lack of resources for the Turkish language. In this study, we introduce the first publicly available cross-domain Turkish Text-to-SQL dataset, named TUR2SQL. This dataset consists of 10,809 pairs of natural language statements and their corresponding SQL queries. We conducted experiments using SQLNet and ChatGPT on the TUR2SQL dataset. The experimental results show that SQLNet has limited performance and ChatGPT has superior performance on the dataset. We believe that TUR2SQL provides a foundation for further exploration and advancements in Turkish language-based Text-to-SQL research.
  • Yayın
    Leveraging transformer-based language models for enhanced service insight in tourism
    (IEEE, 2023-12-22) Er, Aleyna; Özçelik, Şuayb Talha; Yöndem, Meltem Turhan
    Customer feedback is a valuable resource for enhancing customer experience and identifying areas that require improvement. Utilizing user insights allows a tourism company to identify and address problematic points in its service delivery, provide feedback to partner companies regarding their product offerings, and even reconsider agreements by incorporating these opinions when curating their product portfolio. Setur implemented a systematic approach to collecting customer feedback by distributing "after-stay surveys'' to its customers via email following the completion of the agency services provided. Guest answers to open-ended questions that gather opinions about travel experience are analyzed by four tasks: user intention for answering, the sentiment of the review, subjects touched upon, and whom it concerned. For these tasks, transformer-based natural language processing (NLP) models BERT, DistilBERT, RoBERTa, and Electra are fine-Tuned to classify customer reviews. Based on the test results, it is observed that best practices could be gathered using Bert. In addition, we showed that different insights can be obtained from text comments made for two hotels in Aydin, Turkiye. Some users made complaints using neutral sentences. In some cases, people gave high scores to the numerical rating questions, but their open-ended questions could have a negative meaning.
  • Yayın
    Sentiment analysis for hotel reviews in Turkish by using LLMs
    (Institute of Electrical and Electronics Engineers Inc., 2024) Özdemir, Ata Onur; Giritli, Efe Batur; Can, Yekta Said
    The field of sentiment analysis plays a pivotal role in consumer decision-making and service quality improvement within the hospitality industry. This study explores the application of Large Language Models (LLMs) for sentiment analysis of Turkish hotel reviews, contributing to the understanding of customer feedback and satisfaction. We created a dataset of 5,000 reviews by translating an English corpus into Turkish, which was then utilized to evaluate the performance of a state-of-the-art Turkish language model, TURNA. The study demonstrates that LLMs, particularly TURNA, outperform traditional machine learning algorithms and other advanced models in sentiment classification tasks, achieving an accuracy of 99.4%. This research underscores the potential of LLMs to enhance the accuracy of sentiment analysis, offering valuable insights for the tourism and hospitality sectors. The findings contribute to the ongoing evolution of sentiment analysis methodologies and suggest that LLMs can significantly improve t he understanding a nd processing of customer feedback in Turkish hotel reviews.
  • Yayın
    Text-to-SQL: a methodical review of challenges and models
    (TÜBİTAK, 2024-05-20) Kanburoğlu, Ali Buğra; Tek, Faik Boray
    This survey focuses on Text-to-SQL, automated translation of natural language queries into SQL queries. Initially, we describe the problem and its main challenges. Then, by following the PRISMA systematic review methodology, we survey the existing Text-to-SQL review papers in the literature. We apply the same method to extract proposed Text-to-SQL models and classify them with respect to used evaluation metrics and benchmarks. We highlight the accuracies achieved by various models on Text-to-SQL datasets and discuss execution-guided evaluation strategies. We present insights into model training times and implementations of different models. We also explore the availability of Text-to-SQL datasets in non-English languages. Additionally, we focus on large language model (LLM) based approaches for the Text-to-SQL task, where we examine LLM-based studies in the literature and subsequently evaluate the LLMs on the cross-domain Spider dataset. Finally, we conclude with a discussion of future directions for Text-to-SQL research, identifying potential areas of improvement and advancements in this field.
  • Yayın
    TurkEmbed: Turkish embedding model on natural language inference & sentence text similarity tasks
    (Institute of Electrical and Electronics Engineers Inc., 2025) Ezerceli, Özay; Gümüşçekiçci, Gizem; Erkoç, Tuğba; Özenç, Berke
    This paper introduces TurkEmbed, a novel Turkish language embedding model designed to outperform existing models, particularly in Natural Language Inference (NLI) and Semantic Textual Similarity (STS) tasks. Current Turkish embedding models often rely on machine-translated datasets, potentially limiting their accuracy and semantic understanding. TurkEmbed utilizes a combination of diverse datasets and advanced training techniques, including matryoshka representation learning, to achieve more robust and accurate embeddings. This approach enables the model to adapt to various resource-constrained environments, offering faster encoding capabilities. Our evaluation on the Turkish STS-b-TR dataset, using Pearson and Spearman correlation metrics, demonstrates significant improvements in semantic similarity tasks. Furthermore, TurkEmbed surpasses the current state-of-the-art model, Emrecan, on All-NLI-TR and STS-b-TR benchmarks, achieving a 1-4% improvement. TurkEmbed promises to enhance the Turkish NLP ecosystem by providing a more nuanced understanding of language and facilitating advancements in downstream applications.