Arama Sonuçları

Listeleniyor 1 - 2 / 2
  • Yayın
    Extracting meaningful information student surveys with NLP
    (Işık Üniversitesi, Lisansüstü Eğitim Enstitüsü, 2025-01-29) Pourjalil, Kajal; Ekin, Emine; Işık Üniversitesi, Lisansüstü Eğitim Enstitüsü, Bilgisayar Mühendisliği Yüksek Lisans Programı; Işık University, School of Graduate Studies, Master’s Program in Computer Engineering
    This thesis applied NLP techniques to analyze and summarize bilingual student feedback collected via end-of-semester surveys. The dataset, which contained open-ended responses in both English and Turkish, required a model adept at preserving linguistic nuances across languages. The Llama 2-7b-hf model, which had been trained explicitly for text generation, was selected for its capability to produce coherent and contextually relevant summaries. Data preprocessing involved organizing metadata such as department, semester, course name, and section number, segregating comments by word count, and removing personal identifiers to ensure privacy. Shorter comments (fewer than ten words) were grouped and summarized using a pipeline from the Transformers library, while longer comments were fine-tuned with metadataspecific prompts for detailed summarization. To further enhance analysis, sentiment classification was performed using the “cardiffnlp/twitter-robertabase-sentiment” model, categorizing feedback into negative, neutral, and positive sentiments. Evaluation metrics included expert reviews, contextual relevance, and logical consistency with the dataset’s sentiment distribution. Compared to previous models, the Llama 2 model demonstrated superior performance in generating complete, coherent summaries while preserving the overall intent and tone of the comments. Ultimately, this research highlighted the effectiveness of LLMs in processing multilingual educational data and their potential to provide actionable insights for improving course content and student experiences.
  • Yayın
    Comparing pre-trained and fine-tuned transformer-based models for sentiment analysis in Turkish comments in student surveys
    (Institute of Electrical and Electronics Engineers Inc., 2025-08-15) Pourjalil, Kajal; Ekin, Emine; Recal, Füsun
    Student surveys are essential for evaluating teaching quality and course content, but analyzing open-ended responses is challenging due to their unstructured and multilingual nature. This study applies sentiment analysis to Turkish educational survey responses using three transformer-based models: SAVASY, DBMDZ BERT Base Turkish Cased, and XLM-RoBERTa Base. A labeled dataset of real-world student comments was used, with sentiment labels assigned using the Gemini AI tool to facilitate model fine-tuning. Evaluation metrics included accuracy, F1-score, precision, recall, and confidence scores. Results show that fine-tuning improves sentiment classification, effectively identifying positive, negative, and neutral sentiments. This highlights the value of transformer models in analyzing Turkish student feedback.