Evaluation Dataset: RAG System with LLM for Migrant Integration in an HCAI

  1. Castellanos Nieves, Dagoberto 1
  2. García-Forte, Luis 1
  1. 1 Universidad de La Laguna
    info

    Universidad de La Laguna

    San Cristobal de La Laguna, España

    ROR https://ror.org/01r9z8p25

Éditeur: University of La Laguna

Année de publication: 2024

Type: Dataset

CC BY 4.0

DOI: 10.17632/X4X86R6TZD lock_openAccès ouvert editor

Résumé

The data reflect the results of the experimentation with an HCAI system implemented using a RAG framework and the Llama 3.0 model. During the experimentation, 91 questions were utilized in the domain of legal advice and migrant rights. Metrics assessed included contextual enrichment, textual quality, discourse analysis, and sentiment evaluation. This allows for the analysis of sentiments and emotions, bias detection, content and toxicity classification, as well as an analysis of inclusion and diversity.