Evaluation Dataset: RAG System with LLM for Migrant Integration in an HCAI

  1. Castellanos Nieves, Dagoberto 1
  2. García-Forte, Luis 1
  1. 1 Universidad de La Laguna
    info

    Universidad de La Laguna

    San Cristobal de La Laguna, España

    ROR https://ror.org/01r9z8p25

Editor: University of La Laguna

Año de publicación: 2024

Tipo: Dataset

CC BY 4.0

DOI: 10.17632/X4X86R6TZD lock_openAcceso abierto editor

Resumen

The data reflect the results of the experimentation with an HCAI system implemented using a RAG framework and the Llama 3.0 model. During the experimentation, 91 questions were utilized in the domain of legal advice and migrant rights. Metrics assessed included contextual enrichment, textual quality, discourse analysis, and sentiment evaluation. This allows for the analysis of sentiments and emotions, bias detection, content and toxicity classification, as well as an analysis of inclusion and diversity.