Nuno Marques
2026
Progressing beyond Art Masterpieces or Touristic Clichés: how to assess your LLMs for cultural alignment?
António Branco | João Ricardo Silva | Nuno Marques | Luis M. S. Gomes | Ricardo Campos | Raquel Sequeira | Sara Nerea | Rodrigo Silva | Miguel Marques | Rodrigo Duarte | Artur Putyato | Diogo Folques | Tiago Valente
Proceedings of the Fourth Workshop on the Role of Resources in the Age of Large Language Models (RESOURCEFUL 2026)
António Branco | João Ricardo Silva | Nuno Marques | Luis M. S. Gomes | Ricardo Campos | Raquel Sequeira | Sara Nerea | Rodrigo Silva | Miguel Marques | Rodrigo Duarte | Artur Putyato | Diogo Folques | Tiago Valente
Proceedings of the Fourth Workshop on the Role of Resources in the Age of Large Language Models (RESOURCEFUL 2026)
Although the cultural (mis)alignment of Large Language Models (LLMs) has attracted increasing attention - often framed in terms of cultural bias - until recently there has been limited work on the design and development of datasets for cultural assessment. Here, we review existing approaches to such datasets and identify their main limitations. To address these issues, we propose design guidelines for annotators and report on the construction of a dataset built according to these principles. We further present a series of contrastive experiments conducted with this dataset. The results demonstrate that our design yields test sets with greater discriminative power, effectively distinguishing between models specialized for a given culture and those that are not, ceteris paribus.
Sovereign AI-based Public Services Are Viable and Affordable
António Branco | Luis M. S. Gomes | Rodrigo Santos | Eduardo Santos | João Ricardo Silva | Nuno Marques | Madalena Rodrigues
Proceedings of the Fifteenth Language Resources and Evaluation Conference
António Branco | Luis M. S. Gomes | Rodrigo Santos | Eduardo Santos | João Ricardo Silva | Nuno Marques | Madalena Rodrigues
Proceedings of the Fifteenth Language Resources and Evaluation Conference
The rapid expansion of AI-based remote services has intensified debates about the long-term implications of growing structural concentration in infrastructure and expertise. As AI capabilities become increasingly intertwined with geopolitical interests, the availability and reliability of foundational AI services can no longer be taken for granted. This issue is particularly pressing for AI-enabled public services for citizens, as governments and public agencies are progressively adopting 24/7 AI-driven support systems typically operated through commercial offerings from a small oligopoly of global technology providers. This paper challenges the prevailing assumption that general-purpose architectures, offered by these providers, are the optimal choice for all application contexts. Through practical experimentation, we demonstrate that viable and cost-effective alternatives exist—alternatives that align with principles of digital and cultural sovereignty. Our findings provide an empirical illustration that sovereign AI-based public services are both technically feasible and economically sustainable, capable of operating effectively on premises with modest computational and financial resources while maintaining cultural and digital autonomy. The technical insights and deployment lessons reported here are intended to inform the adoption of similar sovereign AI public services by national agencies and governments worldwide.