<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="rabonato-berton-2026-impact">
    <titleInfo>
        <title>The Impact of Language and Portuguese Intralinguistic Variation on NL2SQL</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ricardo</namePart>
        <namePart type="given">Trainotti</namePart>
        <namePart type="family">Rabonato</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Lilian</namePart>
        <namePart type="family">Berton</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-10</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 17th Brazilian Symposium in Information and Human Language Technology</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Bryan</namePart>
            <namePart type="given">Khelven</namePart>
            <namePart type="given">da</namePart>
            <namePart type="given">Silva</namePart>
            <namePart type="family">Barbosa</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Aline</namePart>
            <namePart type="family">Paes</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ariani</namePart>
            <namePart type="given">Di</namePart>
            <namePart type="family">Felippo</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Cuiabá, Mato Grosso, Brazil</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Natural Language to Structured Query Language (NL2SQL) systems have advanced with large language models (LLMs), yet evaluations remain centered on English, leaving open how these systems behave across languages and language varieties. We aim to contribute to this by analyzing two state-of-the-art LLMs (LLaMA 3.3 70B and Qwen 3.6 35B, both zero-shot) on the WikiSQL benchmark in English, Brazilian Portuguese (PT-BR), and European Portuguese (PT-PT), keeping database schemas and inference configuration fixed. Translations were validated through distance metrics (cosine similarity 0.966), contrastive linguistic analysis confirming varietal features (e.g., cleft constructions 36.8× more frequent in PT-PT), and multi-model judgment (85% / 81% semantic equivalence, 95.5% PT-BR and 96.0% PT-PT inter-judge agreement). Results show a marked drop from English (47.25% EX) to Portuguese (PT-BR: 40.03%; PT-PT: 39.34%), with the PT-BR vs. PT-PT difference reaching statistical significance (p = 0.019). English-only successes outnumber Portuguese-only successes nearly 10:1. A replication on a second model (Qwen 3.6 35B) confirms the English-Portuguese gap but suggests that intralinguistic effects may be model-dependent. Stratified analyses show semantic complexity and quantification amplify degradation, particularly for COUNT queries. These findings point to persistent English bias in NL2SQL and measurable effects of intralinguistic variation, even between closely related varieties.</abstract>
    <identifier type="citekey">rabonato-berton-2026-impact</identifier>
    <identifier type="doi">10.5753/stil.2026.26611</identifier>
    <location>
        <url>https://aclanthology.org/2026.stil-1.27/</url>
    </location>
    <part>
        <date>2026-10</date>
        <extent unit="page">
            <start>317</start>
            <end>330</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T The Impact of Language and Portuguese Intralinguistic Variation on NL2SQL
%A Rabonato, Ricardo Trainotti
%A Berton, Lilian
%Y Barbosa, Bryan Khelven da Silva
%Y Paes, Aline
%Y Felippo, Ariani Di
%S Proceedings of the 17th Brazilian Symposium in Information and Human Language Technology
%D 2026
%8 October
%I Association for Computational Linguistics
%C Cuiabá, Mato Grosso, Brazil
%F rabonato-berton-2026-impact
%X Natural Language to Structured Query Language (NL2SQL) systems have advanced with large language models (LLMs), yet evaluations remain centered on English, leaving open how these systems behave across languages and language varieties. We aim to contribute to this by analyzing two state-of-the-art LLMs (LLaMA 3.3 70B and Qwen 3.6 35B, both zero-shot) on the WikiSQL benchmark in English, Brazilian Portuguese (PT-BR), and European Portuguese (PT-PT), keeping database schemas and inference configuration fixed. Translations were validated through distance metrics (cosine similarity 0.966), contrastive linguistic analysis confirming varietal features (e.g., cleft constructions 36.8× more frequent in PT-PT), and multi-model judgment (85% / 81% semantic equivalence, 95.5% PT-BR and 96.0% PT-PT inter-judge agreement). Results show a marked drop from English (47.25% EX) to Portuguese (PT-BR: 40.03%; PT-PT: 39.34%), with the PT-BR vs. PT-PT difference reaching statistical significance (p = 0.019). English-only successes outnumber Portuguese-only successes nearly 10:1. A replication on a second model (Qwen 3.6 35B) confirms the English-Portuguese gap but suggests that intralinguistic effects may be model-dependent. Stratified analyses show semantic complexity and quantification amplify degradation, particularly for COUNT queries. These findings point to persistent English bias in NL2SQL and measurable effects of intralinguistic variation, even between closely related varieties.
%R 10.5753/stil.2026.26611
%U https://aclanthology.org/2026.stil-1.27/
%U https://doi.org/10.5753/stil.2026.26611
%P 317-330

Markdown (Informal)

[The Impact of Language and Portuguese Intralinguistic Variation on NL2SQL](https://aclanthology.org/2026.stil-1.27/) (Rabonato & Berton, STIL 2026)

• The Impact of Language and Portuguese Intralinguistic Variation on NL2SQL (Rabonato & Berton, STIL 2026)

ACL

• Ricardo Trainotti Rabonato and Lilian Berton. 2026. The Impact of Language and Portuguese Intralinguistic Variation on NL2SQL. In Proceedings of the 17th Brazilian Symposium in Information and Human Language Technology, pages 317–330, Cuiabá, Mato Grosso, Brazil. Association for Computational Linguistics.