Alignment of Large Language Models with Human Preferences and Values

Usman Naseem; Gautam Siddharth Kashyap; Kaixuan Ren; Yiran Zhang; Utsav Maskey; Juan Ren; Afrozah Nadeem

Alignment of Large Language Models with Human Preferences and Values

Usman Naseem, Gautam Siddharth Kashyap, Kaixuan Ren, Yiran Zhang, Utsav Maskey, Juan Ren, Afrozah Nadeem

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their reliability and alignment with human expectations remain unresolved challenges. This tutorial introduces the foundations of alignment and provides participants with a conceptual and practical understanding of the field. Core principles such as values, safety, reasoning, and pluralism will be presented through intuitive explanations, worked examples, and case studies. The aim is to equip attendees with the ability to reason about alignment goals, understand how existing methods operate in practice, and critically evaluate their strengths and limitations.

Anthology ID:: 2025.alta-main.20
Volume:: Proceedings of the 23rd Annual Workshop of the Australasian Language Technology Association
Month:: November
Year:: 2025
Address:: Sydney, Australia
Editors:: Jonathan K. Kummerfeld, Aditya Joshi, Mark Dras
Venues:: ALTA | WS
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 245
Language:
URL:: https://aclanthology.org/2025.alta-main.20/
DOI:
Bibkey:
Cite (ACL):: Usman Naseem, Gautam Siddharth Kashyap, Kaixuan Ren, Yiran Zhang, Utsav Maskey, Juan Ren, and Afrozah Nadeem. 2025. Alignment of Large Language Models with Human Preferences and Values. In Proceedings of the 23rd Annual Workshop of the Australasian Language Technology Association, pages 245–245, Sydney, Australia. Association for Computational Linguistics.
Cite (Informal):: Alignment of Large Language Models with Human Preferences and Values (Naseem et al., ALTA 2025)
Copy Citation:
PDF:: https://aclanthology.org/2025.alta-main.20.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{naseem-etal-2025-alignment,
    title = "Alignment of Large Language Models with Human Preferences and Values",
    author = "Naseem, Usman  and
      Kashyap, Gautam Siddharth  and
      Ren, Kaixuan  and
      Zhang, Yiran  and
      Maskey, Utsav  and
      Ren, Juan  and
      Nadeem, Afrozah",
    editor = "Kummerfeld, Jonathan K.  and
      Joshi, Aditya  and
      Dras, Mark",
    booktitle = "Proceedings of the 23rd Annual Workshop of the Australasian Language Technology Association",
    month = nov,
    year = "2025",
    address = "Sydney, Australia",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.alta-main.20/",
    pages = "245--245",
    ISBN = "1834-7037",
    abstract = "Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their reliability and alignment with human expectations remain unresolved challenges. This tutorial introduces the foundations of alignment and provides participants with a conceptual and practical understanding of the field. Core principles such as values, safety, reasoning, and pluralism will be presented through intuitive explanations, worked examples, and case studies. The aim is to equip attendees with the ability to reason about alignment goals, understand how existing methods operate in practice, and critically evaluate their strengths and limitations."
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="naseem-etal-2025-alignment">
    <titleInfo>
        <title>Alignment of Large Language Models with Human Preferences and Values</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Usman</namePart>
        <namePart type="family">Naseem</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Gautam</namePart>
        <namePart type="given">Siddharth</namePart>
        <namePart type="family">Kashyap</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kaixuan</namePart>
        <namePart type="family">Ren</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Yiran</namePart>
        <namePart type="family">Zhang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Utsav</namePart>
        <namePart type="family">Maskey</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Juan</namePart>
        <namePart type="family">Ren</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Afrozah</namePart>
        <namePart type="family">Nadeem</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 23rd Annual Workshop of the Australasian Language Technology Association</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Jonathan</namePart>
            <namePart type="given">K</namePart>
            <namePart type="family">Kummerfeld</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Aditya</namePart>
            <namePart type="family">Joshi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Mark</namePart>
            <namePart type="family">Dras</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Sydney, Australia</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">1834-7037</identifier>
    </relatedItem>
    <abstract>Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their reliability and alignment with human expectations remain unresolved challenges. This tutorial introduces the foundations of alignment and provides participants with a conceptual and practical understanding of the field. Core principles such as values, safety, reasoning, and pluralism will be presented through intuitive explanations, worked examples, and case studies. The aim is to equip attendees with the ability to reason about alignment goals, understand how existing methods operate in practice, and critically evaluate their strengths and limitations.</abstract>
    <identifier type="citekey">naseem-etal-2025-alignment</identifier>
    <location>
        <url>https://aclanthology.org/2025.alta-main.20/</url>
    </location>
    <part>
        <date>2025-11</date>
        <extent unit="page">
            <start>245</start>
            <end>245</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T Alignment of Large Language Models with Human Preferences and Values
%A Naseem, Usman
%A Kashyap, Gautam Siddharth
%A Ren, Kaixuan
%A Zhang, Yiran
%A Maskey, Utsav
%A Ren, Juan
%A Nadeem, Afrozah
%Y Kummerfeld, Jonathan K.
%Y Joshi, Aditya
%Y Dras, Mark
%S Proceedings of the 23rd Annual Workshop of the Australasian Language Technology Association
%D 2025
%8 November
%I Association for Computational Linguistics
%C Sydney, Australia
%@ 1834-7037
%F naseem-etal-2025-alignment
%X Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their reliability and alignment with human expectations remain unresolved challenges. This tutorial introduces the foundations of alignment and provides participants with a conceptual and practical understanding of the field. Core principles such as values, safety, reasoning, and pluralism will be presented through intuitive explanations, worked examples, and case studies. The aim is to equip attendees with the ability to reason about alignment goals, understand how existing methods operate in practice, and critically evaluate their strengths and limitations.
%U https://aclanthology.org/2025.alta-main.20/
%P 245-245

Download as File

Markdown (Informal)

[Alignment of Large Language Models with Human Preferences and Values](https://aclanthology.org/2025.alta-main.20/) (Naseem et al., ALTA 2025)

Alignment of Large Language Models with Human Preferences and Values (Naseem et al., ALTA 2025)

ACL

Usman Naseem, Gautam Siddharth Kashyap, Kaixuan Ren, Yiran Zhang, Utsav Maskey, Juan Ren, and Afrozah Nadeem. 2025. Alignment of Large Language Models with Human Preferences and Values. In Proceedings of the 23rd Annual Workshop of the Australasian Language Technology Association, pages 245–245, Sydney, Australia. Association for Computational Linguistics.