A Recipe For Building a Compliant Real Estate Chatbot

Navid Madani, Anusha Bagalkotkar, Supriya Anand, Gabriel Arnson, Rohini K. Srihari, Kenneth Joseph


Abstract
In recent years, there has been significant effort to align large language models with human preferences. This work focuses on developing a chatbot specialized in the real estate domain, with an emphasis on incorporating compliant behavior to ensure it can be used without perpetuating discriminatory practices like steering and redlining, which have historically plagued the real estate industry in the United States. Building on prior work, we present a method for generating a synthetic general instruction-following dataset, along with safety data. Through extensive evaluations and benchmarks, we fine-tuned a llama-3-8B-instruct model and demonstrated that we can enhance it’s performance significantly to match huge closed-source models like GPT-4o while making it safer and more compliant. We open-source the model, data and code to support further development and research in the community
Anthology ID:
2025.coling-industry.18
Volume:
Proceedings of the 31st International Conference on Computational Linguistics: Industry Track
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert, Kareem Darwish, Apoorv Agarwal
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
213–235
Language:
URL:
https://aclanthology.org/2025.coling-industry.18/
DOI:
Bibkey:
Cite (ACL):
Navid Madani, Anusha Bagalkotkar, Supriya Anand, Gabriel Arnson, Rohini K. Srihari, and Kenneth Joseph. 2025. A Recipe For Building a Compliant Real Estate Chatbot. In Proceedings of the 31st International Conference on Computational Linguistics: Industry Track, pages 213–235, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
A Recipe For Building a Compliant Real Estate Chatbot (Madani et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-industry.18.pdf