Maha Trabelsi
Author directory2026
GNN-CB: A Graph Neural Network Competition Benchmark for Human and LLM Evaluation
Murad Hossen | Tasneem Selim | Gurur Gamgam | Tuga Yousif | Abderrahmane Kasmi | Ikram Aissiou | Mubaraq Onipede | Faran Taimoor Butt | Sanae Zrigui | Rosa Y. G. Paccotacya-Yanque | Ignatius Balayo | Ikram Elhouiti | Hadil Affes | Bijay Adhikari | Sargam Goyal | Muhammad Ibrahim Isah | Mohammad Idrees Bhat | Samuel Kangoni Matia | Peguy Kem-Meka Tiotsop Kadzue | Maha Trabelsi | Emmanuel Owusu | Vinit | Nour Majdoub | Tamiru Alemnew | Islem Rekik
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Murad Hossen | Tasneem Selim | Gurur Gamgam | Tuga Yousif | Abderrahmane Kasmi | Ikram Aissiou | Mubaraq Onipede | Faran Taimoor Butt | Sanae Zrigui | Rosa Y. G. Paccotacya-Yanque | Ignatius Balayo | Ikram Elhouiti | Hadil Affes | Bijay Adhikari | Sargam Goyal | Muhammad Ibrahim Isah | Mohammad Idrees Bhat | Samuel Kangoni Matia | Peguy Kem-Meka Tiotsop Kadzue | Maha Trabelsi | Emmanuel Owusu | Vinit | Nour Majdoub | Tamiru Alemnew | Islem Rekik
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have demonstrated strong performance on coding and reasoning benchmarks; however, their ability to solve graph-structured machine learning problems remains largely unexplored. In particular, no benchmark currently evaluates whether LLMs can autonomously solve end-to-end Graph Neural Network (GNN) coding tasks under realistic competition settings. To address this gap, this paper introduces GNN-CB, the first competition-based benchmark for evaluating both humans and LLMs on GNN coding tasks. GNN-CB consists of 18 curated competitions spanning node-, edge-, and graph-level prediction across diverse graph categories, domains, and difficulty tiers. All submissions are evaluated through a unified automated pipeline with hidden test sets and standardized scoring. Human participants solve tasks under controlled competition constraints, while LLMs are evaluated using a frozen zero-shot prompting protocol based on a plan-then-code paradigm with bounded execute-and-repair loops. The benchmark additionally supports both non-agent and autonomous agent-based evaluation within the same protocol. Under our evaluated protocol, LLMs rarely match Human Top performance and show less stable performance across competitions. No single model dominates: a few competitions are won by LLMs, yet humans still hold the top score on most tasks. We release GNN-CB as a living benchmark with automated evaluation infrastructure, dynamic leaderboards, and reproducible execution pipelines. Beyond benchmarking, GNN-CB provides a practice-oriented resource for studying GNN implementation across progressively diverse graph-learning tasks. The benchmark and evaluation framework are publicly available at https://basiralab.github.io/GNN-CB/.
Search
Fix author
Co-authors
- Bijay Adhikari 1
- Hadil Affes 1
- Ikram Aissiou 1
- Tamiru Alemnew 1
- Ignatius Balayo 1
- Mohammad Idrees Bhat 1
- Faran Taimoor Butt 1
- Ikram Elhouiti 1
- Gurur Gamgam 1
- Sargam Goyal 1
- Murad Hossen 1
- Muhammad Ibrahim Isah 1
- Peguy Kem-Meka Tiotsop Kadzue 1
- Abderrahmane Kasmi 1
- Nour Majdoub 1
- Samuel Kangoni Matia 1
- Mubaraq Onipede 1
- Emmanuel Owusu 1
- Rosa Y. G. Paccotacya-Yanque 1
- Islem Rekik 1
- Tasneem Selim 1
- Vinit 1
- Tuga Yousif 1
- Sanae Zrigui 1