Adam Skurla
Author directory2026
mcdok at SemEval-2026 Task 13: Finetuning LLMs for Detection of Machine-Generated Code
Adam Skurla | Dominik Macko | Jakub Simko
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Adam Skurla | Dominik Macko | Jakub Simko
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Multi-domain detection of the machine-generated code snippets in various programming languages is a challenging task. SemEval-2026 Task 13 copes with this challenge in various angles, as a binary detection problem as well as attribution of the source. Specifically, its subtasks also cover generator LLM family detection, as well as a hybrid code co-generated by humans and machines, or adversarially modified codes hiding its origin. Our submitted systems adjusted the existing mdok approach (focused on machine-generated text detection) to these specific kinds of problems by exploring various base models, more suitable for code understanding. The results indicate that the submitted systems are competitive in all three subtasks. However, the margins from the top-performing systems are significant, and thus further improvements are possible.
Interpretable Predictability-Based AI Text Detection: A Replication Study
Adam Skurla | Dominik Macko | Jakub Simko
Findings of the Association for Computational Linguistics: EMNLP 2026
Adam Skurla | Dominik Macko | Jakub Simko
Findings of the Association for Computational Linguistics: EMNLP 2026
This paper replicates and extends the system used in the AuTexTification shared task for authorship attribution of machine-generated texts. Exact replication was not possible because of differences in data splits, model availability, and implementation details, which we document as a case study in reproducibility. We tested newer multilingual language models (mDeBERTa-v3-base, Qwen, mGPT) and added 26 document-level stylometric features, using ablation, permutation importance, and SHAP analysis to assess feature influence. A single shared configuration was applied to both English and Spanish across Subtask 1 and Subtask 2. Averaged over three random seeds, the shared multilingual configuration performs comparably to or better than the language-specific baseline, with the clearest gains on model attribution (Subtask 2). The additional stylometric features yield small improvements, led by lexical diversity, but their contribution falls within seed variance once predictability-based probabilities are included, which remain the dominant signal. The study also shows that clear documentation is important for reliable replication and fair comparison of systems.