What I work on

Research

My work centers on Code LLMs in settings the field tends to overlook: languages other than English, programming languages other than Python, and safety in classrooms rather than in the abstract.

Current Team

My team is a part of the S2E Lab (Security & Software Engineering Research Lab) at the University of Notre Dame, led by Dr. Joanna C. S. Santos.

Dr. Joanna C. S. Santos Joanna C. S. Santos Assistant Professor · PI
Nishat Raihan Nishat Raihan Postdoctoral Fellow
TBA M.S. Student
Freeman Nkouka Undergraduate
Katherine Comito Katherine Comito Undergraduate
Mariana Lira Undergraduate
Experience
University of Notre Dame
S2E Lab — Security & Software Engineering Research Lab
Aug 2026 – Present
University of Notre Dame · Provost's Postdoctoral Fellow
PI: Dr. Joanna C. S. Santos. Safety-by-construction guardrails and multilingual program synthesis for Code LLMs.
George Mason University
Language Technology Lab
Jan 2023 – Jul 2026
George Mason University · Graduate Research Assistant
PI: Dr. Marcos Zampieri. Multilingual NLP, code-mixed text, and Code LLMs for low-resource settings.
Funding
University of Notre Dame
Provost's Postdoctoral Fellowship
2026 – 2028
College of Engineering, University of Notre Dame
University-wide competitive fellowship funding two years of research on guardrails and multilingual program synthesis for Code LLMs.
George Mason University
Doctoral Research Scholarship, Tier 1
2026
The Graduate Division, George Mason University
Competitive dissertation-year award; declined in favor of the Notre Dame fellowship.
George Mason University
NAVSEA & STTR awards
Ph.D., GMU
Naval Sea Systems Command; multiple STTR awards
Doctoral research supported in part by NAVSEA and several Small Business Technology Transfer awards, with hands-on experience in proposal development and budget planning.
I enjoy the proposal side of research as much as the papers, and I am always building toward the next one. Interested in applying for grants as co-PIs? Reach out: mraihan@nd.edu.
Research Directions

Code LLMs & program synthesis

How code models behave, and how to make them better, outside English and outside Python: dedicated model families, instruction corpora, and execution-based evaluation for low-resource settings.

LREC 2026
The first dedicated family of Code LLMs for Bangla (1B and 9B), built on a 300K instruction–code corpus, with 11–18% Pass@1 gains over larger baselines on MBPP-Bangla.
arXiv 2026
A Taxonomy of Programming Languages for Code Generation
A structured taxonomy of programming languages from the perspective of what Code LLMs can and cannot yet generate (arXiv:2604.00239).
NAACL 2025
Extends HumanEval to 204 natural languages and 25 programming languages, 836,400 prompts in total, so code generation can be measured far beyond English and Python.
NAACL 2025
The first language model and evaluation suite for the Mojo programming language, a case study in adapting Code LLMs to a brand-new language.
BigData 2024
A structured map of the Code LLM landscape: architectures, training data, and evaluation practices.
BLP 2025
The first shared task on Bangla code generation, which I organized, with 158 international participants.

LLM safety & AI in CS education

Guardrails for code assistants and the role of LLMs in introductory computing. This is the thread my Notre Dame fellowship extends, toward safety-by-construction guardrails for Code LLMs.

EMNLP 2026
On the Robustness of Code LLM Guardrails to Code-mixed and Transliterated Inputs
Shows how guardrails for code assistants degrade when prompts arrive code-mixed or transliterated, and what it takes to make them robust (Findings of EMNLP 2026, to appear).
EACL 2026
A prompt taxonomy, an 8K-prompt dataset, and PromptShield (0.93 F1), which together cut harmful code completions by 30–65% while preserving legitimate coding help (Findings of EACL 2026).
ASE 2026
Assesses the security of LLM-generated code when prompts arrive in languages other than English (Automated Software Engineering, Springer).
SIGCSE 2025
A systematic review of how LLMs are actually being used, and misused, in CS classrooms (SIGCSE-TS 2025).
JIIS 2025
Measures how far current LLMs get on real introductory assignments, and where they quietly fail (Journal of Intelligent Information Systems, Springer).

Multilingual & low-resource NLP

Modeling and evaluation across natural languages, with a long-running focus on Bangla and on code-mixed text, plus how multilingual LLMs hold up in sensitive domains.

ACL 2025
Open Bangla LLMs, pretrained and instruction-tuned, that outperform prior open alternatives for the language.
EACL 2026
Evaluates proprietary and open LLMs on eight mental health datasets across languages and their machine-translated counterparts (LoResLM workshop).
BLP 2023
Introduces TB-OLID and shows how offensive language behaves once Bangla is romanized and mixed with English (BLP @ EMNLP 2023).
2023 – 24
Trilingual Bangla-English-Hindi code-mixed corpora for sentiment, offensive language, and emotion detection (AACL 2023; LREC-COLING 2024).

Benchmarks & datasets

Large, openly released resources that make under-tested settings measurable. Most of my modeling work starts by building the yardstick first.

NAACL 2025
836,400 prompts across 204 natural and 25 programming languages, the widest execution-based code generation benchmark of its kind.
ISMIS 2024
A benchmark of real introductory CS prompts for testing how LLMs handle classroom-style programming questions.
LREC 2024
A large multi-task dataset for mental health signals in social media text (LREC-COLING 2024).
BEA 2024
An extensible, massively multilingual lexical simplification pipeline dataset and the BEA 2024 shared task built on it.