Dr. Owen Noel Newton Fernando
College of Computing & Data Science · Nanyang Technological University · Singapore
⭐ Learning with Artificial Intelligence (Flagship Research Area)

This research investigates how AI can act as an interactive partner in learning, supporting reasoning, reflection, and skill development through human–AI collaboration. Key projects include:

AlgoGPT — AI Tutoring Platform for Programming Education

A multi-agent LLM tutoring platform that addresses “vibe coding” — the tendency for students to rely on AI-generated solutions without understanding — by reframing AI from answer generator to Socratic coach. The system pairs a Driver Agent that delivers strictly non-directive feedback in four tiers (analysis → hints → questions → suggestions) with a Navigator Agent that injects plausibly flawed code calibrated to the student’s reasoning level, requiring them to evaluate, debug, and accept or reject the AI’s output. The design is grounded in Cognitive Load Theory (tiered scaffolding directs effort towards germane load) and Self-Regulated Learning (Driver mode supports metacognitive monitoring; Navigator mode supports critical evaluation).

Empirical evidence (NTU SC1007, Jan–Apr 2026): 1,000 active students, 10,333 sessions, 35,433 code submissions across 14 lab questions over 7 lab weeks. Mode-level differences are statistically distinct (Kruskal–Wallis H = 886.01, p < 10−192): Navigator Mode produces the most efficient trajectories (1.80 attempts to first accept) while Driver Mode produces the highest-quality submissions (5.13/10 tests passed). An accompanying SRL survey (N = 155, 12-item scale) returned an overall mean of 3.39/5 with all items significantly above the neutral midpoint — Reflective Self-Evaluation strongest (M = 3.46), Checking Understanding the largest individual effect (t = 6.97).

Reported in Beyond the Perfect Assistant: Provoking Learning with Flawed AI Partners (ACM DIS 2026) and at NIE RPIC 2026. Built on a stateless API architecture (OpenAI backend, React frontend, Azure deployment) so the pedagogical pattern is domain-general and replicable. Funded: NTU-EdeX S$40,000 (2025–2027) · IRB-2023-735 · algogpt.azurewebsites.net →

AIView — Multi-Agent Technical Interview Simulation

Multi-agent AI platform simulating realistic technical interview environments with live coding, speech interaction, emotion recognition, and behavioural analysis. Provides structured, personalised feedback on technical performance and communication skills. Technology Disclosure filed: NTU Ref 2025-208

NALA-Assess — Self-Regulated Learning Analytics Dashboard

Learning analytics system visualising learner behaviour, progress, and topic dependencies for AI chatbot-based learning. Features peer comparison, self-referenced progress tracking, and structured feedback mechanisms. (NIE RPIC 2026)

NALA-Teach — Microteaching Simulation for Teaching Assistants

Multi-agent AI simulation enabling teaching assistants to interact with AI-driven student agents representing diverse learning behaviours, supporting development of facilitation and instructional skills at scale.

GenAI for Graduate Critical Reasoning & Writing

Generative AI chatbots designed to support graduate students’ critical reasoning and academic writing. Co-PI: NIE I3G Grant S$104,897 · (NIE RPIC 2026)

Automated Lesson Microgenre Analysis

Application of LLMs and computer vision to automatically analyse classroom lessons for spatial pedagogy and lesson microgenres, producing pedagogical heatmaps to support educator reflection. (NIE RPIC 2026)

📚 Interactive Learning Technologies

Exploring how interactive technologies enhance learning across diverse educational contexts, integrating technology with pedagogical principles to deliver accessible, personalised learning environments.

Key Projects

  • Learning Companion (MEL901, NIE/NTU) — Socratic questioning & ZPD scaffolding for academic writing. Co-PI: NIE I3G Grant S$104,897
  • AlgoTutor — integrated learning platform for data structures and algorithms with real-time guidance and interactive visualisations (HCII 2024)
  • La Petite Fée Cosmo — 2D puzzle game for linked-list learning via productive failure (Cyberworlds 2019, VRCAI 2019)
  • Interactive Course Materials — dynamic digital formats improving engagement in higher education (HCII 2023)
  • Manufactory — promoting 3D spatial skills through productive failure and educational games (ACE 2018)
  • Productive Failure via Educational Games — tertiary education game-based learning. Co-PI: MOE-TRF S$285,866
  • Personalized Interventions During E-lecture — adaptive e-learning system. Co-PI: NTU-EdeX S$40,000
🎓 Human-Computer Interaction in Education

Designing and analysing human-centred interactive systems for educational contexts. Research investigates affective and behavioural signals during learning, multimodal interfaces for instruction, and child-focused interactive systems for play and learning.

Key Projects

  • Affective State Detection in Programming — keyboard & mouse signals to infer emotional states during coding tasks (ICARCV 2018)
  • Multimodal Virtual Anatomy Learning Tool — 3D CT/fMRI models with multi-touch interactive learning for medical education (IMCIC 2011)
  • Interactive Play and Learning for Children — special-issue research on cute, playful interaction for children (Int. J. of Advances in HCI)
  • BlogWall — social and cultural interaction system for children (Int. J. of Advances in HCI)
🖱️ Human-Computer Interaction

Designing and analysing interactive, human-centred systems beyond the classroom — including interactive media, mobile applications, novel interaction techniques, and ubiquitous computing.

Key Projects

  • Voyager — crowdsourced travel safety mobile application (HCII 2024)
  • ChatAlone — offline anonymous messaging application for enhanced privacy (HCII 2024)
  • MyHistory — automatic photo-album creation using AI (IEEE CAI 2024)
  • Animal Hunt — AI-based animal sound recognition application (HCII 2023)
  • Foodscover — eliminating retail-sector food waste through technology (Cyberworlds 2019)
  • AmbiKraf — non-emissive, fast-changing wearable textile display (Interacting with Computers, Oxford UP, 2013)
  • Kawaii / Cute Interactive Media — research on cuteness as a design dimension in interaction (Universal Access in the Information Society, 2012)
🎭 Multimodal Interaction Systems

Multimodal interfaces that combine audio, visual, and behavioural signals to support collaborative interaction, spatial awareness, and group activity understanding.

Key Projects

  • AI Sports Coaching & Class Observation Analysis — multimodal video, audio, and behavioural-pattern analysis for educators and coaches
  • RelPosGAR — hierarchical relative position-aware interaction modelling for weakly supervised skeleton-based group activity recognition (Pattern Recognition, 2026)
  • Spatial Audio for Mobile Devices — spatial audio interfaces enabling multipresent avatars across workstations and mobile devices (IEICE Trans. on Information and Systems, 2007)
  • Narrowcasting in Collaborative Virtual Environments — privacy and presence operations for multipresent avatars (IJWMC, 2009)
  • Audio Fingerprinting for the Media Industry — content identification using acoustic fingerprint analysis (UbiComp 2018)
  • “Back Seat Driver” — spatial sound for vehicular wayfinding and situation awareness (FCST 2006)
Research Funding Summary
RolePeriodProjectAmount (S$)Funder
PI2025–2027AlgoGPT: Multi-Agent AI for Data Structures Learning40,000NTU-EdeX
Co-PI2025–2026GenAI for Graduate Critical Reasoning & Writing104,897NIE I3G Grant
PI2016–2018Socially Mediated AR for Enhanced User Experience148,000Edge Lab (AIA)
PI2017–2019Twittener: Twitter Speech Synthesis with NLP50,000MOE AcRF Tier 1
PI2016–2018Code Quality Assessment Tool (CQAT)18,000NTU-EdeX
Co-PI2022–2024Migrant Deities: Sacred Pantheon in Singapore89,000MOE AcRF Tier 1
Co-PI2018–2020Hidden Shrines of Singapore70,000NHB HRG Grant
Co-PI2017–2019Productive Failure via Educational Games285,866MOE-TRF Grant
Co-PI2010–2012AR for Military Applications1,880,000MINDEF Singapore
🚀 Innovation & Technology Transfer

Beyond publications, my research has produced commercialisable technologies addressing real-world problems in distributed systems, public health, and consumer applications. To date: 1 patent filed (Petimo), 20 technology disclosures filed at NTU, and 3 technology disclosures licensed to industry and global health partners. Selected licensed technologies are featured below.

Licensed 2018 Licensee: CME Private Limited

Blockchain on a Distributed Database System

Transaction latency is a core limitation of leading blockchain networks, preventing real-time processing in production systems. We embedded blockchain features — immutability and distributed consensus — into Apache Cassandra, a fault-tolerant, highly available, high-throughput distributed database. The result is a hybrid platform that retains blockchain’s integrity guarantees while operating at database-class throughput, suitable for enterprise transaction workloads.

NTU Tech Disclosure 2018-225 · W. K. Ng, E. Bandara, M. H. S. Tharaka, O. N. N. Fernando · Licensed August 2018

Licensed 2017 Licensee: Skoll Global Threats Fund

Mo-Buzz — Socially Mediated Dengue Surveillance

A mobile participatory platform for dengue public health surveillance, communication, and citizen engagement, launched in Colombo, Sri Lanka. Deployed nationally through the DengueFreeChild app, the system enables citizens and schoolchildren to proactively report suspected dengue cases, allowing public health authorities to identify mosquito-breeding hotspots and alert parents in affected localities.

Public health impact: Received widespread national publicity in Sri Lanka across television, radio, and print press (March–April 2018), with documented contributions to earlier outbreak signal detection and stronger community engagement around childhood dengue prevention.

NTU Tech Disclosure TD/248/14 · M. O. Lwin, O. N. N. Fernando, S. Vijaykumar, V. Ratnayake, S. Foo · Licensed September 2017 · Watch coverage →

Licensed 2018 Licensee: Newtonis Technologies Pte Ltd

Eventify — Nearby Events

A location- and interest-aware event discovery platform that recommends nearby events to users based on shared interests and proximity, while allowing anyone to create an event and broadcast it to potential participants in real time. The technology underpins ongoing commercial software consultancy services delivered through Newtonis Technologies Pte Ltd.

NTU Tech Disclosure TD/305/17 · O. N. N. Fernando, N. Y. H. Lee, W. K. Ng · Licensed March 2018