CV
Basics
Name | Athar Mahmoudi |
athar1@ualberta.ca | |
Phone | (587) 501-8919 |
Interests
Reinforcement Learning | |
Model-Free RL | |
Deep Reinforcement Learning | |
RL from Human Feedback (RLHF) | |
Transfer Learning in RL |
Time Series and Sensor Analytics | |
Time Series Analysis | |
Transformers for Time Series | |
Decision Transformer | |
Forecasting and Prediction |
Video Games | |
Games as Psychological Measures | |
Games for Therapy | |
Game Adaptation |
Work
-
2025.01 - Present Edmonton, Canada
Machine Learning Scientist
Advanced Sensor Research (ASR)
Working on innovative, AI-driven solutions for glucose monitoring using advanced sensor technologies.
- Designed and implemented Transformer-based frameworks for accurate glucose level estimation.
- Developed and optimized Long Short-Term Memory (LSTM) networks and autoencoders for robust sensor data processing.
- Conducted extensive sensor data analysis to identify and leverage meaningful patterns for predictive modeling.
-
2022.06 - 2023.05 Montreal, Canada
Intern Research Scientist
Samsung Research Montreal
Focused on reinforcement learning and high-dimensional data representation for load balancing and energy saving in networks.
- Implemented and evaluated reinforcement learning architectures to optimize agent performance.
- Developed curriculum learning strategies to effectively train RL agents.
- Designed and deployed a Vector Quantized Variational Autoencoder (VQ-VAE) for efficient clustering of high-dimensional data.
- Integrated and adapted an Online Decision Transformer within reinforcement learning frameworks.
-
2017.09 - 2018.09 Tehran, Iran
Research Engineer
Pars Cognition
Created engaging video game experiences aimed at cognitive assessment and development.
- Developed mini-serious video games targeting cognitive science applications and research.
Education
-
2018.09 - 2024.12 Edmonton, Canada
Doctor of Philosophy
University of Alberta
Computing Science
Thesis: Automated Personalized Exposure Therapy Based on Physiological Measures Using Experience-driven Procedural Content Generation via Reinforcement Learning
- Intro to Virtual/Augmented Reality and Telepresence
- Machine Learning and the Brain
- Image Processing and Analysis in Diagnostic Imaging
-
2014.09 - 2017.08 Tehran, Iran
Master of Science,
Shahid Beheshti University,
Computer Engineering/Artificial Intelligence
Thesis: Pattern Extraction and Analysis of the Behavior of Children with Autism Spectrum Disorders Using a Designed Video Game
- Machine Learning
- Neural Network
- Pattern Recognition
- Data Mining
- Image Processing
- Natural Language Processing
-
2009.09 - 2014.08 Tehran, Iran
Bachelor of Science
University of Tehran,
Computer Engineering/Software Engineering
Thesis: Designed and Developed a Video Game for Children with Autism to Improve their Receptive Language Skills.
- Advanced Programming
- Database Design
- Data Structures
- Artificial Intelligence
- Operating Systems
- Human-Computer Interaction
- Intro to Multimedia
- Intro to eLearning
Skills
Programming Languages | |
Python | |
MATLAB | |
C# | |
SQL |
Development Tools & Platforms | |
Visual Studio Code | |
Microsoft Visual Studio | |
Git | |
Jupyter Notebook | |
Google Colab | |
Google Cloud Platform | |
AWS |
Frameworks & Libraries | |
PyTorch | |
OpenAI Gym | |
Scikit-learn | |
TensorFlow | |
Hugging Face | |
Microsoft .NET |
Game and Simulation Engines | |
Unity | |
GameMaker Studio | |
Virtual Reality (VR) |
Publications
-
2024 Spiders Based on Anxiety: How Reinforcement Learning Can Deliver Desired User Experience in Virtual Reality Personalized Arachnophobia Treatment
Accepted for publication in ACM Transactions on Interactive Intelligent Systems (TIIS)
This paper introduces a framework for personalized virtual reality exposure therapy for arachnophobia that leverages procedural content generation and reinforcement learning to automatically adapt virtual spiders to elicit specific anxiety responses, demonstrating superior performance over traditional rules-based methods.
-
2024 Stress Detection from Photoplethysmography in a Virtual Reality Environment
ArXiv
This article presents a virtual reality exposure therapy platform that non-intrusively assesses patients' mental states using photoplethysmography (PPG) signals, achieving a 70.6% accuracy in classifying relaxing and stressful states—outperforming more complex methods.
-
2024 Label-Free Subjective Player Experience Modelling via Let's Play Videos
Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment
This paper introduces a label-free approach to Player Experience Modelling (PEM) using gameplay videos, validated through strong correlations with affective measures in Angry Birds gameplay.
-
2021 Arachnophobia exposure therapy using experience-driven procedural content generation via reinforcement learning (EDPCGRL)
Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment
This paper proposes a reinforcement learning-based approach that uses physiological measures to automatically adapt therapeutic content in arachnophobia exposure therapy, generating personalized virtual spiders that adapt more quickly and accurately than existing search-based methods.
-
2021 Automated personalized exposure therapy based on physiological measures using experience-driven procedural content generation
Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment
This research proposes a personalized virtual reality exposure therapy framework that utilizes physiological sensors and machine learning algorithms to automatically adapt exposure parameters through procedural content generation, addressing the limitations of subjective, hand-authored methods, with planned human studies on arachnophobia and fear of public speaking.
-
2018 A framework for easier designs: Augmented intelligence in serious games for cognitive development
IEEE Consumer Electronics Magazine
This article introduces a portable, rapid development framework for intelligent serious games that leverage human intervention to minimize complex AI requirements, enabling caregivers to foster social interactions with children with special needs across various settings.
-
2017 The differences between children with autism and typically developed children in using a hand-eye-coordination video game
Ubiquitous Computing and Ambient Intelligence: 11th International Conference, UCAmI
This paper introduces a touch-based hand-eye coordination video game that effectively differentiates between children with autism and typically developing children using only two in-game features, demonstrating its potential as a cost-free tool for initial screening of motor coordination issues in autism.
Projects
-
Experience-Driven Procedural Content Generation via Reinforcement Learning
Developed an adaptive system using Experience-Driven Procedural Content Generation and Reinforcement Learning to tailor virtual environments based on user experiences.
- Implemented reinforcement learning algorithms in Python
- Utilized OpenAI Gym for environment simulation and testing
-
Glucose Level Estimation Using Transformer-Based Models
Built Transformer, LSTM, and autoencoder models in Python using PyTorch to estimate glucose levels from non-invasive sensor data.
- Implemented Transformer-based architectures for time series forecasting
-
Online Decision Transformer
Developed an Online Decision Transformer using Python and PyTorch to enhance decision-making processes in dynamic environments.
- Implemented transformer models for real-time decision making
- Leveraged PyTorch for efficient model training and deployment
-
Vector Quantized Variational Autoencoder for Time-Series Clustering
Developed a Vector Quantized Variational Autoencoder using Python and PyTorch for effective clustering of time-series data.
- Implemented VQ-VAE architecture for dimensionality reduction
- Applied to time-series data for improved clustering accuracy
-
Curriculum Learning for Reinforcement Learning
Developed a curriculum learning approach for reinforcement learning using Python and OpenAI Gym to improve learning efficiency and performance.
- Implemented progressive learning strategies to enhance RL training
- Utilized OpenAI Gym environments for robust testing and validation
-
Player Experience Modeling for Adaptive Games
Developed player experiences modeling to make Experience-Driven Procedural Content Generation (EDPCG) more accessible from gameplay videos.
- Built a player experience model to predict player tension using data-driven methods
- Conducted human subject study to validate the model
-
Stress Level Estimation Based on Physiological Responses
Estimated stress levels using physiological responses through traditional machine learning methods and LSTM models in Python, Scikit-learn, and PyTorch.
- Developed models to accurately classify stress states
- Integrated physiological data for comprehensive analysis
-
Heart Rate Estimation from Video via CNN
Developed a Convolutional Neural Network in Python and PyTorch to estimate heart rate from video data, enabling non-intrusive physiological monitoring.
- Designed and trained CNN models for accurate heart rate estimation
- Implemented video processing techniques
-
Behavior Pattern Analysis in Games
Applied machine learning techniques in MATLAB to identify distinct behavior patterns in game environments, enhancing user experience and engagement.
- Developed models to detect and categorize user behaviors
- Utilized MATLAB for data analysis and visualization
-
Adaptive Virtual Reality Environment
Created a Virtual Reality environment with dynamic parameters in Unity, allowing real-time adjustments based on user interactions and physiological responses.
- Implemented real-time parameter adjustments to enhance user experience
- Integrated physiological sensors for adaptive environment changes
-
Serious Video Games Development
Developed small serious video games using GameMaker and Unity, focusing on educational and therapeutic applications to engage users effectively.
- Designed game mechanics to support educational and therapeutic goals
- Utilized GameMaker and Unity for cross-platform game development
-
Neural Network for Impulse Noise Detection
Implemented a neural network in MATLAB to detect impulse noise, improving signal processing accuracy in communication systems.
- Designed and trained neural network models for noise detection
-
Hidden Semi-Markov Model for Mobility Tracking
Implemented a hidden semi-Markov model in Java to track mobility patterns with missing data and multiple observation sequences, enhancing data reliability and tracking accuracy.
- Developed robust models to handle incomplete and complex data
- Improved mobility tracking through advanced statistical methods
Volunteer
-
2025 Reviewer
PeerJ Journal
Reviewed academic articles submitted to the PeerJ journal, ensuring the quality and validity of research in AI and related fields.
-
2025 Program Committee Member
AIIDE Conference 2025
Provided peer reviews for research submissions focused on Artificial Intelligence and Interactive Digital Entertainment.
-
2025 Reviewer
Transactions on Affective Computing journal
Served as a reviewer for ransactions on Affective Computing journal, providing peer reviews for submissions in human-computer interaction and related fields.
-
2024 Program Committee Member
Experimental AI in Games (EXAG)
Active committee member served as a reviewer for EXAG workshops focused on experimental AI in games.
-
2024 Reviewer
CHI Conference 2024
Served as a reviewer for CHI Conference 2024, providing peer reviews for submissions in human-computer interaction and related fields.
-
2019 Edmonton, Canada
Treasurer
Computer Science Graduate Student Association (CSGSA)
Managed the financial operations of the CSGSA, a voluntary group offering support and activities for Computing Science graduate students at the University of Alberta.
Awards
- 2008
Olympiad Competition Award
Math and Literature Olympiads for Pre-University Students
Awarded in the Math and Literature Olympiads for pre-university students.
- 2009
Ranked 459th in the Undergraduate Nationwide Universities Entrance Exam
Nationwide Universities Entrance Exam, Iran
Achieved a ranking of 459th in the Undergraduate Nationwide Universities Entrance Exam in Iran, competing against over 300,000 participants.
- 2014
Ranked 65th in the Graduate Nationwide Universities Entrance Exam
Graduate Nationwide Universities Entrance Exam, Iran
Achieved a ranking of 65th in the Graduate Nationwide Universities Entrance Exam in Iran, out of more than 30,000 participants.
References
Dr. Matthew Guzdial | |
Assistant Professor in Computing Science at the University of Alberta, specializing in creative artificial intelligence and machine learning. |
Professor Pierre Boulanger | |
Director of the Advanced Human-Computer Interfaces Laboratory at the University of Alberta, with over 40 years of expertise in 3D computer vision and virtual reality systems. |
Dr. Di Wu | |
Senior Staff Research Scientist at Samsung AI Center Montreal and Adjunct Professor at McGill University, focusing on reinforcement learning and AI for telecommunications. |
Dr. Hadi Moradi | |
Assistant Professor at the University of Tehran's Electrical and Computer Engineering School, specializing in climbing robots and intelligent systems. |