CV

Basics

Name Athar Mahmoudi
Email athar1@ualberta.ca
Phone (587) 501-8919

Interests

Reinforcement Learning
Model-Free RL
Deep Reinforcement Learning
RL from Human Feedback (RLHF)
Transfer Learning in RL
Time Series and Sensor Analytics
Time Series Analysis
Transformers for Time Series
Decision Transformer
Forecasting and Prediction
Video Games
Games as Psychological Measures
Games for Therapy
Game Adaptation

Work

  • 2025.01 - Present

    Edmonton, Canada

    Machine Learning Scientist
    Advanced Sensor Research (ASR)
    Working on innovative, AI-driven solutions for glucose monitoring using advanced sensor technologies.
    • Designed and implemented Transformer-based frameworks for accurate glucose level estimation.
    • Developed and optimized Long Short-Term Memory (LSTM) networks and autoencoders for robust sensor data processing.
    • Conducted extensive sensor data analysis to identify and leverage meaningful patterns for predictive modeling.
  • 2022.06 - 2023.05

    Montreal, Canada

    Intern Research Scientist
    Samsung Research Montreal
    Focused on reinforcement learning and high-dimensional data representation for load balancing and energy saving in networks.
    • Implemented and evaluated reinforcement learning architectures to optimize agent performance.
    • Developed curriculum learning strategies to effectively train RL agents.
    • Designed and deployed a Vector Quantized Variational Autoencoder (VQ-VAE) for efficient clustering of high-dimensional data.
    • Integrated and adapted an Online Decision Transformer within reinforcement learning frameworks.
  • 2017.09 - 2018.09

    Tehran, Iran

    Research Engineer
    Pars Cognition
    Created engaging video game experiences aimed at cognitive assessment and development.
    • Developed mini-serious video games targeting cognitive science applications and research.

Education

  • 2018.09 - 2024.12

    Edmonton, Canada

    Doctor of Philosophy
    University of Alberta
    Computing Science
    Thesis: Automated Personalized Exposure Therapy Based on Physiological Measures Using Experience-driven Procedural Content Generation via Reinforcement Learning
    • Intro to Virtual/Augmented Reality and Telepresence
    • Machine Learning and the Brain
    • Image Processing and Analysis in Diagnostic Imaging
  • 2014.09 - 2017.08

    Tehran, Iran

    Master of Science,
    Shahid Beheshti University,
    Computer Engineering/Artificial Intelligence
    Thesis: Pattern Extraction and Analysis of the Behavior of Children with Autism Spectrum Disorders Using a Designed Video Game
    • Machine Learning
    • Neural Network
    • Pattern Recognition
    • Data Mining
    • Image Processing
    • Natural Language Processing
  • 2009.09 - 2014.08

    Tehran, Iran

    Bachelor of Science
    University of Tehran,
    Computer Engineering/Software Engineering
    Thesis: Designed and Developed a Video Game for Children with Autism to Improve their Receptive Language Skills.
    • Advanced Programming
    • Database Design
    • Data Structures
    • Artificial Intelligence
    • Operating Systems
    • Human-Computer Interaction
    • Intro to Multimedia
    • Intro to eLearning

Skills

Programming Languages
Python
MATLAB
C#
SQL
Development Tools & Platforms
Visual Studio Code
Microsoft Visual Studio
Git
Jupyter Notebook
Google Colab
Google Cloud Platform
AWS
Frameworks & Libraries
PyTorch
OpenAI Gym
Scikit-learn
TensorFlow
Hugging Face
Microsoft .NET
Game and Simulation Engines
Unity
GameMaker Studio
Virtual Reality (VR)

Publications

Projects

  • Experience-Driven Procedural Content Generation via Reinforcement Learning
    Developed an adaptive system using Experience-Driven Procedural Content Generation and Reinforcement Learning to tailor virtual environments based on user experiences.
    • Implemented reinforcement learning algorithms in Python
    • Utilized OpenAI Gym for environment simulation and testing
  • Glucose Level Estimation Using Transformer-Based Models
    Built Transformer, LSTM, and autoencoder models in Python using PyTorch to estimate glucose levels from non-invasive sensor data.
    • Implemented Transformer-based architectures for time series forecasting
  • Online Decision Transformer
    Developed an Online Decision Transformer using Python and PyTorch to enhance decision-making processes in dynamic environments.
    • Implemented transformer models for real-time decision making
    • Leveraged PyTorch for efficient model training and deployment
  • Vector Quantized Variational Autoencoder for Time-Series Clustering
    Developed a Vector Quantized Variational Autoencoder using Python and PyTorch for effective clustering of time-series data.
    • Implemented VQ-VAE architecture for dimensionality reduction
    • Applied to time-series data for improved clustering accuracy
  • Curriculum Learning for Reinforcement Learning
    Developed a curriculum learning approach for reinforcement learning using Python and OpenAI Gym to improve learning efficiency and performance.
    • Implemented progressive learning strategies to enhance RL training
    • Utilized OpenAI Gym environments for robust testing and validation
  • Player Experience Modeling for Adaptive Games
    Developed player experiences modeling to make Experience-Driven Procedural Content Generation (EDPCG) more accessible from gameplay videos.
    • Built a player experience model to predict player tension using data-driven methods
    • Conducted human subject study to validate the model
  • Stress Level Estimation Based on Physiological Responses
    Estimated stress levels using physiological responses through traditional machine learning methods and LSTM models in Python, Scikit-learn, and PyTorch.
    • Developed models to accurately classify stress states
    • Integrated physiological data for comprehensive analysis
  • Heart Rate Estimation from Video via CNN
    Developed a Convolutional Neural Network in Python and PyTorch to estimate heart rate from video data, enabling non-intrusive physiological monitoring.
    • Designed and trained CNN models for accurate heart rate estimation
    • Implemented video processing techniques
  • Behavior Pattern Analysis in Games
    Applied machine learning techniques in MATLAB to identify distinct behavior patterns in game environments, enhancing user experience and engagement.
    • Developed models to detect and categorize user behaviors
    • Utilized MATLAB for data analysis and visualization
  • Adaptive Virtual Reality Environment
    Created a Virtual Reality environment with dynamic parameters in Unity, allowing real-time adjustments based on user interactions and physiological responses.
    • Implemented real-time parameter adjustments to enhance user experience
    • Integrated physiological sensors for adaptive environment changes
  • Serious Video Games Development
    Developed small serious video games using GameMaker and Unity, focusing on educational and therapeutic applications to engage users effectively.
    • Designed game mechanics to support educational and therapeutic goals
    • Utilized GameMaker and Unity for cross-platform game development
  • Neural Network for Impulse Noise Detection
    Implemented a neural network in MATLAB to detect impulse noise, improving signal processing accuracy in communication systems.
    • Designed and trained neural network models for noise detection
  • Hidden Semi-Markov Model for Mobility Tracking
    Implemented a hidden semi-Markov model in Java to track mobility patterns with missing data and multiple observation sequences, enhancing data reliability and tracking accuracy.
    • Developed robust models to handle incomplete and complex data
    • Improved mobility tracking through advanced statistical methods

Volunteer

  • 2025
    Reviewer
    PeerJ Journal
    Reviewed academic articles submitted to the PeerJ journal, ensuring the quality and validity of research in AI and related fields.
  • 2025
    Program Committee Member
    AIIDE Conference 2025
    Provided peer reviews for research submissions focused on Artificial Intelligence and Interactive Digital Entertainment.
  • 2025
    Reviewer
    Transactions on Affective Computing journal
    Served as a reviewer for ransactions on Affective Computing journal, providing peer reviews for submissions in human-computer interaction and related fields.
  • 2024
    Program Committee Member
    Experimental AI in Games (EXAG)
    Active committee member served as a reviewer for EXAG workshops focused on experimental AI in games.
  • 2024
    Reviewer
    CHI Conference 2024
    Served as a reviewer for CHI Conference 2024, providing peer reviews for submissions in human-computer interaction and related fields.
  • 2019

    Edmonton, Canada

    Treasurer
    Computer Science Graduate Student Association (CSGSA)
    Managed the financial operations of the CSGSA, a voluntary group offering support and activities for Computing Science graduate students at the University of Alberta.

Awards

References

Dr. Matthew Guzdial
Assistant Professor in Computing Science at the University of Alberta, specializing in creative artificial intelligence and machine learning.
Professor Pierre Boulanger
Director of the Advanced Human-Computer Interfaces Laboratory at the University of Alberta, with over 40 years of expertise in 3D computer vision and virtual reality systems.
Dr. Di Wu
Senior Staff Research Scientist at Samsung AI Center Montreal and Adjunct Professor at McGill University, focusing on reinforcement learning and AI for telecommunications.
Dr. Hadi Moradi
Assistant Professor at the University of Tehran's Electrical and Computer Engineering School, specializing in climbing robots and intelligent systems.