This project is part of my final semester and involves a team of three members. Our goal is to develop a Machine Learning (ML) model that can train an AI agent to defeat a game boss in DOOM ๐ฎ using deep reinforcement learning (DRL).
We aim to implement a self-learning AI that continuously improves by interacting with the game environment, making real-time decisions, and developing advanced strategies to defeat the DOOM boss.
โ Game Environment ๐ฎ
- ViZDoom โ A reinforcement learning environment for training AI in DOOM
- OpenAI Gym โ For standardized RL training and evaluation
โ Programming & Frameworks ๐ป
- Python โ Primary language for AI training
- TensorFlow / PyTorch โ Deep learning frameworks for model development
- OpenCV โ Computer vision library for processing game frames
โ Reinforcement Learning Algorithms ๐ง
- Deep Q-Learning (DQN) โ A neural network-based RL technique
- Proximal Policy Optimization (PPO) โ Policy-gradient method for training agents
- A3C (Asynchronous Advantage Actor-Critic) โ For parallel training
โ Data Collection & Processing ๐
- Frame Capture & Preprocessing
- Convert game frames into grayscale
- Resize frames for efficient processing
- Feature Extraction
- Identify important pixels (enemies, ammo, health)
- Use convolutional neural networks (CNNs) for visual input
โ Training & Testing ๐ฏ
- Reward-Based Training
- Rewards for shooting enemies, dodging attacks, collecting health packs
- Negative rewards for getting hit, missing shots, or dying
- Model Optimization
- Hyperparameter tuning for better learning rate, batch size, and exploration strategies
- Experimenting with different reward structures
โ Hardware & Deployment โ๏ธ
- Cloud Training โ Using Google Colab ( GCP ) for faster model training
- Local Testing โ Running trained AI models on a high-performance GPU
1๏ธโฃ Setup the ViZDoom Environment ๐น๏ธ
- Install dependencies and configure game settings
2๏ธโฃ Collect Training Data ๐ฅ
- Capture thousands of frames and preprocess them
3๏ธโฃ Build the AI Model ๐ง
- Implement reinforcement learning algorithms (DQN, PPO, A3C)
4๏ธโฃ Train the AI ๐
- Let the model play against the DOOM boss and learn from trial & error
5๏ธโฃ Optimize & Fine-Tune โ๏ธ
- Adjust parameters, improve decision-making, and fine-tune rewards
6๏ธโฃ Test AI Performance ๐
- Measure how effectively the AI adapts and improves against the boss
7๏ธโฃ Final Evaluation & Report ๐
- Analyze results, document progress, and present findings
๐ฏ Goal:
Create an autonomous AI agent that can strategically defeat the DOOM boss by learning from reinforcement training, leveraging computer vision, and making intelligent decisions in real-time.