Text-to-Video
File size: 1,950 Bytes
4ee88b1
 
 
 
fedc75b
 
4ee88b1
 
 
1466979
 
 
 
 
 
 
 
 
 
 
2589b55
2e06c53
1466979
4ee88b1
c59e683
4ee88b1
c59e683
4ee88b1
c59e683
4ee88b1
 
c59e683
4ee88b1
 
0904981
 
 
 
 
4ee88b1
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
license: other
license_name: animegamer-lisence
license_link: LICENSE
pipeline_tag: text-to-video
library_name: diffusers
---

# AnimeGamer: Infinite Anime Life Simulation with Next Game State Prediction
**[Junhao Cheng<sup>1,2</sup>](https://donahowe.github.io/), 
[Yuying Ge<sup>1,&#9993;</sup>](https://geyuying.github.io/), 
[Yixiao Ge<sup>1</sup>](https://geyixiao.com/), 
[Jing Liao<sup>2</sup>](https://scholar.google.com/citations?user=3s9f9VIAAAAJ&hl=en), 
[Ying Shan<sup>1</sup>](https://scholar.google.com/citations?user=4oXBp9UAAAAJ&hl=en)**
<br>
<sup>1</sup>ARC Lab, Tencent PCG, 
<sup>2</sup>City University of Hong Kong
<br>

[![Project Page](https://img.shields.io/badge/Project-blue)](https://howe125.github.io/AnimeGamer.github.io/)
[![arXiv](https://img.shields.io/badge/arXiv-2404.14396-b31b1b.svg)](https://arxiv.org/abs/2504.01014)
[![Static Badge](https://img.shields.io/badge/GitHub-black?logo=github)](https://github.com/TencentARC/AnimeGamer) 


### Introduction 

**Experience the endless adventure of infinite anime life with AnimeGamer!** 🤩

AnimeGamer is a pioneering model designed for infinite anime life simulation. It leverages Multimodal Large Language Models (MLLMs) to generate dynamic animation shots that depict character movements and updates to character states. By incorporating historical visual context, AnimeGamer ensures contextual consistency and engaging gameplay. AnimeGamer uses novel action-aware multimodal representations and a video diffusion model to produce high-quality video clips, creating an immersive and ever-evolving gaming experience.


### Citation
If you find the work helpful, please consider citing:
```bash
@article{cheng2025animegamer,
  title={AnimeGamer: Infinite Anime Life Simulation with Next Game State Prediction},
  author={Cheng, Junhao and Ge, Yuying and Ge, Yixiao and Liao, Jing and Shan, Ying},
  journal={arXiv preprint arXiv:2504.01014},
  year={2025}
}
```