Polygames: Improved Zero Learning
Cazenave, Tristan; Chen, Yen-Chi; Chen, Guan-Wei; Chen, Shi-Yu; Chiu, Xian-Dong; Dehos, Julien; Gong, Qucheng; Hu, Hengyuan; Khalidov, Vasil Khalidov; Li, Cheng-Ling; Lin, Hsin-I; Lin, Yu-Jin; Martinet, Xavier; Mella, Vegard; Rapin, J.; Roziere, B.; Synnaeve, G.; Teytaud, F.; Teytaud, O.; Ye, Shi-Cheng; Ye, Yi-Jun; Yen, Shi-Jim; Zagoruyko, Sergey (2020), Polygames: Improved Zero Learning, International Computer Games Association Journal, 42, 4, p. 244-256
TypeArticle accepté pour publication ou publié
Journal nameInternational Computer Games Association Journal
MetadataShow full item record
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Khalidov, Vasil Khalidov
Abstract (EN)Since DeepMind's AlphaZero, Zero learning quickly became the state-of-the-art method for many board games. It can be improved using a fully convolutional structure (no fully connected layer). Using such an architecture plus global pooling, we can create bots independent of the board size. The training can be made more robust by keeping track of the best checkpoints during the training and by training against them. Using these features, we release Polygames, our framework for Zero learning, with its library of games and its checkpoints. We won against strong humans at the game of Hex in 19x19 , including the human player with the best ELO rank on LittleGolem; we incidentally also won against another Zero implementation, which was weaker than humans: in a discussion on LittleGolem, Hex19 was said to be intractable for zero learning. We also won in Havannah with size 8: win against the strongest player, namely Eobllor, with excellent opening moves. We also won several first places at the TAAI 2019 competitions and had positive results against strong bots in various games.
Subjects / KeywordsZero learning; Board games
Showing items related by title and author.
Liu, Jialin; Moreau, Antoine; Preuss, Mike; Rapin, Jeremy; Roziere, Baptiste; Teytaud, Fabien; Teytaud, O. (2020) Communication / Conférence
Integrated assessment of China’s agricultural vulnerability to climate change: a multi-indicator approach Li, Yingchun; Xiong, Wei; Hu, Wei; Berry, Pam; Ju, Hui; Lin, Erda; Wang, Wen; Li, Kuo; Pan, Jie (2015) Article accepté pour publication ou publié
Public policies for the development of solar photovoltaic energy and the impacts on dynamics of technology systems and markets Yu, Hyun Jin Julie (2016-06) Thèse
Cannarsa, Piermarco; Cheng, Wei; Mendico, Cristian; Wang, Kaizhi (2021) Article accepté pour publication ou publié
Meunier, Laurent; Chevaleyre, Yann; Rapin, J.; Royer, Clément; Teytaud, O. (2020) Communication / Conférence