
Polygames: Improved Zero Learning
Cazenave, Tristan; Chen, Yen-Chi; Chen, Guan-Wei; Chen, Shi-Yu; Chiu, Xian-Dong; Dehos, Julien; Gong, Qucheng; Hu, Hengyuan; Khalidov, Vasil Khalidov; Li, Cheng-Ling; Lin, Hsin-I; Lin, Yu-Jin; Martinet, Xavier; Mella, Vegard; Rapin, J.; Roziere, B.; Synnaeve, G.; Teytaud, F.; Teytaud, O.; Ye, Shi-Cheng; Ye, Yi-Jun; Yen, Shi-Jim; Zagoruyko, Sergey (2020), Polygames: Improved Zero Learning, International Computer Games Association Journal, 42, 4, p. 244-256
View/ Open
Type
Article accepté pour publication ou publiéDate
2020Journal name
International Computer Games Association JournalVolume
42Number
4Pages
244-256
Metadata
Show full item recordAuthor(s)
Cazenave, TristanLaboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Chen, Yen-Chi
Chen, Guan-Wei
Chen, Shi-Yu
Chiu, Xian-Dong
Dehos, Julien
Gong, Qucheng
Hu, Hengyuan
Khalidov, Vasil Khalidov
Li, Cheng-Ling
Lin, Hsin-I
Lin, Yu-Jin
Martinet, Xavier
Mella, Vegard
Rapin, J.
Roziere, B.
Synnaeve, G.
Teytaud, F.
Teytaud, O.
Ye, Shi-Cheng
Ye, Yi-Jun
Yen, Shi-Jim
Zagoruyko, Sergey
Abstract (EN)
Since DeepMind's AlphaZero, Zero learning quickly became the state-of-the-art method for many board games. It can be improved using a fully convolutional structure (no fully connected layer). Using such an architecture plus global pooling, we can create bots independent of the board size. The training can be made more robust by keeping track of the best checkpoints during the training and by training against them. Using these features, we release Polygames, our framework for Zero learning, with its library of games and its checkpoints. We won against strong humans at the game of Hex in 19x19 , including the human player with the best ELO rank on LittleGolem; we incidentally also won against another Zero implementation, which was weaker than humans: in a discussion on LittleGolem, Hex19 was said to be intractable for zero learning. We also won in Havannah with size 8: win against the strongest player, namely Eobllor, with excellent opening moves. We also won several first places at the TAAI 2019 competitions and had positive results against strong bots in various games.Subjects / Keywords
Zero learning; Board gamesRelated items
Showing items related by title and author.
-
Liu, Jialin; Moreau, Antoine; Preuss, Mike; Rapin, Jeremy; Roziere, Baptiste; Teytaud, Fabien; Teytaud, O. (2020) Communication / Conférence
-
Li, Yingchun; Xiong, Wei; Hu, Wei; Berry, Pam; Ju, Hui; Lin, Erda; Wang, Wen; Li, Kuo; Pan, Jie (2015) Article accepté pour publication ou publié
-
Yu, Hyun Jin Julie (2016-06) Thèse
-
Cannarsa, Piermarco; Cheng, Wei; Mendico, Cristian; Wang, Kaizhi (2021) Article accepté pour publication ou publié
-
Meunier, Laurent; Chevaleyre, Yann; Rapin, J.; Royer, Clément; Teytaud, O. (2020) Communication / Conférence