Passe-Science

Machine Learning 2: Architecture et Alphastar (Transformer, attention) - Passe-science #48

On continue sur le machine learning, au programme: l'architecture interne de quelques intelligences artificielles dont Alphastar. On parlera également d'une des révolution du domaine sur les dernières années: les transformers et leur mécanisme d'attention.

- 00:00 Intro
- 00:48 Alphastar
- 09:58 Actor-critic
- 13:12 Specificités Alphastar vs Muzero
- 15:46 Transformer et Few shot learning
- 19:44 Architecture transformer et attention
- 27:31 Outro

Videos
Partie 1 Machine learning: https://www.youtube.com/watch?v=Yoq5cfndzhM
Alphastar: une partie au commentaire abordable: https://www.youtube.com/watch?v=xFSyqWUvJEo
Transformer: https://www.youtube.com/watch?v=4Bdc55j80l8
Alphastar Vue IA: https://www.youtube.com/watch?v=HcZ48JDamyk

Retrouvez Passe-science sur Utip, Tipeee, Twitter et Facebook:
https://utip.io/passescience
https://www.tipeee.com/passe-science
https://twitter.com/ThomasCabaret84
https://www.facebook.com/passescience.youtube/

Source:
Alphastar (voir liens publication)
https://www.deepmind.com/blog/alphastar-mastering-the-real-time-strategy-game-starcraft-ii
https://www.deepmind.com/blog/alphastar-grandmaster-level-in-starcraft-ii-using-multi-agent-reinforcement-learning
Actor critic:
https://julien-vitay.net/deeprl/DPG.html
https://towardsdatascience.com/understanding-actor-critic-methods-931b97b6df3f
Attention is all you need:
https://arxiv.org/abs/1706.03762
https://jalammar.github.io/illustrated-transformer/

Audio:
"THE RIGHT MUSIC FOR VIDEO" HighTechCorporate
"Sport Tapis" https://www.musicscreen.org/Royalty-free/Music/sport-tapis.php
Decisions by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 license. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1100756
Artist: http://incompetech.com/
Impact Prelude by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 license. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1100617
Artist: http://incompetech.com/
Frost Waltz by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 license. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1100516
Artist: http://incompetech.com/
Groove Grove by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 license. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1200054
Artist: http://incompetech.com/
Показать больше
Больше видео

Author: admin