变换器网络(Transformer)

Fabrizio Falchi 和 Manuel Gentile

Transformer是一种神经网络模型,旨在解决循环神经网络在分析数据序列(例如单词或词元)时遇到的限制1。具体来说,Transformer 模型采用了“自注意力”机制,使得可以并行地分析数据序列,同时提取这些序列中元素与其上下文之间的依赖关系。


1 Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., … & Polosukhin, I., Attention is all you need, Advances in neural information processing systems, 30, 2017.

License

知识共享署名 4.0 国际许可的图标

面向教师的人工智能教程: 一本开放式教科书 Copyright © 2024 by Fabrizio Falchi 和 Manuel Gentile is licensed under a 知识共享署名 4.0 国际许可, except where otherwise noted.

Share This Book

面向教师的人工智能教程: 一本开放式教科书
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.