{"id":235,"date":"2023-11-30T16:32:02","date_gmt":"2023-11-30T16:32:02","guid":{"rendered":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/chapter\/transformers\/"},"modified":"2024-01-31T11:52:10","modified_gmt":"2024-01-31T11:52:10","slug":"transformers","status":"publish","type":"chapter","link":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/chapter\/transformers\/","title":{"raw":"Transformers","rendered":"Transformers"},"content":{"raw":"<p class=\"no-indent\">Les <em>transformers<\/em> sont des mod\u00e8les de r\u00e9seaux de neurones con\u00e7us pour surmonter les limites des r\u00e9seaux neuronaux r\u00e9currents dans l\u2019analyse des s\u00e9quences de donn\u00e9es (dans notre cas, des mots ou des tokens)<sup>1<\/sup>.<\/p>\n<p class=\"indent\">Plus sp\u00e9cifiquement, les <em>transformers<\/em>, par le biais d\u2019un m\u00e9canisme de <em>self-attention<\/em>, permettent de parall\u00e9liser l\u2019analyse des s\u00e9quences de donn\u00e9es et d\u2019extraire les d\u00e9pendances entre les \u00e9l\u00e9ments de ces s\u00e9quences ainsi que les contextes en vertu desquels elles se produisent.<\/p>\n\n\n<hr>\n<p class=\"hanging-indent\" style=\"text-align: left\"><sup>1\u00a0<\/sup>Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... &amp; Polosukhin, I., <em>Attention is all you need<\/em>, Advances in neural information processing systems, 30, 2017.<\/p>","rendered":"<p class=\"no-indent\">Les <em>transformers<\/em> sont des mod\u00e8les de r\u00e9seaux de neurones con\u00e7us pour surmonter les limites des r\u00e9seaux neuronaux r\u00e9currents dans l\u2019analyse des s\u00e9quences de donn\u00e9es (dans notre cas, des mots ou des tokens)<sup>1<\/sup>.<\/p>\n<p class=\"indent\">Plus sp\u00e9cifiquement, les <em>transformers<\/em>, par le biais d\u2019un m\u00e9canisme de <em>self-attention<\/em>, permettent de parall\u00e9liser l\u2019analyse des s\u00e9quences de donn\u00e9es et d\u2019extraire les d\u00e9pendances entre les \u00e9l\u00e9ments de ces s\u00e9quences ainsi que les contextes en vertu desquels elles se produisent.<\/p>\n<hr \/>\n<p class=\"hanging-indent\" style=\"text-align: left\"><sup>1\u00a0<\/sup>Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., &#8230; &amp; Polosukhin, I., <em>Attention is all you need<\/em>, Advances in neural information processing systems, 30, 2017.<\/p>\n","protected":false},"author":1,"menu_order":16,"template":"","meta":{"pb_show_title":"","pb_short_title":"","pb_subtitle":"","pb_authors":["manuel-gentile-aftvc5yfsu","fabrizio-falchi-gxhlchkagd"],"pb_section_license":""},"chapter-type":[49],"contributor":[71,63],"license":[],"part":195,"_links":{"self":[{"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/chapters\/235"}],"collection":[{"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":1,"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/chapters\/235\/revisions"}],"predecessor-version":[{"id":236,"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/chapters\/235\/revisions\/236"}],"part":[{"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/parts\/195"}],"metadata":[{"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/chapters\/235\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/wp\/v2\/media?parent=235"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/pressbooks\/v2\/chapter-type?post=235"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/wp\/v2\/contributor?post=235"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/iapourlesenseignants\/wp-json\/wp\/v2\/license?post=235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}