{"id":243,"date":"2023-11-30T17:32:16","date_gmt":"2023-11-30T17:32:16","guid":{"rendered":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/chapter\/transformers\/"},"modified":"2024-01-31T11:49:10","modified_gmt":"2024-01-31T11:49:10","slug":"transformers","status":"publish","type":"chapter","link":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/chapter\/transformers\/","title":{"raw":"Transformatorji","rendered":"Transformatorji"},"content":{"raw":"<p class=\"no-indent\">Transformatorji so model nevronske mre\u017ee, zasnovan za premagovanje omejitev ponavljajo\u010dih se nevronskih mre\u017e pri analizi zaporedij podatkov (v na\u0161em primeru besed ali \u017eetonov)<sup>1<\/sup>.<\/p>\n<p class=\"indent\">Natan\u010dneje, transformatorji preko mehanizma samopozornosti omogo\u010dajo vzporedno analizo podatkovnih zaporedij in izlo\u010danje odvisnosti med elementi teh zaporedij in konteksti, v katerih se pojavljajo.<\/p>\n\n\n<hr>\n<p class=\"hanging-indent\" style=\"text-align: left\"><sup>1\u00a0<\/sup>Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... &amp; Polosukhin, I., <em>Attention is all you need<\/em>, Advances in neural information processing systems, 30, 2017.<\/p>","rendered":"<p class=\"no-indent\">Transformatorji so model nevronske mre\u017ee, zasnovan za premagovanje omejitev ponavljajo\u010dih se nevronskih mre\u017e pri analizi zaporedij podatkov (v na\u0161em primeru besed ali \u017eetonov)<sup>1<\/sup>.<\/p>\n<p class=\"indent\">Natan\u010dneje, transformatorji preko mehanizma samopozornosti omogo\u010dajo vzporedno analizo podatkovnih zaporedij in izlo\u010danje odvisnosti med elementi teh zaporedij in konteksti, v katerih se pojavljajo.<\/p>\n<hr \/>\n<p class=\"hanging-indent\" style=\"text-align: left\"><sup>1\u00a0<\/sup>Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., &#8230; &amp; Polosukhin, I., <em>Attention is all you need<\/em>, Advances in neural information processing systems, 30, 2017.<\/p>\n","protected":false},"author":1,"menu_order":16,"template":"","meta":{"pb_show_title":"","pb_short_title":"","pb_subtitle":"","pb_authors":["manuel-gentile","fabrizio-falchi"],"pb_section_license":""},"chapter-type":[49],"contributor":[71,63],"license":[],"part":204,"_links":{"self":[{"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/chapters\/243"}],"collection":[{"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":1,"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/chapters\/243\/revisions"}],"predecessor-version":[{"id":244,"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/chapters\/243\/revisions\/244"}],"part":[{"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/parts\/204"}],"metadata":[{"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/chapters\/243\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/wp\/v2\/media?parent=243"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/pressbooks\/v2\/chapter-type?post=243"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/wp\/v2\/contributor?post=243"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/umetnainteligenca\/wp-json\/wp\/v2\/license?post=243"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}