{"id":82,"date":"2023-10-21T09:27:01","date_gmt":"2023-10-21T09:27:01","guid":{"rendered":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/chapter\/behind-the-search-lens-effects-of-search-on-the-individual-on-the-society\/"},"modified":"2024-01-31T08:10:47","modified_gmt":"2024-01-31T08:10:47","slug":"behind-the-search-lens-effects-of-search-on-the-individual-on-the-society","status":"publish","type":"chapter","link":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/chapter\/behind-the-search-lens-effects-of-search-on-the-individual-on-the-society\/","title":{"raw":"Behind the Search Lens: Effects of Search on the Society","rendered":"Behind the Search Lens: Effects of Search on the Society"},"content":{"raw":"<h3 style=\"text-align: left\">Social effects<\/h3>\n<p class=\"no-indent\">More and more, there is a feeling that everything that matters is on the web and should be accessible through search<sup>1<\/sup>. As LM Hinman puts it, \u201cEsse est indicato in Google (to be is to be indexed on Google).\u201d As he also notes, \u201ccitizens in a democracy cannot make informed decisions without access to accurate information\u201d<sup>2,3<\/sup>. If democracy stands on free access to undistorted information, search engines directly affect how democratic our countries are. Their role as gatekeepers of knowledge is in direct conflict with their nature as private companies dependent on ads for income. Therefore, for the sake of a free society, we must demand accountability for search engines and transparency in how their algorithms work<sup>2<\/sup>.<\/p>\n\n<h3 style=\"text-align: left\">Creation of filter bubbles<\/h3>\n<p class=\"no-indent\">Systems that recommend content based on user profiles, including search engines, can insulate users from exposure to different views. By feeding content that the user likes, they create self-reinforcing biases and \u201cfilter bubbles\u201d<sup>2,4<\/sup>. These bubbles, created when newly acquired knowledge is based on past interests and activities<sup>5<\/sup>, cement biases as solid foundations of knowledge. This could become particularly dangerous when used with young and impressionable minds. Thus, open discussions with peers and teachers and collaborative learning activities should be promoted in the classroom.<\/p>\n\n<h3 style=\"text-align: left\">Feedback loops<\/h3>\n<p class=\"no-indent\">Search engines, like other recommendation systems, predict what will be of interest to the user. Then, when the user clicks on what was recommended, it\u00a0 (the search engine) takes it as positive feedback. This feedback affects what links are displayed in the future. If a user clicked on the first link displayed, was it because they found it relevant or simply because it was the first result and thus easier to choose?<\/p>\n<p class=\"indent\">Implicit feedback is tricky to interpret. When predictions are based on incorrect interpretation, the effects are even trickier to predict. When certain results are repeatedly shown \u2013 and are the only thing that the user gets to see \u2013 it can even end up changing what the user likes and dislikes \u2013 a self-fulfilling prediction, perhaps.<\/p>\n<p class=\"indent\">In the United States, a predictive policing system was launched whereby high-crime areas of a certain city were highlighted. This meant that more police officers were deployed to such areas. Since these officers knew the area was at high risk, they were careful, and stopped, searched, or arrested more people than normal. The arrests thus validated the prediction, even where the prediction was biased in the first place. Not only that, the arrests were data for future predictions on the same areas and on areas similar to it, compounding biases over time<sup>5<\/sup>.<\/p>\n<p class=\"indent\">We use prediction systems in order to act on the predictions. But acting on biased predictions affects future outcomes, the people involved \u2013 and ultimately society itself. \u201cAs a side-effect of fulfilling its purpose of retrieving relevant information, a search engine will necessarily change the very thing that it aims to measure, sort and rank. Similarly, most machine-learning systems will affect the phenomena that they predict\"<sup>5<\/sup>.<\/p>\n\n<h3 style=\"text-align: left\">Fake news, extreme content and censorship<\/h3>\n<p class=\"no-indent\">There is increasing prevalence of fake news (false stories that appear as news) in online forums, social media sites and blogs, all available to students through search. Small focused groups of people can drive ratings up for specific videos and web sites of extreme content. This increases the content\u2019s popularity and appearance of authenticity, gaming the ranking algorithms<sup>4<\/sup>. Yet, as of now, no clear and explicit policy has been adopted by search-engine companies to control fake news<sup>2<\/sup>.<\/p>\n<p class=\"indent\">On the other hand, search engines systematically exclude certain sites and certain types of sites in favour of others<sup>6<\/sup>. They censor content from some authors, despite not being asked to do so by the public. Search engines, therefore, should be used with awareness, discretion and discrimination.<\/p>\n\n\n<hr>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>1\u00a0<\/sup>Hillis, K., Petit, M., Jarrett, K., <em>Google and the Culture of Search, <\/em>Routledge Taylor and Francis, 2013.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>2<\/sup>\u00a0Tavani, H., Zimmer, M., <em><a href=\"https:\/\/plato.stanford.edu\/archives\/fall2020\/entries\/ethics-search\/\" target=\"_blank\" rel=\"noopener\" data-cke-saved-href=\"https:\/\/plato.stanford.edu\/archives\/fall2020\/entries\/ethics-search\/\">Search Engines and Ethics<\/a><\/em>, The Stanford Encyclopedia of Philosophy, Fall 2020 Edition), Edward N. Zalta (ed.).<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>3 <\/sup>Hinman, L. M., <em>Esse Est Indicato in Google: Ethical and Political Issues in Search Engines<\/em>, International Review of Information Ethics, 3: 19\u201325, 2005.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>4 <\/sup>Milano, S., Taddeo, M., Floridi, L. <em><a href=\"https:\/\/doi.org\/10.1007\/s00146-020-00950-y \" target=\"_blank\" rel=\"noopener\" data-cke-saved-href=\"https:\/\/doi.org\/10.1007\/s00146-020-00950-y \">Recommender systems and their ethical challenges<\/a><\/em>, <i>AI &amp; Soc<\/i> 35, 957\u2013967, 2020.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>5 <\/sup>Barocas, S.,\u00a0 Hardt, M., Narayanan, A., <em><a href=\"https:\/\/fairmlbook.org\/\" target=\"_blank\" rel=\"noopener\" data-cke-saved-href=\"https:\/\/fairmlbook.org\/\">Fairness and machine learning Limitations and Opportunities<\/a>, <\/em>MIT Press, 2023.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>6 <\/sup>Introna, L. and Nissenbaum, H., <em>Shaping the Web: Why The Politics of Search Engines Matters<\/em>, The Information Society, 16(3): 169\u2013185, 2000.<\/p>","rendered":"<h3 style=\"text-align: left\">Social effects<\/h3>\n<p class=\"no-indent\">More and more, there is a feeling that everything that matters is on the web and should be accessible through search<sup>1<\/sup>. As LM Hinman puts it, \u201cEsse est indicato in Google (to be is to be indexed on Google).\u201d As he also notes, \u201ccitizens in a democracy cannot make informed decisions without access to accurate information\u201d<sup>2,3<\/sup>. If democracy stands on free access to undistorted information, search engines directly affect how democratic our countries are. Their role as gatekeepers of knowledge is in direct conflict with their nature as private companies dependent on ads for income. Therefore, for the sake of a free society, we must demand accountability for search engines and transparency in how their algorithms work<sup>2<\/sup>.<\/p>\n<h3 style=\"text-align: left\">Creation of filter bubbles<\/h3>\n<p class=\"no-indent\">Systems that recommend content based on user profiles, including search engines, can insulate users from exposure to different views. By feeding content that the user likes, they create self-reinforcing biases and \u201cfilter bubbles\u201d<sup>2,4<\/sup>. These bubbles, created when newly acquired knowledge is based on past interests and activities<sup>5<\/sup>, cement biases as solid foundations of knowledge. This could become particularly dangerous when used with young and impressionable minds. Thus, open discussions with peers and teachers and collaborative learning activities should be promoted in the classroom.<\/p>\n<h3 style=\"text-align: left\">Feedback loops<\/h3>\n<p class=\"no-indent\">Search engines, like other recommendation systems, predict what will be of interest to the user. Then, when the user clicks on what was recommended, it\u00a0 (the search engine) takes it as positive feedback. This feedback affects what links are displayed in the future. If a user clicked on the first link displayed, was it because they found it relevant or simply because it was the first result and thus easier to choose?<\/p>\n<p class=\"indent\">Implicit feedback is tricky to interpret. When predictions are based on incorrect interpretation, the effects are even trickier to predict. When certain results are repeatedly shown \u2013 and are the only thing that the user gets to see \u2013 it can even end up changing what the user likes and dislikes \u2013 a self-fulfilling prediction, perhaps.<\/p>\n<p class=\"indent\">In the United States, a predictive policing system was launched whereby high-crime areas of a certain city were highlighted. This meant that more police officers were deployed to such areas. Since these officers knew the area was at high risk, they were careful, and stopped, searched, or arrested more people than normal. The arrests thus validated the prediction, even where the prediction was biased in the first place. Not only that, the arrests were data for future predictions on the same areas and on areas similar to it, compounding biases over time<sup>5<\/sup>.<\/p>\n<p class=\"indent\">We use prediction systems in order to act on the predictions. But acting on biased predictions affects future outcomes, the people involved \u2013 and ultimately society itself. \u201cAs a side-effect of fulfilling its purpose of retrieving relevant information, a search engine will necessarily change the very thing that it aims to measure, sort and rank. Similarly, most machine-learning systems will affect the phenomena that they predict&#8221;<sup>5<\/sup>.<\/p>\n<h3 style=\"text-align: left\">Fake news, extreme content and censorship<\/h3>\n<p class=\"no-indent\">There is increasing prevalence of fake news (false stories that appear as news) in online forums, social media sites and blogs, all available to students through search. Small focused groups of people can drive ratings up for specific videos and web sites of extreme content. This increases the content\u2019s popularity and appearance of authenticity, gaming the ranking algorithms<sup>4<\/sup>. Yet, as of now, no clear and explicit policy has been adopted by search-engine companies to control fake news<sup>2<\/sup>.<\/p>\n<p class=\"indent\">On the other hand, search engines systematically exclude certain sites and certain types of sites in favour of others<sup>6<\/sup>. They censor content from some authors, despite not being asked to do so by the public. Search engines, therefore, should be used with awareness, discretion and discrimination.<\/p>\n<hr \/>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>1\u00a0<\/sup>Hillis, K., Petit, M., Jarrett, K., <em>Google and the Culture of Search, <\/em>Routledge Taylor and Francis, 2013.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>2<\/sup>\u00a0Tavani, H., Zimmer, M., <em><a href=\"https:\/\/plato.stanford.edu\/archives\/fall2020\/entries\/ethics-search\/\" target=\"_blank\" rel=\"noopener\" data-cke-saved-href=\"https:\/\/plato.stanford.edu\/archives\/fall2020\/entries\/ethics-search\/\">Search Engines and Ethics<\/a><\/em>, The Stanford Encyclopedia of Philosophy, Fall 2020 Edition), Edward N. Zalta (ed.).<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>3 <\/sup>Hinman, L. M., <em>Esse Est Indicato in Google: Ethical and Political Issues in Search Engines<\/em>, International Review of Information Ethics, 3: 19\u201325, 2005.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>4 <\/sup>Milano, S., Taddeo, M., Floridi, L. <em><a href=\"https:\/\/doi.org\/10.1007\/s00146-020-00950-y\" target=\"_blank\" rel=\"noopener\" data-cke-saved-href=\"https:\/\/doi.org\/10.1007\/s00146-020-00950-y\">Recommender systems and their ethical challenges<\/a><\/em>, <i>AI &amp; Soc<\/i> 35, 957\u2013967, 2020.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>5 <\/sup>Barocas, S.,\u00a0 Hardt, M., Narayanan, A., <em><a href=\"https:\/\/fairmlbook.org\/\" target=\"_blank\" rel=\"noopener\" data-cke-saved-href=\"https:\/\/fairmlbook.org\/\">Fairness and machine learning Limitations and Opportunities<\/a>, <\/em>MIT Press, 2023.<\/p>\n<p class=\"indent hanging-indent\" style=\"text-align: left\"><sup>6 <\/sup>Introna, L. and Nissenbaum, H., <em>Shaping the Web: Why The Politics of Search Engines Matters<\/em>, The Information Society, 16(3): 169\u2013185, 2000.<\/p>\n","protected":false},"author":1,"menu_order":7,"template":"","meta":{"pb_show_title":"","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"part":46,"_links":{"self":[{"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/chapters\/82"}],"collection":[{"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":1,"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/chapters\/82\/revisions"}],"predecessor-version":[{"id":83,"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/chapters\/82\/revisions\/83"}],"part":[{"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/parts\/46"}],"metadata":[{"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/chapters\/82\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/wp\/v2\/media?parent=82"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/pressbooks\/v2\/chapter-type?post=82"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/wp\/v2\/contributor?post=82"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/aiopentext.itd.cnr.it\/aiforteacher\/wp-json\/wp\/v2\/license?post=82"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}