{"id":351,"date":"2024-05-14T07:52:03","date_gmt":"2024-05-14T15:52:03","guid":{"rendered":"https:\/\/www.careervillage.org\/articles\/?p=351"},"modified":"2024-05-14T07:52:04","modified_gmt":"2024-05-14T15:52:04","slug":"learners-embrace-ai-advice-but-want-ethical-use","status":"publish","type":"post","link":"https:\/\/www.careervillage.org\/articles\/insights\/learners-embrace-ai-advice-but-want-ethical-use\/","title":{"rendered":"Learners Embrace AI Advice, But Want Ethical Use: Insights from CareerVillage&#8217;s Latest Survey"},"content":{"rendered":"\n<h4 class=\"wp-block-heading\">We asked learners on CareerVillage how they felt about AI-generated advice. Here\u2019s what we heard.<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">Across the entire internet, there has been a significant increase in AI-generated content, driven by the era of LLMs. Since the fall of 2023, our team has observed an increase in the number of responses on the CareerVillage platform that contains AI-generated or AI-assisted content (or \u2018Human-in-the-loop content\u2019, as it\u2019s termed in our <a href=\"https:\/\/guide.careervillage.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Guidelines<\/a>).&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In tracking and reviewing AI use on our platform, we hope to advance our understanding of this new and ever-changing technology, and ultimately, inform the ongoing development of our AI Policy, as well as the development of <a href=\"https:\/\/www.aicareercoach.org\/?utm_source=careervillage-blog&amp;utm_medium=blog&amp;utm_campaign=surveyresults\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Coach<\/strong><\/a>, the <a href=\"\/articles\/cv-updates\/ai-career-coach-coalition-joint-statement-on-the-application-of-ai-in-career-development\/\">AI-powered career development platform<\/a> we\u2019re launching this summer.<br><br>To gain a deeper understanding of community perspectives on the use of AI-generated and AI-assisted content in response to student questions, we took the additional step of conducting an 8-question survey among two segments in April 2024.&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>CareerVillage Learners<\/strong>: 1,384 learners who created accounts in March 2024 were invited to complete the survey. To incentivize engagement, the first ten users to complete the survey were sent a $10 gift card. Ultimately, we received 102 completed survey responses from this segment.<\/li>\n\n\n\n<li><strong>Early Adult Participants<\/strong>: Conducted among 60 English-fluent participants aged 18-22, sourced from a trusted online platform for research participant recruitment.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Ultimately, we received 162 survey responses. <strong>The results showed a slight preference for AI-generated responses, though concerns about AI\u2019s impact on education and work remain.<\/strong><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Learners See Value in AI Advice<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Our survey, encompassing both CareerVillage learners and early adult participants, revealed a preference for AI-generated advice. These results suggest that AI can be a valuable tool for delivering clear and informative responses. However, it is important to note the scope was limited. There were just two survey questions in which respondents directly compared AI-generated and non-AI responses to learner queries, ultimately choosing a preferred piece of advice from two unlabeled options.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"384\" src=\"https:\/\/www.careervillage.org\/wp-content\/uploads\/2024\/05\/CT-survey-results-graphic-1024x384.png\" alt=\"Bar graphs of survey results: Both CareerVillage learners and early adult respondents indicated a preference for AI advice.\" class=\"wp-image-352\" srcset=\"https:\/\/www.careervillage.org\/wp-content\/uploads\/2024\/05\/CT-survey-results-graphic-1024x384.png 1024w, https:\/\/www.careervillage.org\/wp-content\/uploads\/2024\/05\/CT-survey-results-graphic-300x113.png 300w, https:\/\/www.careervillage.org\/wp-content\/uploads\/2024\/05\/CT-survey-results-graphic-768x288.png 768w, https:\/\/www.careervillage.org\/wp-content\/uploads\/2024\/05\/CT-survey-results-graphic-1536x576.png 1536w, https:\/\/www.careervillage.org\/wp-content\/uploads\/2024\/05\/CT-survey-results-graphic-2048x768.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><sub>Both segments of respondents indicated a preference for AI-generated advice.<\/sub><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Three other questions asked respondents to read a specific piece of advice and rate its helpfulness on a scale of one to five. Of these three survey questions, two asked respondents to rate AI-generated answers to learner queries. Each was rated at an average of 4.5, while the non-AI answer was rated at 4.4 \u2013 not a meaningful difference.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Beyond the Hype: Learners Want Ethical Use<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">When asked an open-ended question about their general feelings toward AI (How do you feel about AI? Do you use it in your education or personal life?), respondents expressed a mix of enthusiasm and concern, especially over the potential for misuse:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><em>\u201cI think AI can be a useful tool in school, but it shouldn\u2019t be used to cheat. I do use AI to check my work for mistakes or see where I need to improve.\u201d<\/em><\/li>\n\n\n\n<li><em>\u201cI sometimes use it, but I don\u2019t rely on it. I\u2019ll use it for ideas and stuff.\u201d<\/em><\/li>\n\n\n\n<li><em>\u201cAI can help assist grammatical errors in work; however, it shouldn\u2019t be taken advantage of nor used to plagiarize to take someone else\u2019s credit.\u201d<\/em><\/li>\n\n\n\n<li><em>\u201cLove it! Helpful but can be misused\u201d<\/em><\/li>\n\n\n\n<li><em>\u201cI like it a bit. I like to use it in my education and personal life for small things but not big things. I don\u2019t like that AI is taking over jobs.\u201d<\/em><\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">The Road Ahead: Balancing Innovation with Trust<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">These findings have us re-evaluating how CareerVillage handles AI-generated content. While the survey suggests learners find value in AI, it also raises important questions for our team to consider:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Should users be allowed to copy-paste AI answers?<\/li>\n\n\n\n<li>Should AI-generated answers be labeled?<\/li>\n\n\n\n<li>How can we balance the benefits of AI with genuine human advice?<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">A Conversation, Not a Conclusion<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The survey results are just the beginning of a crucial conversation. The CareerVillage team is committed to striking a balance between embracing innovation and maintaining the authenticity and trust that our community of students, educators, and volunteers thrives on. We&#8217;re all in this together, navigating the ever-evolving world of career learning!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We asked learners on CareerVillage how they felt about AI-generated advice. Here\u2019s what we heard. Across the entire internet, there has been a significant increase in AI-generated content, driven by the era of LLMs. Since the fall of 2023, our team has observed an increase in the number of responses on the CareerVillage platform that [&hellip;]<\/p>\n","protected":false},"author":16,"featured_media":358,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[77,13],"tags":[75,79,81,82,78,80],"class_list":["post-351","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-coach","category-insights","tag-ai","tag-ai-advice","tag-careervillage","tag-coach","tag-insights","tag-survey"],"_links":{"self":[{"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/posts\/351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/comments?post=351"}],"version-history":[{"count":6,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/posts\/351\/revisions"}],"predecessor-version":[{"id":361,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/posts\/351\/revisions\/361"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/media\/358"}],"wp:attachment":[{"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/media?parent=351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/categories?post=351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.careervillage.org\/articles\/wp-json\/wp\/v2\/tags?post=351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}