{"id":148485,"date":"2023-10-24T11:25:26","date_gmt":"2023-10-24T15:25:26","guid":{"rendered":"http:\/\/www.bu.edu\/tech\/?page_id=148485"},"modified":"2023-10-25T10:05:15","modified_gmt":"2023-10-25T14:05:15","slug":"llm-ethics-with-professor-kevin-gold","status":"publish","type":"page","link":"https:\/\/www.bu.edu\/tech\/support\/information-security\/cam\/llm-ethics-with-professor-kevin-gold\/","title":{"rendered":"LLM Ethics with Professor Kevin Gold"},"content":{"rendered":"

There are security and ethical concerns around the use of LLM platforms. For insight on how LLMs affect higher education ethically, we consulted BU\u2019s own Associate Professor of the Practice of Computing & Data Sciences, Kevin Gold<\/a>:\u00a0<\/em><\/p>\n

How will LLMs, such as ChatGPT, Llama, WormGPT, etc, change the tasks that are expected of students and professors in higher ed?<\/strong><\/p>\n

I think the status quo definitely has to change.\u00a0 The main threat to the existing education model is that students can just ask LLMs to do their take-home work for them.\u00a0 And the AIs we have now are not perfect, but they suffice to get passing or even decent grades for a lot of tasks.\u00a0 If universities are content to give degrees for LLM-generated work, that really devalues university degrees in the long run, and it hurts the students if they shoot themselves in the foot by taking shortcuts to avoid their own education.\u00a0 So it’s up to professors to figure out how to evaluate students in a way that can’t be faked with LLM content, and just as tricky, try to figure out how to leverage the LLM power so we aren’t just running from the new technology, but making use of it.<\/p>\n

 <\/p>\n

What new skills will both (students and professors) have to gain in order to live in the era of LLMs?<\/strong><\/p>\n

What new skills will both (students and professors) have to gain in order to live in the era o <\/span>There are a few things we can do as professors that come to mind – we can ask novel questions that require careful thought, which something like ChatGPT is more likely to get wrong because it often thinks fuzzily or just recalls what it saw on the Internet.\u00a0 That’s theoretically something we often do, but I think we also assign work that is not that, and ChatGPT can be a wake-up call to remind us to be original and clever.\u00a0 We can have in-class exams that test what students know when they’re disconnected from the Internet; sometimes the old ways are new again.\u00a0 We can be more picky about submitted work and say that fuzzy arguments and uninspired creations aren’t good enough anymore to be competitive with the bots.\u00a0 And something I’m experimenting with is making an intermediary agent for querying LLMs, where it knows more – it’s been told the answers – but it’s also been told to not just give the problem away, but just help the student along.\u00a0 We’ll see.\u00a0 As professors figure this out, I think it’s on students to really be careful not to cheat themselves of knowledge and skills – think twice before LLM use and ask, “Is this going to let me learn more, or less?”\u00a0 They haven’t historically had this power to decide what work to just skip, and I hope they use it sparingly and wisely.<\/p>\n

What can people do now to adapt to the changes and challenges you mentioned before?<\/strong><\/p>\n

Everybody’s got to become more familiar with what LLMs can really do, which is quite a lot, but often of not great quality.\u00a0 Novices at a subject get really impressed with what LLMs can do, while experts dismiss the quality as not being good enough.\u00a0 It seems hard so far for everybody to accept that the truth is in the middle – the LLM poem is a great time-saver if you did not want to write it yourself, but an experienced poet is going to recognize it as kind of bad.\u00a0 Students need to understand those papers are not great.\u00a0 Professors need to understand that their students may not care that they are not great.\u00a0 The ramifications of having a mediocre alternative for many tasks are really mind-boggling, but if people only see it as perfect or terrible, they’ll make bad decisions about it.
\nI think everybody also just needs to take a step back and try to see the value of the original activity that the LLMs could replace.\u00a0 Professors need to communicate that value effectively – the joy of writing, of making things, of figuring things out for yourself.\u00a0 They’ve got to believe it and take a hard look at anything that isn’t pulling its weight in the educational process.\u00a0 And students have to be willing to see that value – accept that their worlds could be bigger, and if they don’t get bigger in college, then something’s really been lost.<\/p>\n

What counter measures, if any, do we have for detecting if content was created by a LLM?<\/strong><\/p>\n

As far as I know, this just doesn’t work with any reliability currently.\u00a0 Whatever signal the detector might use to find the LLM content, an instruction to the LLM can mask that signal.\u00a0 There are detectors with better than chance accuracy, but better than chance is not really a good grounds for making big decisions.\u00a0 But, who knows, the landscape is changing all the time.<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

There are security and ethical concerns around the use of LLM platforms. For insight on how LLMs affect higher education ethically, we consulted BU\u2019s own Associate Professor of the Practice of Computing & Data Sciences, Kevin Gold:\u00a0 How will LLMs, such as ChatGPT, Llama, WormGPT, etc, change the tasks that are expected of students and…<\/p>\n","protected":false},"author":4352,"featured_media":0,"parent":99563,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/pages\/148485"}],"collection":[{"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/users\/4352"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/comments?post=148485"}],"version-history":[{"count":4,"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/pages\/148485\/revisions"}],"predecessor-version":[{"id":148532,"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/pages\/148485\/revisions\/148532"}],"up":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/pages\/99563"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/tech\/wp-json\/wp\/v2\/media?parent=148485"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}