Answers.Body: <p>The lure to recycle past problems is great. It's so great to save work. It's so great to reduce risk by using exercises that worked well in the past. I used to succumb to that lure early on. Students told me decades ago that this is a terrible mistake. Especially the good/ambitious students become disenfranchised in courses where it's known that problems are recycled. The students argued that recycling exercises that are worth marks - be it for exams or graded homework - rewards being well-connected rather than able to solve the problems themselves. That's when I changed. I never regretted the change.</p>
  <p>If one resists that lure, there's more work to create new problems every session, more risk that the problems are not that good, but there are also sizeable benefits:</p>
  <ul>
  <li>discussing solutions in detail leads to learning (I used to ask for volunteers who wanted their solutions discussed, anonymised 2 of those solutions, typically a good and a bad one, and then discussed the good and the bad of each in class)</li>
  <li>cheating by copying from previous cohorts is eradicated</li>
  <li>contract cheating is more expensive and easier to spot on the usual sites such as freelancer.com</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-22T14:08:06.533Z
Answers.Text: Good arguments. (And I still disagree.) I guess it partly depends on what sort of material you are teaching. For my own courses I find it very hard to come up with many good exercises. I can make totally-made-up-exercsie-for-the-sake-of-exercise problems, I have some exercises that bear some relation to reality, and the next step up is embedding the material in some humongous real context that will be impssible to explain in finite time.
Answers.UserDisplayName: Victor Eijkhout
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-22T20:27:26.040Z
Answers.Text: I agree with @VictorEijkhout that it really must depend on what you're teaching. Some topics are a LOT harder than others when it comes to generating reasonable problems.
Answers.UserDisplayName: Ben I.
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-22T10:55:13.977Z
Answers.LastActivityDate: 2023-02-22T10:55:13.977Z
Answers.UserDisplayName: Kai
Answers.Body: <p>I'm against publishing answers to exercises. Credentials: I'm in the situation that I have several textbooks to my name, all of which have exercises with not-published solutions. (Only if an instructor mails me, from an <code>.edu</code> address, and with promises of confidentiality, I will send them the solutions manual. Maybe.)</p>
  <p>I teach from my textbooks multiple times. So I'd like to assign exercises this year, and again next year, maybe with a minor tweak. I can not do that if the answers are out in the wild.</p>
  <p>Designing good exercises is hard! I do not have the time to come up with a dozen (number of weeks in a typical semester) brand-new problems every time I teach my courses.</p>
  <p>So what do I give students after they have been graded? I discuss their submissions, point out what's good, and what they missed. But I still don't give them full worked-out solutions.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-12-04T08:50:48.147Z
Answers.Text: [Instructors can assign marked questions from other books, without divulging these other books to students. Multiple textbooks cover](https://redd.it/xpb1rw)  computer science.
Answers.UserDisplayName: user131533
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-12-13T19:17:39.507Z
Answers.Text: "Designing good exercises is hard! " indeed it is!  FWIW sometimes I do the assignment in front of the students in real-time in a lecture/seminar.  It isn't recorded and I don't provide notes etc.  It has the advantage of demonstrating not only *what* the solution looks like, but *how* to go about the programming task - e.g. breaking down the problem, problem solving, writing small test programs to work out how to do something, testing and debugging.
Answers.UserDisplayName: Dikran Marsupial
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-11-21T19:26:37.390Z
Answers.LastActivityDate: 2022-11-21T19:26:37.390Z
Answers.UserDisplayName: Victor Eijkhout
Answers.Body: <p>In a world with ChatGPT and other similar tools, publishing detailed solutions to all exercises and problems will lead to a world where there is no problem that can be set where the student can't get ChatGPT to give them the answer (and explanation).  The only way to avoid that is likely to be to set abstruse exercises that are hard to understand, hard for students to grasp, and of low educational value.</p>
  <p>At the end of the day, there are skills, such as maths and programming that you can only really learn or be good at by doing them for yourself.  Looking at worked solutions is a bit like going to the gym and watching someone else pump iron.  It will teach you how to use the gym equipment, but it won't make you any stronger.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-29T02:56:16.847Z
Answers.Text: A world with ChatGPT needs a world where students are graded on their ability to explain their code. For that matter, so does a world without ChatGPT.
Answers.UserDisplayName: candied_orange
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-29T09:06:41.470Z
Answers.Text: @candied_orange ChatGPT can explain the code it poduces, so that won't work.
Answers.UserDisplayName: Dikran Marsupial
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-25T14:21:10.133Z
Answers.Text: @downvoter some feedback on why you disagree with my answer would be appreciated.
Answers.UserDisplayName: Dikran Marsupial
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-12-13T19:16:55.787Z
Answers.LastActivityDate: 2022-12-13T19:16:55.787Z
Answers.UserDisplayName: Dikran Marsupial
Body: <p>Besides the 2 mathematicians quoted below and me, who else has touted free dissemination <em><strong>to students</strong></em> of detailed solutions, to EVERY exercise and problem (like in textbooks)? I uphold this wholeheartedly! This free dissemination ought to be the norm!</p>
  <p>I do NOT refer to snippety one-line answers at the back of a textbook, student solution manuals that solve merely some or half of the exercises, or solution manuals  restricted to instructors.</p>
  <ol>
  <li>Robert  Ash (1935-2015), <a href="https://faculty.math.illinois.edu/%7Er-ash/RV/RVPreface.pdf" rel="nofollow noreferrer">Preface</a> to <a href="https://faculty.math.illinois.edu/%7Er-ash/RV.html" rel="nofollow noreferrer"><em>Real Variables with Basic Metric Space Topology</em></a>.</li>
  </ol>
  <blockquote>
  <p>I rely especially on one of the most useful of all learning devices: the inclusion of detailed solutions to exercises. Solutions to problems are commonplace in elementary texts but quite rare (although equally valuable) at the upper division undergraduate and graduate level. This feature makes the
  book suitable for independent study, and further widens the audience.</p>
  </blockquote>
  <ol start="2">
  <li>David Patrick, <em>Introduction to Counting and Probability</em> (2005), page v.</li>
  </ol>
  <blockquote>
  <p>However,
  if you are using this book on your own to learn independently, then you probably have a copy of the
  solution book, in which case there are some very important things to keep in mind:</p>
  <ol>
  <li><p>Make sure that you make a serious attempt at the problem before looking at the solution. Don't
  use the solution book as a crutch to avoid really thinking about a problem first. You should think
  <em>hard</em> about a problem before deciding to give up and look at the solution.</p>
  </li>
  <li><p><strong>After you solve a problem, it's usually a good idea to read the solution, even if you think you know
  how to solve the problem. The solution that's in the solution book might show you a quicker or
  more concise way to solve the problem, or it might have a completely different solution method
  that you might not have thought of. [emboldening mine]</strong></p>
  </li>
  <li><p>If you have to look at the solution in order to solve a problem, make sure that you make a note of
  that problem. Come back to it in a week or two to make sure that you are able to solve it on your
  own, without resorting to the solution.</p>
  </li>
  </ol>
  </blockquote>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-11-16T14:26:15.810Z
Comments.Text: Put me in the "This is a profoundly bad idea" column. It is even worse for math than CS though. Reading an answer isn't nearly the same for learning as doing it. And, point 3 under the Patrick quote is just foolish. Rote memory is for eight year olds, not for mathematicians or computer scientists.
Comments.UserDisplayName: Buffy
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-11-17T04:57:00.527Z
Comments.Text: Neither quote says "to every exercise".
Comments.UserDisplayName: philipxy
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-11-17T09:58:24.640Z
Comments.Text: @Buffy, I'm not quite following how you got "rote memory" from point 3. I read it entirely differently; it seems to me Patrick is saying that the student should do their best to solve the problem on their own, but if they fail to do so, they should consult the solution, attempt to understand and internalize the approach taken there, and then after a while (when they forgot the exact details of the solution) to assess whether they have indeed successfully adopted the technique into their toolbox. I don't see anything rote about this.
Comments.UserDisplayName: yoniLavi
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-11-21T14:44:03.693Z
Comments.Text: I firmly believe that for problems which are not graded, students should have immediate access to the solutions. If we are talking about higher education, people should be assumed to be responsible and offered the tools they need to learn the best way possible. If they want to cheat themselves and immediately see the solution, it's on them - that work is not graded. Especially in programming there are many potential approaches and sometimes people are stuck - learning by example (and examples can as well be solutions to handed tasks) is proven to be very effective. [...]
Comments.UserDisplayName: Fureeish
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-11-21T14:48:05.737Z
Comments.Text: [...] If we're considering graded assignents, I think the solutions for them should also be published, but only after the deadline of the tasks in question. By the time the deadline is over, the execrise becomes an ungraded, optional work for everyone who wishes to improve their solution / complete it. The only problem I see with sharing solutions to pretty much *everything* is that every year we need to come up with slightly new problems for graded work, because students will have easy access to exercises from the past. For example I would be against publishing solved exams and tests.
Comments.UserDisplayName: Fureeish
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-11-21T19:20:34.503Z
Comments.Text: Just curious, are you an instructor? Do you use a textbook? How do you grade exercises for which the solutions are available?
Comments.UserDisplayName: Victor Eijkhout
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-12-13T19:28:04.307Z
Comments.Text: "I see with sharing solutions to pretty much everything is that every year we need to come up with slightly new problems for graded work, " if it is only *slightly* different, the published solutions for previous years assignments are likely to be very helpful (not necessarily in a good way)
Comments.UserDisplayName: Dikran Marsupial
Tags: <exercises>
Title: What computer scientists have advocated for freely publicizing detailed solutions, to every exercise?
ThreadText: # What computer scientists have advocated for freely publicizing detailed solutions, to every exercise?
  
  (Asked by: username_0 on 2022-11-16)
  
  Besides the 2 mathematicians quoted below and me, who else has touted free dissemination ***to students*** of detailed solutions, to EVERY exercise and problem (like in textbooks)? I uphold this wholeheartedly! This free dissemination ought to be the norm!
  
  I do NOT refer to snippety one-line answers at the back of a textbook, student solution manuals that solve merely some or half of the exercises, or solution manuals restricted to instructors.
  
  1. Robert Ash (1935-2015), [Preface](https://faculty.math.illinois.edu/%7Er-ash/RV/RVPreface.pdf) to [*Real Variables with Basic Metric Space Topology*](https://faculty.math.illinois.edu/%7Er-ash/RV.html).
  
  > I rely especially on one of the most useful of all learning devices: the inclusion of detailed solutions to exercises. Solutions to problems are commonplace in elementary texts but quite rare (although equally valuable) at the upper division undergraduate and graduate level. This feature makes the
  > book suitable for independent study, and further widens the audience.
  
  2. David Patrick, *Introduction to Counting and Probability* (2005), page v.
  
  > However,
  > if you are using this book on your own to learn independently, then you probably have a copy of the
  > solution book, in which case there are some very important things to keep in mind:
  >
  > 1. Make sure that you make a serious attempt at the problem before looking at the solution. Don't
  >    use the solution book as a crutch to avoid really thinking about a problem first. You should think
  >    *hard* about a problem before deciding to give up and look at the solution.
  > 2. **After you solve a problem, it's usually a good idea to read the solution, even if you think you know
  >    how to solve the problem. The solution that's in the solution book might show you a quicker or
  >    more concise way to solve the problem, or it might have a completely different solution method
  >    that you might not have thought of. [emboldening mine]**
  > 3. If you have to look at the solution in order to solve a problem, make sure that you make a note of
  >    that problem. Come back to it in a week or two to make sure that you are able to solve it on your
  >    own, without resorting to the solution.
  
  **Tags:** exercises
  
  > **Comments:**
  > **username_1**: Put me in the "This is a profoundly bad idea" column. It is even worse for math than CS though. Reading an answer isn't nearly the same for learning as doing it. And, point 3 under the Patrick quote is just foolish. Rote memory is for eight year olds, not for mathematicians or computer scientists.  
  > **username_2**: Neither quote says "to every exercise".  
  > **username_3**: @username_1, I'm not quite following how you got "rote memory" from point 3. I read it entirely differently; it seems to me Patrick is saying that the student should do their best to solve the problem on their own, but if they fail to do so, they should consult the solution, attempt to understand and internalize the approach taken there, and then after a while (when they forgot the exact details of the solution) to assess whether they have indeed successfully adopted the technique into their toolbox. I don't see anything rote about this.  
  > **username_4**: I firmly believe that for problems which are not graded, students should have immediate access to the solutions. If we are talking about higher education, people should be assumed to be responsible and offered the tools they need to learn the best way possible. If they want to cheat themselves and immediately see the solution, it's on them - that work is not graded. Especially in programming there are many potential approaches and sometimes people are stuck - learning by example (and examples can as well be solutions to handed tasks) is proven to be very effective. [...]  
  > **username_4**: [...] If we're considering graded assignents, I think the solutions for them should also be published, but only after the deadline of the tasks in question. By the time the deadline is over, the execrise becomes an ungraded, optional work for everyone who wishes to improve their solution / complete it. The only problem I see with sharing solutions to pretty much *everything* is that every year we need to come up with slightly new problems for graded work, because students will have easy access to exercises from the past. For example I would be against publishing solved exams and tests.  
  > **username_5**: Just curious, are you an instructor? Do you use a textbook? How do you grade exercises for which the solutions are available?  
  > **username_6**: "I see with sharing solutions to pretty much everything is that every year we need to come up with slightly new problems for graded work, " if it is only *slightly* different, the published solutions for previous years assignments are likely to be very helpful (not necessarily in a good way)  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_7 on 2023-02-22. Score: 2 | Accepted answer
  
  The lure to recycle past problems is great. It's so great to save work. It's so great to reduce risk by using exercises that worked well in the past. I used to succumb to that lure early on. Students told me decades ago that this is a terrible mistake. Especially the good/ambitious students become disenfranchised in courses where it's known that problems are recycled. The students argued that recycling exercises that are worth marks - be it for exams or graded homework - rewards being well-connected rather than able to solve the problems themselves. That's when I changed. I never regretted the change.
  
  If one resists that lure, there's more work to create new problems every session, more risk that the problems are not that good, but there are also sizeable benefits:
  
  * discussing solutions in detail leads to learning (I used to ask for volunteers who wanted their solutions discussed, anonymised 2 of those solutions, typically a good and a bad one, and then discussed the good and the bad of each in class)
  * cheating by copying from previous cohorts is eradicated
  * contract cheating is more expensive and easier to spot on the usual sites such as freelancer.com
  
  > **Comments:**
  > **username_5**: Good arguments. (And I still disagree.) I guess it partly depends on what sort of material you are teaching. For my own courses I find it very hard to come up with many good exercises. I can make totally-made-up-exercsie-for-the-sake-of-exercise problems, I have some exercises that bear some relation to reality, and the next step up is embedding the material in some humongous real context that will be impssible to explain in finite time.  
  > **username_8**: I agree with @username_5 that it really must depend on what you're teaching. Some topics are a LOT harder than others when it comes to generating reasonable problems.  
  
  ---
  
  ### Answer by username_5 on 2022-11-21. Score: 5
  
  I'm against publishing answers to exercises. Credentials: I'm in the situation that I have several textbooks to my name, all of which have exercises with not-published solutions. (Only if an instructor mails me, from an `.edu` address, and with promises of confidentiality, I will send them the solutions manual. Maybe.)
  
  I teach from my textbooks multiple times. So I'd like to assign exercises this year, and again next year, maybe with a minor tweak. I can not do that if the answers are out in the wild.
  
  Designing good exercises is hard! I do not have the time to come up with a dozen (number of weeks in a typical semester) brand-new problems every time I teach my courses.
  
  So what do I give students after they have been graded? I discuss their submissions, point out what's good, and what they missed. But I still don't give them full worked-out solutions.
  
  > **Comments:**
  > **username_0**: [Instructors can assign marked questions from other books, without divulging these other books to students. Multiple textbooks cover](https://redd.it/xpb1rw)  computer science.  
  > **username_6**: "Designing good exercises is hard! " indeed it is!  FWIW sometimes I do the assignment in front of the students in real-time in a lecture/seminar.  It isn't recorded and I don't provide notes etc.  It has the advantage of demonstrating not only *what* the solution looks like, but *how* to go about the programming task - e.g. breaking down the problem, problem solving, writing small test programs to work out how to do something, testing and debugging.  
  
  ---
  
  ### Answer by username_6 on 2022-12-13. Score: 2
  
  In a world with ChatGPT and other similar tools, publishing detailed solutions to all exercises and problems will lead to a world where there is no problem that can be set where the student can't get ChatGPT to give them the answer (and explanation). The only way to avoid that is likely to be to set abstruse exercises that are hard to understand, hard for students to grasp, and of low educational value.
  
  At the end of the day, there are skills, such as maths and programming that you can only really learn or be good at by doing them for yourself. Looking at worked solutions is a bit like going to the gym and watching someone else pump iron. It will teach you how to use the gym equipment, but it won't make you any stronger.
  
  > **Comments:**
  > **username_9**: A world with ChatGPT needs a world where students are graded on their ability to explain their code. For that matter, so does a world without ChatGPT.  
  > **username_6**: @username_9 ChatGPT can explain the code it poduces, so that won't work.  
  > **username_6**: @downvoter some feedback on why you disagree with my answer would be appreciated.  
  
  ---
  
  