Answers.Body: <p>I have done something similar to this.  I've found <a href="https://codingbat.com/java" rel="nofollow noreferrer">codingbat</a> to be a great resource.  The exercises there are not complex and are structured in a way that later exercises build on previous ones. There are more exercises there for Java than Python but at worst it may be useful for prompting ideas.
  <a href="https://i.sstatic.net/AUGms.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/AUGms.png" alt="CodingBat exercises" /></a></p>
  <p>Now, I have set classroom exercises using some of the ones here, not least because it shows them the tests that are run on the code and I would hope- gets them thinking about test cases, boundaries and so on.  Even though I had stated in previous years that some exam questions would be sourced from the site, I have been disappointed to see very few actually engage with the exercises.</p>
  <p>Last year I used <a href="https://replit.com/" rel="nofollow noreferrer">replit</a> for the first time.  Rather than use codingbat for code challenges, I was inspired to create my own version of it where I could actually &quot;see&quot; what people in the class were coding, and I could write my own tests to test their code.  I have found this to be extremely useful, and each evening I can review their code submissions, offer suggestions, see where they are having problems- syntax, logic, indentation (python), incorrect docstrings and so on.</p>
  <p><a href="https://i.sstatic.net/fPOMe.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/fPOMe.png" alt="Exercises posted to the Edu Team" /></a></p>
  <p>These are the codingbat-style exercises I wrote and posted. I can also set up tests that they can run and see what cases fail.</p>
  <p><a href="https://i.sstatic.net/H6hHW.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/H6hHW.png" alt="one of the labs with a view of the unit tests" /></a></p>
  <p>Once a learner views a lab, it forks a copy for them and I can see the clock icon. If they submit it, I will see an hourglass icon and how many tests were passed and then I review the file for things that unit test will not catch- tidyness and so on.  Once I have reviewed and accept the submission, it appears with a tick mark icon.</p>
  <p><a href="https://i.sstatic.net/UCA9d.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/UCA9d.png" alt="overview of learner progress" /></a></p>
  <p>Admittedly it is more work than using something that it &quot;there&quot;, but I can jump into their repls and join them in coding, or observe them coding, add comments or chat in real time.  If we have to do remote work again this will be really useful, but even in class I find it useful as I do a &quot;walk-through&quot; akin to strolling around the room to see where each learner is at. I am pretty impressed by what is available on this platform.</p>
  <p>There are lots of videos that show how to use it- here is just one that I found useful.</p>
  <p><a href="https://youtu.be/hCgGzIUJtY4" rel="nofollow noreferrer">Overview of using Teams for Edu</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-10-17T17:48:59.357Z
Answers.Text: Thanks for the links for these interesting resources!
Answers.UserDisplayName: Erel Segal-Halevi
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-05-07T15:21:42.273Z
Answers.Text: @ErelSegal-Halevi the repl Teams for Edu are now FREE. I paid when I joined as it was worth it for me to have those features.
Answers.UserDisplayName: srattigan
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-10-17T17:12:56.177Z
Answers.LastActivityDate: 2021-10-17T17:12:56.177Z
Answers.UserDisplayName: srattigan
Answers.Body: <p>Those problems are usually more in the line of 2 hour work to get it done, so I'd either sample <em>very</em> carefully and/or simplify. For on-line exams the format of an input in a fixed format, no validation needed, and a fixed output is nice (can be graded by test cases). You'll want to add a code review. A generic rubric of mine for programs ran roughly like:</p>
  <ul>
  <li>50% Running
  <ul>
  <li>15% Test cases given with the problem</li>
  <li>35% Unpublished test cases</li>
  </ul>
  </li>
  <li>50% Code quality
  <ul>
  <li>5% Compíles without warnings</li>
  <li>10% Code organization (decent variable/function names, comments,     consistent indentation, ...)</li>
  <li>20% Use of the language facilities (use switch/if, loops, ...)</li>
  <li>15% Use of library facilities that are appropriate, external tooling (<code>Makefile</code> or such)</li>
  </ul>
  </li>
  </ul>
  <p>Obviously you'd adjust according if needed to tailor to particular problems. But tell them beforehand that this will be the rough grading scheme.</p>
  <p>You could asign some of the problems as homework, with a similar grading idea. But check first, I've seen problems misclassified as to best/recommended solution strategy, some <em>very</em> hard problems are said to be &quot;medium&quot;, and sometimes the posed problem is just impossible to understand (looks nice at first glance, though). And check that solutions aren't available (some miscreants publish their solutions on <a href="http://www.github.com" rel="nofollow noreferrer">github</a>).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-10-13T20:49:02.147Z
Answers.LastActivityDate: 2021-10-13T20:49:02.147Z
Answers.UserDisplayName: vonbrand
Answers.Body: <p>Whether this is a good plan or not depends on some things, most especially the nature of your students. </p>
  
  <p>However, it seems a bit too unstructured. If you have a general mix of student ability it could cause problems unless you incorporate the questions from the site(s) more formally into your teaching. There are a <em>lot</em> of questions available, I would guess and some of your students will panic, thinking that (a) they need to do everything or (b) it is hopeless. This is a special problem if these extra questions are above and beyond all necessary assigned work. </p>
  
  <p>However, one good aspect of your plan is to show them in advance the kinds of things that they will be expected to know and that other students also regularly deal with. Much better that than hiding your intent and springing things on them unexpectedly.</p>
  
  <p>But I think a better plan is for you to incorporate a sampling of the found questions into your labs and homework assignments. For the most challenging questions you could have five minute brainstorming sessions as part of several class periods. </p>
  
  <p>In short, as part of the regular process it should work out, but if it is completely "extra but not formally rewarded" work it might backfire on you. </p>
  
  <hr>
  
  <p>An additional dimension here, of course, is that you could use the site(s) to teach yourself how to ask better questions. And your focus on "creative questions" rather than necessarily "challenging questions" is a good one, I think. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-01-22T07:43:30.760Z
Answers.Text: +1 for the last para.  Especially if OP's course teaches "don't just copy/paste answers from code sites (like SO) when doing homework".
Answers.UserDisplayName: mcalex
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-01-21T16:38:38.773Z
Answers.LastActivityDate: 2018-01-21T16:38:38.773Z
Answers.UserDisplayName: Buffy
Body: <p>There are various websites like <a href="https://www.codewars.com/" rel="noreferrer">codewars</a> that present programming challenges in various languages and difficulty levels. 
  I looked at some of their challenges and they seem to be more creative than me in making good questions. So, I thought of using this website as a source for exam questions in a programming course I am going to teach next semester. </p>
  
  <p>My plan is to tell the students in advance that some (or all) of the exam questions will come from this website, so that they have the entire semester for practicing. Moreover, I plan to tell them that, if they have any difficulty in solving a challenge, or want any feedback on their solution, they can ask me or the other course staff for help during the semester. My hope is that this will encourage them to practice programming in a competitive and fun environment. Do you think this a good plan? Do you have experience using such websites in programming courses?</p>
  
Tags: <exercises><resource-information><homework><exams>
Title: Using questions from a code-competition website in homework and exams
ThreadText: # Using questions from a code-competition website in homework and exams
  
  (Asked by: username_0 on 2018-01-21)
  
  There are various websites like [codewars](https://www.codewars.com/) that present programming challenges in various languages and difficulty levels.
  I looked at some of their challenges and they seem to be more creative than me in making good questions. So, I thought of using this website as a source for exam questions in a programming course I am going to teach next semester.
  
  My plan is to tell the students in advance that some (or all) of the exam questions will come from this website, so that they have the entire semester for practicing. Moreover, I plan to tell them that, if they have any difficulty in solving a challenge, or want any feedback on their solution, they can ask me or the other course staff for help during the semester. My hope is that this will encourage them to practice programming in a competitive and fun environment. Do you think this a good plan? Do you have experience using such websites in programming courses?
  
  **Tags:** exercises, resource-information, homework, exams
  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_3 on 2018-01-21. Score: 7 | Accepted answer
  
  Whether this is a good plan or not depends on some things, most especially the nature of your students.
  
  However, it seems a bit too unstructured. If you have a general mix of student ability it could cause problems unless you incorporate the questions from the site(s) more formally into your teaching. There are a *lot* of questions available, I would guess and some of your students will panic, thinking that (a) they need to do everything or (b) it is hopeless. This is a special problem if these extra questions are above and beyond all necessary assigned work.
  
  However, one good aspect of your plan is to show them in advance the kinds of things that they will be expected to know and that other students also regularly deal with. Much better that than hiding your intent and springing things on them unexpectedly.
  
  But I think a better plan is for you to incorporate a sampling of the found questions into your labs and homework assignments. For the most challenging questions you could have five minute brainstorming sessions as part of several class periods.
  
  In short, as part of the regular process it should work out, but if it is completely "extra but not formally rewarded" work it might backfire on you.
  
  ---
  
  An additional dimension here, of course, is that you could use the site(s) to teach yourself how to ask better questions. And your focus on "creative questions" rather than necessarily "challenging questions" is a good one, I think.
  
  > **Comments:**
  > **username_4**: +1 for the last para.  Especially if OP's course teaches "don't just copy/paste answers from code sites (like SO) when doing homework".  
  
  ---
  
  ### Answer by username_1 on 2021-10-17. Score: 2
  
  I have done something similar to this. I've found [codingbat](https://codingbat.com/java) to be a great resource. The exercises there are not complex and are structured in a way that later exercises build on previous ones. There are more exercises there for Java than Python but at worst it may be useful for prompting ideas.
  [![CodingBat exercises](https://i.sstatic.net/AUGms.png)](https://i.sstatic.net/AUGms.png)
  
  Now, I have set classroom exercises using some of the ones here, not least because it shows them the tests that are run on the code and I would hope- gets them thinking about test cases, boundaries and so on. Even though I had stated in previous years that some exam questions would be sourced from the site, I have been disappointed to see very few actually engage with the exercises.
  
  Last year I used [replit](https://replit.com/) for the first time. Rather than use codingbat for code challenges, I was inspired to create my own version of it where I could actually "see" what people in the class were coding, and I could write my own tests to test their code. I have found this to be extremely useful, and each evening I can review their code submissions, offer suggestions, see where they are having problems- syntax, logic, indentation (python), incorrect docstrings and so on.
  
  [![Exercises posted to the Edu Team](https://i.sstatic.net/fPOMe.png)](https://i.sstatic.net/fPOMe.png)
  
  These are the codingbat-style exercises I wrote and posted. I can also set up tests that they can run and see what cases fail.
  
  [![one of the labs with a view of the unit tests](https://i.sstatic.net/H6hHW.png)](https://i.sstatic.net/H6hHW.png)
  
  Once a learner views a lab, it forks a copy for them and I can see the clock icon. If they submit it, I will see an hourglass icon and how many tests were passed and then I review the file for things that unit test will not catch- tidyness and so on. Once I have reviewed and accept the submission, it appears with a tick mark icon.
  
  [![overview of learner progress](https://i.sstatic.net/UCA9d.png)](https://i.sstatic.net/UCA9d.png)
  
  Admittedly it is more work than using something that it "there", but I can jump into their repls and join them in coding, or observe them coding, add comments or chat in real time. If we have to do remote work again this will be really useful, but even in class I find it useful as I do a "walk-through" akin to strolling around the room to see where each learner is at. I am pretty impressed by what is available on this platform.
  
  There are lots of videos that show how to use it- here is just one that I found useful.
  
  [Overview of using Teams for Edu](https://youtu.be/hCgGzIUJtY4)
  
  > **Comments:**
  > **username_0**: Thanks for the links for these interesting resources!  
  > **username_1**: @username_0 the repl Teams for Edu are now FREE. I paid when I joined as it was worth it for me to have those features.  
  
  ---
  
  ### Answer by username_2 on 2021-10-13. Score: 1
  
  Those problems are usually more in the line of 2 hour work to get it done, so I'd either sample *very* carefully and/or simplify. For on-line exams the format of an input in a fixed format, no validation needed, and a fixed output is nice (can be graded by test cases). You'll want to add a code review. A generic rubric of mine for programs ran roughly like:
  
  * 50% Running
    + 15% Test cases given with the problem
    + 35% Unpublished test cases
  * 50% Code quality
    + 5% Compíles without warnings
    + 10% Code organization (decent variable/function names, comments, consistent indentation, ...)
    + 20% Use of the language facilities (use switch/if, loops, ...)
    + 15% Use of library facilities that are appropriate, external tooling (`Makefile` or such)
  
  Obviously you'd adjust according if needed to tailor to particular problems. But tell them beforehand that this will be the rough grading scheme.
  
  You could asign some of the problems as homework, with a similar grading idea. But check first, I've seen problems misclassified as to best/recommended solution strategy, some *very* hard problems are said to be "medium", and sometimes the posed problem is just impossible to understand (looks nice at first glance, though). And check that solutions aren't available (some miscreants publish their solutions on [github](http://www.github.com)).
  
  
  ---
  
  