Answers.Body: <p>If your main concern is related to cheating in tests, there are some ways to somehow minimize it (not 100%, though).</p>
  
  <p>I am in "forced" quarantine since March 4th, so, almost all the 2nd semester is held online (I haven't returned to the uni since, so haven't the students). :)</p>
  
  <p>I and all the CS teachers at my Uni rely mostly on small quizzes, oral presentations, small assignments or larger individual ou group projects. Traditional tests will still take place, but their weight in the final grade was reduced. In any case, it is almost always assumed that the tests are open-book tests, so the students are asked to give their opinion or apply some concepts and not simply give definitions.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-16T22:47:58.340Z
Answers.Text: No, it isn't my main concern. But these are good suggestions.
Answers.UserDisplayName: Buffy
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-16T22:37:39.753Z
Answers.LastActivityDate: 2020-04-16T22:37:39.753Z
Answers.UserDisplayName: Nuno Gil Fonseca
Answers.Body: <p>One excellent resource to introduce students to Python programming remotely is CMU CS Academy (with which I am affiliated). CMU CS Academy is a free online, interactive high school computer science curriculum.  The curriculum includes notes, exercises with an autograder, creative tasks at the end of each unit to apply what they have learned so far, as well as quizzes. </p>
  
  <p>They are currently providing daily webinars for educators interested in learning more.  You can sign up at <a href="https://academy.cs.cmu.edu/r/12103?fbclid=IwAR0b7O9En6dRqFp6p8a2cik62GAXlHyiWqnXK3oELM3afHReZQf-lrakBrk" rel="nofollow noreferrer">https://academy.cs.cmu.edu/r/12103?fbclid=IwAR0b7O9En6dRqFp6p8a2cik62GAXlHyiWqnXK3oELM3afHReZQf-lrakBrk</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-22T23:46:03.447Z
Answers.Text: Sorry, but this isn't an answer and it is technically spam by the rules here since you don't give your affiliation with CMU.
Answers.UserDisplayName: Buffy
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-24T02:01:58.073Z
Answers.Text: @Buffy I'm puzzled by your assertion that it's not an answer, since it's about education without testing (or at least without testing that has stakes.  The "testing" there is aboue creating recall opportunities, no?)  I agree that it's in violation of the rule about disclosing the author's affiliation, though.  (Seeing as the user is unregistered, I will edit.)
Answers.UserDisplayName: Ben I.
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-24T11:34:05.763Z
Answers.Text: @BenI. The question was about _evaluation_ without testing.
Answers.UserDisplayName: Buffy
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-24T12:31:41.813Z
Answers.Text: @Buffy That's... a good point.  Somehow I had misunderstood the question to be about *education* without testing, but looking at it, it is plainly not.  Sometimes I look back at something I have misunderstood and absolutely cannot figure out what I didn't see.  The question is perfectly clear.
Answers.UserDisplayName: Ben I.
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-22T23:40:02.487Z
Answers.LastActivityDate: 2020-03-24T02:02:24.093Z
Answers.LastEditDate: 2020-03-24T02:02:24.093Z
Answers.UserDisplayName: Nico Ortiz de Zarate
Answers.Body: <p>As part of an algorithms module (first-year undergraduate level), I got students to choose a computational problem from a list of options I provided, write an algorithm to solve it, and write a 750-word report explaining:</p>
  
  <ul>
  <li>The problem in their own words,</li>
  <li>How their algorithm works (with code), and</li>
  <li>How they tested it.</li>
  </ul>
  
  <p>Students had a few weeks to complete this task, worked in their own time, and then submitted their report to the university's Moodle site; so this kind of assessment could work equally well in a non-face-to-face course.</p>
  
  <p>The idea behind asking students to explain their algorithm came from the fact that interviewees for software jobs often have to solve a problem during the interview and explain how their solution works. Being able to explain how one's code works is also important for many other things a programmer might do, like rubber-duck debugging, code review, or writing good answers on Stack Overflow.</p>
  
  <p>Your question doesn't dwell on it, but one of the key differences between in-person and online assessments is the opportunity for cheating and the difficulty of detecting it. As a convenient side-effect of having students explain the problem and their solution in their own words, suspected cheaters can be identified in two ways:</p>
  
  <ul>
  <li>A student who is unable to write the code themselves is usually also unable to adequately explain how the code works.</li>
  <li>A student who also copies the explanation (or parts of it) can be detected by standard tools such as TurnItIn, so you don't need a more sophisticated tool for comparing code similarity.</li>
  </ul>
  
  <p>In the former case, a poor explanation deserves a low grade anyway, whether or not they cheated. In the latter case, my experience of running the assessment over two years with ~250 students each year is that TurnItIn works well enough for catching students who copy from an online source or from each other. With fewer students, you can group the assessment submissions by which problem they attempted, and probably notice any collusion yourself even without a tool like TurnItIn.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-10T21:50:24.593Z
Answers.LastActivityDate: 2020-03-10T21:50:24.593Z
Answers.UserDisplayName: kaya3
Answers.Body: <p>I agree with kaya3. You can assign open-ended projects where students apply techniques from the course. Or you can give them more structured projects, e.g., from this book by Havill (the website includes skeleton code):
  <a href="http://discovercs.denison.edu/" rel="nofollow noreferrer">http://discovercs.denison.edu/</a>
  or inspired by these data science projects by Nolan and Temple Lang:
  <a href="http://rdatasciencecases.org/Data.html" rel="nofollow noreferrer">http://rdatasciencecases.org/Data.html</a></p>
  
  <p>You could build up to the projects with more and more complex problem-solving done in an online system, where the grading is automatic, like CodingBat. Students can go to Preferences and "Share To" so that their instructor can see a report on their progress. You could assign them 4-5 problems a week, and a project after a couple of weeks of building up their problem solving ability. A zillion exercises in Python can be found on my various pages on there:
  <a href="https://codingbat.com/home/david.white@denison.edu/" rel="nofollow noreferrer">https://codingbat.com/home/david.white@denison.edu/</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-10T22:20:21.670Z
Answers.LastActivityDate: 2020-03-10T22:20:21.670Z
Answers.UserDisplayName: David White
Body: <p>The current situation with the spread of a serious disease worldwide has caused a number of universities and schools to move courses to an online model where students don't meet face to face in large groups. </p>
  
  <p>The problem of evaluating students then arises, and traditional tests are ill suited for an online model as it is much harder to monitor them or assure validity. </p>
  
  <p>Ideally, any evaluation method should foster learning, not just memorization, so traditional testing has its own downside. Perhaps the current emergency can result in finding better evaluation methods that are also amenable to use online, as well as in traditional classrooms. </p>
  
  <p>Have you used innovative evaluation methods - beyond testing - that foster good learning and proper student habits but which can be adapted to courses that don't meet face to face for instruction or testing? Can you describe what you do. </p>
  
  <p>My own preference has long been to replace traditional tests in ordinary classrooms, and especially high risk, anxiety inducing, tests with small group and pair projects. This was combined with peer evaluation. In the current situation, it might be acceptable for students to meet in pairs or small groups with less risk than meeting in larger groups. But, it would probably have to be done in a way that meeting face to face is optional. </p>
  
Tags: <evaluation><distance-learning>
Title: What evaluation methods can be used that don't involve testing but are adaptable to online courses
ThreadText: # What evaluation methods can be used that don't involve testing but are adaptable to online courses
  
  (Asked by: username_0 on 2020-03-10)
  
  The current situation with the spread of a serious disease worldwide has caused a number of universities and schools to move courses to an online model where students don't meet face to face in large groups.
  
  The problem of evaluating students then arises, and traditional tests are ill suited for an online model as it is much harder to monitor them or assure validity.
  
  Ideally, any evaluation method should foster learning, not just memorization, so traditional testing has its own downside. Perhaps the current emergency can result in finding better evaluation methods that are also amenable to use online, as well as in traditional classrooms.
  
  Have you used innovative evaluation methods - beyond testing - that foster good learning and proper student habits but which can be adapted to courses that don't meet face to face for instruction or testing? Can you describe what you do.
  
  My own preference has long been to replace traditional tests in ordinary classrooms, and especially high risk, anxiety inducing, tests with small group and pair projects. This was combined with peer evaluation. In the current situation, it might be acceptable for students to meet in pairs or small groups with less risk than meeting in larger groups. But, it would probably have to be done in a way that meeting face to face is optional.
  
  **Tags:** evaluation, distance-learning
  
  
  ---
  
  ## 4 answers
  
  ### Answer by username_4 on 2020-03-10. Score: 5
  
  As part of an algorithms module (first-year undergraduate level), I got students to choose a computational problem from a list of options I provided, write an algorithm to solve it, and write a 750-word report explaining:
  
  * The problem in their own words,
  * How their algorithm works (with code), and
  * How they tested it.
  
  Students had a few weeks to complete this task, worked in their own time, and then submitted their report to the university's Moodle site; so this kind of assessment could work equally well in a non-face-to-face course.
  
  The idea behind asking students to explain their algorithm came from the fact that interviewees for software jobs often have to solve a problem during the interview and explain how their solution works. Being able to explain how one's code works is also important for many other things a programmer might do, like rubber-duck debugging, code review, or writing good answers on Stack Overflow.
  
  Your question doesn't dwell on it, but one of the key differences between in-person and online assessments is the opportunity for cheating and the difficulty of detecting it. As a convenient side-effect of having students explain the problem and their solution in their own words, suspected cheaters can be identified in two ways:
  
  * A student who is unable to write the code themselves is usually also unable to adequately explain how the code works.
  * A student who also copies the explanation (or parts of it) can be detected by standard tools such as TurnItIn, so you don't need a more sophisticated tool for comparing code similarity.
  
  In the former case, a poor explanation deserves a low grade anyway, whether or not they cheated. In the latter case, my experience of running the assessment over two years with ~250 students each year is that TurnItIn works well enough for catching students who copy from an online source or from each other. With fewer students, you can group the assessment submissions by which problem they attempted, and probably notice any collusion yourself even without a tool like TurnItIn.
  
  
  ---
  
  ### Answer by username_5 on 2020-03-10. Score: 3
  
  I agree with username_4. You can assign open-ended projects where students apply techniques from the course. Or you can give them more structured projects, e.g., from this book by Havill (the website includes skeleton code):
  <http://discovercs.denison.edu/>
  or inspired by these data science projects by Nolan and Temple Lang:
  <http://rdatasciencecases.org/Data.html>
  
  You could build up to the projects with more and more complex problem-solving done in an online system, where the grading is automatic, like CodingBat. Students can go to Preferences and "Share To" so that their instructor can see a report on their progress. You could assign them 4-5 problems a week, and a project after a couple of weeks of building up their problem solving ability. A zillion exercises in Python can be found on my various pages on there:
  <https://codingbat.com/home/username_5.username_5@denison.edu/>
  
  
  ---
  
  ### Answer by username_1 on 2020-04-16. Score: 1
  
  If your main concern is related to cheating in tests, there are some ways to somehow minimize it (not 100%, though).
  
  I am in "forced" quarantine since March 4th, so, almost all the 2nd semester is held online (I haven't returned to the uni since, so haven't the students). :)
  
  I and all the CS teachers at my Uni rely mostly on small quizzes, oral presentations, small assignments or larger individual ou group projects. Traditional tests will still take place, but their weight in the final grade was reduced. In any case, it is almost always assumed that the tests are open-book tests, so the students are asked to give their opinion or apply some concepts and not simply give definitions.
  
  > **Comments:**
  > **username_0**: No, it isn't my main concern. But these are good suggestions.  
  
  ---
  
  ### Answer by username_2 on 2020-03-22. Score: 0
  
  One excellent resource to introduce students to Python programming remotely is CMU CS Academy (with which I am affiliated). CMU CS Academy is a free online, interactive high school computer science curriculum. The curriculum includes notes, exercises with an autograder, creative tasks at the end of each unit to apply what they have learned so far, as well as quizzes.
  
  They are currently providing daily webinars for educators interested in learning more. You can sign up at <https://academy.cs.cmu.edu/r/12103?fbclid=IwAR0b7O9En6dRqFp6p8a2cik62GAXlHyiWqnXK3oELM3afHReZQf-lrakBrk>
  
  > **Comments:**
  > **username_0**: Sorry, but this isn't an answer and it is technically spam by the rules here since you don't give your affiliation with CMU.  
  > **username_3**: @username_0 I'm puzzled by your assertion that it's not an answer, since it's about education without testing (or at least without testing that has stakes.  The "testing" there is aboue creating recall opportunities, no?)  I agree that it's in violation of the rule about disclosing the author's affiliation, though.  (Seeing as the user is unregistered, I will edit.)  
  > **username_0**: @BenI. The question was about _evaluation_ without testing.  
  > **username_3**: @username_0 That's... a good point.  Somehow I had misunderstood the question to be about *education* without testing, but looking at it, it is plainly not.  Sometimes I look back at something I have misunderstood and absolutely cannot figure out what I didn't see.  The question is perfectly clear.  
  
  ---
  
  