JeremyMar 5
@krismicinski did some experiments with codex today, looks like it can generate many grad level PL theory solutions in Lean.
Show threadColin GordonMar 5

@jeremysiek @krismicinski I'm moving all of my classes to required code walks. Has the nice side effect of the fact that once you convince your students that the code walk grade doesn't suffer when you find a bug during it, it often turns into a design discussion and talking about debugging strategies. I think the students also feel like their hard work is more appreciated after they actually get to chat with faculty about it.

Has worked wonderfully in undergrad compilers and grad distributed systems.

Hard to scale past 40 students though

Show threadLindsey KuperMar 5
@csgordon @jeremysiek @krismicinski Yeah, I tried to do this in my PL course with ~150 students, and it was a massive logistical headache and left me and all the course staff exhausted. I would love to do it, but it's not feasible with the enrollments we have.
Show threadColin GordonMar 5
@lindsey @jeremysiek @krismicinski yeah... our first-year courses (~400 students) are trying a lightweight version of this with 10 minute chats, with random samples of students each week. so I think each student meets twice a term. It seems to be going well, but it's still a stretch even with an additional faculty member volunteering to help with these(!). The deeper material in later courses definitely needs more than 10 minutes.
Show threadJan de Muijnck-HughesMar 5

@csgordon @lindsey @jeremysiek @krismicinski I know it doesn’t help much, but I ask my students to produce a short report along side the technical submission.

The idea being you can eyeball the differences between written report and code submission. Identify where more interrogation isrequired. I know genai could produce these reports but every little helps.

Submission canaries, for want of a better phrase.

Show threadColin GordonMar 5
@jfdm @lindsey @jeremysiek @krismicinski I've long had students do a form of this with their assignments, but the generated reports got "good" enough a year and a half or so ago that I spent more time waffling on whether something crosses the line plus basically arguing politely with offended students than I would just meeting with everyone. (I'm sure this balance point varies depending how exactly you set things up with the report, but I couldn't figure out a more effective setup.) Meeting with everyone has ended up more equal for students, less frustrating for me, and more positive (i.e., non-adversarial) for students. The tipping point also depends on enrollment.
Show threadJan de Muijnck-HughesMar 5

@csgordon @lindsey @jeremysiek @krismicinski There are two routes I have considered:

1. learn how to write more open book take home assignments;
2. get students to do programming coursework in the lab in exam conditions

Either way, we are doomed.

Show threadStefan Marr
@jfdm @csgordon @lindsey @jeremysiek @krismicinski at least you could sell 2. as "practice for coding interviews", assuming that's still a thing when they graduate... 🙈
Mar 5 at 7:00pmWeb