1378 stories
·
1 follower

College Admissions are Nonsense

1 Share

College admissions are nonsense.

Not because colleges are malicious or because admissions officers are stupid, but because the process itself pretends to have a level of precision and moral seriousness it simply does not possess.

There is a study I would love to run someday if I ever get a PhD (I probably won’t).

Take a set of elite colleges and ask their admissions offices to re-evaluate last year’s applicants completely blind: no names, no legacy markers, no institutional memory of who actually enrolled. Then compare the newly admitted class to the one they actually chose. My guess is the overlap would be far closer to 50 percent than 100 percent.

If that’s anywhere close to correct, it tells us something important. The problem isn’t that admissions officers make occasional mistakes. It’s that “holistic review” cannot reliably distinguish among thousands of highly qualified applicants, even when applied by the same institution to the same pool. The differences between who gets in and who doesn’t are not fine judgments of merit.

Yet, colleges refuse to acknowledge this arbitrariness. Instead, they force students to behave as if every essay sentence, extracurricular choice, and leadership title might be decisive. This fuels an escalating arms race — one that rewards those with time, money, and inside knowledge. It also warps the lives of teenagers, who use their free time to build resumes rather than explore their interests, and become risk-averse learners.

There is a simpler and more honest alternative: set a clear academic threshold for readiness and then admit students by lottery.1

Join the Center for Educational Progress and receive all our content — and thanks to all our amazing paid subscribers for their support.


How Holistic Admissions Processes Reward Wealth, Not Merit

One of the most comprehensive pieces of research on the negative impacts of holistic admission on high-achieving, low-income students comes from the Jack Kent Cooke Foundation’s True Merit report.

Their findings reveal that the system of preferences and discretionary criteria used by admissions officers at selective colleges unfairly puts HALO students at a disadvantage against applicants with social and economic advantage.

Example #1: Donor and Legacy Preferences

  • Donor and legacy preferences are among the most straightforward ways wealth is converted into admissions advantage, and they illustrate the central flaw of holistic admissions more clearly than almost any other practice. In theory, these preferences are justified as tools for institutional stability or alumni engagement. In practice, they disproportionately benefit students from affluent families who already enjoy advantages across every other dimension of the application process.

Example #2: Advanced Coursework and GPAs

  • Federal education data shows that low-income students are less likely to have access to AP/IB classes - a key factor in “academic index” scores selective colleges use to screen large applicant pools. Because students enrolled in these classes are often able to have GPAs greater than a 4.0, it gives an edge to students from affluent schools.

Example #3: Standardized Test Advantages

  • Wealthier students are much more likely to enroll in test preparation courses and take the SAT/ACT multiple times, inflating their scores. While research on the benefits of test preparation courses is mixed, recent research from Harvard University shows that retaking the SAT substantially improves scores and increases four-year college enrollment rates. Often, only wealthy students are able to take advantage of these opportunities.2

Example #4: Demonstrated Interest

  • Selective colleges reward students who visit campus or engage in recruitment events. One reason for this is that it increases the institution’s yield rate, i.e. the percentage of applicants granted admission that actually enroll. These activities are often inaccessible to low-income students due to travel costs or work obligations.

Example #5: Early Decision/Action

  • Applicants that submit early decision or early action applications have significantly higher admission rates. However, low-income students are much less likely to apply early because they must compare financial aid packages before committing. This disadvantages them for admissions through no fault of their own.

Example #6: Student Essays

  • A 2021 study from Stanford’s Center for Education Policy Analysis found that application essays were more strongly correlated with household income than SAT scores, meaning essays encode socioeconomic status through vocabulary, themes, and narrative style. This matters because essays are treated as signals of depth, curiosity, and fit, when, in reality, they often signal access to coaching and cultural knowledge about what admissions officers want to hear.

Example #7: Letters of Recommendation

  • In theory, letters of recommendation provide admissions officers with a character assessment of the applicant. In practice, however, they reward students who attend schools with low guidance counselor caseloads, experienced college-savvy teachers, and institutional familiarity with selective admissions norms. In contrast, high-achieving low-income students often attend schools where counselors manage hundreds of students, teachers are stretched thin, and recommendation letters are brief, generic, or procedural due to sheer caseload.

Example #8: Extra-Curricular Activities

  • Extracurricular activities are often treated as evidence of passion, leadership, and initiative, but in holistic admissions, they function largely as proxies for time and money. Many of the activities admissions offices reward — sport travel teams, research internships, unpaid summer programs, or sustained leadership in clubs — require flexible schedules, transportation, and resources.

The Holistic Admissions Rat Race

Holistic admissions changes how teenagers spend their lives.

When colleges insist that every element of an application might matter, they create a system in which marginal effort always seems potentially decisive. This is the core mechanism of the admissions rat race.

If there is no clear bar and no honest admission that many applicants are indistinguishable from each other, students are rational to assume that one more activity or one more line on a resume could be the difference between acceptance and rejection.

This mindset reshapes how students learn, think, and spend their time.

Teenagers become risk-averse learners, avoiding challenging questions or courses, where an A is not guaranteed. During my limited time as a teacher early in my career at a private school in the suburbs of Chicago, I routinely witnessed bright students choose assignments that were easier-to-answer even when I rewarded more potential points for more difficult questions. Why risk the hit to a GPA to scratch the itch of curiosity?

This mindset also limits teenagers’ time for creative exploration. Instead, they participate in activities they do not enjoy, but are beneficial in building a competitive application.

All of this can take a significant toll. Research suggests that when students are overloaded with academic and extracurricular commitments, the marginal cognitive benefit of extra effort flattens out while the negative outcomes (i.e. anxiety, sleep deprivation, etc.) rise. In other words, students are not just “working hard”: they are over-optimizing for an opaque and hyper-competitive signals game, at the cost of rest, curiosity, and mental health.

When admissions decisions hinge on subtle, subjective differences, students internalize scarcity and anxiety as foundational truths about education, rather than as byproducts of a flawed selection process.


Why a Lottery is Fairer and Healthier

A lottery admissions system would be fairer for HALO students because it dampens the advantage of wealth. By setting a clear academic threshold, such as a minimum ACT/SAT score, colleges would identify a pool of students who can succeed. Once that bar is met, selection by lottery acknowledges an uncomfortable, but honest truth: beyond readiness, differences among applicants are often too small, too subjective, or too context-dependent to rank meaningfully. For HALO students, this matters enormously.

A lottery would also change how many teenagers live their lives. When students know that meeting a clear academic bar is sufficient, the incentive to endlessly optimize disappears. Free time no longer has to be admissions-relevant; learning no longer has to be risk-free. Students can take harder classes without fearing that a single low-grade will sink them, explore interests without worrying whether they count, and spend time working, resting, or helping family without feeling they are losing an invisible race.

More importantly, a lottery tells students that they didn’t personally fail if they don’t get into their first-choice school. In a lottery system, rejection reflects scarcity, not deficiency. Students who meet a clear academic bar can understand that they were qualified, but not selected — and not secretly judged and found wanting. Making luck explicit strips rejection of its moral weight and weakens the idea that every outcome is a referendum on one’s self-worth.

From Here to There

I’ve worked in public policy long enough to know that this post will not suddenly convince selective colleges to abandon admissions criteria they’ve relied on for decades. But, I also actually want to change how the college admissions process works — and I have a track record of doing so when systems become indefensible.3 If we care about fairness rather than rhetoric, there are concrete steps we can take through public policy and sustained advocacy to make the admissions process more like a lottery.

Example #1 - Prohibit Legacy and Donor Preferences in College Admissions

A growing number of states have passed laws prohibiting admissions officers at public universities from considering legacy or donor status when assembling an incoming class. California has gone further, enacting a law in 2025 that extends this prohibition to private, nonprofit colleges and universities operating in the state. That matters. Legacy and donor preferences are among the most explicit ways wealth is converted into admissions advantage, and banning them is one of the rare reforms that improves equity without introducing new distortions. Expanding these laws to more states is a clear step in the right direction.

Example #2 - Repeal Test-Optional/No-Test Policies

This is an area where California has gotten things exactly wrong. In an effort to address equity concerns surrounding standardized tests, the state has instead entrenched an admissions system that disadvantages HALO students. Eliminating the SAT and ACT does not eliminate wealth advantage; it amplifies it by shifting weight onto essays, recommendations, and extracurriculars — all of which are more strongly correlated with family income than test scores. Worse, research shows that high-achieving, low-income students are less likely to submit test scores even when they perform well, meaning test-optional policies systematically suppress one of the few signals that can help them compete.

Example #3 - Participate in the Federal Tax Credit Scholarship Program

Most advocates supported the federal tax credit scholarship program because it allows scholarships to be used for private school tuition. But an under-reported feature is that the program also allows scholarships to cover non-tuition educational expenses, including tutoring, SAT/ACT preparation, and exam fees. For HALO students competing against peers who can take standardized tests multiple times with tailored instruction, these supports are equalizers. Access to high-quality test prep and the ability to sit for exams without financial stress affects outcomes, and this program directly addresses that imbalance.

Example #4 - Pass State-Based Education Expense Scholarships or Credits

If governors or legislatures are uncomfortable participating in the federal program, states can pursue similar goals on their own. State-based education expense tax credits or scholarships — particularly those targeted to low- and middle-income families — can be used to offset the costs of tutoring, test preparation, and other enrichment activities. These policies need not include private school tuition to be effective. Several states, including Illinois, already operate programs along these lines. Properly designed, they reduce the role of wealth at the margins of competition rather than pretending it doesn’t exist.

Example #5 - Pressure Campaigns by Alumni and Donors

Not every problem has a legislative solution. Admissions offices are acutely sensitive to alumni and donor sentiment, and that reality can be leveraged for reform. Coordinated pressure campaigns can push institutions to drop legacy and donor preferences, adopt clearer admissions thresholds, or pilot lottery-based selection among qualified applicants. Colleges often justify inequitable practices as “institutional necessities,” but those arguments weaken quickly when a sufficient number of alumni and donors demand change.

None of these reforms will single-handedly fix college admissions. But, taken together, they would reduce the degree to which wealth masquerades as merit, lower the stakes of resume optimization, and make the process more honest about uncertainty and scarcity. That is not radical. It is what fairness looks like in a system that has spent far too long pretending it can finely rank students when, in reality, it cannot.


Selective college admissions has become an exercise in false precision. Faced with thousands of academically capable applicants, institutions insist on ranking the unrankable, leaning on criteria that quietly reward wealth and inside knowledge while pretending to measure merit. The result is a system that is neither fair nor honest. It is one that disadvantages HALO students, fuels an exhausting rat race, and teaches teenagers that college admissions outcome is a referendum on their worth.

A lottery system offers a better alternative. By setting a clear academic standard for readiness and then using a lottery to allocate scarce seats, selective colleges would acknowledge what they already know, but rarely say out loud: beyond a certain point, many applicants are equally qualified. This approach is fairer because it limits the returns to wealth at the margins. It is healthier because it changes incentives, allowing teenagers to learn deeply, take intellectual risks, and spend their time on pursuits that matter to them. And, it is more humane, because it makes room for luck as an unavoidable feature of life.

1

If I was in charge, I’d make it a minimum SAT/ACT score.

2

How can you say that selective colleges should only use SAT/ACT scores to select students and then argue that these tests advantage the wealthy? Read until the end to find out.

3

I wrote and passed Illinois’ Accelerated Placement Act, a statewide policy that allows students to enter early, take above grade level coursework, skip grades, and graduate early, after meeting and talking with families who desperately wanted to send their students to public schools, but felt like they couldn’t because the refused the schools refused to meet their child’s educational needs.

Read the whole story
mrmarchant
47 minutes ago
reply
Share this story
Delete

Milk Is Not $20

1 Share
Milk Is Not $20

I was listening to a surprisingly combative interview with Razer CEO Min-Liang Tan yesterday and amidst all the usual, expected stuff--like his general AI delusions and bizarre evasion of the question "what video game are you playing right now?"--I was struck by one response in particular, about subscription costs.

Gamers will learn to love AI, says Razer CEO
Razer’s Min-Liang Tan on AI backlash, partnering with Grok, and the future of gaming.
Milk Is Not $20

Asked by The Verge's Nilay Patel whether he truly sees value in subscribing to AI platforms, Tan says he sees value in all kinds of subscriptions. Here's a transcript of the part I'm talking about:

Patel: Are you seeing signs that the AI stuff is gonna be worth paying for that way? I mean, this is the bubble. We’re gonna spend all this money, we’ll forward invest in all this infrastructure. We’re gonna skyrocket the price of RAM and GPUs, and then at the end of the day, people are going to say, “That’s not actually worth the 20 bucks a month.”
Tan: I don’t necessarily see it as AI, per se, but I see the kind of value that I get out of it. So, for example, a ChatGPT subscription, or a Grok subscription, for that matter. I do see value in it, and that’s why I pay for it. And that’s the way I see it. I don’t see myself as paying for AI, per se. I see it as what am I getting out of a chatbot, for example, that can advise me on travel matters, health matters, whatever it is, my day-to-day, and stuff like that. Is that worth 20 bucks to me?
Because you’re a billionaire, right?
Sure.
I’m just saying, the marginal cost is meaningless to you.
20 bucks is still 20 bucks, that’s right.
I’m just saying.
Right.
I think for a lot of people, that is meaningful, especially stacked on top of all the other money they pay. Basically, I’m saying, do you see that critique of AI as a bubble? That the investment has not yet delivered the value that will make it so obvious that the investment’s worth it?
So I see that. I mean, huge amounts of investments are going into it. We are investing in AI, I think, as we speak. But I do see the potential at this point. In many cases, I mean, look at the number of paid subscribers for ChatGPT, for example. People do see the value in terms of whether it’s a chatbot AI, so on and so forth. I do think the potential is going to be realized.

"Because you’re a billionaire" has stuck with me. Tan is one of many billionaires at the vanguard of the AI push, empty men whose only reference point and purpose in life is seemingly to make a line go up for as long as possible. And that push, as it stands, is almost entirely reliant on platforms like ChatGPT and Grok going from free, idle curiosities to something millions of people pay a substantial amount of money for every month.

I am not a billionaire, but I am a guy reliant on people paying a monthly subscription for something people used to get for free, and let me tell you: good luck guys. At its height in the 2010s, I was writing for an audience at Kotaku that could number between 20-30 million people every month. I am now co-founder of a website that, asking for $7 in return for video game blogs, has 5000 paying subscribers (thank you everyone!).

That math works out for me because I am a normal person with normal person obligations like bills and groceries. It absolutely does not work out for companies that are on the hook for billions in data centre and loans, let alone lawsuits and licensing disputes. To even entertain the thought that the AI bubble could be propped up in any way by subscription costs, let alone commit your entire business model to it, is insane to a normal person!

But these aren't normal people. They're billionaires. And hearing Tan say "I do see value in it, and that’s why I pay for it", oblivious to what subscription costs (and fatigue) means to the average person on the street, made me think of this famous (if you're into basketball) line from Dwyane Wade's wife Gabrielle Union, where she explains how the multi-millionaire former pro athlete had no idea how much milk cost when he retired:

Wade's wife Gabrielle Union says he doesn't know how much milk costs or what happens at car washes: "He has no idea how much milk costs. He's like 'what is that, like $20?'"
by u/deadskin in nba

That's a cute story! Dwyane Wade seems like a nice guy, and I'm sure he now knows exactly how much milk costs. He was not, like Tan, a billionaire entirely divorced from the common human experience, trying to force a lake-boiling, job-displacing plagiarism machine on the world against its collective wishes.

There are a lot of ideas going around right now about how we can best curb the power of the billionaire class. Capping personal incomes, increasing taxes and tighter regulation of the share markets are all good places to start, but maybe I can add another one on top (they'd have to do this as well as pay more tax): every person who earns over 999 million has to spend a year stuck with the rest of us, doing what amounts to community service, in so much as it forces them to be part of a community. They have to draw from a median salary, pay a mortgage, feed kids, commute to work and navigate the healthcare system, without their billions or associated support network to bail them out.

Let's see what dipshits like Tan think about subscription costs for AI slop when $20 is three hours' work. If that job hasn't been replaced with AI already.

Read the whole story
mrmarchant
49 minutes ago
reply
Share this story
Delete

The nation’s trails are disappearing

1 Share

Government-issued maps offer a promise for safely exploring our public lands, but they no longer reflect the reality of what’s actually on the ground.

The post The nation’s trails are disappearing appeared first on High Country News.

Read the whole story
mrmarchant
22 hours ago
reply
Share this story
Delete

Plume: A Tale of Murder and Martyrdom in the Everglades

1 Share

For The Bitter Southerner, Mike Kane brings us a gothic, savor-y true crime story about the life and death of America’s first game warden. Kane and photographer Teague Kennedy brave mosquitos and crocodiles to retrace the steps of Guy Bradley, who was paid $35 a month in the early 1900s to deter and arrest poachers bent on harvesting the beautiful plumage of wading birds in the Florida Everglades. Illegal hunters prized the feathers, which were sold to milliners making hats for wealthy women in the Gilded Age.

July 8, 1905. A blood-soaked, small wooden skiff bobbed in the waves, adrift off the eastern short of Cape Sable in Florida Bay. Inside, a man lay dead from a single gunshot wound, a revolver by his side.

There are a million ways to die here in the waters surrounding the Everglades and the Ten Thousand Islands. These include: venomous snakes, alligators, crocodiles, sharks, swarms of mosquitoes, punishing heat, and the near constant threat of tropical storms and hurricanes. The man had understood that, here, nature gives no quarter.

He was keenly aware that certain men wanted him dead, simply because his job was protecting local birds whose plumage had become more valuable than gold in the Gilded Age lust for exotic millinery. Still, he persisted, paddling and slogging across vast distances in an audacious bid to defend the defenseless, and knowing it would likely cost him his life.

His name was Guy Bradley, and we are chasing his ghost.

Read the whole story
mrmarchant
1 day ago
reply
Share this story
Delete

The Writing Revolution in Math Class: Because, But, So

1 Share
Paperback The Writing Revolution 2.0: A Guide to Advancing Thinking Through Writing in All Subjects and Grades Book

This fall I read The Writing Revolution 2.0 by Judith Hochman and Natalie Wexler. It’s a book about teaching writing. The book is fantastic, I highly recommend it. Even if you don’t see yourself as a writing teacher, the authors share a lot of wisdom about teaching more broadly and describe writing activities that can be used in any subject.

Break It Down

Here’s a general principle of teaching: if students are struggling with a skill, a helpful approach is to break the skill down into smaller chunks, focus on one chunk at a time, and build up to the larger concept.

That’s the core idea behind The Writing Revolution. I won’t try to review the whole book here. Instead, I’m going to pull out one specific part of the book that I found really helpful to incorporate writing in math class.

The first part of the book is about sentences. The claim is that sentences are the core building blocks of writing, and teaching students to better understand and craft sentences will help them communicate more complex ideas in their writing. All writing consists of sentences. A focus on sentence construction reduces the cognitive load of writing while developing skills that will improve students’ broader writing skills.

Hochman and Wexler emphasize that these activities help students to improve their writing, but they also help students to think deeply about the content of that writing. The goal isn’t to give students random writing assignments. The goal is to have students write about what they are learning, and deepen that learning. If students are learning about ancient Egypt, they can craft sentences about ancient Egypt. If students are learning about Frankenstein, they can craft sentences about Frankenstein. And if students are learning about negative numbers, they can craft sentences about negative numbers.

The book shares a wide variety of sentence-writing activities. I won’t try to do justice to all of them here. I picked one to start because I wanted to build a routine that my students could become familiar with. I hope to write about additional sentence-level activities in the future.

Because, But, So

One challenge students often have in writing is that their writing is limited to simple sentences. Writing in simple sentences limits students to communicating simple ideas. One aspect of sentence-level work is practicing expanding sentences using conjunctions. Because, But, So is a sentence-level activity that practices using common conjunctions to expand sentences.

In the activity, I take one sentence kernel and ask students to complete three sentences using because, but, and so. Here’s the first one I used with my students:

-2 + 6 is positive because…

-2 + 6 is positive, but…

-2 + 6 is positive, so…

What’s the Goal?

I wrote a few paragraphs ago about how a major goal of writing activities is to think deeply about content. One goal here is to help my students practice their writing. But the most important goal is simply to have students think hard about math — in this case, the relationship between integers being added and whether the answer is positive or negative.

In the first class I did this, I remember one student looking at this task and saying, “that’s not positive…OHHH.” That’s exactly what I’m going for. Giving students practice problems is great. I do it all the time. But practice problems lend themselves to quick, surface-level thinking. Because, But, So asks students to slow down and think more deeply about a topic.

That’s really the point of writing here. Slowing down and writing about a topic is a great way to think deeply about it, to make connections, to consider hypotheticals, to reason about cause and effect. Thinking deeply about a topic makes it much more likely students will remember and be able to apply that learning in the future.

Writing in math class can feel formulaic. It’s common for curricula to tag “explain your thinking” onto the end of half of their problems because we feel like we should make a half-hearted nod toward writing. A Because, But, So activity scaffolds writing and makes it easier to start. It also focuses the writing on the core mathematical ideas, rather than an endless stream of “I found my answer by multiplying” explanations.

Examples

When I pick a sentence kernel for a Because, But, So activity, I try to pick a true statement that is worth explaining and expanding on. Here are a few examples of kernels and some sample sentences students might write.

Because

-2 + 6 is positive because there are more positive than negatives.

4x and 5x are like terms because they both have an x.

When multiplying three negative numbers, the answer is negative because two negatives multiply to a positive and the third negative makes it negative again.

Discount is an example of percent decrease because the discount is subtracted from the total.

But

-2 + 6 is positive, but -2 x 6 is negative.

4x and 5x are like terms, but 4x and 5y are not like terms.

When multiplying three negative numbers the answer is negative, but multiplying four negatives is a positive.

Discount is an example of percent decrease, but tip is an example of percent increase.

So

-2 + 6 is positive, so it makes sense that the answer is 4.

4x and 5x are like terms, so you can add them and get 9x.

When multiplying three negative numbers the answer is negative, so you can multiply as if the numbers are positive and then make the answer negative.

Discount is an example of percent decrease, so to find the answer you subtract the discount from the total.

What Does This Look Like in Class?

I try not to overthink this activity. The basic routine is simple:

  • I typically start with a model, using a different sentence kernel. I might model a sentence with one of the conjunctions, then ask students to come up with a sentence for one of the others and do a pair-share. I often model the “so” sentence because that one is the hardest for my students. I’ve modeled a bit less as students have gotten used to the routine, but some modeling is still valuable.

  • Then I pass out a half-sheet with the sentence kernels and ask students to write three sentences.

  • Once students have had a bit of time to write I have them share their sentences with a partner while I circulate and pick a few sentences to share out.

  • My goal is to pick at least one because, one but, and one so sentence to share with the class. We share those, and often talk a bit about the math or maybe think about some follow-up questions.

  • I might then have students pull out mini whiteboards and solve a few questions to stamp the learning.

The whole thing lasts ten minutes or less. Here’s the template I use:

Some Advice

Here are a few pieces of advice if you’re going to use this routine:

  • Be consistent. Stick with the routine for a few weeks. Students will get better at it over time.

  • Don’t stress if the writing isn’t perfect. I gave a bunch of examples above. Those are what I’m aiming for, but I see plenty of sentences that are a bit hollow or don’t fully engage with the math. Sometimes a student asks some great questions about the topic and we have a nice conversation about the math even if their sentences are a bit confused. That can lead to learning, and give me some information about what students do and don’t understand. If the sentences aren’t perfect, it’s not the end of the world. The first goal is to learn something about math.

  • Make sure students know the math. When I used the like terms example above I introduced it too soon, right after students learned the concept. Students were still a bit hazy on what like terms meant. The sentences were a mixed bag that day. Some were good, some were pretty confused. It was still a decent learning experience, but students would have learned more if I waited a bit longer and made sure students had a solid understanding of like terms before writing about them.

  • Most of all, give this a shot. Because, But, So has been a great way to add a different tool to my toolkit and contribute some variety to math classes. It doesn’t take long to prep, and watching students write has me thinking about learning in different ways. The activity hasn’t been perfect every time and that’s fine, I’m learning a ton along the way.

Read the whole story
mrmarchant
1 day ago
reply
Share this story
Delete

Giving University Exams in the Age of Chatbots

2 Shares

Giving University Exams in the Age of Chatbots

What I like most about teaching "Open Source Strategies" at École Polytechnique de Louvain is how much I learn from my students, especially during the exam.

I dislike exams. I still have nightmares about exams. That’s why I try to subvert this stressful moment and make it a learning opportunity. I know that adrenaline increases memorization dramatically. I make sure to explain to each student what I was expecting and to be helpful.

Here are the rules:

1. You can have all the resources you want (including a laptop connected to the Internet)
2. There’s no formal time limit (but if you stay too long, it’s a symptom of a deeper problem)
3. I allow students to discuss among themselves if it is on topic. (in reality, they never do it spontanously until I force two students with a similar problem to discuss together)
4. You can prepare and bring your own exam question if you want (something done by fewer than 10% of the students)
5. Come dressed for the exam you dream of taking!

This last rule is awesome. Over the years, I have had a lot of fun with traditional folkloric clothing from different countries, students in pajamas, a banana and this year’s champion, my Studentausorus Rex!

An inflatable Tyranosaurus Rex passing my exam in 2026
An inflatable Tyranosaurus Rex passing my exam in 2026

My all-time favourite is still a fully clothed Minnie Mouse, who did an awesome exam with full face make-up, big ears, big shoes, and huge gloves. I still regret not taking a picture, but she was the very first student to take my words for what was a joke and started a tradition over the years.

Giving Chatbots Choice to the Students

Rule N°1 implies having all the resources you want. But what about chatbots? I didn’t want to test how ChatGPT was answering my questions, I wanted to help my students better understand what Open Source means.

Before the exam, I copy/pasted my questions into some LLMs and, yes, the results were interesting enough. So I came up with the following solution: I would let the students choose whether they wanted to use an LLM or not. This was an experiment.

The questionnaire contained the following:

# Use of Chatbots

Tell the professor if you usually use chatbots (ChatGPT/LLM/whatever) when doing research and investigating a subject. You have the choice to use them or not during the exam, but you must decide in advance and inform the professor.

Option A: I will not use any chatbot, only traditional web searches. Any use of them will be considered cheating.

Option B: I may use a chatbot as it’s part of my toolbox. I will then respect the following rules:
1) I will inform the professor each time information come from a chatbot
2) When explaining my answers, I will share the prompts I’ve used so the professor understands how I use the tool
3) I will identify mistakes in answers from the chatbot and explain why those are mistakes

Not following those rules will be considered cheating. Mistakes made by chatbots will be considered more important than honest human mistakes, resulting in the loss of more points. If you use chatbots, you should be held accountable for the output.

I thought this was fair. You can use chatbots, but you will be held accountable for it.

Most Students Don’t Want to Use Chatbots

This January, I saw 60 students. I interacted with each of them for a mean time of 26 minutes. This is a tiring but really rewarding process.

Of 60 students, 57 decided not to use any chatbots. For 30 of them, I managed to ask them to explain their choices. For the others, I unfortunately did not have the time. After the exam, I grouped those justifications into four different clusters. I did it without looking at their grades.

The first group is the "personal preference" group. They prefer not to use chatbots. They use them only as a last resort, in very special cases or for very specific subjects. Some even made it a matter of personal pride. Two students told me explicitly "For this course, I want to be proud of myself." Another also explained: "If I need to verify what an LLM said, it will take more time!"

The second group was the "never use" one. They don’t use LLMs at all. Some are even very angry at them, not for philosophical reasons, but mainly because they hate the interactions. One student told me: "Can I summarize this for you? No, shut up! I can read it by myself you stupid bot."

The third group was the "pragmatic" group. They reasoned that this was the kind of exam where it would not be needed.

The last and fourth group was the "heavy user" group. They told me they heavily use chatbots but, in this case, were afraid of the constraints. They were afraid of having to justify a chatbot’s output or of missing a mistake.

After doing that clustering, I wrote the grade of each student in its own cluster and I was shocked by how coherent it was. Note: grades are between 0 and 20, with 10 being the minimum grade to pass the class.

The "personal preference" students were all between 15 and 19, which makes them very good students, without exception! The "proud" students were all above 17!

The "never use" was composed of middle-ground students around 13 with one outlier below 10.

The pragmatics were in the same vein but a bit better: they were all between 12 and 16 without exceptions.

The heavy users were, by far, the worst. All students were between 8 and 11, with only one exception at 16.

This is, of course, not an unbiased scientific experiment. I didn’t expect anything. I will not make any conclusion. I only share the observation.

But Some Do

Of 60 students, only 3 decided to use chatbots. This is not very representative, but I still learned a lot because part of the constraints was to show me how they used chatbots. I hoped to learn more about their process.

The first chatbot student forgot to use it. He did the whole exam and then, at the end, told me he hadn’t thought about using chatbots. I guess this put him in the "pragmatic" group.

The second chatbot student asked only a couple of short questions to make sure he clearly understood some concepts. This was a smart and minimal use of LLMs. The resulting exam was good. I’m sure he could have done it without a chatbot. The questions he asked were mostly a matter of improving his confidence in his own reasoning.

This reminded me of a previous-year student who told me he used chatbots to study. When I asked how, he told me he would tell the chatbot to act as the professor and ask exam questions. As a student, this allowed him to know whether he understood enough. I found the idea smart but not groundbreaking (my generation simply used previous years’ questions).

The third chatbot-using student had a very complex setup where he would use one LLM, then ask another unrelated LLM for confirmation. He had walls of text that were barely readable. When glancing at his screen, I immediately spotted a mistake (a chatbot explaining that "Sepia Search is a compass for the whole Fediverse"). I asked if he understood the problem with that specific sentence. He did not. Then I asked him questions for which I had seen the solution printed in his LLM output. He could not answer even though he had the answer on his screen.

But once we began a chatbot-less discussion, I discovered that his understanding of the whole matter was okay-ish. So, in this case, chatbots disserved him heavily. He was totally lost in his own setup. He had LLMs generate walls of text he could not read. Instead of trying to think for himself, he tried to have chatbots pass the exam for him, which was doomed to fail because I was asking him, not the chatbots. He passed but would probably have fared better without chatbots.

Can chatbots help? Yes, if you know how to use them. But if you do, chances are you don’t need chatbots.

A Generational Fear of Cheating

One clear conclusion is that the vast majority of students do not trust chatbots. If they are explicitly made accountable for what a chatbot says, they immediately choose not to use it at all.

One obvious bias is that students want to please the teacher, and I guess they know where I am on this spectrum. One even told me: "I think you do not like chatbots very much so I will pass the exam without them" (very pragmatic of him).

But I also minimized one important generational bias: the fear of cheating. When I was a student, being caught cheating was a clear zero for the exam. You could, in theory, be expelled from university for aggravated cheating, whatever "aggravated" could mean.

During the exam, a good number of students called me panicked because Google was forcing autogenerated answers and they could not disable it. They were very worried I would consider this cheating.

First, I realized that, like GitHub, Google has a 100% market share, to the point students don’t even consider using something else a possibility. I should work on that next year.

Second, I learned that cheating, however lightly, is now considered a major crime. It might result in the student being banned from any university in the country for three years. Discussing exam with someone who has yet to pass it might be considered cheating. Students have very strict rules on their Discord.

I was completely flabbergasted because, to me, discussing "What questions did you have?" was always part of the collaboration between students. I remember one specific exam where we gathered in an empty room and we helped each other before passing it. When one would finish her exam, she would come back to the room and tell all the remaining students what questions she had and how she solved them. We never considered that "cheating" and, as a professor, I always design my exams hoping that the good one (who usually choose to pass the exam early) will help the remaining crowd. Every learning opportunity is good to take!

I realized that my students are so afraid of cheating that they mostly don’t collaborate before their exams! At least not as much as what we were doing.

In retrospect, my instructions were probably too harsh and discouraged some students from using chatbots.

Stream of Consciousness

My 2025 banana student!
My 2025 banana student!

Another innovation I introduced in the 2026 exam was the stream of consciousness. I asked them to open an empty text file and keep a stream of consciousness during the exam. The rules were the following:

In this file, please write all your questions and all your answers as a "stream of consciousness." This means the following rules:

1. Don’t delete anything.
2. Don’t correct anything.
3. Never go backward to retouch anything.
4. Write as thoughts come.
5. No copy/pasting allowed (only exception: URLs)
6. Rule 5. implies no chatbot for this exercice. This is your own stream of consciousness.

Don’t worry, you won’t be judged on that file. This is a tool to help you during the exam. You can swear, you can write wrong things. Just keep writing without deleting. If you are lost, write why you are lost. Be honest with yourself.

This file will only be used to try to get you more points, but only if it is clear that the rules have been followed.

I asked them to send me the file within 24h after the exam. Out of 60 students, I received 55 files (the remaining 5 were not penalized). There was also a bonus point if you sent it to the exam git repository using git-send-email, something 24 managed to do correctly.

The results were incredible. I did not read them all but this tool allowed me to have a glimpse inside the minds of the students. One said: "I should have used AI, this is the kind of question perfect for AI" (he did very well without it). For others, I realized how much stress they had but were hiding. I was touched by one stream of consciousness starting with "I’m stressed, this doesn’t make any sense. Why can’t we correct what we write in this file" then, 15 lines later "this is funny how writing the questions with my own words made the problem much clearer and how the stress start to fade away".

And yes, I read all the failed students and managed to save a bunch of them when it was clear that they, in fact, understood the matter but could not articulate it well in front of me because of the stress. Unfortunately, not everybody could be saved.

Conclusion

My main takeaway is that I will keep this method next year. I believe that students are confronted with their own use of chatbots. I also learn how they use them. I’m delighted to read their thought processes through the stream of consciousness.

Like every generation of students, there are good students, bad students and very brilliant students. It will always be the case, people evolve (I was, myself, not a very good student). Chatbots don’t change anything regarding that. Like every new technology, smart young people are very critical and, by defintion, smart about how they use it.

The problem is not the young generation. The problem is the older generation destroying critical infrastructure out of fear of missing out on the new shiny thing from big corp’s marketing department.

Most of my students don’t like email. An awful lot of them learned only with me that Git is not the GitHub command-line tool. It turns out that by imposing Outlook with mandatory subscription to useless academic emails, we make sure that students hate email (Microsoft is on a mission to destroy email with the worst possible user experience).

I will never forgive the people who decided to migrate university mail servers to Outlook. This was both incompetence and malice on a terrifying level because there were enough warnings and opposition from very competent people at the time. Yet they decided to destroy one of the university’s core infrastructures and historical foundations (UCLouvain is listed by Peter Salus as the very first European university to have a mail server, there were famous pioneers in the department).

By using Outlook, they continue to destroy the email experience. Out of 55 streams of consciousness, 15 ended in my spam folder. All had their links destroyed by Outlook. And university keep sending so many useless emails to everyone. One of my students told me that they refer to their university email as "La boîte à spams du recteur" (Chancellor’s spam inbox). And I dare to ask why they use Discord?

Another student asked me why it took four years of computer engineering studies to get a teacher explaining to them that Git was not GitHub and that GitHub was part of Microsoft. He had a distressed look: "How could I have known? We were imposed GitHub for so many exercises!"

Each year, I tell my students the following:

It took me 20 years after university to learn what I know today about computers. And I’ve only one reason to be there in front of you: be sure you are faster than me. Be sure that you do it better and deeper than I did. If you don’t manage to outsmart me, I will have failed.

Because that’s what progress is about. Progress is each generation going further than the previous one while learning from the mistakes of olders. I’m there to tell you about my own mistakes and the mistakes of my generation.

I know that most of you are only there to get a diploma while doing the minimal required effort. Fair enough, that’s part of the game. Challenge accepted. I will try to make you think even if you don’t intend to do it.

In earnest, I have a lot of fun teaching, even during the exam. For my students, the mileage may vary. But for the second time in my life, a student gave me the best possible compliment:

— You know, you are the only course for which I wake up at 8AM.

To which I responded:

– This is reciprocal. I hate waking up early, except to teach in front of you.

About the author

I’m Ploum, a writer and an engineer. I like to explore how technology impacts society. You can subscribe by email or by rss. I value privacy and never share your adress.

I write science-fiction novels in French. For Bikepunk, my new post-apocalyptic-cyclist book, my publisher is looking for contacts in other countries to distribute it in languages other than French. If you can help, contact me!

Read the whole story
mrmarchant
2 days ago
reply
Share this story
Delete
Next Page of Stories