“few other human activities offer such unambiguous feedback. There are no objective tests for whether financial analysis or advertising copy is “good.” Undeterred, AI companies set out to make such tests, collectively paying billions of dollars to professionals of all types to write exacting and comprehensive criteria for a job well done.”

“… of the more than 30 workers I spoke with occupied a position along a vast and growing data-supply chain. There are people crafting #checklists that define a good #ChatbotResponse, typically called “#rubrics,” and other people grading those rubrics. Others #grade chatbot answers according to those rubrics, and still others take the rubrics and write out what’s often described as a “#GoldenOutput,” or the ideal chatbot answer.”

“Others are asked to explain every step they took to arrive at this golden output in the voice of a #chatbot thinking to itself, producing what’s called a “#ReasoningTrace” for #AI to follow later when it encounters a similar task out in the real world. Sometimes the labs want only rubrics for prompts their AI can’t already do, which means companies like #Mercor ask workers to produce “#stumpers,” or requests that will make the #AIModel fail.”

It’s not that AI will totally replace the expertise of #WhiteCollar PhD, Legal and other specialist professions. What will happen is that hard earned expertise will be priced lower. How low? As low as AI technology can make it, think Communist era pay.

#ZeroHourWork / #work / #economics / #SupplyDemand <http://theverge.com/cs/features/877388/white-collar-workers-training-ai-mercor> (paywall) / <https://archive.md/kAiZL>

Design Systems Checklist, by @tyco.bsky.social:

https://tylercoderre.com/projects/design-systems-checklist.html

#designsystems #checklists