@Soroush

1.6K Followers
205 Following
344 Posts

the json don

accessibility @ square

Last nameKhanlou
Twitter@khanlou
Location 📍NYC
Website 🌐https://khanlou.com
@jpsim @ole it's been a while since I've been but it's a really nice town
@jpsim @ole once we record the same video in Geneva we’ll really be cooking
@pbg da loopa?!
@mattiem no, 20x more than they currently cost. Put another way, between the chip companies, the data centers, the cloud companies, the ai labs, and the actual end user product companies, how big of a subsidy are we looking at?
@mattiem that might not stay true if token prices 10x or 20x, though. I don’t think that’s going to happen? But it is possible I would say
@mattiem I wish I had a sense for how much tech companies are spending on tokens and how they think about what a good amount to spend is

@mattiem

2. “You will get to pay them back with cheap AI hours tomorrow”: citation needed here, lol. Tokens are currently massively subsidized and it’s not clear what happens when we have to pay full rack rate. The model companies are betting that tokens get cheaper faster than their subsidies run out, but that remains to be seen!

@mattiem I’m glad you shared this, it was very thought provoking. I see two issues though:

1. The LLMs are making the debt, not reducing it. Talk to someone who has a big project written entirely by LLMs, it often has 10x more LoCs than it feels like it should have. If they’re expecting future LLMs to be able to solve this, that’s is exactly what debt is. “I’ll totally be able to pay this back later.”