Well, thanks to Paul, Harel, and Julian, we collected a bunch of thoughts on what happened in 2023 and more importantly what folks think might happen in 2024. These thoughts are our own and I'm sure they are wrong, but I thought it might be useful to others to find it interesting. There is a Google Slide deck that comes with it so lmk if you want it.
Of course, all of these are random opinions for entertainment only. It's not like either of us knows the future or has any deep information, but surfing the Internet makes it easy to learn what others are thinking. Here's the YouTube version, subscribe now
YouTube version is best
The audio version wherever you listen to your Podcasts:
DT5. 8 AI Diamonds for you. Insights from 2023 and 2024 Predictions - Paul, Deon & Tong
Ok, you heard it from us first, this is a summary of all the many things that happened in the AI moment of 2023. It's a huge list, but we go through 8 diamonds that are in the blizzard of Artificial Intelligence and machine learning work that has happened, plus some predictions for the future!Of course, all of these are random opinions for entertainment only. It's not like either of us knows the future or has any deep information, but surfing the Internet makes it easy to learn what others are thinking. See https://tongfamily.com/2024/03/05/pod-deon-and-tong-review-ai-and-predict-2024/ for details And some errata and apologies. Sorry, it was too much to go in and Reddit this, so what you hear is what you get. But,1. Of course we know that Andrej Karpathy's name isn't literally "St. Andrew", but having just spent a holiday in Scotland (what a place), it seemed like a small inside joke for us. Apologies Mr. Karpathy, please keep the insight coming.2. There are some terminology and "slang" I didn't get quite right. whats, one abbreviation we had was a vLLM for a Visual LLM (mainly because it doesn't fit on the slide). But to be clear (and apologies to the vLLM team), is an LLM inference and service that uses PagedAttention (hence the v is for virtual not visual) and focuses on which keys and values to store in the attention buffer, we update the slides to say viLLM to distinguish, but not here. https://blog.vllm.ai/2023/06/20/vllm.html 0:00 - Introduction01:13 - In a Nutshell: 8 Diamonds05:59 - Diamond 1: LLM as an OS14:52 - D2: It's raining LLMs!34:21 - D3: LLM Refinements1:08:13 - D4: Training Magic Show1:24:59 - D5: Programming LLMs1:31:28 - D6: Hardware Advances1:35:09 - D7: Safety, safety, safety1:36:39 - D8: Customers and Industry--- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message
DT5. 8 AI Diamonds for you. Insights from 2023 and 2024 Predictions01:50:55
RT5. Testing, testing, 1, 2, 3...03:04
PT6. AI Geeks and Happy Birthday France45:50
DT4. AI Adventurers! 2023-06-2440:02
RT1. Devindra on ChatGPT and Education in India21:16
Share this:
https://tongfamily.com/2024/03/05/pod-deon-and-tong-review-ai-and-predict-2024/
#deon