Prediction 2023: Self improving AI systems with synthetic data. We ain't seen nothing yet. #ai
---
RT @mathemagic1an
The 'data engine' idea of defensibility in AI may not be as defensible as we thought:
In SELF-INSTRUCT, authors get GPT-3 to generate it's *own* dataset for instruction tuning, outperforming vanilla GPT-3 and comparable to InstructGPT.
https://arxiv.org/pdf/2212.10560.pdf
Here's how 👇
https://twitter.com/mathemagic1an/status/1607384423942742019