@MandyCanUDigIt
In my experience from years of raising Datura, the warning literature is always a tad hyped up in similar vein as Reefer Madness. It's very toxic, but it takes more than just a few seeds. It's a deliberate exaggeration to scare people, especially children, from trying to have a fun time with it. Fools think it's on par with magic mushrooms, then land themselves in the hospital or a casket. Same reason applies to "Touch Aconite and you'll die."
You won't, but a fool might eat it.