In case anyone else was wondering - Yes, you could absolutely misuse an AV1 video stream to make a sprite graphics engine, but it has no good compositing operations, so if you want any sort of overlapping graphics, you'd have to go uncomfortably close to actually using the format as intended.