Anyone know about box AI and sensitive documents? I am dubious that it is secure (or useful), but recently WashU enabled it.
After a few messaging rounds trying to get details about what the Box AI button does, the wustl IT folks sent this: "Yes, the HIPAA protections are still in place with the BOX-AI application.
Box AI securely engages an external AI provider to compute embeddings from these text chunks and the user’s question. Advanced embeddings models, such as Azure OpenAI’s ada-02, are utilized for this purpose. Let’s peek behind the curtain on this step, and see what all is done as part of Computing embeddings:
a. Secure data transfer: The embeddings computation involves an end-to-end encrypted network API call to one of Box supported AI providers (GCP, Azure, based on which AI model is being used).
b. In-memory processing: The AI provider processes the data in memory without storing any data in logs or writing it to disk, preventing any permanent record of the document. We take precautions to ensure our providers do not save the data during processing. [...]
c. Rapid processing: [...] after which the query, the answer and any context from the document is purged from the AI provider’s memory.
d. Data use assurance: AI model providers never use the customer data for training any of their models nor for logging any information."
Should I be relieved and tell my colleagues box AI is ok? Or move all our sensitive data from box?
#box #AI #boxAI #HIPAA #privacy