Update README.md

This commit is contained in:
2024-01-13 17:16:15 +00:00
committed by GitHub
parent e7865b96bb
commit 33a23b38cf

View File

@@ -1,6 +1,19 @@
# Confidential DVM
The goal of this research is to create [Data Vending Machines](https://www.data-vending-machines.org/) that are capable of interacting with confidential data, preventing the provider to ever see what is being worked on and at the same time giving the user the ability to provide the DVM with contextual information or sensitive data for processing.
Currently the only way to process confidential data is to either:
- give up the privacy
- run it locally
One is potentially viable but you need access to the hardware and models, the other is just nuts. While you can process a lot of things locally on consumer hardware your needs might be bigger or just occasional where you can't build a cluster at home. The other issue is that you can't rent an algorithm (model) for one run. Confidential computing is the third way. Both parties provide their part (model & data) to an encrypted blob called a virtual machine and the owner of the data gets the encrypted result. There are still some trust assumptions to solve.
Ideally for maximum privacy you'd push the entire VM to the provider but that can be a bit heavy on the overhead, hence the exploration of solving this with confidential containers and DVMs.
## Use cases
- providing sensitive data as RAG to an LLM
- analyzing confidential data
-
## Currnet high level thinking
1) Deploy a new confidential container for each job
2) Establish secure communication channel with the user
@@ -16,7 +29,9 @@ The goal of this research is to create [Data Vending Machines](https://www.data-
5) Execute the job
- deliver the result to the user over secure channel
6) Destroy the VM
Reading materials:
## Reading materials:
- [Trusted Container Extensions for Container-based Confidential Computing ](https://arxiv.org/pdf/2205.05747.pdf)
- [Trusted execution environment](https://en.wikipedia.org/wiki/Trusted_execution_environment)
- [Confidential Containers](https://github.com/confidential-containers/)