Double-Blind AI Evals with PySyft | Full 10 Min Walkthrough

OpenMined
147 views •

In this walkthrough, you'll see how PySyft lets two parties evaluate a model without either side exposing confidential assets. What the demo covers: - Setting up a PySyft server locally - Submitting a model for evaluation without sharing weights - Running an eval dataset without revealing test cases - Reading results both parties can trust Try it yourself: https://github.com/OpenMined/PySyft **Timestamps:** 0:00 Overview 0:24 The parties 1:02 Spinning up the enclave 1:46 PySyft's peer-to-peer setup 2:43 Attesting the enclave 3:20 Benchmark owner 4:27 Model owner 6:21 Job submission + dual approval 7:40 Reading the obfuscated code 8:47 Running the final job 9:55 Results OpenMined is a non-profit foundation creating open-source technology infrastructure that helps researchers get answers from data without needing a copy or direct access. Our community of technologists is building Syft: the public network for non-public information. Learn more → www.openmined.org Supported by the OpenMined Foundation, the OpenMined Community is an online ecosystem of over 17,000 technologists, researchers, and industry professionals keen to unlock 1000x more data in every scientific field and industry. Join us on Slack → slack.openmined.org LinkedIn → www.linkedin.com/company/openmined X/Twitter → x.com/openminedorg Facebook → fb.com/openminedorg

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close