DVC + Git LFS for Seamless Hugging Face Model and Data Versioning

DVCorg
1,182 views January 9, 2024

Peter Rowlands, member of the DVC Core Team of engineers, shows of the new integration he built with Git LFS. This integration enables any files stored with Git LFS to know easily be imported with DVC and versioned and tracked with DVC. He shows the difference in how it worked with Hugging Face models and datasets before and after the release of 3.30 when the feature was added. Now there's nothing holding you back from being able to reproduce all the great work you are doing with Hugging Face models and datasets and any other Git LFS stored files! If you'd like to learn more about how Peter and the team accomplished the integration, check out his blog post about it here: https://iterative.ai/blog/dvc-git-lfs See the release notes here: https://github.com/iterative/dvc/releases/tag/3.31.0 📌 START LEARNING DVC • 📘 Docs: https://dvc.org/doc • 🎓 Free Online Course: https://learn.dvc.org • 💻 VS Code Extension: https://marketplace.visualstudio.com/items?itemName=Iterative.dvc • 📺 Subscribe to our channel: https://www.youtube.com/@dvcorg8370?sub_confirmation=1 💬 LET'S CONNECT • GitHub: https://github.com/treeverse/dvc • Discord Community: https://dvc.org/chat • Twitter/X: https://twitter.com/DVCorg 👇 COMMENT: What part of DVC would you like us to cover next? #DataVersionControl #MLOps #MachineLearning #ReproducibleML #DVC

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close