What can I annotate in FiftyOne? | Voxel51

What can I annotate in FiftyOne? Eric Hofesmann, founding ML engineer and product manager at Voxel51, walks through every label type you can annotate in the FiftyOne App, from segmentation masks and 3D cuboids to label schema attributes and VLM captions. In FiftyOne open source, you can annotate individual samples across bounding boxes, segmentation masks, polylines, and 3D cuboids that project into image slices. Define label schemas and ontologies with custom attributes, such as a vehicle's make. Then go further with plugins: Eric demos a custom plugin for editing captions generated by a vision-language model for a robot episode, used to refine a vision-language-action (VLA) model. This is the second video in FiftyOne Questions, a series where each video answers one question about FiftyOne and Voxel51, our enterprise offering. 📝 Read the full post, with all three videos: voxel51.com/blog/in-app-annotation-fiftyone ⏱️ Chapters 0:00 Visualize and curate on your laptop with open source 0:40 Segmentation masks with SAM in the Annotate tab 1:14 3D cuboids for autonomous vehicle perception 1:38 Label schemas, ontologies, and attributes 3:27 Custom workflows: editing VLM captions for a VLA model 4:50 Build your own annotation workflows with plugins 5:27 Scaling up: auto labeling, agents, and an annotation workforce ▶️ FiftyOne Questions Previous: How does visualization work in FiftyOne? https://youtu.be/E6xJGXIhpOM Next: How do I annotate a dataset in FiftyOne? https://youtu.be/LABk0yzGbTY 🔗 Learn more What is a label schema? https://voxel51.com/glossary/label-schema What is click-to-segment? https://voxel51.com/glossary/click-to-segment In-app annotation docs: https://docs.voxel51.com/user_guide/annotation.html FiftyOne open source: https://voxel51.com/fiftyone Voxel51 for annotation at scale: https://voxel51.com/annotation Get started: pip install fiftyone 💬 Join the community: https://community.voxel51.com FiftyOne is the open source multimodal data platform for physical AI. Voxel51 is the enterprise platform built on it, adding annotation workflows, auto labeling, GPU-backed models, and team collaboration. Together they help ML teams curate, annotate, and evaluate data for visual AI and physical AI models, across images, video, 3D, and multimodal sensor data. #FiftyOne #DataAnnotation #PhysicalAI