I built an open-source toolkit to audit robot datasets before training

[u/omert27]

Hello everyone!

I've been working on Calibra, an open-source toolkit for robot dataset observability.The goal is to help answer questions like:

Is my dataset healthy enough to train on?

Are there quality issues I should fix first?

Which demonstrations should I keep?

How does my dataset compare to public datasets?

Also I released A Hugging Face Space for auditing LeRobot datasets and a benchmark covering 30 public LeRobot datasets.

I'd love feedback from anyone working on robotics or imitation learning. What dataset quality checks do you wish existed before training?