Efficient, Robust, and Self-Supervised Algorithm-Hardware Co-Design