Rt-h: Action hierarchies using language
Language provides a way to break down complex concepts into digestible pieces. Recent
works in robot imitation learning use language-conditioned policies that predict actions given …
works in robot imitation learning use language-conditioned policies that predict actions given …
Droid: A large-scale in-the-wild robot manipulation dataset
The creation of large, diverse, high-quality robot manipulation datasets is an important
stepping stone on the path toward more capable and robust robotic manipulation policies. …
stepping stone on the path toward more capable and robust robotic manipulation policies. …
Hydra: Hybrid robot actions for imitation learning
Imitation Learning (IL) is a sample efficient paradigm for robot learning using expert
demonstrations. However, policies learned through IL suffer from state distribution shift at test time, …
demonstrations. However, policies learned through IL suffer from state distribution shift at test time, …
Data quality in imitation learning
In supervised learning, the question of data quality and curation has been sidelined in recent
years in favor of increasingly more powerful and expressive models that can ingest internet-…
years in favor of increasingly more powerful and expressive models that can ingest internet-…
Balancing efficiency and comfort in robot-assisted bite transfer
Robot-assisted feeding in household environments is challenging because it requires robots
to generate trajectories that effectively bring food items of varying shapes and sizes into the …
to generate trajectories that effectively bring food items of varying shapes and sizes into the …
Open x-embodiment: Robotic learning datasets and rt-x models
Large, high-capacity models trained on diverse datasets have shown remarkable successes
on efficiently tackling downstream applications. In domains from NLP to Computer Vision, …
on efficiently tackling downstream applications. In domains from NLP to Computer Vision, …
Parallel sampling of diffusion models
Diffusion models are powerful generative models but suffer from slow sampling, often taking
1000 sequential denoising steps for one sample. As a result, considerable efforts have been …
1000 sequential denoising steps for one sample. As a result, considerable efforts have been …
Training strategies for efficient embodied reasoning
Robot chain-of-thought reasoning (CoT) -- wherein a model predicts helpful intermediate
representations before choosing actions -- provides an effective method for improving the …
representations before choosing actions -- provides an effective method for improving the …
Model-based meta-reinforcement learning for flight with suspended payloads
Transporting suspended payloads is challenging for autonomous aerial vehicles because
the payload can cause significant and unpredictable changes to the robot's dynamics. These …
the payload can cause significant and unpredictable changes to the robot's dynamics. These …
Generalization through simulation: Integrating simulated and real data into deep reinforcement learning for vision-based autonomous flight
Deep reinforcement learning provides a promising approach for vision-based control of real-world
robots. However, the generalization of such models depends critically on the quantity …
robots. However, the generalization of such models depends critically on the quantity …