๐ค HF LeRobot Hackathon Highlights ๐ค
๐ ๐ญ, ๐ฎ, ๐ฏ โฆ ๐ฐ ๐ช๐๐ก๐ก๐๐ฅ๐ฆ ! ๐๐ป๐ฐ๐น๐๐ฑ๐ถ๐ป๐ด ๐๐ต๐ฒ ๐ญ๐๐ ๐ฎ๐ป๐ฑ ๐ฏ๐ฟ๐ฑ ๐ฝ๐น๐ฎ๐ฐ๐ฒ ! ๐ซ
๐ ๐ ๐๐ก๐. ๐๐๐ข๐ช๐ก !!! ๐
We are delighted and proud to announce that ๐ฐ ๐๐ฒ๐ฎ๐บ๐ from last weekendโs Hugging Face ๐๐ฒ๐ฅ๐ผ๐ฏ๐ผ๐ ๐ช๐ผ๐ฟ๐น๐ฑ๐ช๐ถ๐ฑ๐ฒ ๐๐ฎ๐ฐ๐ธ๐ฎ๐๐ต๐ผ๐ป hosted in 42 Paris have made it to the ๐ง๐ข๐ฃ๐ฏ๐ฌ ๐ผ๐ณ ๐๐ต๐ถ๐ ๐๐ฒ๐ฎ๐ฟโ๐ ๐ฒ๐ฑ๐ถ๐๐ถ๐ผ๐ป, including the winner and 3rd place ! ๐ฆพ
After one wild day of public voting on LeRobotโs Discord, the public has finally made its decision โฆ and boy, that was tight until the end ! Thanks to the 42 community worldwide for their mobilization !
๐จโ๐ณ ๐๐ฒ๐๐ต๐ฒ๐ณ ๐ถ๐ ๐๐ต๐ถ๐ ๐๐ฒ๐ฎ๐ฟโ๐ ๐ด๐ฟ๐ฎ๐ป๐ฑ ๐๐ถ๐ป๐ป๐ฒ๐ฟ ๐ !
โ ๐๐ฒ๐ฆ๐ฝ๐น๐ฎ๐ ๐บ๐ฎ๐ป๐ฎ๐ด๐ฒ๐ฑ ๐๐ผ ๐น๐ฒ๐๐ฒ๐น ๐๐ฝ ๐๐ผ ๐๐ต๐ฒ ๐ฏ๐ฟ๐ฑ ๐ฝ๐น๐ฎ๐ฐ๐ฒ !๐ฅ
2 teams on the podium โฆ a result that goes beyond our wildest expectations ! ๐ ๐ซ
Check out the list of the 30 winning projects announced this morning and their videos ๐
The 30 Winners Video Submissions
Letโs showcase our winnersโ works !
#1 ๐ : ๐งโ๐ณ ๐๐ฒ๐๐ต๐ฒ๐ณ - ๐ฌ๐ผ๐๐ฟ ๐ฝ๐ฒ๐ฟ๐๐ผ๐ป๐ฎ๐น ๐๐ฎ๐ป๐ฑ๐๐ถ๐ฐ๐ต-๐บ๐ฎ๐ธ๐ฒ๐ฟ ! ๐ฅช
LeRobot on a linear rail system to enhance its movement, using a customized base ACT model implementing conditional logic, with an LLM-powered interface which literally allows you to talk your way to your favorite sandwich !
Huge congratulations to Thomas Gossin, Imad Sidhoum, Badr Kebrit and Leonardo Chiodi !!!
On top of the world ! ๐ ๐๐๐
#3๐ฅ: ๐๐ฒ๐ฆ๐ฝ๐น๐ฎ๐ : ๐ฏ๐-๐ด๐ฒ๐ผ๐บ๐ฒ๐๐ฟ๐ ๐ถ๐ป๐ณ๐ผ๐ฟ๐บ๐ฒ๐ฑ ๐ฑ๐ฎ๐๐ฎ ๐ฎ๐๐ด๐บ๐ฒ๐ป๐๐ฎ๐๐ถ๐ผ๐ป โ
Making the training of robot policies more robust against small camera displacements by synthesizing novel views and adding them to the dataset.
Tremendous work by Arne Vandendorpe, Jรฉrรฉmy Keusters, Jan Verheyen and Niels Rogge that will benefit the whole LeRobot ecosystem ! ๐๐๐
#13๐ : ๐๐ฒ๐๐๐ฏ๐ผ๐ฟ๐ด : ๐ฏ๐ฟ๐ฑ ๐๐ฟ๐บ ๐๐๐ฏ๐ฒ๐ฟ๐ป๐ฒ๐๐ถ๐ฐ ๐๐ป๐ต๐ฎ๐ป๐ฐ๐ฒ๐บ๐ฒ๐ป๐ ๐ฆพ
by Erwan Martin and Baptiste Lubrano Lavadera ๐๐๐
A custom dataset created using a wearable SO100 arm attached to a backpack, equipped with both a wrist camera and a context camera.
A MyoWare EMG sensor was used to record muscle activity from the user, which data was incorporated into the observation space of the robot, in order to make the robot react to the userโs muscle contractions/activity.
#23๐ : ๐๐ฒ๐๐ฎ๐ฏ : ๐ ๐ช๐ฒ๐ฏ ๐๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ ๐ณ๐ผ๐ฟ ๐๐ฒ๐ฅ๐ผ๐ฏ๐ผ๐ ๐ฅ๏ธ
by Alba Marรญa Tรฉllez Fernรกndez, Nicolas Rabault, Victor Oldensand and Adam Kadmani ๐๐๐
LeLab is a simple, user-friendly web wrapper for leRobot, designed to make physical AI accessible to everyone โ almost no terminal needed.
Contribute to the project on their HuggingFace space and make AI Robotics even more accessible to everyone using LeLab !
Photos ๐ท
Check out all the photos from the event on our new GooglePhotos space ๐
42AI HuggingFace LeRobot Hackathon Photos
Appreciation time !
Bravo for these incredible results and for your contribution to the open #AI #Robotics revolution !!! ๐ซ ๐ ๐ค ๐ฆพ
From beginners to experts, our attendees confirmed that LeRobotโs users are indeed a โvibrant community of curious mindsโ, and weโve been amazed by the passion, enthusiasm and energy our participants brought in ! ๐
But this event would not have been such a success without the presence of a few volunteering experts that spent the weekend with us and provided guidance and advises to the teams ! ๐ซถ
We would like to give a special round of applause and huge thanks to :
- Khalil MEFTAH, ML Engineer and active contributor to LeRobot GitHub repository
- Pierre-Louis Biojout and Nicolas Oulianov from our sponsor phospho (YC W24) ๐งช
- Fode Doumbouya from Zettasquare
Also, we would like to thank Hugging Face and especially LeRobot team and organization for lending us robotic arms for our students to play around with ! ๐ฆพ
We are also extremely grateful to the sponsors that made this event possible :
As a little gesture from 42 Artificial Intelligence to this amazing community, weโre happy to share with you a 3D-printable keyring of HuggingFace (Courtesy of Baptiste and Erwan) as a souvenir !
Check it out on Thingiverse ๐
3D-printable HuggingFace Keyring
Finally, a word of appreciation to the 42AI who made an incredible work into making this event the success it has been !
- Charlotte Madrangeas especially, who proposed the idea of hosting this Hackathon and made a tremendous work in finding sponsors !
- Eliot Lacroix
- Tatiana Komaristaia
- Mathieu Perez
Looking forward for the next edition ! ๐
42 Artificial Intelligence will be there again for sure ! ๐ค
Until then โฆ KEEP HACKING !!! ๐
From 42 Paris with โค๏ธ
