This Fall, I'm teaching a new "Hands-on Robot Learning" class at @JHUCompSci A full-stack class where students will get SO-101 robot kits, build robots out, collect data, train and deploy learned policies/WAMs/agents/etc. Materials will be posted here: hands-on-robot-learning.gith…
26
88
921
49,060
Krishna Murthy retweeted
Making it easy to shape tactile sensors for arbitrary surface geometries is really important for making these kind of sensors as ubiquitous as cameras! Where you mount sensors plays a pivotal role in how useful they are for a robot. It is even more true for tactile sensors where contact is required for signal!
Your robot's shape shouldn't limit its sense of touch. Meet OpenTac: an open ecosystem for custom tactile skins that sense normal + shear forces. Very excited about this collaborative project! Can’t wait to see what the community builds with it. 🧵👇 opentac.github.io
3
8
558
Krishna Murthy retweeted
What if you could give almost any robot a sense of touch? OpenTac is an open-source toolkit that lets you design custom tactile sensor skins for robot fingers, grippers, hands and even robot feet. Its CAD tool converts a 2D outline or 3D model into fabrication-ready flexible PCBs and 3D-printed sensor covers. The sensors detect both pressure and shear, helping robots understand when they're touching, pushing or slipping against an object. Its adaptive readout reaches 1286 partial updates per second on a 1,024-sensor array which is quite impressive. What would you build if your robot could feel?
Sharing our new work OpenTac; a tactile sensor + ecosystem that let’s you automatically design, customize, and deploy tactile skins on any robot surface! Work led by @arikslep and in collaboration with a large group of robotics faculty new-and-not-new @JohnsHopkins. This also is my first preprint since I started my faculty position @JHUCompSci @HopkinsDSAI and setup SciPhy lab this Fall. OpenTac is a piezoresistive robot skin that can accurately estimate normal and shear forces, can be adapted to sensorize any developable robot surface, and based on how sparse your contact is, adaptively readout at kilohertz-rate. All of our software, hardware, and firmware is made available under open, permissive licenses for research or commercial use. 🧵
4
16
101
4,661
Krishna Murthy retweeted
here are some new designs for tendon-based hands to arm
this was to slowly work up to them actually playing catch via one arm having a glove and the other grabbing the ball to throw at 30 feet distance you can see this PPO (sims) session fail at first then begin to succeed via 24 worlds
6
60
7,035
Krishna Murthy retweeted
Touch sensing for any part of the robot, not just the fingertips. OpenTac designs a tactile skin from a 2D outline or a 3D model and gives you the PCB files plus 3D-printed bumps. They built and tested 31 designs this way. The interesting finding is shear. For plug insertion without vision, adding normal force alone didn't help at all over proprioception. Shear is what made it work. The trick is small bumps that tilt when pushed sideways. The skins are also tough: hammered, thrown and run over by an office chair, and they still work. And a smart readout gets about 1,300 partial frames per second from a 1,024-taxel skin, vs 67 full frames with normal scanning. The repo even ships a skill, so Claude Code can design a sensor for you.
Your robot's shape shouldn't limit its sense of touch. Meet OpenTac: an open ecosystem for custom tactile skins that sense normal + shear forces. Very excited about this collaborative project! Can’t wait to see what the community builds with it. 🧵👇 opentac.github.io
2
3
20
1,373
Robotics labs that want touch sensing can now build their own. OpenTac is open source: design a tactile skin for any part of the robot, read it out, and simulate it.
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
1
3
127
ロボットの「触覚」を、様々な表面に実装できるOpenTac。 3D触覚センサーをロボットの形に合わせて設計・製造、データ取得、異なるセンサー間でのデータ共有などを支援。 ロボットごとに異なる触覚システムを構築する負担が減れば、Physical AIに大きく影響しそう。
Arik Slepyan
2
3
6
1,302
Arik Slepyan presents OpenTac, an open ecosystem for 3D tactile sensing on any robot surface: design and fabricate high-density tactile skins, read them out, simulate them and share data across sensors. Credit: @arikslep
Arik Slepyan
2
3
288
Echo the broad sentiment, but with one edit: wrapping flat tactile sensors around curved surfaces is *not* physically impossible -- it just requires clever design
Most robotic hands are completely numb because wrapping flat tactile sensors around curved geometry is physically impossible. @JohnsHopkins and @MIT just fixed this with OpenTac. This open source ecosystem automatically designs custom 3D tactile skins for any robot surface, delivering normal and shear force feedback at a blazing 1286 frames per second.
1
1
9
748
If the barriers to entry for tactile sensing for you are: - "It's too hard -- I need to have mechanical and electronic design expertise", - "Aren't the sensors usually very fragile?", - "I don't know where even to start", - "Assembling and customizing sensors is a lot of work", or - "It's very expensive. Who'd pay $500 for a fingertip sensor that wears out in a week of heavy use?" then you'll want to try OpenTac. @arikslep and team worked extra hard to ensure everything 'just works'
Replying to @robotsdigest
The hardware barrier to entry is gone. Instead of manually engineering sensor arrays, developers just upload a 3D model of their robot part into OpenTac CAD. Within three seconds, the software automatically routes a custom flexible printed circuit board and generates files for a 3D printable protective bump case, covering up to 93 percent of the target area.
2
2
22
1,612
Krishna Murthy retweeted
Amazing work by the Johns Hopkins team on tactile sensing and compliant control! Proud to support researchers pushing the boundaries of what’s possible with Physical AI through our Research Grant Program.
Replying to @_krishna_murthy
We strapped an OpenTac skin on the forearm of a @DexmateAI Vega-1 robot. We can sense external contacts and nudge the robot around by implementing a compliant controller that monitors pushes and complies with the direction of each push.
1
3
11
871
Krishna Murthy retweeted
The sensors withstand hammer strikes, stomping and office-chair loading without a change in response, and show no false response under a heat gun. The readout gain sets the range, about 0.1–10 N by default (configurable up to 60 N).
1
1
6
1,590
Krishna Murthy retweeted
We're getting better at teaching robots where things are. The next challenge is teaching them what to do when they make contact. Projects like OpenTac are helping make that feedback more accessible.
Your robot's shape shouldn't limit its sense of touch. Meet OpenTac: an open ecosystem for custom tactile skins that sense normal + shear forces. Very excited about this collaborative project! Can’t wait to see what the community builds with it. 🧵👇 opentac.github.io
1
6
28
1,403
Krishna Murthy retweeted
This is one of the best examples of robustness I have seen!!! 🤓
Replying to @arikslep
The sensors withstand hammer strikes, stomping and office-chair loading without a change in response, and show no false response under a heat gun. The readout gain sets the range, about 0.1–10 N by default (configurable up to 60 N).
1
3
877
Krishna Murthy retweeted
Replying to @_krishna_murthy
That's what you get for shipping a CAD tool and order-ready boards with the paper instead of a "code coming soon"
3
3
286
Wild! 1. We put out a preprint this afternoon. 2. It hasn't even hit arXiv yet, 3. and yet we have someone build a nontrivial design using our method by daisy-chaining multiple OpenTac sensors.
the new opentac paper from @JohnsHopkins and @MIT was released today, and its sensor skin system is already integrated into our tendon-based hands you can now implement anything from the paper in your own designs through @branvyr, wiring and all, from a one-shot prompt
3
4
31
1,742
Krishna Murthy retweeted
That clip of testing robustness is toptier. 😂
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
1
3
4
453
Krishna Murthy retweeted
Tactile sensing is one modality that struggles intensely with data scarcity. That's why, I think efforts to unify hardware across the field is very valuable for future research. Very exciting to see this! @arikslep
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
1
6
20
983
Krishna Murthy retweeted
Whole-body tactile skin with shear force is amazing! Can't wait to try this!
Your robot's shape shouldn't limit its sense of touch. Meet OpenTac: an open ecosystem for custom tactile skins that sense normal + shear forces. Very excited about this collaborative project! Can’t wait to see what the community builds with it. 🧵👇 opentac.github.io
1
7
20
1,510
Krishna Murthy retweeted
High-resolution, easy-to-make tactile sensors that measure *both normal and shear force* for any robot surface area! This is incredible @arikslep @mangahomanga
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
1
3
8
535
Krishna Murthy retweeted
Tactile sensor for any body, now open source that you can build and configure.
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
3
14
140
8,115