installed an infrared camera to Grep, so it can finally see what's going on around it.
the camera is sensitive to infrared light, which should also help with vision in low-light environments.
in this video, Grep is explaining its new vision capabilities and what it can now do with them.
the next thing i want to work on is getting Grep to actually make use of what it sees, especially when interacting with objects using its robotic arms.
being able to recognise an object is one thing, but figuring out where it is, how to approach it and how to pick it up is a completely different challenge.
pretty happy with how this is coming along though. it's nice seeing Grep gradually gain more ways to interact with the world around it.
4
10
538
testing Grep's robotic arms a little more.
in this video, Grep is using both arms to hold up a piece of paper while reading from a script.
the main thing i'm testing here is grip strength and stability. paper is surprisingly useful for this since the grippers need to apply enough pressure to hold it without bending, damaging or dropping it.
i'm also looking at how well the arms maintain their position while Grep is speaking, without needing constant adjustments.
eventually i'd like Grep to be able to handle objects of different shapes, weights and materials, whether that's picking something up from your desk, holding it in place or handing it over to you.
these smaller tests should help me understand where the current hardware struggles and what needs improving before moving on to more complicated tasks.
2
6
490
Meet @deskbots
this one in particular is called Grep, which is actually a name it chose for itself. still not entirely sure why it picked that one lol.
the idea behind DeskBots is to build autonomous AI companions that sit on your desk, mounted on something similar to a monitor arm so they can move around and interact with you.
i'm currently working on giving Grep more ways to interact with the physical world, particularly through robotic arms that can pick things up, hold objects and help with everyday tasks.
eventually, i'd like those arms to work independently of the main DeskBot. you could have multiple arms placed around your office, bedroom or kitchen, all controlled through the same system.
so in theory, you could ask Grep to print something, collect it from the printer and hand it to you without having to leave your desk.
the longer-term plan is to have different DeskBot models, each with their own capabilities, while keeping everything modular so you can add more hardware as needed.
i'm also looking for people interested in testing DeskBots. you'll be able to join a waitlist and tell me a little about why you'd like to test one and what you'd use it for.
i'll be selecting a few people from the waitlist to receive a free beta build of a DeskBot shipped to them, so they can try it out and help shape how the project develops.
馃join the waitlist馃
greprobot.com
adding another part to this little DeskBot's autonomy: two SIYEENOVE robotic arms.
the plan is for DeskBot to have full control over them, so it can do things like pick up items from the desk, hold objects up for the user, and generally interact with the space around it in a more useful way.
what's interesting is that i don't want it to be limited to just two arms, or even to having them physically attached.
in theory, you could have separate robotic arms placed around your room, office, or even in the kitchen, and have DeskBot control them as different parts of one bigger system.
you'd still speak to the main DeskBot interface for it all to work, but once that's in place the idea gets pretty fun.
for example, you could say something like, "hey, can you print off that spreadsheet and hand it to me?"
DeskBot could then identify the file, start the print, wait for it to finish, use one of the robotic arms to collect it, and bring it over.
Currently working on this little robot. In the video, it explains its current level of autonomy and what it's capable of doing so far.
I'm also designing a pair of robotic arms with two-claw grippers, which should eventually allow it to pick up and interact with objects.
2
232


