mobile-use

There was this project that recently dropped open source https://github.com/minitap-ai/mobile-use I do think that kernel level access is not needed as this is some good amount of automation though I assume what apple can make do however is actually not require another laptop connected to automate your mobile but rather the npu?/gpu? inside your phone. I am surprised by why they haven't done it already.

Two months ago, my friends in AI and I asked: What if an AI could actually use a phone like a human? So we built an agentic framework that taps, swipes, types… and somehow it’s outperforming giant labs like Google DeepMind and Microsoft Research on the AndroidWorld benchmark. We were thrilled about our results until a massive lab (Zhipu AI) released its results last week to take the top spot. They’re slightly ahead, but they have an army of 50+ phds and I don't see how a team like us can compete with them, that does not seem realistic... except that they're closed source. And we decided to open-source everything. That way, even as a small team, we can make our work count. We’re currently building our own custom mobile RL gyms, training environments made to push this agent further and get closer to 100% on the benchmark. What do you think