My 45-Euro Phone Became the Server: Now I Direct From the Laptop
Three weeks of tiny-keyboard fatigue ended with a remote gateway: How the Hermes desktop app turned my phone into a server and my laptop into a window.
Kein fertiges Produkt und keine Hochglanz-Rückschau: Dieser Eintrag hält fest, was gebaut, getestet, verworfen und als Nächstes überprüft wird.
For three weeks I controlled my AI agent through a miniature keyboard. The device is a Google Pixel 6a with a 6-inch screen, I type with two thumbs, and for anything longer I used the phone's speech recognition. It worked – and it was exhausting. On September 21, that changed, and the change taught me something about ergonomics in one-person tech projects.
The phone was never the full workstation
The setup: a used Pixel 6a, bought for 45 euros, runs as my agent host. A Hermes agent lives there – gateway, cron jobs, memory layers, a blog. Thinking happens in the cloud, the phone orchestrates. The question nobody asks about setups like this: how do you actually control it day to day? The honest answer: with thumbs. Voice input helps for long sentences, but control commands, slugs, passwords, paths – dictating those is misery. The tiny keyboard was a bottleneck I had simply accepted as part of the deal.
The desktop app and the remote gateway
Hermes ships a desktop app that normally runs its own local agent. But it can also connect to a remote backend – a Hermes server process running on another machine. On September 21 I started that server on the phone, bound to the network interface, protected by a login. The MacBook app now connects over my home Wi-Fi directly to the phone. Setup effort: two config values, one persistent server process. The app immediately showed every session, every skill, the agent's memory – everything that lives on the phone.
The app is not a copy of the agent; it is a window. Rendering happens on the laptop, orchestration on the phone, thinking in the cloud. Nothing about that requires an expensive machine anywhere. The server process uses 199 MB of RAM and nearly zero CPU while idle – the phone barely notices the app exists.
What actually changed
First: input quality. I now write full paragraphs to the agent instead of fragments, because typing no longer hurts. Long briefings, raw blog material, correction lists – the kind of rich input that makes collaboration genuinely better. The keyboard had been silently limiting the quality of everything I sent. Second: files. I drag images directly into the app instead of photographing screens or routing through cloud services. Third: reading. A large window instead of scrolling a 6-inch screen like a hamster.
The bottleneck was the keyboard
What I did not expect: response speed. I assumed the desktop route would be slower – more hops, more layers. It is faster. The laptop renders instantly, the thinking happens in the cloud regardless, and the phone only does lightweight orchestration. My mental model had the phone as the bottleneck; in reality the phone was fine all along, and the keyboard was the constraint. Once that was gone, everything else felt faster too.
What I would tell my past self
Set up the server mode earlier. The friction I feared – security, networking, configuration – was one afternoon, not a project. The part I got right: never moving the agent off the phone. The cheap device stays the backend, the laptop is just a better door into the same house. Same memory, same skills, same quality chain, from both devices. If your agent lives on cheap hardware and you're still typing on its screen, this is the upgrade that costs nothing and changes everything.
Do I need a second agent for the desktop app?
No. The app connects to the same backend on the phone – same sessions, skills, and memory. It is a window, not a second agent.
Is exposing the backend safe?
On your home Wi-Fi with a login, yes. For access from outside, use a VPN like Tailscale instead of port forwarding.
Does the app slow down the phone?
On my Pixel 6a the server process uses about 199 MB of RAM and almost no CPU when idle. I do not notice it in daily use.
A thought that ran through my head during setup: the desktop app feels faster because of where each task actually runs. Thinking happens in the Ollama cloud regardless of where I type. Rendering happens on the laptop and is instant. The phone only orchestrates with 199 MB of RAM and almost no CPU while idle. The perceived speed comes from the right division of labor, not from a faster processor – the same principle that made the whole cheap-hardware setup work in the first place.
The second thought was cost. The connection added zero extra money: the server mode is part of the Hermes install, the MacBook already existed, and the network is my Wi-Fi. What it took was two config values and a password. The most expensive part of this upgrade was the three weeks of hesitation before I set it up. The cheap phone stays the server, the laptop is a better door – that combination is the whole trick.
One more operational detail: the server mode survives the phone's daily life. Android kills background processes aggressively, so the serve process runs under the same watchdog structure as the gateway – if it dies, it comes back automatically. Without that scaffolding the desktop connection would have been a nice experiment that died on the first battery-saving cycle. With it, the door stays open. The phone is 6 GB of RAM and it carries the gateway, the serve process, the agent runtime, and my blog pipeline with room to spare – after cleaning up a dead update process that had been hoarding over a gigabyte.
The ergonomics point deserves one honest paragraph. Three weeks of thumb-typing did not just slow me down – it changed what I asked the agent to do. Short inputs meant small tasks. Now I write full briefings, paste raw material, and ask for complete drafts, and the agent's answers got better not because it changed but because my questions did. The quality of agent collaboration is limited by the quality of what you feed it, and the feed was limited by a keyboard the size of a candy bar.
A practical note on profiles: the desktop app can hold several named gateway connections, so the same laptop can talk to multiple agent hosts – a phone here, a home server there – and switch between them in the session sidebar. Each connection keeps its own profile rail, its own sessions, and its own model defaults. That means the cheap-phone backend does not have to be your only backend forever; adding a second host later does not require redoing this setup.
And a note on what the remote gateway does not do: it does not replace the messaging channels. Telegram and Buzz keep running on the phone independently of the desktop connection. If the MacBook is offline, the agent still answers on Telegram, the crons still fire, and the community channels still get their replies. The app is additive – a better window, not a new dependency. That was the design goal from the start: more comfort without more moving parts.
Nachgebaut oder getestet?
Teile deine Erfahrung mit genau diesem Build-Log. Reviews werden vor der Veröffentlichung moderiert.
Noch keine Reviews für diesen Eintrag.
Fragen, Reaktionen und Verbesserungen werden direkt über GitHub Discussions eingebettet.
GitHub-Bereich öffnen ↗