Personal AI agent · open source · MIT

Lives on your machine. Answers the phone.

Factor is an AI agent in a single ~15 MB file. Talk to it in the terminal, on Telegram, over the phone, or out loud across the room. It works your browser and desktop, remembers what matters, and gets back to you when the work is done.

Other builds and Go

Channels

Four ways in. One agent.

Whichever door you use, you reach the same agent, with the same tools and the same memory. Start something at your desk and hear back on your phone.

Terminal

Run factor for a chat whose prompt stays editable while it works, or factor -m for one question.

Telegram

Message it from anywhere. Only the accounts you allow get an answer.

Phone

Give it a number and it picks up. It also calls or texts you when a job lands. Twilio or Telnyx.

The room

Speak to the machine itself. Wake word or push-to-talk, and talk over it to stop it mid-word.

Grid vision

It doesn't guess pixels. It names the cell.

Vision models are bad at coordinates. So Factor lays a battleship grid over your screen, lets the model say where, zooms in, and clicks.

  1. screen_viewCaptures the screen under a lettered grid. The model answers: “Export is in D4.”
  2. screen_zoom cell=D4Magnifies that cell under a finer grid, down to about ten pixels.
  3. mouse click cell=B3Clicks the center of the cell, mapped back to real screen pixels.

The same hands drive a real browser: Chromium over DevTools where there is a screen, or Camofox, a Firefox build with a spoofed fingerprint, for sites that turn headless browsers away. Pure Go image math. No OCR, no OpenCV.

Background jobs

Hand it the slow stuff. Go do something else.

Long work runs as a background job and messages you when it lands. While it works, it tells you what it's doing. Change your mind halfway and it hears you at the next step.

  • Says what it's doing. A progress line while the tools run, never a silent minute.
  • Steer it mid-task. A second message joins the turn that's running.
  • Asks when only you know. In your chat, your terminal, or a dialog on your desktop.
  • Keeps a schedule. Cron jobs, reminders, and a heartbeat that costs nothing while idle.

Memory · smrti

Remembers what matters. Forgets the rest.

Memory is smrti, an engine that runs beside Factor on your machine. It consolidates what you tell it, lets trivia decay, and turns past failures into rules it follows. Before every turn, it recalls what is relevant.

It writes its own skills.

A task that took four or more tool calls, or two if you had to steer it, gets a second look once the session goes quiet. If it holds a workflow worth keeping, Factor writes it down and lists it next time. Most of the time the answer is SKIP. Skills you wrote stay yours.

Voice · speaker ID

It knows who's listening.

Factor reads a recording voice by voice. You keep your own conversation, and a guest it recognizes gets theirs. When someone else is in the room, it switches to a shared memory, so your private things stay private.

Speaker ID needs the local speech tier. The split covers memory; your instruction files still reach every turn.

The fine print, up front

Small, local, and straight with you.

~15 MB

One file

A single static Go binary without CGO. The wizard fetches whatever else a feature needs. It runs happily on an old Puppy Linux box.

7

Builds

Linux on x86-64, 386, ARM64 and ARMv7. macOS on Intel and Apple silicon. Windows, with an installer that needs no administrator.

0

Telemetry

Factor reports nothing home, and it switches off the telemetry of every engine, library and browser it runs.

$

Every call priced

Each model call is billed to its session, with caps you set. Run factor -p 127.0.0.1:8080 and read every prompt it sends through your own proxy.

!

Rails, not a sandbox

Workspace-restricted files, command deny-lists, sender allowlists, scrubbed secrets. They stop accidents and casual prompt injection. They are not a security boundary, and we won't pretend they are.

Install

Give it a home.

Download one file and run the wizard. It checks every step live and installs what's missing: the memory engine, a browser, your desktop's helpers.

curl -fLo factor \
  https://github.com/cyqlelabs/factor/releases/latest/download/factor-linux-amd64
chmod +x factor && mkdir -p ~/.local/bin && mv factor ~/.local/bin/
~/.local/bin/factor init

Other CPUs: arm64 · armv7 · 386

Somebody's home.