IETF 127 · HotRFC

CroakOS: Engineering Impacts of a Distributed Operating System.

CroakOS is a distributed operating system. It gives the machines on a network, at one site or across the Internet, one shared memory and one scheduler, so a distributed program is written as one program: each part writes the facts it owns and waits on the facts it needs. Discovery, routing, the encrypted overlay, roles, naming, and recovery after a split are the operating system’s job, not the application’s. Existing systems are converted by keeping their API as the contract and their own tests as the judge, and removing the plumbing in between.

The talk

Slides and the speaker’s notes.

The notes are the full text of what was said.

The results reported

Each one measured against the system it replaces.

Code and complexity are from matched audits: the same tool and rules applied to both sides.

resultagainst
PyTorch, the backend convertedlevel with gloo, the same results; 66% less code, 47% less complexitystock PyTorch v2.15.0 with gloo
PyTorch, the training rewritten329× at batch 64, 5.5× at batch 4096, the same held-out loss; the data moves to the fastest machine instead of gradients moving between all of themstock DDP with gloo, the same five-node Internet mesh
lispers.net as Ribbit-LISP17× lookups, 7.9× registrations; 68% less code, 41% less complexitylispers.net 0.643, over the Internet
OpenEOCteams keep logging through a cut and the logs rejoin by themselves 7–8 s after the link returnsOpenEOC’s own Report Packet
The recordthirteen systems built or converted, each with its oracle and its code
The source

Open source, GPL-2.0-only.

One command runs the whole machine in the simulator on a single Linux computer.

What you can get today

Available, demonstrated, offered as a service, or proposed.

whathow
AvailableCroakOS and FrogNet, the node installers, the simulator, the Android app and Windows bridge, the Communicator, and the published source of the converted systemsfree software under GPL-2.0-only: download, get started; commercial licence on request
DemonstratedOpenEOC, Psychedelic FrogTorch, Ribbit-LISP, FrogTastic-RAM, Redis and Mosquitto on Ribbitbuilt, run and measured against the original; the code is in the repository. The results
Serviceconversion assessments, conversions, installation and support, trainingWork with me
Proposedthe packaged family boxthe software it would run is available now
Talk to me

Bring your complexity: your interface and the tests it has to pass.