CroakOS: Engineering Impacts of a Distributed Operating System.
CroakOS is a distributed operating system. It gives the machines on a network, at one site or across the Internet, one shared memory and one scheduler, so a distributed program is written as one program: each part writes the facts it owns and waits on the facts it needs. Discovery, routing, the encrypted overlay, roles, naming, and recovery after a split are the operating system’s job, not the application’s. Existing systems are converted by keeping their API as the contract and their own tests as the judge, and removing the plumbing in between.
Slides and the speaker’s notes.
The notes are the full text of what was said.
Each one measured against the system it replaces.
Code and complexity are from matched audits: the same tool and rules applied to both sides.
| result | against | |
|---|---|---|
| PyTorch, the backend converted | level with gloo, the same results; 66% less code, 47% less complexity | stock PyTorch v2.15.0 with gloo |
| PyTorch, the training rewritten | 329× at batch 64, 5.5× at batch 4096, the same held-out loss; the data moves to the fastest machine instead of gradients moving between all of them | stock DDP with gloo, the same five-node Internet mesh |
| lispers.net as Ribbit-LISP | 17× lookups, 7.9× registrations; 68% less code, 41% less complexity | lispers.net 0.643, over the Internet |
| OpenEOC | teams keep logging through a cut and the logs rejoin by themselves 7–8 s after the link returns | OpenEOC’s own Report Packet |
| The record | thirteen systems built or converted, each with its oracle and its code |
Open source, GPL-2.0-only.
One command runs the whole machine in the simulator on a single Linux computer.
Available, demonstrated, offered as a service, or proposed.
| what | how | |
|---|---|---|
| Available | CroakOS and FrogNet, the node installers, the simulator, the Android app and Windows bridge, the Communicator, and the published source of the converted systems | free software under GPL-2.0-only: download, get started; commercial licence on request |
| Demonstrated | OpenEOC, Psychedelic FrogTorch, Ribbit-LISP, FrogTastic-RAM, Redis and Mosquitto on Ribbit | built, run and measured against the original; the code is in the repository. The results |
| Service | conversion assessments, conversions, installation and support, training | Work with me |
| Proposed | the packaged family box | the software it would run is available now |