DAGraph is a visual, graph-based data tool that runs entirely in your browser; no backend, no account. Nodes range from simple arithmetic up to OLAP SQL over Parquet, and the whole graph is reactive: change an input, downstream nodes recompute.
Built in Rust, targeting WASM (and native). SQL nodes use Apache DataFusion (Arrow + Parquet); UI is Egui; data is stored in OPFS using OpenDAL. Full bundle is under 25 MB (8 MB over the wire).
Built solo, still rough in places. Happy to get into the DataFusion/WASM side, the reactive graph, or any other technical details.
Hi, I'm JC and I built DAGraph over the past few months. It is a visual, graph-based, local-first data web-app, to do computations from simple arithmetic to advanced OLAP SQL.
There's no account or sign up needed to use it. Your data stays in the browser, no upload.
Some technical aspects that might be of interest here:
- written in Rust targeting WASM with Trunk;
- Apache DataFusion for SQL engine + Arrow + Parquet;
- Apache OpenDAL for OPFS for workspace data in browser;
- Egui, an immediate mode GUI (works on WASM and native);
- computation graph is built on top of 'reactive_graph', a core component of the Leptos web framework;
- it's a dynamic functional DAG (directed acyclic graph), dependencies between nodes are determined by the engine (via SQL parsing). Modify an input and the downstream output are recomputed dynamically.
It's still very early - many more features are to be added but it's usable.
It requires a modern browser (WASM and OPFS); works on desktop, tablet and phone although a bigger screen is really recommended (zooming out will allow for higher density UI to make it somewhat usable on phones).
To give a bit of context on some of the choices and possibly start discussions, in no particular order:
- dynamic UIs, graphs and analytics: it's a domain I've been interested in. Bret Victor is an inspiration;
- while working on data analytics projects using popular languages and their libraries, I would run into inconsistent APIs and I would eventually end up doing most of the work in SQL. Quite annoying are the platforms that have their own sub-par DSLs (don't get me started on DSLs built on top of YAML);
- immediate mode is an interesting approach to UIs worth experimenting with.
- in-browser app: instead of scaling up, you have to optimize down. The WASM bundle is less than 25MB, 8MB over the wire.
- Local-first: 4-fold: no account needed (it puts me off if I have to create an account when it's clearly not needed); data privacy (both for the user and for dev); as a solo-dev, very low infrastructure cost plus laptops are powerful enough for many workloads now; and no network latency.
DAGraph is a local-first reactive DAG for analytical SQL (OLAP), running entirely in the browser (there is also a native version in the works).
Some tech details: written in Rust, targeting WASM (and native). The SQL engine is Apache DataFusion[1]. The UI uses Egui[2]. Workspace data is persisted in browser using OPFS[3] via OpenDAL[4]. The graph is functional and handles dependencies for you (via parsing the SQL).
Building this to be accessible for beginners while remaining powerful for advanced users. Still very early, lots more features to add, but now usable.
Built in Rust, targeting WASM (and native). SQL nodes use Apache DataFusion (Arrow + Parquet); UI is Egui; data is stored in OPFS using OpenDAL. Full bundle is under 25 MB (8 MB over the wire).
Built solo, still rough in places. Happy to get into the DataFusion/WASM side, the reactive graph, or any other technical details.
reply