4️⃣ Streaming API

[joocer]

Replace Mabel with a streaming/batch writer and a batch reader.

This should be simpler than the Mabel codebase.

This would probably look like writing to an LSM and b-tree indexes.

This LSM could then be converted to parquet, or just kept as the native LSM. Native LSM with b-trees could be a native database functionality, and potentially used for when records are spilt to disk or Opteryx is just needs a database.