DAG Graph Pagination #159
Description
Hey @dominikbraun
First, thanks again for writing this library, its been incredibly helpful in my Fasten Health project!
I know that this might not be a common use-case, but we're creating a massive DAG containing references to every single medical record associated with a patient. In some cases this can get to be 10,000s of records. Thankfully this can still be done in a couple of seconds, so its still reasonable to generate the DAG just-in-time.
Because of the way we display the expanded data to the user, we need to paginate the results.
Currently we do the following:
- populate the DAG using references.
- inflate the root vertices in the DAG (do DB queries for the full data, instead of just the reference/id information)
- sort the root vertices (for consistency when paginating)
- determine the page window (selected root DAG vertices)
- inflate any descendant vertices for the selected root vertices
- return the results
This doesn't seem to be working as expected. Do you have any ideas for how we can paginate though a massive DAG?