Feature Request - Dependency Chain Export

[Murry-Ovo]

It would be great to be able to enter a series of tags, actions or select 'whole project' and be able to export the dependency chain that is created for these runs.

[BenBirt]

Can you clarify how you'd like this to be exported? Is dataform compile --json sufficient?

[Murry-Ovo]

I was thinking of a more visual representation, similar to the graphical view in the run logs, however a JSON output would also be useful

[Ekrekr]

This would be a fun feature to make. CLI based text representations would be a bit ugly, because of the limits of scrolling and scaling. I think it would be better to use graphviz to create an image instead. For example:

• Add a new CLI option for --dot
• If that option is set, convert the compiled graph JSON format

  dataform/cli/index.ts

  Line 329 in c0d1a74

  const compiledGraph = await compile({

  to a dot file instead
  • A dotfile would instead like digraph { dataset.table1 -> dataset.table2 }
• If the --dot option is set, print the dot file output rather than the json output.
• Users can then use that dotfile as they wish - probably with the graphviz CLI https://graphviz.org/doc/info/command.html
  • Alternatively we could bundle graphViz in with the CLI, and make the image on demand https://github.com/ts-graphviz/node