<h1 id="workflow">Workflow<a aria-hidden="true" class="anchor-heading icon-link" href="#workflow"></a></h1>
The usual suspects. Here's a good overview, <a href="https://ploomber.io/blog/survey/">https://ploomber.io/blog/survey/</a>. The ploober document lists the following, but it's also a sales site, so listing tools separately without opinion:
<ul>
<li><a href="https://ploomber.io">Ploomber</a></li>
<li><a href="https://airflow.apache.org">Airflow</a></li>
<li><a href="https://www.dagster.io">Dagster</a></li>
<li>DVC (Data Pipelines)</li>
<li>Elyra</li>
<li>Flyte</li>
<li>Kale</li>
<li>Kedro</li>
<li>Kubeflow pipelines</li>
<li>Luigi</li>
<li>Metaflow</li>
<li><a href="https://www.prefect.io">Prefect</a></li>
<li>Tensorflow Extended (TFX)</li>
</ul>
<a href="https://www.getdbt.com">DBT</a> is an "data transformation tool," more focused on flowing SQL and database data, but very powerful there.
<a href="https://www.nextflow.io/">Nextflow</a>, a Java tool, is especially liked in the academic research community.
Useful in the academic and research environment, we've run across <a href="https://snakemake.readthedocs.io/en/stable/index.html">SnakeMake</a>.
<a href="https://docs.ray.io/en/latest/workflows/basics.html">Ray Workflows</a> - Part of the Ray distributed compute project.
<a href="https://www.globus.org/platform/services/flows">Globus Flows</a> - Part of Globus, a research-focused data management suite.

Workflow

## Welcome

This is the root page for the Software Engineering Team's (SET) notegraph. This content is organized using [Dendron](https://www.dendron.so/).

New team member onboarding should use the checklist: [[Software Engineering Team Onboarding Checklist|admin.onboading.checklist#software-engineering-team-onboarding-checklist]]