# apache-airflow-providers-lamindb

> Apache Airflow provider for LaminDB: DAG runs as flows, tasks as steps, and DAGs triggered by LaminHub events.

Apache Airflow 3 provider for [LaminDB](https://lamin.ai). It records DAG runs as LaminDB flow runs and
tasks as steps, with lamindb running in a virtualenv (`@task.lamindb_venv`) or a Kubernetes pod
(`@task.lamindb_k8s`), never on the worker. Event triggers schedule DAGs on artifacts, records and branches
changing in a LaminHub-hosted instance, and deferrable sensors wait for them inside a DAG. Install with
`pip install apache-airflow-providers-lamindb` (add the `[cncf.kubernetes]` extra for `@task.lamindb_k8s`); it needs
Apache Airflow 3.3.0 or newer and lamindb 2.8.1 or newer.

## Basics

- [Home](<https://danplischke.github.io/apache-airflow-providers-lamindb/index.md>): Features, requirements and installation
- [Changelog](<https://danplischke.github.io/apache-airflow-providers-lamindb/changelog/index.md>): Changes per release

## Guides

- [LaminDB Connection](<https://danplischke.github.io/apache-airflow-providers-lamindb/connections/lamindb/index.md>): The lamindb connection type: API key, instance, LaminHub API URL, cache directory, templated connection ids
- [Lineage](<https://danplischke.github.io/apache-airflow-providers-lamindb/lineage/index.md>): DAG runs as flow runs and tasks as steps: @task.lamindb_venv, @task.lamindb_k8s, the flow operators, auto-wiring, settings, limitations
- [Triggers](<https://danplischke.github.io/apache-airflow-providers-lamindb/triggers/index.md>): Event-driven scheduling on artifacts, records and branches, delivery guarantees, cursor stores, event payloads
- [Sensors and hook](<https://danplischke.github.io/apache-airflow-providers-lamindb/sensors/index.md>): Deferrable sensors for branches, records and artifacts, and LaminDBHook
- [Filters](<https://danplischke.github.io/apache-airflow-providers-lamindb/filters/index.md>): Building LaminHub REST filters with F, the field enums and the operators

## Optional

- [Python API](<https://danplischke.github.io/apache-airflow-providers-lamindb/api/index.md>): Python API reference of the operators, decorators, triggers, sensors, hook, filters and enums