Search for a command to run...
Articles tagged with #airflow
Dynamic task mapping (DTM) is a major feature that adds a lot of flexibility to how you build your DAGs. However, it does not provide infinite flexibility and break you free of being beholden to Airflow's patterns. For example, your task mappings are...
Ever wanted to actually know when an Airflow DAG Run has completed? Perhaps your use case involves this completed work being some sort of workflow dependency, or perhaps it is used in a CI/CD pipeline. I'm sure there are a myriad of possible scenario...
We bet our business around our customers being sold on running our software in their own infrastructure, rather than building a more traditional SaaS platform. Redactics is all things data management: primarily data pipelining with PII removal for te...
Airflow's PostgresOperator includes a field called parameters for providing SQL parameters for prepared statements. We wanted to use named parameters since our parameter order would vary, which meant understanding the syntax. In their provided exampl...
