The code here is very similar to what you would use when creating a single DAG, but it is wrapped in a function that allows for custom parameters to be passed in.įrom airflow. In this case, you're going to define a DAG template within a create_dag function. To dynamically create DAGs from a file, you need to define a Python function that will generate the DAGs based on an input parameter. In the following examples, the single-file method is implemented differently based on which input parameters are used for generating DAGs. This can cause performance issues if the total number of DAGs is large, or if the code is connecting to an external system such as a database. How frequently this occurs is controlled by the min_file_process_interval parameter.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |