Web scheduler9/12/2023 How many new DAG runs should be created/scheduled per loop How many task instances scheduler processes in one loop How much time scheduler waits between re-parsing of the same DAG (it happens continuously) How many parsing processes you have in your scheduler Whether parsing your DAG file involves importing a lot of libraries or heavy processing at the top level how fast they can be parsed, how many tasks and dependencies they have) How large the DAG files are (remember DAG parser needs to read and parse the file every n seconds)
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |