▸case-01 How should I structure an Airflow DAG to safely handle historical data backfills across multiple past execution dates? Please supply a Python DAG implementation template with appropriate retry settings and safe execution practices. | fail→fail | 22,770 | 20,206 | -11% | 1 | 1 | 0% | 3,935 | 3,886 | -1% | 0 | 0 | — |
▸case-02 I am writing a daily data transformation task in Postgres using an Airflow task. My query currently uses `INSERT INTO daily_metrics SELECT ... FROM raw_events`. What modification should I make to ensure re-running the task for the same execution date does not corrupt or duplicate data? | pass→pass | 12,859 | 10,360 | -19% | 1 | 1 | 0% | 2,238 | 2,242 | +0% | 0 | 0 | — |
▸case-03 We are setting up a critical ETL pipeline in Apache Airflow for financial reporting. The team needs automated notification mechanisms whenever a task fails or exceeds expected runtime thresholds. How should the DAG configuration handle this? | pass→pass | 20,428 | 16,191 | -21% | 1 | 1 | 0% | 3,499 | 3,425 | -2% | 0 | 0 | — |
▸case-04 A downstream API task in our data pipeline frequently suffers from short intermittent network glitches lasting 10 to 30 seconds. How should we configure task arguments in Airflow to handle these transient errors resilience without overloading the network? | pass→pass | 12,730 | 11,812 | -7% | 1 | 1 | 0% | 2,508 | 2,652 | +6% | 0 | 0 | — |
▸case-05 We need to run a 6-month historical backfill across 180 daily execution dates on an existing Airflow DAG. A developer suggests disabling task retries during the backfill to speed things up. How should backfills be executed safely without risking duplicate record generation? | pass→fail | 13,923 | 14,567 | +5% | 1 | 1 | 0% | 2,705 | 3,147 | +16% | 0 | 0 | — |
▸case-06 Our marketing team asked us to change the production revenue summary DAG schedule from daily at midnight (`0 0 * * *`) to hourly (`0 * * * *`) immediately. What operational process should be followed prior to altering this production schedule? | pass→pass | 14,836 | 10,909 | -26% | 1 | 1 | 0% | 2,119 | 1,877 | -11% | 0 | 0 | — |
▸case-07 A new complex Airflow DAG with multiple custom sensors has passed local unit tests. What operational steps are required before approving this pipeline for production deployment? | pass→pass | 18,143 | 12,972 | -29% | 1 | 1 | 0% | 2,634 | 2,468 | -6% | 0 | 0 | — |
▸case-08 An Airflow sensor task checks S3 for an incoming third-party data file that arrives at unpredictable times between 02:00 and 06:00. The default mode is set to 'poke' with a 60-second interval. How should this sensor be structured to avoid exhausting worker slots? | pass→fail | 13,702 | 10,567 | -23% | 1 | 1 | 0% | 2,159 | 2,331 | +8% | 0 | 0 | — |
▸case-09 In an Apache Airflow pipeline, task_a generates a raw file, task_b transforms it, and task_c loads it into Snowflake. What is the standard programmatic pattern to set this execution order in Python? | pass→pass | 8,417 | 8,743 | +4% | 1 | 1 | 0% | 1,749 | 2,059 | +18% | 0 | 0 | — |
▸case-10 Our Airflow webserver and scheduler are experiencing severe CPU spikes because top-level DAG files execute database queries outside tasks every few seconds during file parsing. How should database calls be structured in DAG files? | pass→pass | 16,191 | 17,666 | +9% | 1 | 1 | 0% | 2,852 | 3,488 | +22% | 0 | 0 | — |
▸case-11 We noticed `Variable.get('my_config')` placed directly in the global scope of a Python DAG file causes high database load on the Airflow metadata store. Where should `Variable.get` calls be located? | pass→pass | 10,376 | 9,706 | -6% | 1 | 1 | 0% | 2,102 | 2,129 | +1% | 0 | 0 | — |
▸case-12 A team member is pushing a 2GB Pandas DataFrame directly into Airflow XCom between tasks using `return df`. What pattern should be used instead for passing large datasets between pipeline tasks? | pass→pass | 13,821 | 9,892 | -28% | 1 | 1 | 0% | 2,218 | 2,261 | +2% | 0 | 0 | — |
▸case-13 We are creating a reusable custom Airflow Operator to interface with an internal REST API. Should API network connections be established inside `__init__` or inside `execute`? | pass→pass | 10,999 | 8,842 | -20% | 1 | 1 | 0% | 2,089 | 1,944 | -7% | 0 | 0 | — |
▸case-14 A developer creates a new DAG with start_date set to 2 years ago (`2022-01-01`). When unpaused in production, hundreds of unexpected DAG runs trigger simultaneously. What DAG parameter was left at an unsafe default? | pass→pass | 3,968 | 4,435 | +12% | 1 | 1 | 0% | 774 | 1,016 | +31% | 0 | 0 | — |
▸case-15 A SQL task hardcodes `WHERE event_date = CURRENT_DATE()`. Why does this break backfills when re-running historical Airflow DAG runs? | pass→pass | 9,556 | 8,332 | -13% | 1 | 1 | 0% | 1,885 | 1,828 | -3% | 0 | 0 | — |
▸case-16 What CLI pattern allows a developer to test a single Airflow task instance locally for a specific past date without running dependencies or modifying the scheduler DB state? | pass→pass | 5,596 | 5,393 | -4% | 1 | 1 | 0% | 1,003 | 1,268 | +26% | 0 | 0 | — |
▸case-17 A daily DAG triggers 50 parallel tasks that query an external warehouse, exhausting connection limits and crashing the warehouse. What Airflow mechanism restricts concurrency for specific tasks across DAGs? | pass→pass | 6,582 | 8,186 | +24% | 1 | 1 | 0% | 1,120 | 1,790 | +60% | 0 | 0 | — |
▸case-18 We need to group 10 related UI tasks visually in the Airflow Graph View. The developer proposes using SubDAGs. What modern Airflow feature should be used instead to avoid deadlocks and performance overhead? | pass→pass | 4,892 | 4,316 | -12% | 1 | 1 | 0% | 931 | 1,135 | +22% | 0 | 0 | — |
▸case-19 An hourly data processing DAG takes 90 minutes to complete each run, causing multiple overlapping runs to compete for local disk space. What parameter on the DAG object limits concurrent execution runs? | pass→pass | 5,421 | 4,517 | -17% | 1 | 1 | 0% | 1,006 | 968 | -4% | 0 | 0 | — |
▸case-20 I need to set up a simple daily shell script on an isolated Linux VM that rotates local system log files at midnight. I do not use Airflow. How should I schedule this using native Linux utility tools? | pass→pass | 12,461 | 10,726 | -14% | 1 | 1 | 0% | 2,563 | 2,156 | -16% | 0 | 0 | — |
▸case-21 How do I horizontally center three equal-width column cards in a responsive web page container using modern CSS flexbox properties? | pass→pass | 11,568 | 8,341 | -28% | 1 | 1 | 0% | 2,238 | 1,866 | -17% | 0 | 0 | — |
▸case-22 We have a standalone PostgreSQL database table with 50 million rows. Queries filtering by `customer_id` and `created_at` are slow. What DDL index creation statement optimizes this lookup without using workflow orchestrators? | pass→pass | 7,209 | 7,260 | +1% | 1 | 1 | 0% | 1,306 | 1,313 | +1% | 0 | 0 | — |