목록개발노트/airflow (2)

오지's blog

airflow에서 sftp로 파일 여러개 다운받으려고 할때

https://sftp_multiple_files_download_operator.py/ import os from airflow.exceptions import AirflowException from airflow.models import BaseOperator # from airflow.contrib.hooks import SSHHook from airflow.providers.ssh.hooks.ssh import SSHHook from typing import Any class SFTPMultipleFilesDownloadOperator(BaseOperator): template_fields = ('local_directory', 'remote_filename_pattern', 'remote_hos..
개발노트/airflow 2024. 4. 19. 14:09
airflow에서 timezone 변경

dag_run.logical_date.astimezone(dag.timezone) date_check = PythonOperator(task_id="date_check", python_callable=date_check,dag=dag, op_kwargs={'table_name':'marketing', 'date':'{{dag_run.logical_date.astimezone(dag.timezone) | prev_ds_nodash}}'}) References https://stackoverflow.com/questions/70924756/airflow-wrong-execution-date-for-timezone-aware-dags Airflow wrong execution_date for timezone ..
개발노트/airflow 2023. 1. 27. 16:21
Prev 1 Next