일 | 월 | 화 | 수 | 목 | 금 | 토 |
---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | 6 | 7 |
8 | 9 | 10 | 11 | 12 | 13 | 14 |
15 | 16 | 17 | 18 | 19 | 20 | 21 |
22 | 23 | 24 | 25 | 26 | 27 | 28 |
29 | 30 |
- 신종코로나
- red hearse
- cnn
- 중국외교부
- 미중
- 조현병
- 필리핀사망
- 최성재
- sharonchoi
- 봉준호감독통역
- 전염병
- 웨일즈
- 우한코로나바이러스
- 치앙마이
- 우한 코로나
- 우한
- 코로나바이러스
- Bolton
- 코로나
- 확진자수
- 정은경 본부장님
- 우한코로나
- 봉준호감독통역사
- 어서와한국은처음이지
- 창궐
- 진짜영웅
- wuhan
- 코로나19
- parasite
- everybody wants you
- Today
- Total
목록개발노트 (96)
오지's blog
connection_args = {"user":SNOWFLAKE_IMED_DB_USER ,"private_key":pkb ,"account":SNOWFLAKE_IMED_DB_HOST ,"warehouse":'GCIMED_WH' ,"database":'GCIMED_DB' ,"schema":'DM'}with snow.connect(**connection_args) as conn:
import datetimefrom pytz import UTCoriginal_time = datetime.datetime(1970, 1, 1, 0, 0, 0, tzinfo=UTC).timestamp()now = datetime.datetime.now().timestamp()
JDBC;DRIVER={net.snowflake.client.jdbc.SnowflakeDriver};URL={jdbc:snowflake://xxx.ap-northeast-2.aws.snowflakecomputing.com/?user=xx&password=xxx&warehouse=xxx&db=xx&schema=DM&private_key_file=/app/mstr/MicroStrategy/keys/xx.p8&private_key_pwd=xxx};CLIENT_PREFETCH_THREADS=10;fetchsize=160; 아래로 변경 JDBC;DRIVER={net.snowflake.client.jdbc.SnowflakeDriver};URL={jdbc:snowflake://xxx.ap-northeast-2.aws..
ip를 추가해도 접속이 안되서 알아보니 vpc의 라우팅테이블에도 추가해야 한다.
https://sftp_multiple_files_download_operator.py/ import os from airflow.exceptions import AirflowException from airflow.models import BaseOperator # from airflow.contrib.hooks import SSHHook from airflow.providers.ssh.hooks.ssh import SSHHook from typing import Any class SFTPMultipleFilesDownloadOperator(BaseOperator): template_fields = ('local_directory', 'remote_filename_pattern', 'remote_hos..
SELECT REG_DATE FROM ( SELECT DISTINCT(REPLACE(SUBSTR(CNSL_REG_TME, 1, 10), '-', '')) AS REG_DATE FROM GCWB_WDB.ODS.O_CS_CNSL_HST ) ORDER BY REG_DATE DESC; 하나씩 풀어간다
result = engine.execute(f"SELECT TABLE_NAME FROM information_schema.TABLES WHERE ENGINE LIKE '%InnoDB%' AND TABLE_TYPE='BASE TABLE';").fetchone() ValueError: unsupported format character 'I' (0x49) at index 69 에러 발생 % 대신 %%으로 수정하여 해결 result = engine.execute(f"SELECT TABLE_NAME FROM information_schema.TABLES WHERE ENGINE LIKE '%%InnoDB%%' AND TABLE_TYPE='BASE TABLE';").fetchone()
df = pd.read_sql_query(sql = sql, con = mysql_conn) AttributeError: 'OptionEngine' object has no attribute 'execute' 다음과 같이 변경 필요 df = pd.read_sql_query(sql = text(sql), con = mysql_conn.connect()) reference. https://levelup.gitconnected.com/how-to-fix-attributeerror-optionengine-object-has-no-attribute-execute-in-pandas-eb635fbb89e4 How to Fix AttributeError: ‘OptionEngine’ object has no attrib..
sf_hook = SnowflakeHook(snowflake_conn_id="SNOWFLAKE_CONN_ID") sql = f"SELECT DISTINCT(REPLACE(SUBSTR({date_column_name}, 1, 10),'-', '')) FROM {table_name} WHERE SUBSTR({date_column_name}, 1, 10)='{yesterday.strftime(date_string)}';" conn = sf_hook.get_conn() cursor = conn.cursor() cursor.execute(sql) result = cursor.fetchone() 참고 https://stackoverflow.com/questions/53565834/fetch-results-from-..
s3의 특정버킷내 stackoverflow를 보면서 아름다운 코드를 발견하여 이에 기록하게 되었다. https://stackoverflow.com/questions/45375999/how-to-download-the-latest-file-of-an-s3-bucket-using-boto3 How to download the latest file of an S3 bucket using Boto3? The other questions I could find were refering to an older version of Boto. I would like to download the latest file of an S3 bucket. In the documentation I found that there is..