airflow

https://www.jianshu.com/p/75c64b63122b  调研airflow

http://dockone.io/article/9364                      airflow使用

https://www.cnblogs.com/cord/p/9450910.html  airflow介绍

https://www.douban.com/note/620024057/ 生成环境使用

https://zhuanlan.zhihu.com/p/43383509   实战总结

 

python -c “from cryptography.fernet import Fernet;

print(Fernet.generate_key().decode())”

export AIRFLOW__CORE__FERNET_KEY=oNu9XwewQNyx9mAJT2vZvtm3qzPRZIWRqwk9hSVch4A=

set @@global.explicit_defaults_for_timestamp=on;

https://blog.csdn.net/jk_gome/article/details/97932222  实战

https://blog.csdn.net/frone/article/details/82659105  时间

 

mysql问题 https://www.jianshu.com/p/939eb5157e83

alter user 'root'@'localhost' identified with mysql_native_password by 'password'; 
flush privileges;

删除kafka的topics

参考:

http://www.bubuko.com/infodetail-2859810.html

https://blog.csdn.net/russle/article/details/82881297

https://blog.csdn.net/dianyueneo/article/details/37527087

https://blog.csdn.net/little_fxc/article/details/98494263

<code>

kafka-topics.sh –delete –zookeeper localhost:2181 –topic `kafka-topics.sh –list –zookeeper localhost:2181`
while read line
do
echo $line
kafka-configs.sh –zookeeper localhost:2181 –alter –entity-name $line –entity-type topics –add-config retention.ms=1000
kafka-config.sh –zookeeper localhost:2181 –alter –entity-name $line –entity-type topics -add-config cleanup.policy=delete
kafka-topics.sh –delete –zookeeper localhost:2181 –topic $line
done < /opt/tmp.topics2

</code>