๐Ÿ“ฆ anna-geller / packaging-prefect-flows

Examples of various flow deployments for Prefect 1.0 (storage and run configurations)

โ˜… 35 stars โ‘‚ 4 forks ๐Ÿ‘ 35 watching
๐Ÿ“ฅ Clone https://github.com/anna-geller/packaging-prefect-flows.git
HTTPS git clone https://github.com/anna-geller/packaging-prefect-flows.git
SSH git clone git@github.com:anna-geller/packaging-prefect-flows.git
CLI gh repo clone anna-geller/packaging-prefect-flows
Anna Geller Anna Geller Update README.md b442ea5 4 years ago ๐Ÿ“ History
๐Ÿ“‚ b442ea5255d631706df6ee57545fc3c500685437 View all commits โ†’
๐Ÿ“ .idea
๐Ÿ“ flow_utilities
๐Ÿ“ flows
๐Ÿ“„ .gitignore
๐Ÿ“„ commands.bash
๐Ÿ“„ Dockerfile
๐Ÿ“„ README.md
๐Ÿ“„ requirements.txt
๐Ÿ“„ setup.py
๐Ÿ“„ README.md

Working examples with various Storage and RunConfigurations

  • `flow_utilities shows custom utilities that may be reused across many flows. ## Building ECR image as shown in commands.bash ## Kubernetes Secrets for image_pull_secrets In order to get a custom image from a remote private container image repository, you need to create a Kubernetes secret object and pass it to the KubernetesRun`
Here is an example for AWS ECR: TOKEN=$(aws ecr get-login-password --region eu-central-1) kubectl create secret docker-registry aws-ecr-secret \ --docker-server=https://123456789.dkr.ecr.eu-central-1.amazonaws.com \ --docker-email=fake.email@example.com \ --docker-username=AWS \ --docker-password=$TOKEN

Note that this token is valid only for 12 hours. For production deployments, you should instead use IAM roles.