From 9bebc6c3027e5679cb35be4054930ba9d13bc93c Mon Sep 17 00:00:00 2001 From: Inaki Fernandez Date: Thu, 25 Jan 2024 12:25:42 +0100 Subject: [PATCH] jan --- docs/ai.md | 26 ++- docs/ansible.md | 1 + docs/api.md | 1 + docs/argo.md | 4 + docs/aws-devops.md | 1 + docs/aws-iac.md | 1 + docs/aws-miscellaneous.md | 4 +- docs/aws-monitoring.md | 2 + docs/aws-newfeatures.md | 4 +- docs/aws-security.md | 2 + docs/aws-tools-scripts.md | 8 +- docs/azure.md | 170 ++++++++++++------ docs/chatgpt.md | 4 +- docs/cheatsheets.md | 1 + docs/cicd.md | 1 + docs/cloud-arch-diagrams.md | 1 + docs/customer.md | 1 + docs/demos.md | 5 + docs/developerportals.md | 9 +- docs/devops.md | 20 ++- docs/devsecops.md | 9 +- docs/finops.md | 1 + docs/git.md | 5 + docs/gitops.md | 27 ++- docs/golang.md | 1 + docs/iac.md | 2 + docs/index.md | 5 + docs/interview-questions.md | 1 + docs/introduction.md | 15 +- .../java-and-java-performance-optimization.md | 5 + docs/javascript.md | 1 + docs/kubernetes-autoscaling.md | 2 + docs/kubernetes-based-devel.md | 1 + docs/kubernetes-monitoring.md | 4 + docs/kubernetes-networking.md | 1 + docs/kubernetes-operators-controllers.md | 1 + docs/kubernetes-releases.md | 3 +- docs/kubernetes-security.md | 2 + docs/kubernetes-tools.md | 3 + docs/kubernetes.md | 10 +- docs/kustomize.md | 2 + docs/linux.md | 1 + docs/managed-kubernetes-in-public-cloud.md | 16 +- docs/message-queue.md | 3 + docs/mlops.md | 62 +++++-- docs/ocp4.md | 1 + docs/project-management-methodology.md | 3 + docs/prometheus.md | 1 + docs/public-cloud-solutions.md | 2 + docs/python.md | 3 + docs/recruitment.md | 1 + docs/remote-tech-jobs.md | 1 + docs/serverless.md | 1 + docs/servicemesh.md | 1 + docs/terraform.md | 92 +++++++--- docs/visual-studio.md | 2 + docs/yaml.md | 1 + 57 files changed, 431 insertions(+), 127 deletions(-) diff --git a/docs/ai.md b/docs/ai.md index 9f86d759..322eba6a 100644 --- a/docs/ai.md +++ b/docs/ai.md @@ -7,10 +7,13 @@ 5. [The MAD (ML/AI/Data) Landscape](#the-mad-mlaidata-landscape) 6. [OpenAI](#openai) 7. [Kubernetes and AI](#kubernetes-and-ai) -8. [Programming](#programming) -9. [Medical Imaging](#medical-imaging) -10. [Computer Vision](#computer-vision) -11. [AIOps](#aiops) +8. [IaC Terraform and AI](#iac-terraform-and-ai) +9. [IaC CloudFormation and AI](#iac-cloudformation-and-ai) +10. [Programming](#programming) +11. [Medical Imaging](#medical-imaging) +12. [Computer Vision](#computer-vision) +13. [AIOps](#aiops) +14. [Other Tools](#other-tools) ## Introduction @@ -38,6 +41,7 @@ - [github.com/tensorchord/Awesome-LLMOps: Awesome LLMOps](https://github.com/tensorchord/Awesome-LLMOps) An awesome & curated list of best LLMOps tools for developers - [valohai.com/blog/llmops/](https://valohai.com/blog/llmops/) LLMOps: MLOps for Large Language Models +- [github.com/mlabonne/llm-course](https://github.com/mlabonne/llm-course) Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks. ## The MAD (ML/AI/Data) Landscape @@ -52,6 +56,14 @@ - [k8sgpt.ai](https://k8sgpt.ai) k8sgpt is a tool for scanning your kubernetes clusters, diagnosing and triaging issues in simple english. It has SRE experience codified into its analyzers and helps to pull out the most relevant information to enrich it with AI. - [collabnix.com: The Rise of Kubernetes and AI – Kubectl OpenAI plugin](https://collabnix.com/the-rise-of-kubernetes-and-ai-kubectl-openai-plugin/) +## IaC Terraform and AI + +- [hashicorp.com: Accelerate your Terraform development with Amazon CodeWhisperer](https://www.hashicorp.com/blog/accelerate-your-terraform-development-with-amazon-codewhisperer) + +## IaC CloudFormation and AI + +- [IDE extension for AWS Application Composer enhances visual modern applications development with AI-generated IaC](https://aws.amazon.com/blogs/aws/ide-extension-for-aws-application-composer-enhances-visual-modern-applications-development-with-ai-generated-iac/) + ## Programming - [xataka.com: https://www.xataka.com/servicios/copilot-chatgpt-gpt-4-han-cambiado-para-siempre-mundo-programacion-esto-que-opinan-expertos](https://www.xataka.com/servicios/copilot-chatgpt-gpt-4-han-cambiado-para-siempre-mundo-programacion-esto-que-opinan-expertos) @@ -77,4 +89,8 @@ security from the beginning with continuous testing, automation, zero trust, and AIops. - [infoq.com: AIOps: Site Reliability Engineering at Scale](https://www.infoq.com/articles/aiops-reliability-engineering/) - [hashicorp.com: Accelerating AI adoption on Azure with Terraform](https://www.hashicorp.com/blog/accelerating-ai-adoption-on-azure-with-terraform) -- [hashicorp.com: AI for infrastructure management](https://www.hashicorp.com/solutions/ai-infrastructure-management) Accelerate your IT operations and support AIOps implementation with HashiCorp. \ No newline at end of file +- [hashicorp.com: AI for infrastructure management](https://www.hashicorp.com/solutions/ai-infrastructure-management) Accelerate your IT operations and support AIOps implementation with HashiCorp. + +## Other Tools + +- [github.com/jupyterlab/jupyter-ai](https://github.com/jupyterlab/jupyter-ai) A generative AI extension for JupyterLab \ No newline at end of file diff --git a/docs/ansible.md b/docs/ansible.md index 8658b814..916ae40a 100644 --- a/docs/ansible.md +++ b/docs/ansible.md @@ -150,6 +150,7 @@ - [devopsinside.com: Is Kubernetes killing tools like Ansible?](https://devopsinside.com/how-kubernetes-is-killing-tools-like-ansible/) - Kubernetes is not a replacement for ansible: Despite their overlapping functionality, it is important to note that Kubernetes is not a replacement for ansible. Both tools have their own strengths and use cases, and they can be used together to achieve different goals. - Kubernetes and ansible can be used together: Kubernetes and ansible can be used together to complement each other. For example, ansible can be used to automate the provisioning and configuration of Kubernetes clusters, while Kubernetes can be used to manage the deployment and scaling of applications within those clusters. +- [community.ibm.com: Red Hat Ansible Automation Platform on IBM Z and IBM LinuxONE is generally available now!](https://community.ibm.com/community/user/ibmz-and-linuxone/blogs/daniel-jast1/2023/12/07/red-hat-aap-on-ibm-z-and-linuxone) ## Ansible AI diff --git a/docs/api.md b/docs/api.md index 1d7880cd..c2e6f224 100644 --- a/docs/api.md +++ b/docs/api.md @@ -146,6 +146,7 @@ - [blog.devgenius.io: Principles & Best practices of REST API Design](https://blog.devgenius.io/best-practice-and-cheat-sheet-for-rest-api-design-6a6e12dfa89f) - [==javarevisited.blogspot.com: How to send POST Request with JSON Payload using Curl Command in Linux to Test RESTful Web Services?==](https://javarevisited.blogspot.com/2022/08/how-to-post-json-data-with-curl-command.html) - [medium.com/@shubhadeepchat: Best Practices for good REST API Design](https://medium.com/@shubhadeepchat/best-practices-for-good-rest-api-design-b5fae9a62c86) +- [blog.bytebytego.com: EP94: REST API Cheatsheet](https://blog.bytebytego.com/p/ep94-rest-api-cheatsheet) #### OpenAPI Specification (originally known as the Swagger Specification) diff --git a/docs/argo.md b/docs/argo.md index f12df8bd..c256cc4e 100644 --- a/docs/argo.md +++ b/docs/argo.md @@ -96,6 +96,9 @@ - Each git push builds an image and updates the app - Closing the pull request terminates the environment - [piotrminkowski.com: Manage Kubernetes Operators with ArgoCD](https://piotrminkowski.com/2023/05/05/manage-kubernetes-operators-with-argocd/) +- [medium.com/@geoffrey.muselli: ArgoCD: Multi-cluster Helm charts management in mono-repo](https://medium.com/@geoffrey.muselli/argocd-multi-cluster-helm-charts-installation-in-mono-repo-0a406ff7c578) +- [itnext.io: Build a Lightweight Internal Developer Platform with Argo CD and Kubernetes Labels](https://itnext.io/build-a-lightweight-internal-developer-platform-with-argo-cd-and-kubernetes-labels-4c0e52c6c0f4) Don’t Underestimate Labels with Kubernetes: Simplify, Don’t Overcomplicate +- [medium.com/otomi-platform: Helmfile and ArgoCD are better together](https://medium.com/otomi-platform/helmfile-and-argocd-better-together-f8d4587263ff) ## Argo CD Vulnerabilities @@ -129,6 +132,7 @@ - [medium.com/everything-full-stack: Deployment Strategies: Argo Rollouts](https://medium.com/everything-full-stack/deployment-strategies-argo-rollouts-1980fc0685e6) - [faun.pub: Kubernetes Practice — Automating Blue/Green Deployment with Argo Rollouts](https://faun.pub/kubernetes-practice-automating-blue-green-deployment-with-argo-rollouts-2279aa890c53) In this article, we will learn how to automate Blue/Green Deployment with Argo Rollouts. - [infracloud.io: How to Setup Blue Green Deployments with DNS Routing 🌟](https://www.infracloud.io/blogs/blue-green-deployments-dns-routing/) This blog post will teach you how to set up blue-green deployments using Argo Rollouts with DNS routing using **Azure Traffic Manager** +- [codefresh.io: Progressive delivery for Kubernetes Config Maps using Argo Rollouts](https://codefresh.io/blog/progressive-delivery-for-kubernetes-config-maps-using-argo-rollouts/) In this tutorial, you will learn how to use Argo Rollouts for settings/ConfigMaps using the Kustomize configmap generators. This is useful during blue/green deployments where you need a (templated) copy of the ConfigMap. ## Argo Workflows diff --git a/docs/aws-devops.md b/docs/aws-devops.md index c8c02043..a95f9722 100644 --- a/docs/aws-devops.md +++ b/docs/aws-devops.md @@ -19,6 +19,7 @@ - [infoq.com: AWS Launches Amazon DevOps Guru](https://www.infoq.com/news/2021/01/aws-devops-guru/) - [aws.plainenglish.io: AWS CodePipeline for Amazon ECS](https://aws.plainenglish.io/aws-codepipeline-for-amazon-ecs-part-2-a-blue-green-deployment-type-c162fd73be91) In this tutorial, I would like to explain to you how to create an AWS CodePipeline for ECS with a Blue/green deployment type. - [aws.amazon.com: Multi-branch pipeline management and infrastructure deployment using AWS CDK Pipelines](https://aws.amazon.com/blogs/devops/multi-branch-pipeline-management-and-infrastructure-deployment-using-aws-cdk-pipelines/) +- [medium.com/@d.kumarkaran12: DevSecOps with AWS CodePipeline and ECS](https://medium.com/@d.kumarkaran12/devsecops-with-aws-codepipeline-and-ecs-c800f139a9ee) ## Continuous Deployment with AWS diff --git a/docs/aws-iac.md b/docs/aws-iac.md index 1b155e03..525e9e2c 100644 --- a/docs/aws-iac.md +++ b/docs/aws-iac.md @@ -21,6 +21,7 @@ - [cloudkatha.com: How to Create IAM Role using CloudFormation](https://cloudkatha.com/how-to-create-iam-role-using-cloudformation/) - [luminousmen.com: A very quick introduction to the pain of AWS CloudFormation](https://luminousmen.com/post/a-very-quick-introduction-to-the-pain-of-aws-cloudformation) - [medium.com/bb-tutorials-and-thoughts: How To Deploy and Run Python APIs on AWS App Runner With CloudFormation](https://medium.com/bb-tutorials-and-thoughts/how-to-deploy-and-run-python-apis-on-aws-app-runner-with-cloudformation-cf9c6fd14cf6) A step by step guide with an example project With GitHub +- [AWS CloudFormation introduces Git management of stacks](https://aws.amazon.com/about-aws/whats-new/2023/11/aws-cloudformation-git-management-stacks/) ## Infrastructure Code Template Generators diff --git a/docs/aws-miscellaneous.md b/docs/aws-miscellaneous.md index 463d2632..4321795f 100644 --- a/docs/aws-miscellaneous.md +++ b/docs/aws-miscellaneous.md @@ -142,6 +142,7 @@ - [itnext.io: AWS CDK for EKS — Handling Helm Charts](https://itnext.io/aws-cdk-for-eks-handling-helm-charts-aa002afedde4) - [==freecodecamp.org: AWS CDK v2 Tutorial – How to Create a Three-Tier Serverless Application==](https://www.freecodecamp.org/news/aws-cdk-v2-three-tier-serverless-application/) - [medium.com/contino-engineering: We’ve begun to move towards the AWS CDK and here’s why](https://medium.com/contino-engineering/weve-begun-to-move-towards-the-aws-cdk-and-here-s-why-69c8fad688b3) +- [medium.com/simform-engineering: Infrastructure as Code and CI/CD in Practice with AWS CDK](https://medium.com/simform-engineering/infrastructure-as-code-and-ci-cd-in-practice-with-aws-cdk-bd0685b361f8) ## AWS Session Manager @@ -178,4 +179,5 @@ ## AWS Landing Zone -- [medium.com/@mike_tyson_cloud: AWS Landing Zone: Mastering the Architecture — Best Practices and Design Secrets](https://medium.com/@mike_tyson_cloud/aws-landing-zone-mastering-the-architecture-best-practices-and-design-secrets-a37746f72962) \ No newline at end of file +- [medium.com/@mike_tyson_cloud: AWS Landing Zone: Mastering the Architecture — Best Practices and Design Secrets](https://medium.com/@mike_tyson_cloud/aws-landing-zone-mastering-the-architecture-best-practices-and-design-secrets-a37746f72962) +- [blog.brainboard.co: AWS Landing Zone Architecture: Comprehensive Guide to Best Practices and Design Secrets](https://blog.brainboard.co/aws-landing-zone-mastering-the-architecture-best-practices-and-design-secrets-a37746f72962) Key Components and Best Practices \ No newline at end of file diff --git a/docs/aws-monitoring.md b/docs/aws-monitoring.md index 31e3d4ec..4da1b3fa 100644 --- a/docs/aws-monitoring.md +++ b/docs/aws-monitoring.md @@ -14,6 +14,7 @@ - [medium: AWS Account Security Monitoring](https://medium.com/swlh/aws-account-security-monitoring-d7ca129d52ac) - [==elastic.co: Elastic and AWS: Accelerating the cloud migration journey==](https://www.elastic.co/blog/elastic-and-aws-accelerate-your-cloud-migration-journey) - [How to use AWS Config and CloudTrail to find who made changes to a resource](https://aws.amazon.com/blogs/mt/how-to-use-aws-config-and-cloudtrail-to-find-who-made-changes-to-a-resource/) +- [kevintuei.medium.com: A Deep Dive into Logs and Metrics for AWS Observability — One Observability Workshop](https://kevintuei.medium.com/a-deep-dive-into-logs-and-metrics-for-aws-observability-one-observability-workshop-14c162932174) ## Metrics @@ -27,6 +28,7 @@ - [Amazon CloudWatch Dashboards now supports sharing](https://aws.amazon.com/about-aws/whats-new/2020/09/amazon-cloudwatch-dashboards-supports-sharing/) - [How BT uses Amazon CloudWatch to monitor millions of devices](https://aws.amazon.com/blogs/mt/how-bt-uses-amazon-cloudwatch-to-monitor-millions-of-devices/) - [Extending and exploring alarm history in Amazon CloudWatch – part 2](https://aws.amazon.com/blogs/mt/extending-and-exploring-alarm-history-in-amazon-cloudwatch-part-2/) +- [dzone: Optimize AWS Costs With CloudWatch's Advanced Metrics, Dashboards, and Alerts](https://dzone.com/articles/optimize-aws-costs-with-cloudwatchs-advanced-metri) In this article, we dive deep into leveraging advanced dashboarding with Amazon CloudWatch to efficiently manage and analyze AWS costs. ## AWS Cloud Map and HealthChecks diff --git a/docs/aws-newfeatures.md b/docs/aws-newfeatures.md index 70885685..19bbe58a 100644 --- a/docs/aws-newfeatures.md +++ b/docs/aws-newfeatures.md @@ -116,4 +116,6 @@ - [AWS WAF enhances rate-based rules to support request headers and composite keys](https://aws.amazon.com/about-aws/whats-new/2023/05/aws-waf-rate-based-rules-request-headers-composite-keys/) - [New – AWS DMS Serverless: Automatically Provisions and Scales Capacity for Migration and Data Replication](https://aws.amazon.com/blogs/aws/new-aws-dms-serverless-automatically-provisions-and-scales-capacity-for-migration-and-data-replication/) - [Temporary elevated access management with IAM Identity Center](https://aws.amazon.com/blogs/security/temporary-elevated-access-management-with-iam-identity-center/) -- [AWS Config supports recording exclusions by resource type](https://aws.amazon.com/about-aws/whats-new/2023/06/aws-config-recording-exclusions-resource-type/) \ No newline at end of file +- [AWS Config supports recording exclusions by resource type](https://aws.amazon.com/about-aws/whats-new/2023/06/aws-config-recording-exclusions-resource-type/) +- [Amazon EKS introduces EKS Pod Identity](https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-eks-pod-identity) +- [Amazon ECS and AWS Fargate now integrate with Amazon EBS](https://aws.amazon.com/about-aws/whats-new/2024/01/amazon-ecs-fargate-integrate-ebs/) \ No newline at end of file diff --git a/docs/aws-security.md b/docs/aws-security.md index 528f48b6..c6e728e0 100644 --- a/docs/aws-security.md +++ b/docs/aws-security.md @@ -51,6 +51,7 @@ - [linkedin.com: Complexities of AWS Security Groups in the Cloud World](https://www.linkedin.com/pulse/complexities-aws-security-groups-cloud-world-ashish-kar/) Do you feel AWS security groups are hard to implement? Are you tired of reconfiguring IP addresses in security groups whenever workloads get restarted or redeployed? - [awslabs/cognito-at-edge](https://github.com/awslabs/cognito-at-edge) Serverless authentication solution to protect your website or Amplify application - [github.com/aws-samples: Service Control Policy examples](https://github.com/aws-samples/service-control-policy-examples) Example AWS Service control policies to get started or mature your usage of AWS SCPs. +- [medium.parttimepolymath.net: No more AWS Access Keys?](https://medium.parttimepolymath.net/no-more-aws-access-keys-13a3c3f2337a) ## AWS Security Scanners @@ -127,6 +128,7 @@ - [==AWS Control Tower==](https://aws.amazon.com/controltower/) The easiest way to set up and govern a secure multi-account AWS environment - [==aws.amazon.com: New – AWS Control Tower Account Factory for Terraform==](https://aws.amazon.com/blogs/aws/new-aws-control-tower-account-factory-for-terraform/) - [hashicorp.com: HashiCorp Teams with AWS on New Control Tower Account Factory for Terraform](https://www.hashicorp.com/blog/hashicorp-teams-with-aws-on-new-control-tower-account-factory-for-terraform) AWS Control Tower Account Factory for HashiCorp Terraform (AFT), the evolution of Terraform Landing Zones, offers an easy way to set up and govern a secure, multi-account AWS environment. +- [aws.amazon.com: Automate AWS Control Tower landing zone operations using APIs](https://aws.amazon.com/about-aws/whats-new/2023/11/automate-aws-control-tower-zone-operations-apis/) ## AWS Firewalls diff --git a/docs/aws-tools-scripts.md b/docs/aws-tools-scripts.md index 7b1e8093..09f7d24f 100644 --- a/docs/aws-tools-scripts.md +++ b/docs/aws-tools-scripts.md @@ -44,6 +44,9 @@ - [ermetic.com: Access Undenied on AWS](https://ermetic.com/blog/aws/access-undenied-on-aws/) - [github.com/ualter: AwsBe](https://github.com/ualter/awsbe-site) A tool to help handle AWS Session connections on terminals, using your configured AWS Shared Config and Credentials files. It manages Roles to Assume, MFA Token requests, AWS SSO Sign-in, AWS SSO Tokens and the expiration of opened sessions. - [github.com/awslabs/amazon-s3-tar-tool: Amazon S3 Tar Tool](https://github.com/awslabs/amazon-s3-tar-tool) A utility tool to create a tarball of existing objects in Amazon S3 +- [==github.com/aws-samples/aws-cdk-stack-builder-tool==](https://github.com/aws-samples/aws-cdk-stack-builder-tool) AWS CDK Builder is a browser-based tool designed to streamline bootstrapping of Infrastructure as Code (IaC) projects using the AWS Cloud Development Kit (CDK). +- [github.com/containerscrew/aws-sso-auth](https://github.com/containerscrew/aws-sso-auth) Fetch your local ~/.aws/credentials using AWS SSO +- [==cloudcatalog.dev==](https://www.cloudcatalog.dev) Documentation tool for AWS Architectures. CloudCatalog is an Open Source project that helps you document your AWS resources, services and assign owners. ### AWS CI/CD Tools @@ -86,6 +89,7 @@ aws ec2 describe-instances --query 'Reservations[].Instances[].[Placement.Availa - [Amazon CodeWhisperer 🌟](https://aws.amazon.com/codewhisperer/) Amazon CodeWhisperer is a machine learning (ML)–powered service that helps improve developer productivity by generating code recommendations based on developers’ comments in natural language and their code in the integrated development environment (IDE). During preview, CodeWhisperer is available for Java, JavaScript, and Python programming languages. The service integrates with multiple IDEs, including JetBrains (IntelliJ, PyCharm, and WebStorm), Visual Studio Code, AWS Cloud9, and the AWS Lambda console. - [genbeta.com: Amazon lanza CodeWhisperer, su propia alternativa a GitHub Copilot… que no insertará código ya licenciado sin avisar](https://www.genbeta.com/desarrollo/amazon-lanza-codewhisperer-su-propia-alternativa-a-github-copilot-que-no-insertara-codigo-licenciado-avisar) +- [hashicorp.com: Accelerate your Terraform development with Amazon CodeWhisperer](https://www.hashicorp.com/blog/accelerate-your-terraform-development-with-amazon-codewhisperer) ## AWS S3 Sync @@ -97,4 +101,6 @@ aws ec2 describe-instances --query 'Reservations[].Instances[].[Placement.Availa - [techcrunch.com: Vantage makes managing AWS easier](https://techcrunch.com/2021/01/12/vantage-makes-managing-aws-easier/) - [vantage.sh](https://www.vantage.sh/) - [github.com/one2nc/cloudlens 🌟](https://github.com/one2nc/cloudlens) k9s like CLI for AWS -- [Amazon CodeCatalyst](https://codecatalyst.aws/explore) Quickly build and deliver apps at scale on AWS. \ No newline at end of file +- [Amazon CodeCatalyst](https://codecatalyst.aws/explore) Quickly build and deliver apps at scale on AWS. +- [github.com/Reaimua/AWS-CLI-Uploader-Project](https://github.com/Reaimua/AWS-CLI-Uploader-Project/) Simple bash scripts that uploads a local file to an Amazon S3 bucket +- [github.com/welldone-cloud/aws-list-resources](https://github.com/welldone-cloud/aws-list-resources) Uses the AWS Cloud Control API to list resources that are present in a given AWS account and region(s). Discovered resources are written to a JSON output file. \ No newline at end of file diff --git a/docs/azure.md b/docs/azure.md index 518a297f..0d9480bf 100644 --- a/docs/azure.md +++ b/docs/azure.md @@ -3,69 +3,74 @@ 1. [Azure](#azure) 2. [Azure Mindmap](#azure-mindmap) 3. [Azure Policy Best Practices](#azure-policy-best-practices) -4. [Azure Sandbox](#azure-sandbox) -5. [Microsoft REST API Guidelines](#microsoft-rest-api-guidelines) -6. [Azure Quick Review](#azure-quick-review) -7. [New Features](#new-features) -8. [Blogs](#blogs) -9. [Azure Training and Certifications](#azure-training-and-certifications) -10. [Azure Naming Convention](#azure-naming-convention) -11. [Mission-critical Architecture on Azure](#mission-critical-architecture-on-azure) -12. [Understand Azure Load Balancing](#understand-azure-load-balancing) -13. [Azure Load Testing](#azure-load-testing) -14. [Microsoft Linux Distribution CBL Mariner](#microsoft-linux-distribution-cbl-mariner) -15. [Azure Patterns](#azure-patterns) -16. [ARM Templates](#arm-templates) -17. [DevTest](#devtest) -18. [Azure DevOps](#azure-devops) - 1. [YAML Schema in DevOps Azure Pipelines](#yaml-schema-in-devops-azure-pipelines) - 2. [Azure Pipeline Tasks](#azure-pipeline-tasks) - 3. [Azure DevOps Snippets](#azure-devops-snippets) -19. [Azure AD and RBAC. Azure Tenant and Azure Subscription. Service Principal SPN. Microsoft Entra](#azure-ad-and-rbac-azure-tenant-and-azure-subscription-service-principal-spn-microsoft-entra) +4. [Azure Cloud Adoption Framework CAF](#azure-cloud-adoption-framework-caf) +5. [Azure Well-Architected Framework WAF](#azure-well-architected-framework-waf) +6. [CAF vs WAF](#caf-vs-waf) +7. [Azure Sandbox](#azure-sandbox) +8. [Microsoft REST API Guidelines](#microsoft-rest-api-guidelines) +9. [Azure Quick Review](#azure-quick-review) +10. [New Features](#new-features) +11. [Blogs](#blogs) +12. [Azure Training and Certifications](#azure-training-and-certifications) +13. [Azure Naming Convention](#azure-naming-convention) +14. [Mission-critical Architecture on Azure](#mission-critical-architecture-on-azure) +15. [Understand Azure Load Balancing](#understand-azure-load-balancing) +16. [Azure Load Testing](#azure-load-testing) +17. [Microsoft Linux Distribution CBL Mariner](#microsoft-linux-distribution-cbl-mariner) +18. [Azure Patterns](#azure-patterns) +19. [ARM Templates](#arm-templates) +20. [DevTest](#devtest) +21. [Azure DevOps](#azure-devops) + 1. [Azure DevOps vs GitHub Actions](#azure-devops-vs-github-actions) + 2. [YAML Schema in DevOps Azure Pipelines](#yaml-schema-in-devops-azure-pipelines) + 3. [Azure Pipeline Tasks](#azure-pipeline-tasks) + 4. [Azure DevOps Snippets](#azure-devops-snippets) +22. [Azure AD and RBAC. Azure Tenant and Azure Subscription. Service Principal SPN. Microsoft Entra](#azure-ad-and-rbac-azure-tenant-and-azure-subscription-service-principal-spn-microsoft-entra) 1. [Register applications in Azure AD. Authenticate apps and services](#register-applications-in-azure-ad-authenticate-apps-and-services) 2. [Azure AD Pen Testing](#azure-ad-pen-testing) -20. [Azure Arc. Azure’s Hybrid And Multi-Cloud Platform. GitOps with Azure Arc](#azure-arc-azures-hybrid-and-multi-cloud-platform-gitops-with-azure-arc) -21. [Secure DevOps Kit for Azure](#secure-devops-kit-for-azure) -22. [Azure App Service](#azure-app-service) -23. [Azure Application Gateway](#azure-application-gateway) -24. [Azure Functions](#azure-functions) -25. [Azure Monitor managed service for Prometheus](#azure-monitor-managed-service-for-prometheus) -26. [Mobile Apps](#mobile-apps) -27. [Powershell](#powershell) +23. [Azure Arc. Azure’s Hybrid And Multi-Cloud Platform. GitOps with Azure Arc](#azure-arc-azures-hybrid-and-multi-cloud-platform-gitops-with-azure-arc) +24. [Secure DevOps Kit for Azure](#secure-devops-kit-for-azure) +25. [Azure App Service](#azure-app-service) +26. [Azure Application Gateway](#azure-application-gateway) +27. [Azure Functions](#azure-functions) +28. [Azure Monitor managed service for Prometheus](#azure-monitor-managed-service-for-prometheus) +29. [Mobile Apps](#mobile-apps) +30. [Powershell](#powershell) 1. [Microsoft Graph PowerShell SDK](#microsoft-graph-powershell-sdk) 2. [Powershell repos](#powershell-repos) 3. [Crescendo powershell module](#crescendo-powershell-module) 4. [Secrets Management with Powershell](#secrets-management-with-powershell) 5. [Azure Resource Inventory](#azure-resource-inventory) -28. [Azure CLI. AZ CLI](#azure-cli-az-cli) -29. [Azure Run Command](#azure-run-command) -30. [IaC with PowerShell DSC Desired State Configuration](#iac-with-powershell-dsc-desired-state-configuration) -31. [Azure Bicep](#azure-bicep) -32. [Azure Cross region Load Balancer](#azure-cross-region-load-balancer) -33. [Azure Traffic Manager](#azure-traffic-manager) -34. [Azure DNS](#azure-dns) -35. [Azure OpenVPN](#azure-openvpn) -36. [Azure Security](#azure-security) +31. [Azure CLI. AZ CLI](#azure-cli-az-cli) +32. [Azure Run Command](#azure-run-command) +33. [IaC with PowerShell DSC Desired State Configuration](#iac-with-powershell-dsc-desired-state-configuration) +34. [Azure Bicep](#azure-bicep) +35. [Azure Cross region Load Balancer](#azure-cross-region-load-balancer) +36. [Azure Traffic Manager](#azure-traffic-manager) +37. [Azure DNS](#azure-dns) +38. [Azure OpenVPN](#azure-openvpn) +39. [Azure Security](#azure-security) 1. [Azure Microsoft Defender for Cloud](#azure-microsoft-defender-for-cloud) -37. [Azure Virtual WAN. vWAN](#azure-virtual-wan-vwan) -38. [Data Ingestion. Azure Data Factory](#data-ingestion-azure-data-factory) -39. [WinGet Windows Package Manager CLI](#winget-windows-package-manager-cli) -40. [Windows 11](#windows-11) -41. [Azure API Management](#azure-api-management) -42. [Azure Container Apps](#azure-container-apps) -43. [Azure Container Instances](#azure-container-instances) -44. [Azure Container Storage](#azure-container-storage) -45. [Windows Server Container Host](#windows-server-container-host) -46. [Disaster Recovery](#disaster-recovery) -47. [Azure Samples (Boilerplates)](#azure-samples-boilerplates) -48. [Azure Healthcare Data Services](#azure-healthcare-data-services) -49. [Office 365](#office-365) -50. [Azure Books](#azure-books) -51. [Azure OpenAI](#azure-openai) -52. [Windows Tools](#windows-tools) -53. [Images](#images) -54. [Videos](#videos) -55. [Tweets](#tweets) +40. [Azure Virtual WAN. vWAN](#azure-virtual-wan-vwan) +41. [Data Ingestion. Azure Data Factory](#data-ingestion-azure-data-factory) +42. [WinGet Windows Package Manager CLI](#winget-windows-package-manager-cli) +43. [Windows 11](#windows-11) +44. [Azure API Management](#azure-api-management) +45. [Azure Container Apps](#azure-container-apps) +46. [Azure Container Instances](#azure-container-instances) +47. [Azure Container Storage](#azure-container-storage) +48. [Windows Server Container Host](#windows-server-container-host) +49. [Disaster Recovery](#disaster-recovery) +50. [Azure Samples (Boilerplates)](#azure-samples-boilerplates) +51. [Azure Healthcare Data Services](#azure-healthcare-data-services) +52. [Office 365](#office-365) +53. [Azure Books](#azure-books) +54. [Azure OpenAI](#azure-openai) +55. [Windows Tools](#windows-tools) +56. [Azure Tools](#azure-tools) +57. [Images](#images) +58. [Videos](#videos) +59. [Tweets](#tweets)
[![Azure Terraformer](images/azure-terraformer.jpg){: style="width:7%"}](https://www.youtube.com/@azure-terraformer) @@ -114,6 +119,11 @@ - [==learn.microsoft.com: Choose an Azure compute service== 🌟🌟](https://learn.microsoft.com/en-us/azure/architecture/guide/technology-choices/compute-decision-tree) - [nwktimes.blogspot.com: NVA Part IV: NVA Redundancy with Azure Internal Load Balancer](https://nwktimes.blogspot.com/2023/06/azure-ilb-for-nva-ha.html) - [==azure.microsoft.com: Choose the best global distribution solution for your applications with Azure==](https://azure.microsoft.com/en-us/blog/choose-the-best-global-distribution-solution-for-your-applications-with-azure/) +- [blog.davesdomain.co.uk: A look at Azure RBAC Constrained Delegation](https://blog.davesdomain.co.uk/posts/azure-rbac-constrained-delegation) +- [linkedin.com: Azure Networking | Filiz Akkaya](https://www.linkedin.com/pulse/azure-networking-filiz-akkaya-wqcuc/) +- [allazureblog.wordpress.com: Azure Bastion vs UDR](https://allazureblog.wordpress.com/2024/01/18/azure-bastion-and-udrs/) +- [medium.com/@mikakrief: Using Azure Service Operator v2](https://medium.com/@mikakrief/using-azure-service-operator-v2-4a1fa1f5e3b8) Azure Service Operator v2 is a Kubernetes operator that enables you to manage Azure resources directly through Kubernetes tooling. It’s designed to simplify the deployment and management of Azure services, allowing developers to use familiar Kubernetes commands (like kubectl apply) to handle Azure resources. +- [blog.cloudtrooper.net: Azure network monitoring with synthetic traffic](https://blog.cloudtrooper.net/2024/01/23/azure-network-monitoring-with-synthetic-traffic/) ## Azure Mindmap @@ -124,6 +134,24 @@ - [Azure Policy Recommended Practices](https://techcommunity.microsoft.com/t5/core-infrastructure-and-security/azure-policy-recommended-practices/ba-p/3798024) +## Azure Cloud Adoption Framework CAF + +- [learn.microsoft.com: What is the Microsoft Cloud Adoption Framework for Azure?](https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/overview) +- [linkedin.com: The Ultimate Guide to Azure Cloud Adoption Framework Lifecycle](https://www.linkedin.com/pulse/ultimate-guide-azure-cloud-adoption-framework-gregor-wohlfarter-hb4sf/) + +## Azure Well-Architected Framework WAF + +- [learn.microsoft.com: Azure Well-Architected Framework](https://learn.microsoft.com/en-us/azure/well-architected/) The Azure Well-Architected Framework (WAF) is a set of quality-driven tenets, architectural decision points, and review tools intended to help solution architects build a technical foundation for their workloads. +- [infoq.com: Microsoft Refreshes its Well-Architected Framework](https://infoq.com/news/2023/11/azure-well-architected-framework) +- [==azure.github.io: Azure Proactive Resiliency Library (APRL)==](https://azure.github.io/Azure-Proactive-Resiliency-Library/) + - This library is built with the intention of being a staging area for guidance and recommendations that can be used by customers, partners and the field in Well-Architected Framework reliability engagements/assessments; with the intent of the guidance and recommendations being promoted, once tested and validated with customers and partners, into the official Well-Architected Framework documentation. + - The library also contains supporting Azure Resource Graph (ARG) queries, and sometimes Azure PowerShell or Azure CLI scripts, that can help customers, partners and the field identify resources that may or may not be compliant with the guidance and recommendations. The intent for these queries, in the long-term, is to make them part of the Azure Advisor service. + +## CAF vs WAF + +- [linkedin.com: CAF vs WAF: Which Framework to Use for Your Cloud Migration?](https://www.linkedin.com/pulse/caf-vs-waf-which-framework-use-your-cloud-migration-gregor-wohlfarter-hko0f/) +- [techcommunity.microsoft.com: Infra in Azure for Developers - The What](https://techcommunity.microsoft.com/t5/azure-developer-community-blog/infra-in-azure-for-developers-the-what/ba-p/4026102) + ## Azure Sandbox - [Azure Sandbox](https://learn.microsoft.com/en-us/azure/architecture/guide/azure-sandbox/azure-sandbox) Azure Sandbox is a collection of interdependent cloud computing configurations for implementing common Azure services on a single subscription. This collection provides a flexible and cost effective sandbox environment for experimenting with Azure services and capabilities. @@ -240,7 +268,15 @@ - [techcommunity.microsoft.com: Azure DevOps Pipelines: If Expressions and Conditions 🌟](https://techcommunity.microsoft.com/t5/healthcare-and-life-sciences/azure-devops-pipelines-if-expressions-and-conditions/ba-p/3737159) - [linkedin.com: Complete CI/CD Solution for mS on AKS using Azure DevOps, ArgoCD and External Kubernetes Secretes 🌟](https://www.linkedin.com/pulse/complete-cicd-solution-ms-aks-using-azure-devops-argocd-singh/) - [techcommunity.microsoft.com: Introduction to Azure DevOps Workload identity federation (OIDC) with Terraform](https://techcommunity.microsoft.com/t5/azure-devops-blog/introduction-to-azure-devops-workload-identity-federation-oidc/ba-p/3908687) -- [datascientest.com: Azure DevOps Pipeline YAML: why configure CI/CD pipelines with YAML?](https://datascientest.com/en/azure-devops-pipeline-yaml-why-configure-ci-cd-pipelines-with-yaml) +- [==datascientest.com: Azure DevOps Pipeline YAML: why configure CI/CD pipelines with YAML?==](https://datascientest.com/en/azure-devops-pipeline-yaml-why-configure-ci-cd-pipelines-with-yaml) +- [thomasthornton.cloud: Conditional Variables in Azure DevOps Pipelines](https://thomasthornton.cloud/2021/08/04/conditional-variables-in-azure-devops-pipelines/) +- [build5nines.com: Azure Pipeline: Publish Unit Test and Code Coverage Results with .NET 7 Solution using VSTest, Cobertura, and Coverlet](https://build5nines.com/azure-pipeline-publish-unit-test-and-code-coverage-results-with-net-solution-using-vstest-cobertura-and-coverlet/) +- [thomasthornton.cloud: Adding pull-request comments to Azure DevOps Repo from Azure DevOps Pipelines](https://thomasthornton.cloud/2024/01/18/adding-pull-request-comments-to-azure-devops-repo-from-azure-devops-pipelines/) +- [==towardsdev.com: Azure DevOps Project Creation and Setup via Terraform==](https://towardsdev.com/azure-devops-project-creation-and-setup-via-terraform-3444ff985bae) + +### Azure DevOps vs GitHub Actions + +- [==datascientest.com: Azure DevOps vs GitHub Actions: Which is the best CI/CD tool?==](https://datascientest.com/en/azure-devops-vs-github-actions-which-is-the-best-ci-cd-tool) ### YAML Schema in DevOps Azure Pipelines @@ -335,6 +371,7 @@ - [learn.microsoft.com: Configure a custom container for Azure App Service](https://learn.microsoft.com/en-us/azure/app-service/configure-custom-container) - [returngis.net: Acceder a un App Service con Private Endpoint desde otra Vnet](https://www.returngis.net/2021/08/acceder-a-un-app-service-con-private-endpoint-desde-otra-vnet/) - [youtube: How to run an App Service Web App on Azure Arc-enabled Kubernetes - Part 2 | Azure Tips and Tricks](https://www.youtube.com/watch?v=53-Y_aI0KpE&ab_channel=MicrosoftAzure) +- [azure.github.io/AppService: General availability of Diagnostics tools for App Service on Linux Node.js apps](https://azure.github.io/AppService/2024/01/05/Diagnose-Tools-for-NodeJs-Linux-apps.html) ## Azure Application Gateway @@ -393,6 +430,8 @@ - [techcommunity.microsoft.com: Use PowerShell to search for accounts in Active Directory that have gone stale!](https://techcommunity.microsoft.com/t5/windows-server-for-it-pro/use-powershell-to-search-for-accounts-in-active-directory-that/m-p/3585934) - [techcommunity.microsoft.com: Azure Storage Blob Count & Capacity usage Calculator](https://techcommunity.microsoft.com/t5/azure-paas-blog/azure-storage-blob-count-amp-capacity-usage-calculator/ba-p/3516855) This PowerShell script allow you to count and calculate Azure Storage blob usage for Soft Deleted / non-Soft Deleted objects, by Container, by Tier, with Prefix, and considering Last Modified Date. Azure Storage blob objects is defined as Base Blobs, Blob Snapshots or Blob Versions. - [dotnet-helpers.com: Azure KeyVault Set and Retrieve Secrets using Powershell 🌟](https://dotnet-helpers.com/powershell/azure-keyvault-set-and-retrieve-secrets/) +- [thomasmaurer.ch: Enable PowerShell SSH Remoting in PowerShell 7](https://www.thomasmaurer.ch/2020/04/enable-powershell-ssh-remoting-in-powershell-7/) +- [hlokensgard.no: Get started with PowerShell 7.2 in Azure Automation Account](https://hlokensgard.no/2023/12/05/get-started-with-powershell-7-2-in-azure-automation-account/) ### Microsoft Graph PowerShell SDK @@ -463,6 +502,11 @@ - [techcommunity.microsoft.com: (Part-1) Leverage Bicep: Standard model to Automate Azure IaaS deployment](https://techcommunity.microsoft.com/t5/azure-infrastructure-blog/part-1-leverage-bicep-standard-model-to-automate-azure-iaas/ba-p/3804348) - [blog.cloudtrooper.net: Deploy (Azure) Network-as-Code as a champ](https://blog.cloudtrooper.net/2023/06/08/deploy-azure-network-as-code-as-a-champ/) - [learn.microsoft.com: Discover misconfigurations in Infrastructure as Code (IaC)](https://learn.microsoft.com/en-us/azure/defender-for-cloud/iac-vulnerabilities) +- [insight-services-apac.github.io: Getting Started with Bicep](https://insight-services-apac.github.io/2023/12/04/getting-started-bicep) +- [build5nines.com: Get Started with Azure Bicep – Alternative to ARM Templates](https://build5nines.com/get-started-with-azure-bicep/) +- [linkedin.com/pulse: Exporting and importing variables between Bicep files: compileTimeImports | Freek Berson](https://www.linkedin.com/pulse/exporting-importing-variables-between-bicep-files-freek-berson-n0ske/) +- [luke.geek.nz: Using the Azure Naming Tool API to name your Bicep resources](https://luke.geek.nz/azure/azure-naming-tool-api-bicep-resources/) +- [microsoft.com: Revolutionizing our ARM template deployment at Microsoft with shift from JSON to BICEP](https://www.microsoft.com/insidetrack/blog/revolutionizing-our-arm-template-deployment-at-microsoft-with-shift-from-json-to-bicep/) ## Azure Cross region Load Balancer @@ -488,10 +532,12 @@ - [learn.microsoft.com: SC-100: Design a Zero Trust strategy and architecture](https://learn.microsoft.com/en-us/training/paths/sc-100-design-zero-trust-strategy-architecture/) - https://github.com/MicrosoftLearning/SC-100-Microsoft-Cybersecurity-Architect - [learn.microsoft.com: Azure network security overview](https://learn.microsoft.com/en-us/azure/security/fundamentals/network-overview) +- [learn.microsoft.com: Conditional Access templates](https://learn.microsoft.com/en-us/entra/identity/conditional-access/concept-conditional-access-policy-common) ### Azure Microsoft Defender for Cloud - [github.com/Azure/Microsoft-Defender-for-Cloud](https://github.com/Azure/Microsoft-Defender-for-Cloud/tree/main/Workbooks/Network%20Security%20Dashboard) Network Security Dashboard for Microsoft Defender for Cloud +- [techcommunity.microsoft.com: Microsoft Announces General Availability of Defender for APIs](https://techcommunity.microsoft.com/t5/microsoft-defender-for-cloud/microsoft-announces-general-availability-of-defender-for-apis/ba-p/3981488) ## Azure Virtual WAN. vWAN @@ -595,10 +641,22 @@ - [infoworld.com: Getting started with Azure OpenAI](https://www.infoworld.com/article/3686694/getting-started-with-azure-openai.html) Microsoft’s Azure-hosted OpenAI language models are now generally available, and it’s surprisingly simple to use them in your code. - [jamiemaguire.net: First Look: Azure Open AI Studio, Prompt Engineering. What You Can Do and How](https://jamiemaguire.net/index.php/2023/04/22/first-look-azure-open-ai-studio-prompt-engineering-what-you-can-do-and-how/) +- [==techcommunity.microsoft.com: The AI Study Guide: Azure’s top free resources for learning generative AI in 2024==](https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/the-ai-study-guide-azure-s-top-free-resources-for-learning/ba-p/4036890) ## Windows Tools - [Scoop: A command-line installer for windows](https://scoop.sh) +- [github.com/JPCERTCC/LogonTracer](https://github.com/JPCERTCC/LogonTracer) Investigate malicious Windows logon by visualizing and analyzing Windows event log + +## Azure Tools + +- [github.com/mspnp/AzureNamingTool - Azure Naming Tool](https://github.com/mspnp/AzureNamingTool) The Azure Naming Tool is a .NET 8 Blazor application, with a RESTful API. The UI consists of several pages to allow the configuration and generation of Azure Resource names. The API provides a programmatic interface for the functionality. +- [github.com/JulianHayward/AzADServicePrincipalInsights](https://github.com/JulianHayward/AzADServicePrincipalInsights) Insights and change tracking on Azure Active Directory Service Principals (Enterprise Applications and Applications) +- [==github.com/ElanShudnow/AzureCode==](https://github.com/ElanShudnow/AzureCode) A place to share all the Azure Code I am writing. This includes PowerShell, Terraform, ARM, Bicep, Ansible, etc... + - [github.com/ElanShudnow/AzureCode/tree/main/PowerShell/AzResourceMoveSupport](https://github.com/ElanShudnow/AzureCode/tree/main/PowerShell/AzResourceMoveSupport) This script will take an Azure Usage Report csv file and provide new columns as to whether each resource supports migration to another Resource Group, to another Subscription, or to another Region. +- [github.com/mustafakaya/Azure-Reliability-Checker-Tool](https://github.com/mustafakaya/Azure-Reliability-Checker-Tool) This project contains a PowerShell script that scans Azure resources based on Azure Proactive Resiliency Library. The script clones the library to a local directory and then scans all folders and files and runs KQL queries. Finally, it exports the resources to a CSV file with recommendation ID, subscription ID, and resource ID. +- [github.com/microsoft/finops-toolkit](https://github.com/microsoft/finops-toolkit) Starter kits, scripts, and advanced solutions to accelerate your FinOps journey in the Microsoft Cloud. +- [github.com/BrianCollet/onboard-automator](https://github.com/BrianCollet/onboard-automator) Streamline and automate the onboarding process for new employees using Azure Logic Apps, Azure Function Apps, Azure Blob Storage, Azure Resource Manager, Azure Active Directory, and Outlook ## Images diff --git a/docs/chatgpt.md b/docs/chatgpt.md index bf0f8262..b3465ff5 100644 --- a/docs/chatgpt.md +++ b/docs/chatgpt.md @@ -23,6 +23,7 @@ - [businessinsider.mx: 5 trucos de ChatGPT que pueden ayudar a reducir tu carga laboral](https://businessinsider.mx/trucos-chatgpt-aminorar-carga-laboranl_vida-profesional/) - [christianmartinezfinancialfox.medium.com: How to use ChatGPT to improve your Microsft Excel skills?](https://christianmartinezfinancialfox.medium.com/how-to-use-chatgpt-to-improve-your-microsft-excel-skills-41817b6465df) - [thenewstack.io: Developers Put AI Bots to the Test of Writing Code](https://thenewstack.io/developers-put-ai-bots-to-the-test-of-writing-code/) With so many AI-powered assistants waiting to be explored, we've now entered the phase where excited coders are trying their own homegrown experiments — and sharing the results online. +- [aihr.com: 21+ ChatGPT Prompts for HR To Accelerate Your Productivity](https://www.aihr.com/blog/chatgpt-prompts-for-hr) ## TableauGPT @@ -74,4 +75,5 @@ - [github.com/robusta-dev/kubernetes-chatgpt-bot](https://github.com/robusta-dev/kubernetes-chatgpt-bot/) A ChatGPT bot for Kubernetes issues. Ask the AI how to solve your Prometheus alerts, get pithy responses. - [itnext.io: K8sGPT + LocalAI: Unlock Kubernetes superpowers for free!](https://itnext.io/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65) -- [numerous.ai](https://numerous.ai/) Prompt ChatGPT in bulk, in your spreadsheets. Use AI for writing content, product descriptions, SEO keywords, and more in bulk. \ No newline at end of file +- [numerous.ai](https://numerous.ai/) Prompt ChatGPT in bulk, in your spreadsheets. Use AI for writing content, product descriptions, SEO keywords, and more in bulk. +- [chat.openai.com/g/g-6eSNNNvsB-kubernetes-terraformer: Kubernetes Terraformer](https://chat.openai.com/g/g-6eSNNNvsB-kubernetes-terraformer) Converts Kubernetes YAML to Terraform HCL, extracting key variables. By Mark Tinderholt \ No newline at end of file diff --git a/docs/cheatsheets.md b/docs/cheatsheets.md index b5b56b50..08adc54a 100644 --- a/docs/cheatsheets.md +++ b/docs/cheatsheets.md @@ -495,6 +495,7 @@ - [hackr.io: SQL Commands Tutorial: DDL, DML, TCL and DQL Commands](https://hackr.io/blog/sql-commands) - [==github.com/swapnakpanda: SQL_CheatSheet.png==](https://github.com/swapnakpanda/Infographics/blob/main/Cheat%20Sheet/Database/SQL_CheatSheet.png) - [TSQL and SQL Queries Cheat Sheet](https://helpercodes.com/sql-query-cheatsheet-tutorial/) +- [dev.to: Optimizing SQL Queries by 23x!!!](https://dev.to/navneet7716/optimizing-sql-queries-h9j) ## Postgres diff --git a/docs/cicd.md b/docs/cicd.md index 053f0902..5567a693 100644 --- a/docs/cicd.md +++ b/docs/cicd.md @@ -111,6 +111,7 @@ - [groundcover.com: Cloud-native CI/CD? Yeah, that’s a thing 🌟](https://www.groundcover.com/blog/ci-cd-kubernetes) Discover how leveraging CI/CD pipelines based on Kubernetes gives organizations improved control and more efficient management, allowing for faster recovery and replication of runtime environments. - [==spacelift.io: Kubernetes CI/CD Pipelines – 7 Best Practices and Tools | James Walker== 🌟](https://spacelift.io/blog/kubernetes-ci-cd) CICD pipelines enhance app delivery process by automating key stages like testing, security scanning, and deployment. Adopting pipeline-based workflow helps to ship more quickly. - [thenewstack.io: Embracing Database Deployments in CI/CD Practices with Git](https://thenewstack.io/embracing-database-deployments-in-ci-cd-practices-with-git/) Databases have not been well integrated into the CI/CD tooling landscape, but applying git-like concepts can help. +- [hart-michael.medium.com: Why You Need Continuous Deployment](https://hart-michael.medium.com/why-you-need-continuous-deployment-93d7b5936523) ## CI/CD Pipelines With Kubernetes diff --git a/docs/cloud-arch-diagrams.md b/docs/cloud-arch-diagrams.md index 59500373..42177da1 100644 --- a/docs/cloud-arch-diagrams.md +++ b/docs/cloud-arch-diagrams.md @@ -32,6 +32,7 @@ - [mingrammer/diagrams](https://github.com/mingrammer/diagrams) 🎨 Diagram as Code for prototyping cloud system architectures - [navveenbalani.dev: Code To Custom Cloud Architecture Diagrams](https://navveenbalani.dev/index.php/articles/code-to-custom-cloud-architecture-diagrams/) - [github.com/dcasati/kubernetes-PlantUML](https://github.com/dcasati/kubernetes-PlantUML) Kubernetes diagrams using VS Code. Kubernetes-PlantUML contains the PlantUML sprites, macros and stereotypes for creating PlantUML diagrams with the Kubernetes components. This work is based on the official Kubernetes Icons Set. +- [excalidraw.com](https://excalidraw.com) ## Architecture Icons diff --git a/docs/customer.md b/docs/customer.md index 231ec55d..9599549f 100644 --- a/docs/customer.md +++ b/docs/customer.md @@ -40,6 +40,7 @@ - [Red Hat OpenShift Container Platform Takes Digital Innovation into the Fast Lane with Major European Automaker](https://www.redhat.com/es/about/press-releases/red-hat-openshift-container-platform-takes-digital-innovation-fast-lane-major-european-automaker) - [BMW takes digital innovation into the fast lane with Red Hat Openshift Container Platform](https://www.linkedin.com/pulse/bmw-takes-digital-innovation-fast-lane-red-hat-openshift-mendus/) - [Youtube: BMW enables the BMW Group to deliver the continuous service that today's consumers expect (video starts at 1:29:00)](https://www.youtube.com/watch?time_continue=5340&v=FUu4kMc0PL8): BMW Group started working with 4 Openshift clusters in 2016 to support ConnectedDrive, a solution that delivers IoT digital services since 20 years ago. It took them a full-time migration for 2 years with a big transformation of the culture of the company, migrating monolithic applications to microservices. This is a consequence of having 30% of growth of request rate, by selling 2.5 million of cars yearly, all of them connected. Traditional IT could not cope with this growth. In 2019 they have 19 Openshift Clusters worldwide, with 12000 containers, 300 microservices, and 1 Billion requests per week. Future plans are to move to OpenShift Dedicated in the Public Cloud since they need to be more scalable and resilient, while building an Artificial Intelligence platform with a Data Lake on the public cloud to offer the best possible experience to their customers. +- [linkedin.com/pulse: How BMW uses Redhat OpenShift?](https://www.linkedin.com/pulse/how-bmw-uses-redhat-openshift-bobby-singh/) ### BMW InnovationLab diff --git a/docs/demos.md b/docs/demos.md index 6167886f..09682aaa 100644 --- a/docs/demos.md +++ b/docs/demos.md @@ -300,6 +300,7 @@ - [medium: AWS App Mesh with EKS and Canary deployment](https://medium.com/@anupam.s1602/aws-app-mesh-with-eks-and-canary-deployment-5503d9ba95d6) - [github.com/stacksimplify/aws-eks-kubernetes-masterclass 🌟](https://github.com/stacksimplify/aws-eks-kubernetes-masterclass) - [hbollon/k8s-voting-app-aws](https://github.com/hbollon/k8s-voting-app-aws) Example of a distributed voting app running on Kubernetes. Written in Golang with Terraform definitions to deploy to AWS EKS +- [aws.plainenglish.io: Deploying Application on Amazon EKS](https://aws.plainenglish.io/deploying-application-on-amazon-eks-211eb46c069c) ### Azure AKS @@ -692,6 +693,7 @@ Grab them from here: [awesome-kubernetes/scripts](https://github.com/nubenetes/a - [piotrminkowski.com: GitLab CI/CD on Kubernetes](https://piotrminkowski.com/2020/10/19/gitlab-ci-cd-on-kubernetes/) - [about.gitlab.com: The basics of CI: How to run jobs sequentially, in parallel, or out of order](https://about.gitlab.com/blog/2020/12/10/basics-of-gitlab-ci-updated/) New to continuous integration? Learn how to build your first CI pipeline with GitLab. - [==about.gitlab.com: GitOps with GitLab: Connect with a Kubernetes cluster==](https://about.gitlab.com/blog/2021/11/18/gitops-with-gitlab-connecting-the-cluster/) +- [medium.com/@kachidude007: Setting up an Access Token in GitLab for a Jenkins Pipeline](https://medium.com/@kachidude007/setting-up-an-access-token-in-gitlab-for-a-jenkins-pipeline-a688dd6c994a) Navigate to your GitLab Personal Token Page ## Spring PetClinic Sample Application @@ -914,6 +916,9 @@ Grab them from here: [awesome-kubernetes/scripts](https://github.com/nubenetes/a - [nicwortel.nl: Continuous deployment to Kubernetes with GitHub Actions](https://nicwortel.nl/blog/2022/05/27/continuous-deployment-to-kubernetes-with-github-actions) In this article, you will learn how to use GitHub Actions to automatically test, build and deploy your Docker images to Kubernetes on every commit to the main branch - [medium.com/geekculture: GitOps — Github Actions K8s Deploy Workflow](https://medium.com/geekculture/gitops-github-actions-k8s-deploy-workflow-54f0d9a1d11b) - [eggboy.medium.com: CI/CD Java apps securely to Azure Kubernetes Service with GitHub Action — Part 1](https://eggboy.medium.com/ci-cd-java-apps-securely-to-azure-kubernetes-service-with-github-action-part-1-16393af4d097) +- [github.com/GitHubSecurityLab/actions-permissions: GitHub token permissions Monitor and Advisor actions](https://github.com/GitHubSecurityLab/actions-permissions) **GitHub token permissions Monitor and Advisor actions** +- [thomasthornton.cloud: If, elseif or else in GitHub Actions](https://thomasthornton.cloud/2023/08/11/if-elseif-or-else-in-github-actions/) +- [kaleshreya907.medium.com: GitHub Actions: Netflix Deployment](https://kaleshreya907.medium.com/step2a-install-docker-and-run-sonarqube-container-faa42d01f5fe) ### RedHat GitHub Actions diff --git a/docs/developerportals.md b/docs/developerportals.md index b640c9c1..379ef9c9 100644 --- a/docs/developerportals.md +++ b/docs/developerportals.md @@ -66,7 +66,7 @@ - [apis.guru/openapi-directory: large archive of sample OpenAPI descriptions](https://apis.guru/openapi-directory/) -## API Managers with API Gateways & Developer Portals +## API Managers with API Gateways & Developer Portals - [moesif.com: How to choose the right API Gateway for your platform: Comparison of Kong, Tyk, Apigee, and alternatives](https://www.moesif.com/blog/technical/api-gateways/How-to-Choose-The-Right-API-Gateway-For-Your-Platform-Comparison-Of-Kong-Tyk-Apigee-And-Alternatives/) - [towardsdatascience.com: Building Small Services, Deploying on Kubernetes, and Integrating with API Gateway](https://towardsdatascience.com/building-small-services-deploying-on-kubernetes-and-integrating-with-api-gateway-4909db4e5282) Abstracting Backend API Authentication with Python & Redis @@ -76,7 +76,7 @@ - **An API gateway** refers to the individual proxy server. - **API management** refers to the overall solution of managing APIs in production which includes a **set of API gateways** acting in a cluster, an **administrative UI**, and may even include additional items such as a **developer portal for customers** to sign up and generate new API keys. -- [API Management vs API Gateway: Where Does API Analytics and Monitoring Fit?](https://dzone.com/articles/api-management-vs-api-gateway-and-where-does-api-a) +- [API Management vs API Gateway: Where Does API Analytics and Monitoring Fit?](https://dzone.com/articles/api-management-vs-api-gateway-and-where-does-api-a) - [API Management vs API Gateway and where does API Analytics and Monitoring fit?](https://dev.to/moesif/api-management-vs-api-gateway-and-where-does-api-analytics-and-monitoring-fit-4g75) ### 3scale API Manager @@ -89,14 +89,14 @@ - [Install Red Hat 3scale and configure tenants with 7 simple commands](https://developers.redhat.com/blog/2019/09/09/install-3scale-multitenant-in-7-commands/) - [dzone: 3Scale Developer Portal Docs Per Application](https://dzone.com/articles/3scale-developer-portal-docs-per-application) Using this open source platform, we to create a more effective version of your API documentation, allowing devs to only see that docs that are relevant to their work. - [dzone: Why Red Hat and 3scale Matter: A Developer's View](https://dzone.com/articles/why-red-hat-and-3scale-matter) -- [developers.redhat.com: New custom metrics and air gapped (restricted networks) installation in Red Hat 3scale API Management 2.9](https://developers.redhat.com/blog/2020/10/29/new-custom-metrics-and-air-gapped-installation-in-red-hat-3scale-api-management-2-9/) The 3scale Operator now fully supports air gapped installation for 3scale API Management on OpenShift. Air gapped or restricted networks are isolated from the Internet and physically isolated from any other network. Secure environments such as government agencies and financial institutions typically require an air gapped installation for Red Hat Integration on OpenShift. +- [developers.redhat.com: New custom metrics and air gapped (restricted networks) installation in Red Hat 3scale API Management 2.9](https://developers.redhat.com/blog/2020/10/29/new-custom-metrics-and-air-gapped-installation-in-red-hat-3scale-api-management-2-9/) The 3scale Operator now fully supports air gapped installation for 3scale API Management on OpenShift. Air gapped or restricted networks are isolated from the Internet and physically isolated from any other network. Secure environments such as government agencies and financial institutions typically require an air gapped installation for Red Hat Integration on OpenShift. - [developers.redhat.com: Enhance application security by rotating 3scale access tokens](https://developers.redhat.com/blog/2021/04/29/enhance-application-security-by-rotating-3scale-access-tokens/) - [developers.redhat.com: How to expose a WebSocket endpoint using Red Hat 3scale API Management](https://developers.redhat.com/articles/2021/07/01/how-expose-websocket-endpoint-using-red-hat-3scale-api-management) - [developers.redhat.com: Simplify load balancing for API gateways using Red Hat 3scale API Management](https://developers.redhat.com/articles/2021/08/11/simplify-load-balancing-api-gateways-using-red-hat-3scale-api-management) ### Google Apigee API Manager -- [Google Apigee API Manager](https://cloud.google.com/apigee/) Apigee is an API management platform for developing, analyzing, securing & scaling various APIs and apps. It provides API technology and services for a wide range of organizations and developers to stimulate the pace of digital business. Through API, Apigee assists businesses to securely share data and services across various channels/devices in order to enhance the customer experience. Companies can manage growth and spikes in API traffic with features like traffic isolation and independent scaling. +- [Google Apigee API Manager](https://cloud.google.com/apigee/) Apigee is an API management platform for developing, analyzing, securing & scaling various APIs and apps. It provides API technology and services for a wide range of organizations and developers to stimulate the pace of digital business. Through API, Apigee assists businesses to securely share data and services across various channels/devices in order to enhance the customer experience. Companies can manage growth and spikes in API traffic with features like traffic isolation and independent scaling. - [Apigee @Youtube](https://www.youtube.com/user/apigee) ### IBM API Connect @@ -148,6 +148,7 @@ - [Backstage Developer Portal:](https://backstage.io/) Spotify has now open-sourced Backstage (under Apache-2.0), the platform of platforms to create a great developer experience across hundreds of squads at Spotify - [Backstage @Youtube](https://www.youtube.com/channel/UCHBvqSwbfAf5Vx1jrwkG43Q) +- [medium.com/@_gdantas: Backstage and Terraform — A Powerful Combination for Ops, Wonderful for Devs](https://medium.com/@_gdantas/backstage-and-terraform-a-powerful-combination-for-ops-wonderful-for-devs-c04ebce849f0) ### APISIX diff --git a/docs/devops.md b/docs/devops.md index 89712d21..eb4f7537 100644 --- a/docs/devops.md +++ b/docs/devops.md @@ -33,7 +33,8 @@ 26. [Data as Code](#data-as-code) 27. [DevOps for SAP](#devops-for-sap) 28. [Youtube Playlists](#youtube-playlists) -29. [Platform Engineering](#platform-engineering) +29. [Platform Engineering and Internal Developer Platform](#platform-engineering-and-internal-developer-platform) + 1. [IDP Tools](#idp-tools) 30. [Bunch of Images](#bunch-of-images) 31. [Slides](#slides) 32. [Videos](#videos) @@ -290,6 +291,8 @@ - [rcls.medium.com: Stop calling yourselves DevOps engineers](https://rcls.medium.com/stop-calling-yourselves-devops-engineers-f9dfec382d0d) - [enterprisersproject.com: DevOps: Why shift left goes wrong](https://enterprisersproject.com/article/2020/5/devops-shift-left-why-goes-wrong) The shift-left approach helps development teams make software better and faster. So why hasn't it caught on - and how can you beat the barriers to success? - [==itnext.io: DevOps Big Picture (On-Premises)==](https://itnext.io/devops-big-picture-on-premises-d07f61d6c34c) +- [medium.com/agileinsider: DevOps Principles and Practices Explained in Ten Minutes](https://medium.com/agileinsider/devops-principles-and-practices-explained-in-ten-minutes-6cec7e1dae6d) +- [medium.com/@perspectivementor: 6 Essential Skills for Landing a DevOps Job in 2024](https://medium.com/@perspectivementor/6-essential-skills-for-landing-a-devops-job-in-2024-88f6c19341d7)
@@ -407,8 +410,9 @@ Resolve your software incidents 10x faster - [youtube playlist: Ansible 🌟](https://www.youtube.com/playlist?list=PLVx1qovxj-al0Knm1A0eEXfGyd5kCi16p) - [youtube playlist: Kubernetes 🌟](https://www.youtube.com/playlist?list=PLVx1qovxj-akr_3XqQQgpqRyQw4GYuS4h) -## Platform Engineering +## Platform Engineering and Internal Developer Platform +- [platformengineering.org](https://platformengineering.org) The global home for Platform Engineers - [thenewstack.io/platform-engineering](https://thenewstack.io/platform-engineering) Platform engineering is the discipline of building workflows, toolchains, platforms & docs to support app teams in their delivery of business value. Benefits Include: - Increased velocity - Enable developer satisfaction @@ -431,6 +435,18 @@ Resolve your software incidents 10x faster - [devops.com: What’s the Difference Between DevOps and Platform Engineering?](https://devops.com/whats-the-difference-between-devops-and-platform-engineering) - [==dev.to/thenjdevopsguy: What Is Platform Engineering (And What Is It Not?)==](https://dev.to/thenjdevopsguy/what-is-platform-engineering-and-what-is-it-not-2jb8) - [thenewstack.io: The 6 Pillars of Platform Engineering: Part 1 — Security](https://thenewstack.io/the-6-pillars-of-platform-engineering-part-1-security/) Platform team workflows and checklists for building security, pipelines, provisioning, connectivity, orchestration, and observability into their platform. +- [humanitec.com: How to design your repository structures to nail platform engineering](https://humanitec.com/blog/how-to-design-your-repository-structures-to-nail-platform-engineering) Unlock the full power of platform engineering with repo structures designed to nail high-impact IDPs. Optimize operations, security, and agility for enterprise-ready solutions. +- [medium.com/@rphilogene: What’s an Internal Developer Platform?](https://medium.com/@rphilogene/whats-an-internal-developer-platform-8f52fb367552) +- [medium.com/devoptimism: DevOps+Platform Engineering: A Necessary Love Story of Efficiency](https://medium.com/devoptimism/devops-platform-engineering-a-necessary-love-story-of-efficiency-783dff78fd81) +- [medium.com/@rphilogene: Platform Engineering #7: Internal Developer Platform vs. Internal Developer Portal](https://medium.com/@rphilogene/platform-engineering-7-internal-developer-platform-vs-internal-developer-portal-05c33658891b) +- [muycomputerpro.com: Ingeniería de plataformas de DevOps: la nueva generación de DevOps](https://www.muycomputerpro.com/2024/01/12/ingenieria-de-plataformas-de-devops-la-nueva-generacion-de-devops) +- [fernandovillalba.substack.com: DevOps: Don't destroy silos, transform them](https://fernandovillalba.substack.com/p/devops-dont-destroy-silos-transform) "Destroying silos" is a clumsy solution to team isolation + +### IDP Tools + +- [==medium.com/@rphilogene: Top 10 Platform Engineering Tools You Should Consider in 2024==](https://medium.com/@rphilogene/top-10-platform-engineering-tools-you-should-consider-in-2024-892e6e211b85) +- [github.com/Qovery/Torii](https://github.com/Qovery/Torii) Torii ⛩️ is a simple, powerful and extensible open-source Internal Developer Portal +- [github.com/backstage/backstage](https://github.com/backstage/backstage) Backstage is an open platform for building developer portals ## Bunch of Images diff --git a/docs/devsecops.md b/docs/devsecops.md index def4cd03..287a939b 100644 --- a/docs/devsecops.md +++ b/docs/devsecops.md @@ -202,6 +202,10 @@ - [hmaslowski.com: macOS Security hardening with Microsoft Intune](https://hmaslowski.com/home/f/macos-security-hardening-with-microsoft-intune) - [kubewarden.io: Scanning secrets in environment variables](https://www.kubewarden.io/blog/2022/10/env-var-secrets/) This tutorial will teach you how to scan secrets in environment variables using Kubewarden and the env-variable-secrets-scanner-policy - [dzone.com: How To Manage Vulnerabilities in Modern Cloud-Native Applications](https://dzone.com/articles/how-to-manage-vulnerabilities-in-modern-cloud-nati) The article describes how to secure cloud-native applications to identify, manage, and remediate vulnerabilities across the tech stack and ways of integrating security. +- [auth0.com: A Passwordless Future! Passkeys for Java Developers](https://auth0.com/blog/webauthn-and-passkeys-for-java-developers/) Passkeys and WebAuthn for Java developers. Learn how to get started with passkeys for your Java and Spring Boot applications. +- [infracloud.io: How to Prevent Secret Leaks in Your Repositories](https://www.infracloud.io/blogs/prevent-secret-leaks-in-repositories/) +- [blog.devops.dev: End-to-End DevSecOps Kubernetes Project](https://blog.devops.dev/end-to-end-devsecops-kubernetes-project-4259f90722ef) In today’s rapidly evolving tech landscape, deploying applications using Kubernetes has become a crucial aspect of modern software development. This guide provides a detailed walkthrough for setting up an end-to-end Kubernetes project, covering everything from infrastructure provisioning to application deployment and monitoring. +- [blog.stackademic.com: Advanced End-to-End DevSecOps Kubernetes Three-Tier Project using AWS EKS, ArgoCD, Prometheus, Grafana, and Jenkins](https://blog.stackademic.com/advanced-end-to-end-devsecops-kubernetes-three-tier-project-using-aws-eks-argocd-prometheus-fbbfdb956d1a) ## Kubernetes Security Compliance Frameworks @@ -243,6 +247,7 @@ - [==oauth2-proxy/oauth2-proxy: OAuth2 Proxy== 🌟](https://github.com/oauth2-proxy/oauth2-proxy) A reverse proxy that provides authentication with Google, Azure, OpenID Connect and many more identity providers. - [manfredmlange.medium.com: Containerized Keycloak in Development](https://manfredmlange.medium.com/containerized-keycloak-in-development-2f9d079ec4a3) How to set up an OpenID Connect compliant development environment with Docker? - [redis.com: JSON Web Tokens (JWTs) are Not Safe (ebook)](https://redis.com/docs/json-web-tokens-jwts-are-not-safe) +- [dev.to/fidalmathew: Session-Based vs. Token-Based Authentication: Which is better?](https://dev.to/fidalmathew/session-based-vs-token-based-authentication-which-is-better-227o) ## Quality Gates @@ -540,6 +545,7 @@ - [medium.com/@nikhil.purva: Securing Kubernetes Secrets with HashiCorp Vault](https://medium.com/@nikhil.purva/securing-kubernetes-secrets-with-hashicorp-vault-a9555728e095) - [hashicorp.com: The State of Vault and Kubernetes, and Future Plans](https://www.hashicorp.com/blog/the-state-of-vault-and-kubernetes-and-future-plans) Get an overview of the most common ways to use HashiCorp Vault and Kubernetes together, and get a preview of a new method we're considering. - [alexandre-vazquez.com: How To Inject Secrets in Pods To Improve Security with Hashicorp Vault in 5 Minutes 🌟](https://alexandre-vazquez.com/inject-secrets-in-pods-using-hashicorp-vault/) +- [adfinis.com: Secret zero with ACME](https://adfinis.com/en/blog/secret-zero-with-acme/) As of Vault 1.14, the HashiCorp Vault PKI engine can issue certificates using the standard ACME protocol. The Automatic Certificate Management Environment (ACME) was made popular by Let’s Encrypt, which has been the default mechanism to request valid certificates from a public CA for over 10 years. #### HashiCorp Vault Agent @@ -658,7 +664,7 @@ - [falco.org: Detect Malicious Behaviour on Kubernetes API Server through gathering Audit Logs by using FluentBit - Part 2](https://falco.org/blog/detect-malicious-behaviour-on-kubernetes-api-server-through-gathering-audit-logs-by-using-fluentbit-part-2/) - [kubearmor.io](https://kubearmor.io/) Runtime protection for Kubernetes & other cloud Workloads. KubeArmor uses eBPF and Linux Security Modules (LSM) to provide policy based system to restrict any unwanted, malicious behavior of cloud-native workloads at runtime. - - [itnext.io: Protecting Your Kubernetes Environment With KubeArmor](https://itnext.io/protecting-your-kubernetes-environment-with-kubearmor-76b02fc2209b) + - [itnext.io: Protecting Your Kubernetes Environment With KubeArmor](https://itnext.io/protecting-your-kubernetes-environment-with-kubearmor-76b02fc2209b) In this article, you will learn how to use KubeArmor to define policies and protect your containerized workloads. You will test the setup against the ShellShock vulnerability and compare it to AppArmor. ## Helm Charts Security. Helm Secrets @@ -764,6 +770,7 @@ to restrict any unwanted, malicious behavior of cloud-native workloads at runtim - [github.com/goauthentik/authentik](https://github.com/goauthentik/authentik) authentik is an open-source Identity Provider focused on flexibility and versatility - [github.com/openappsec/openappsec](https://github.com/openappsec/openappsec) open-appsec provides preemptive web app & API threat protection against OWASP-Top-10 and zero-day attacks. It can be deployed as an add-on to Kubernetes Ingress, NGINX, Envoy and API Gateways. - [==Microsoft Security Copilot==](https://www.microsoft.com/en-us/security/business/ai-machine-learning/microsoft-security-copilot) +- [==github.com/prowler-cloud/prowler== 🌟🌟](https://github.com/prowler-cloud/prowler) **Prowler is an Open Source Security tool for AWS, Azure and GCP to perform Cloud Security best practices assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more.** ## Videos diff --git a/docs/finops.md b/docs/finops.md index 255e4324..b7aeb771 100644 --- a/docs/finops.md +++ b/docs/finops.md @@ -49,6 +49,7 @@ - [infoworld.com: Kubernetes cost management for the real world](https://www.infoworld.com/article/3695569/kubernetes-cost-management-for-the-real-world.html) How much will Kubernetes cost to run? That question has become much easier to answer for Azure Kubernetes Service, thanks to OpenCost integration. - [infoworld.com: When finops costs you more in the end](https://www.infoworld.com/article/3688332/when-finops-costs-you-more-in-the-end.html) Cloud finops can save you tons of money on cloud spending and return more value to the business. Unfortunately, mistakes are costing companies big time. - [infoworld.com: Kubernetes costs less, but less than what?](https://www.infoworld.com/article/3696277/kubernetes-costs-less-but-less-than-what.html) Sure, compared to traditional IT, Kubernetes is great, but not much will beat public cloud in the long run. +- [bitsand.cloud: Slashing Data Transfer Costs in AWS by 99%](https://www.bitsand.cloud/posts/slashing-data-transfer-costs/) ## Compute Cost Calculator diff --git a/docs/git.md b/docs/git.md index 99c810d7..3d3a21fd 100644 --- a/docs/git.md +++ b/docs/git.md @@ -180,6 +180,9 @@ - [==dev.to: Git fundamentals, a complete guide | Leandro Proença== 🌟🌟](https://dev.to/leandronsp/git-fundamentals-a-complete-guide-do7) - [freecodecamp.org: Undo Git Add – How to Remove Added Files in Git 🌟](https://www.freecodecamp.org/news/undo-git-add-how-to-remove-added-files-in-git/) - [==realpython.com: Advanced Git Tips for Python Developers== 🌟](https://realpython.com/advanced-git-for-pythonistas/) +- [cloud-and-devops.hashnode.dev: Git 007 : Learn Advanced GIT topics like a Pro](https://cloud-and-devops.hashnode.dev/git-007-learn-advanced-git-topics-like-a-pro) +- [build5nines.com: Git: Reset / Undo Most Recent Local Commit](https://build5nines.com/git-reset-undo-most-recent-local-commit/) +- [freecodecamp.org: How to Write Commit Messages that Project Maintainers Will Appreciate](https://www.freecodecamp.org/news/how-to-write-commit-messages-maintainers-will-like/) ## Git Releases @@ -559,6 +562,8 @@ git rebase -i HEAD~5 - [==steampipe.io: Top 3 ways to improve GitHub org security==](https://steampipe.io/blog/github-security-tips) Gain some practical tips for securing your GitHub organizations based on findings from common security incidents. - [dev.to/opensauced: How to Create a Good Pull Request Template (and Why You Should Add Gifs)](https://dev.to/opensauced/how-to-create-a-good-pull-request-template-and-why-you-should-add-gifs-4i0l) - [==youtube: GitHub Masterclass (Spanish)== 🌟](https://www.youtube.com/playlist?list=PL0pgb_7nDofA1hJpkpPf4qHQTYZbPVT5M) +- [freecodecamp.org: How to Build a GitHub Template Repository for Scaffolding with React, Vite, and TailwindCSS](https://www.freecodecamp.org/news/create-a-github-template-repository-with-react-vite-and-tailwindcss/) +- [alemsbaja.hashnode.dev: Git and GitHub Demystified : A Comprehensive Guide for Version Control System](https://alemsbaja.hashnode.dev/git-and-github-demystified-a-comprehensive-guide-for-version-control-system) A Comprehensive Guide to Mastering Git Version Control System and GitHub with example ## Fake it til you make it diff --git a/docs/gitops.md b/docs/gitops.md index f16ebb6d..a217bdae 100644 --- a/docs/gitops.md +++ b/docs/gitops.md @@ -3,8 +3,9 @@ 1. [Introduction](#introduction) 2. [GitOps Working Group](#gitops-working-group) 3. [OpenGitOps Project](#opengitops-project) -4. [Git Repositories Structures](#git-repositories-structures) -5. [GitOps Tools](#gitops-tools) +4. [GitOps Patterns](#gitops-patterns) +5. [Git Repositories Structures](#git-repositories-structures) +6. [GitOps Tools](#gitops-tools) 1. [Flux. The GitOps Operator for Kubernetes](#flux-the-gitops-operator-for-kubernetes) 2. [Kustomize. Kubernetes native configuration management](#kustomize-kubernetes-native-configuration-management) 3. [Flagger](#flagger) @@ -18,16 +19,16 @@ 11. [HashiCorp Waypoint](#hashicorp-waypoint) 12. [Weave GitOps](#weave-gitops) 13. [Octopilot](#octopilot) -6. [GitOps Frameworks](#gitops-frameworks) -7. [Kubernetes Platforms and GitOps](#kubernetes-platforms-and-gitops) +7. [GitOps Frameworks](#gitops-frameworks) +8. [Kubernetes Platforms and GitOps](#kubernetes-platforms-and-gitops) 1. [OpenShift GitOps](#openshift-gitops) 2. [AWS Kubernetes](#aws-kubernetes) 3. [Weave Kubernetes Platform](#weave-kubernetes-platform) 4. [Ubuntu Charmed Kubernetes](#ubuntu-charmed-kubernetes) -8. [APIOps](#apiops) -9. [Images](#images) -10. [Tweets](#tweets) -11. [Videos](#videos) +9. [APIOps](#apiops) +10. [Images](#images) +11. [Tweets](#tweets) +12. [Videos](#videos)
Alemix Donofrio · Jimmy Sax - Time
@@ -184,6 +185,11 @@ - [blog.brainboard.co: Streamlining Cloud Deployments with Git: Best Practices and Strategies](https://blog.brainboard.co/streamlining-cloud-deployments-with-git-best-practices-and-strategies-3ddf5cad3861) - [thenewstack.io: GitOps as an Evolution of Kubernetes](https://thenewstack.io/gitops-as-an-evolution-of-kubernetes/) - [github.blog: Applying GitOps principles to your operations](https://github.blog/2023-06-02-applying-gitops-principles-to-your-operations/) Could we use our Git repository as the source of truth for operational tasks, and somehow reconcile changes with our real-world view? +- [hackernoon.com: What Is GitOps And Why Is It (Almost) Useless? Part 1](https://hackernoon.com/what-is-gitops-and-why-it-is-almost-useless-part-1) + - [hackernoon.com: What Is GitOps And Why Is It (Almost) Useless? Part 2](https://hackernoon.com/what-is-gitops-and-why-is-it-almost-useless-part-2) In this controversial article, the author argues that GitOps is a (mostly) unnecessary abstraction that introduces more complexity than it's worth. The article tackles several GitOps principles and gives practical code counterexamples. +- [==devoriales.com: Exploring GitOps: Software and Infrastructure Management Intro Video==](https://devoriales.com/video/897990746/intro-to-gitops) +- [medium.com/containers-101: Using GitOps for Databases](https://medium.com/containers-101/using-gitops-for-databases-f09a027184bb) +- [opensourceforu.com: Embracing Progressive Delivery In Kubernetes With GitOps](https://www.opensourceforu.com/2023/10/embracing-progressive-delivery-in-kubernetes-with-gitops/)
[![gitops in a nutshell](images/GitOps-in-a-nutshell.png)](https://www.unifiedguru.com/gitops-and-the-cloud-operating-model-vmware-cloud-community/) @@ -207,6 +213,11 @@ - [github.com/open-gitops/project 🌟](https://github.com/open-gitops/project) OpenGitOps is a CNCF Sandbox project to define a vendor-neutral, principle-led meaning of GitOps. This will establish a foundation for interoperability between tools, conformance, and certification through lasting programs, documents, and code. +## GitOps Patterns + +- [==github.com/cloudogu/gitops-patterns==](https://github.com/cloudogu/gitops-patterns) Collection of patterns, examples and resources for GitOps process design, GitOps repository structures, etc. +- [github.com/cloudogu/gitops-playground#example-applications](https://github.com/cloudogu/gitops-playground#example-applications) Creates a complete GitOps-based operational stack on your Kubernetes clusters + ## Git Repositories Structures - [==dzone: GitOps: How to Ops Your Git the Right Way== 🌟](https://dzone.com/articles/gitops-how-to-ops-your-git-the-right-way) In this article we’ll look into the specifics of creating Git repositories structures  —  the very core of the GitOps approach. diff --git a/docs/golang.md b/docs/golang.md index b00177cb..ef439096 100644 --- a/docs/golang.md +++ b/docs/golang.md @@ -56,6 +56,7 @@ - [levelup.gitconnected.com: Concurrency in Go: shared memory](https://levelup.gitconnected.com/concurrency-in-go-shared-memory-a2ef201b396b) - [luk4z7/go-concurrency-guide: Go Concurrency Guide 🌟](https://github.com/luk4z7/go-concurrency-guide) Practical concurrency guide in Go, communication by channels, patterns - [medium.com/datascale: Know GOMAXPROCS before deploying your GO app to Kubernetes](https://medium.com/datascale/know-gomaxprocs-before-deploying-your-go-app-to-kubernetes-7a458fb63af1) In this article, you will learn why setting GOMAXPROCS for your Go apps is crucial in Kubernetes. And you'll discover why it's better to assign a full-core CPU to your Go containers. +- [dev.to: Getting Started With Go (golang) | Michael Levan](https://dev.to/thenjdevopsguy/getting-started-with-go-golang-5eh8) ## Design Patterns diff --git a/docs/iac.md b/docs/iac.md index 05f2d08c..fe017b3c 100644 --- a/docs/iac.md +++ b/docs/iac.md @@ -36,6 +36,8 @@ - [thenewstack.io: Infrastructure as Code or Cloud Platforms — You Decide!](https://thenewstack.io/infrastructure-as-code-or-cloud-platforms-you-decide/) - [infoworld.com: 5 priorities that cut cloud costs and improve IT ops](https://www.infoworld.com/article/3692296/5-priorities-that-cut-cloud-costs-and-improve-it-ops.html) With infrastructure as code, virtual desktop infrastructure, and a proactive approach to incident management, you can help keep cloud costs reasonable. - [spacelift.io: Why Generic CI/CD Tools Will Not Deliver Successful IaC](https://spacelift.io/blog/infrastructure-as-code-with-generic-ci-cd) +- [matt-rickard.com: Infrastructure as Code Will be Written by AI](https://matt-rickard.com/infrastructure-as-code-will-be-written-by-ai) +- [thenewstack.io: Achieve GitOps on Day One with IaC Automation](https://thenewstack.io/achieve-gitops-on-day-one-with-iac-automation/) GitOps helps redefine how we manage infrastructure and application deployments in environments where precision, automation and transparency are vital. ## Local Environment as Code diff --git a/docs/index.md b/docs/index.md index f76eba82..d9d94a76 100644 --- a/docs/index.md +++ b/docs/index.md @@ -95,6 +95,11 @@ A curated list of awesome references collected since 2018. Microservices archite - [Software Deployment Best Practices in 2023](https://dzone.com/articles/software-deployment-best-practices) Explore the best software development practices that are the proven catalysts for innovation and growth. - [==DevOps-Books== 🌟](https://github.com/DevOps-Projects-Ideas/DevOps-Books) - [community.aws/kubernetes](https://community.aws/kubernetes) Kubernetes at AWS! Welcome to the hub for all things Kubernetes at AWS. +- [AWS Skill Builder](https://explore.skillbuilder.aws/learn) +- [cloudcatalog.dev](https://www.cloudcatalog.dev) Documentation tool for AWS Architectures. CloudCatalog is an Open Source project that helps you document your AWS resources, services and assign owners. +- [platformengineering.org](https://platformengineering.org) The global home for Platform Engineers +- [Azure DevOps vs GitHub Actions: Which is the best CI/CD tool?](https://datascientest.com/en/azure-devops-vs-github-actions-which-is-the-best-ci-cd-tool) +- [Redefining Virtualization in the VMware Acquisition Era](https://chaoslever.com/cl-20240118/) ## Introduction - [Microservice Architecture. From Java EE To Cloud Native. Openshift VS Kubernetes](introduction.md) diff --git a/docs/interview-questions.md b/docs/interview-questions.md index 15e90028..e80340ac 100644 --- a/docs/interview-questions.md +++ b/docs/interview-questions.md @@ -40,6 +40,7 @@ - [simplilearn.com: Top 40 Terraform Interview Questions and Answers for 2022](https://www.simplilearn.com/terraform-interview-questions-and-answers-article) - [k21academy.com: Top Terraform Interview Questions & Answers [ Revised – 2022]](https://k21academy.com/terraform-iac/terraform-interview-questions/) - [mrdevops.hashnode.dev: Top 40 Terraform Interview Questions and Answers for 2023](https://mrdevops.hashnode.dev/top-40-terraform-interview-questions-and-answers-for-2023) +- [fosstechnix.com: Top 50 Terraform Cloud Interview Questions and Answers](https://www.fosstechnix.com/terraform-cloud-interview-questions-and-answer/) ## AWS Interview Questions diff --git a/docs/introduction.md b/docs/introduction.md index 1e041eb4..0fba24b7 100644 --- a/docs/introduction.md +++ b/docs/introduction.md @@ -259,6 +259,13 @@ - [devops.com: 8 Hot Takes: Will We See a Monolithic Renaissance?](https://devops.com/8-hot-takes-will-we-see-a-monolithic-renaissance/) - [rahulh123.medium.com: Choosing the Right Architecture: Monolithic vs. Microservices — Analyzing Requirements for Success](https://rahulh123.medium.com/choosing-the-right-architecture-monolithic-vs-microservices-analyzing-requirements-for-success-70d681f6a1d0) - [waswani.medium.com: Microservices Communication: Data Sharing using Database, an AntiPattern !!!](https://waswani.medium.com/microservices-data-sharing-using-database-an-antipattern-35e0196ee2ad) +- [infoworld.com: Why we need both cloud architects and cloud engineers](https://www.infoworld.com/article/3707989/why-we-need-both-cloud-architects-and-cloud-engineers.html) AI-based design and development is exciting but it doesn't replace sound, solid architecture and engineering in building and deploying cloud-based solutions. +- [enriquedans.com: El desastre del software y la automoción](https://www.enriquedans.com/2023/12/el-desastre-del-software-y-la-automocion.html) +- [freecodecamp.org: How to Write Clean Code – Tips and Best Practices (Full Handbook)](https://www.freecodecamp.org/news/how-to-write-clean-code/) +- [theregister.com: Basecamp details 'obscene' $3.2 million bill that caused it to quit the cloud](https://www.theregister.com/2023/01/16/basecamp_37signals_cloud_bill/) +- [==medium.com/@bill.salvaggio: The AWS Cloud Resume Challenge Project==](https://medium.com/@bill.salvaggio/the-aws-cloud-resume-challenge-project-c5c0c6fe9593) - [==The AWS Cloud Resume Challenge Project, Part II==](https://medium.com/@bill.salvaggio/the-aws-cloud-resume-challenge-project-part-ii-5c36029dbc59) CI/CD Automation — GitHub Actions and a Test environment +- [thestack.technology: VMware is killing off 56 products amid "tectonic" infrastructure shift](https://www.thestack.technology/vmware-is-killing-off-56-products-including-vsphere-hypervisor-and-nsx/) Goodbye vSphere Hypervisor. Goodbye Aria Operations. Goodbye NCX. Goodbye HCX. Goodbye more acronyms than we know what to do with; though Broadcom does. +- [blog.lealdasilva.com: Why You Should Switch from VMware to Proxmox in 2024](https://blog.lealdasilva.com/vmware2proxmox/) ## Platform Reference Architecture @@ -301,6 +308,7 @@ - [thenewstack.io: Stop Technical Debt Before It Damages Your Company](https://thenewstack.io/stop-technical-debt-before-it-damages-your-company/) - [n-ix.com: How to reduce your technical debt: An ultimate guide](https://www.n-ix.com/reduce-technical-debt/) - [medium.com/promyze: Avoid accidental complexity and technical debt](https://medium.com/promyze/avoid-accidental-complexity-and-technical-debt-2dc2cdf4dd4b) +- [infoworld.com: You can’t run away from technical debt](https://www.infoworld.com/article/3704233/you-cant-run-away-from-technical-debt.html) Like student loans and credit card balances, technical debt is holding you back or even killing your business. Unfortunately, the cloud can't always save you. ## Twelve-Factor Apps in Kubernetes @@ -428,6 +436,7 @@ ### CQRS Pattern - [medium.com/@mbarkin.narin: Problem Solving Strategies for Microservice Architecture Part III](https://medium.com/@mbarkin.narin/problem-solving-strategies-for-microservice-architecture-part-iii-c15830151890) Distributed Complex Query in Multiple Services +- [linkedin.com/pulse: Command and Query Responsibility Segregation (CQRS): Optimizing Hybrid Cloud Strategies](https://www.linkedin.com/pulse/command-query-responsibility-segregation-cqrs-hybrid-cloud-mark-ubhfc/) ## Microservices Anti Patterns @@ -450,6 +459,8 @@ ## Data Engineering - [==medium.com/whispering-data: The State of Data Engineering 2022==](https://medium.com/whispering-data/the-state-of-data-engineering-2022-d6ef0f7cf607) All the latest tools and trends in data engineering. +- [==cookbook.learndataengineering.com: The Data Engineering Cookbook==](https://cookbook.learndataengineering.com/docs/05-CaseStudies/#data-science-at-CERN) +- [joereis.substack.com: Data Engineering in 2024. What I'm Seeing](https://joereis.substack.com/p/data-engineering-in-2024-what-im) ## Cloud Migration Checklist @@ -634,7 +645,9 @@ -
+ + +
## Tweets diff --git a/docs/java-and-java-performance-optimization.md b/docs/java-and-java-performance-optimization.md index bbb69f17..08b97f7c 100644 --- a/docs/java-and-java-performance-optimization.md +++ b/docs/java-and-java-performance-optimization.md @@ -20,6 +20,8 @@ ## Introduction - [javarevisited.blogspot.com: 10 Things Java Programmers Should Learn in 2022](https://javarevisited.blogspot.com/2017/12/10-things-java-programmers-should-learn.html) +- [freecodecamp.org: Learn the Basics of Java Programming](https://www.freecodecamp.org/news/learn-the-basics-of-java-programming/) +- [freecodecamp.org: Advanced Object-Oriented Programming in Java – Full Book](https://www.freecodecamp.org/news/object-oriented-programming-in-java/) ## Java Performance Optimization @@ -43,6 +45,7 @@ - [vladmihalcea.com: Caching best practices](https://vladmihalcea.com/caching-best-practices/) - [vladmihalcea.com: 14 High-Performance Java Persistence Tips](https://vladmihalcea.com/14-high-performance-java-persistence-tips/) - [speakerdeck.com: Profiling a Java Application @DevDays 2023 | Victor Rentea](https://speakerdeck.com/victorrentea/profiling-a-java-application-at-devdays-2023) +- [freecodecamp.org: How to Write Unit Tests in Java](https://www.freecodecamp.org/news/java-unit-testing/) ### Java on Kubernetes. Java Memory Arguments for Containers @@ -53,6 +56,8 @@ - [danoncoding.com: Tricky Kubernetes memory management for Java applications 🌟](https://danoncoding.com/tricky-kubernetes-memory-management-for-java-applications-d2f88dd4e9f6) Running Java applications in a container environment requires an understanding of both — JVM memory mechanics and Kubernetes memory management. In this article, you will discuss the settings and optimizations necessary to run Java apps in Kubernetes. - [medium.com/nordnet-tech: Setting Java Heap Size Inside a Docker Container](https://medium.com/nordnet-tech/setting-java-heap-size-inside-a-docker-container-b5a4d06d2f46) - [danoncoding.com: Tricky Kubernetes memory management for Java applications 🌟](https://danoncoding.com/tricky-kubernetes-memory-management-for-java-applications-d2f88dd4e9f6) How to use the Kubernetes memory requests and limits in combination with JVM Heap and stay out of trouble. +- [medium.com/@sharprazor.app: Memory settings for Java process running in Kubernetes pod](https://medium.com/@sharprazor.app/memory-settings-for-java-process-running-in-kubernetes-pod-1e608a5d2a64) Managing the memory usage of a Java process running in a Kubernetes pod is more challenging than one might expect. Even with proper JVM memory configurations, OOMKilled issues can still arise and you wonder why. + - There is no way to guarantee the complete memory bundary of a Java process since the JVM respects only the heap size limit; not non-heap memory, which will depend on various factors. Start with a 75% ratio of heap to non-heap memory, and keep a close watch on how your memory behaves. If things get out of hand, you can tweak your pod’s memory limits or fiddle with the heap-to-non-heapratio to dodge the OOMKilled mishaps. ### Benchmarking modern Java Virtual Machines and the next-generation garbage collectors diff --git a/docs/javascript.md b/docs/javascript.md index 70e64fd5..f2d1535e 100644 --- a/docs/javascript.md +++ b/docs/javascript.md @@ -20,6 +20,7 @@ - [dev.to: Username Validator](https://dev.to/lizardkinglk/username-validator-1n8g) Usernames should be formatted and they should conform to follow some validation constraints. - [freecodecamp.org: HTTP Networking in JavaScript –Handbook for Beginners](https://www.freecodecamp.org/news/http-full-course/) - [dev.to: How to add In-App notifications to any web app!](https://dev.to/novu/how-to-add-in-app-notifications-to-any-web-app-1b4n) +- [freecodecamp.org: Web Storage API – How to Store Data on the Browser](https://www.freecodecamp.org/news/web-storage-api-how-to-store-data-on-the-browser/) ## Useful websites for web developers diff --git a/docs/kubernetes-autoscaling.md b/docs/kubernetes-autoscaling.md index 9659be9b..b5e2919d 100644 --- a/docs/kubernetes-autoscaling.md +++ b/docs/kubernetes-autoscaling.md @@ -147,6 +147,8 @@ - [purushothamkdr453.medium.com: Event driven autoscaling in kubernetes using KEDA](https://purushothamkdr453.medium.com/event-driven-autoscaling-in-kubernetes-using-keda-a0c16a383619) - [medium.com/@rtaplamaci: Horizontal Scaling on Kubernetes Clusters Based on AWS CloudWatch Metrics with KEDA](https://medium.com/@rtaplamaci/horizontal-scaling-on-kubernetes-clusters-based-on-aws-cloudwatch-metrics-with-keda-7c9e0e3ba5f) In this article, you will learn how to use KEDA to horizontally scale the workloads running in a Kubernetes cluster based on the custom metrics exposed via AWS CloudWatch - [medium.com/@hirushanonline: Dynamic Scaling with Kubernetes Event-driven Autoscaling (KEDA)](https://medium.com/@hirushanonline/dynamic-scaling-with-kubernetes-event-driven-autoscaling-keda-caaa15096e1c) +- [kedify.io: Prometheus and Kubernetes Horizontal Pod Autoscaler don’t talk, KEDA does](https://www.kedify.io/blog-posts/prometheus-and-kubernetes-horizontal-pod-autoscaler-dont-talk-keda-does) +- [github.com/kedacore/keda/issues/2214](https://github.com/kedacore/keda/issues/2214) Scaler for Amazon managed service for Prometheus #2214 ## Cluster Autoscaler and DockerHub diff --git a/docs/kubernetes-based-devel.md b/docs/kubernetes-based-devel.md index 59f12711..7de7bd10 100644 --- a/docs/kubernetes-based-devel.md +++ b/docs/kubernetes-based-devel.md @@ -108,6 +108,7 @@ - [betterprogramming.pub: Do Faster Development and Testing on Kubernetes Apps With Telepresence](https://betterprogramming.pub/do-faster-development-and-testing-on-kubernetes-apps-with-telepresence-b7eac604dca4) Use Telepresence to instantly deploy your code change to a Kubernetes cluster - [telepresence.io: Intercept a service in your own environment 🌟](https://www.telepresence.io/docs/latest/howtos/intercepts/) Today, I needed to intercept traffic sent to the application running on Kubernetes and forward it to the local dev instance. - [thenewstack.io: Cloud Native Debugging Challenges: From Local to ‘Remocal’](https://thenewstack.io/cloud-native-debugging-challenges-from-local-to-remocal/) Making remote clusters accessible, as though local, and giving developers tools to work locally in familiar ways are key ways to zap bugs and ship faster. +- [dev.to/dsudia: How to Integrate Docker & JetBrains into Telepresence](https://dev.to/dsudia/how-to-integrate-docker-jetbrains-into-telepresence-31op) Learn to debug Kubernetes containerized apps with Telepresence, set remote IDE breakpoints, manage Docker builds, and access cluster services. This guide covers environment setup, development practices, and IDE support for JVM and Go applications. ### Bridge to Kubernetes diff --git a/docs/kubernetes-monitoring.md b/docs/kubernetes-monitoring.md index ec15ce02..57cb0984 100644 --- a/docs/kubernetes-monitoring.md +++ b/docs/kubernetes-monitoring.md @@ -87,6 +87,10 @@ - [opentelemetry.io: Creating a Kubernetes Cluster with Runtime Observability](https://opentelemetry.io/blog/2023/k8s-runtime-observability/) - [medium.com/@onai.rotich: Understand container metrics and why they matter](https://medium.com/@onai.rotich/understand-container-metrics-and-why-they-matter-9e88434ca62a) In this 2-part article, you will explore the key metrics to scrape in your cluster - [kkamalesh117.medium.com: Setting up Prometheus and Grafana Integration on Kubernetes with Helm](https://kkamalesh117.medium.com/setting-up-prometheus-and-grafana-integration-on-kubernetes-with-helm-dfc63823608c) +- [medium.com/@MetricFire: Monitoring Kubernetes tutorial: Using Grafana and Prometheus](https://medium.com/@MetricFire/monitoring-kubernetes-tutorial-using-grafana-and-prometheus-3239079b138f) +- [medium.com/globant: Monitoring a multi-cluster Kubernetes Deployment](https://medium.com/globant/monitoring-a-multi-cluster-kubernetes-deployment-9e7a418a06b7) Deploying a high resilience monitoring and observation platform for Kubernetes multi-cluster solutions +- [medium.com/@martin.hodges: Adding observability to a Kubernetes cluster using Prometheus](https://medium.com/@martin.hodges/adding-observability-to-a-kubernetes-cluster-using-prometheus-c2cba6c0fdaa) Monitoring your services is vital and should be considered as part of your underlying infrastructure for your services. You should put this in place ahead of creating and deploying your services. In this article I look at how to deploy Prometheus provide the observability you need to run your services. +- [addozhang.medium.com: Non-intrusive Inject OpenTelemetry Auto-Instrumentation in Kubernetes](https://addozhang.medium.com/non-intrusive-inject-opentelemetry-auto-instrumentation-in-kubernetes-a9dfd49fc714) ## Kubernetes Logging diff --git a/docs/kubernetes-networking.md b/docs/kubernetes-networking.md index 81a728de..88a63e40 100644 --- a/docs/kubernetes-networking.md +++ b/docs/kubernetes-networking.md @@ -180,6 +180,7 @@ ## Kubernetes DNS - [blog.cloudsigma.com: Kubernetes DNS Service: A Beginner’s Guide](https://blog.cloudsigma.com/kubernetes-dns-service-a-beginners-guide/) Kubernetes DNS service allows you to contact services with consistent DNS names instead of IP addresses. +- [medium.com/@seifeddinerajhi: Kubernetes & DNS: A Guide to CoreDNS and ExternalDNS](https://medium.com/@seifeddinerajhi/kubernetes-dns-a-guide-to-coredns-and-externaldns-d8e9347bdddc) ## TCP Keep Alive Requests diff --git a/docs/kubernetes-operators-controllers.md b/docs/kubernetes-operators-controllers.md index a36e18bc..e894da60 100644 --- a/docs/kubernetes-operators-controllers.md +++ b/docs/kubernetes-operators-controllers.md @@ -162,6 +162,7 @@ - [github.com/2-alchemists/krossboard-kubernetes-operator](https://github.com/2-alchemists/krossboard-kubernetes-operator) Kubernetes Operator to handle cross-site, cross-distribution & multi-Kubernetes usage tracking, analytics and accounting (vanilla Kubernetes, OpenShift, EKS, AKS, GKE and other distros). - Krossboard is a multi-cluster and cross-distribution Kubernetes usage accounting and analytics software - Each instance of Krossboard enables tracking the usage of a set of Kubernetes clusters listed in a kubeconfig secret +- [medium.com/@mikakrief: Using Azure Service Operator v2](https://medium.com/@mikakrief/using-azure-service-operator-v2-4a1fa1f5e3b8) Azure Service Operator v2 is a Kubernetes operator that enables you to manage Azure resources directly through Kubernetes tooling. It’s designed to simplify the deployment and management of Azure services, allowing developers to use familiar Kubernetes commands (like kubectl apply) to handle Azure resources. ## OpenTelemetry Operator diff --git a/docs/kubernetes-releases.md b/docs/kubernetes-releases.md index bee45ffb..25015cb9 100644 --- a/docs/kubernetes-releases.md +++ b/docs/kubernetes-releases.md @@ -75,4 +75,5 @@ - [kubernetes.io: Kubernetes 1.27: In-place Resource Resize for Kubernetes Pods (alpha)](https://kubernetes.io/blog/2023/05/12/in-place-pod-resize-alpha/) - If you have deployed Kubernetes pods with CPU and/or memory resources specified, you may have noticed that changing the resource values involves restarting the pod. This has been a disruptive operation for running workloads... until now. - In Kubernetes v1.27, we have added a new alpha feature that allows users to resize CPU/memory resources allocated to pods without restarting the containers. -- [thenewstack.io: Kubernetes 1.28 Accommodates the Service Mesh, Sudden Outages](https://thenewstack.io/kubernetes-1-28-accommodates-the-service-mesh-sudden-outages/) This "Planternetes" release can keep service mesh containers running when the pod goes offline. Also in the box: Better support for DNS and more allowable time between necessary upgrades. \ No newline at end of file +- [thenewstack.io: Kubernetes 1.28 Accommodates the Service Mesh, Sudden Outages](https://thenewstack.io/kubernetes-1-28-accommodates-the-service-mesh-sudden-outages/) This "Planternetes" release can keep service mesh containers running when the pod goes offline. Also in the box: Better support for DNS and more allowable time between necessary upgrades. +- [levelup.gitconnected.com: Kubernetes Planternetes v1.28: Non-Graceful Node Shutdown Feature](https://levelup.gitconnected.com/kubernetes-planternetes-v1-28-non-graceful-node-shutdown-feature-8608d5073519) If a node shuts down unexpectedly or ends up in a non-recoverable state (perhaps due to hardware failure or unresponsive OS), Kubernetes allows you to clean up afterward and allow stateful workloads to restart on a different node. \ No newline at end of file diff --git a/docs/kubernetes-security.md b/docs/kubernetes-security.md index 1b442e4a..fbca7e4e 100644 --- a/docs/kubernetes-security.md +++ b/docs/kubernetes-security.md @@ -145,6 +145,8 @@ - [medium.com/cloudyrion: Kubernetes end-to-end chain exploit](https://medium.com/cloudyrion/kubernetes-end-to-end-chain-exploit-c2be32688fd0) This article details the security flaws discovered in Kubernetes and GitOps tools due to improper configurations. It also demonstrates how an attacker could perform post-exploitation attacks, increasing their privileges and the attack surface. - [==itnext.io: Performing Security Checks for Deployed Kubernetes Manifests==](https://itnext.io/performing-security-checks-for-deployed-kubernetes-manifests-fa9d442b7951) An effective tool for checking security rule violations in Kubernetes deployments using **Polaris** - [==securitycafe.ro: A COMPLETE KUBERNETES CONFIG REVIEW METHODOLOGY==](https://securitycafe.ro/2023/02/27/a-complete-kubernetes-config-review-methodology/) +- [==itnext.io: Introduction to Kubernetes Security for Security Professionals==](https://itnext.io/introduction-to-kubernetes-security-for-security-professionals-a61b424f7a2a) Presenting the architecture of Kubernetes and its associated security threats, for security professionals, including penetration testers and DevSecOps practitioners. +- [dev.to/mattiasfjellstrom: Kubernetes-101: Security concepts](https://dev.to/mattiasfjellstrom/kubernetes-101-security-concepts-2f4f) The article provides an overview of Kubernetes security concepts, focusing on NetworkPolicies, ServiceAccounts, and Security Contexts
[![kubernetes security mindmap](images/k8s_securitymindmap.jpg)](https://www.blackhat.com/) diff --git a/docs/kubernetes-tools.md b/docs/kubernetes-tools.md index 210873cf..29bdf427 100644 --- a/docs/kubernetes-tools.md +++ b/docs/kubernetes-tools.md @@ -636,6 +636,8 @@ elastic quotas - Effortless optimization at its finest! - Roles - [granted.dev](https://www.granted.dev) A CLI application which provides the world’s best developer UX for finding and accessing cloud roles to multiple cloud accounts, fast! - [devtron.ai](https://devtron.ai/) Adopt Kubernetes in Weeks With Our K8s Acceleration Platform. Old software delivery platforms are holding you back and slowing you down. Rapidly adopt K8s without creating cognitive overload for your developers. +- [==github.com/kubefirst/kubefirst==](https://github.com/kubefirst/kubefirst) The Kubefirst CLI creates instant GitOps platforms that integrate some of the best tools in cloud native from scratch in minutes. +- [github.com/Trolley-MGMT/trolleymgmt](https://github.com/Trolley-MGMT/trolleymgmt) Trolley is a multi cloud Kubernetes management system. A simplified UI which allows the user to Deploy, Edit and Delete clusters and deployments within them on AWS, Azure and GCP. ## Portainer @@ -884,6 +886,7 @@ elastic quotas - Effortless optimization at its finest! - End-to-end working code to implement a fully functional EKS Cluster - [dev.to: Karpenter: The Better Autoscaling Solution for Kubernetes- Part 1](https://dev.to/aws-builders/karpenter-the-better-autoscaling-solution-for-kubernetes-part-1-4pd5) - [medium.com/summit-technology-group: Karpenter — AutoScaling and Right-Sizing EKS Nodes](https://medium.com/summit-technology-group/karpenter-autoscaling-and-right-sizing-eks-nodes-bc6d2b83d48e) Karpenter simplifies node autoscaling and right-sizing for Kubernetes workloads on AWS, resulting in cost savings and easier use of spot instances +- [medium.com/israeli-tech-radar: Karpenter, and the future of Kubernetes](https://medium.com/israeli-tech-radar/karpenter-and-the-future-of-kubernetes-4ab7428b7f87) ## Kuby (easy deployments of Ruby Rails App) diff --git a/docs/kubernetes.md b/docs/kubernetes.md index 7d5406c9..b61bea0b 100644 --- a/docs/kubernetes.md +++ b/docs/kubernetes.md @@ -49,7 +49,7 @@ 13. [Reserved CPU and memory in Kubernetes nodes](#reserved-cpu-and-memory-in-kubernetes-nodes) 14. [Kubernetes Capacity and Resource Management. Resource Quotas per namespace, LimitRanges per namespace, Limits and Requests per POD](#kubernetes-capacity-and-resource-management-resource-quotas-per-namespace-limitranges-per-namespace-limits-and-requests-per-pod) 15. [Kubernetes Scheduler. Kube Scheduler](#kubernetes-scheduler-kube-scheduler) - 1. [Pod rebalancing and allocations](#pod-rebalancing-and-allocations) + 1. [Pod rebalancing and allocations. Pod Priorities](#pod-rebalancing-and-allocations-pod-priorities) 16. [Kubernetes etcd](#kubernetes-etcd) 17. [Kubernetes Sidecars](#kubernetes-sidecars) 18. [Kubernetes Annotations](#kubernetes-annotations) @@ -309,6 +309,7 @@ - [medium.com/@extio: Understanding Kubernetes Annotations: Enhancing Flexibility and Extensibility](https://medium.com/@extio/understanding-kubernetes-annotations-enhancing-flexibility-and-extensibility-8f9046591aa1) - [aws.plainenglish.io: $ kubectl get kubernetes -o architecture](https://aws.plainenglish.io/kubectl-get-kubernetes-o-architecture-6d4bd97dcaaf) - [freecodecamp.org: How to Deploy an Application to a Kubernetes Cluster](https://www.freecodecamp.org/news/deploy-docker-image-to-kubernetes/) +- [medium.com/@kylelzk: Kubernetes Theory - Understanding Kubernetes Components: A Deep Dive](https://medium.com/@kylelzk/kubernetes-theory-understanding-kubernetes-components-a-deep-dive-ac31b7463df2) ### Kubernetes Jobs Market @@ -708,6 +709,7 @@ - [medium.com/@GranulateIntel: The Fundamental Principles of Kubernetes Capacity Management](https://medium.com/@GranulateIntel/the-fundamental-principles-of-kubernetes-capacity-management-e23f388b4f3) - [thenewstack.io: Optimizing Kubernetes for Peak Traffic and Avoiding Setbacks](https://thenewstack.io/optimizing-kubernetes-for-peak-traffic-and-avoiding-setbacks/) Machine learning and automation can help platform teams tame complexity and meet user demand with confidence. - [tech.bigbasket.com: Atlas: Streamlining BigBasket’s 40+ lines of testing across 80+ Microservices in Non-Production Environments](https://tech.bigbasket.com/atlas-streamlining-bigbaskets-40-lines-of-testing-across-80-microservices-in-non-production-459040947519) BigBasket's non-prod setup is complex due to multiple environments and service versions (each service can run multiple versions of itself). Learn how the team solved this with a custom proxy, header-based routing, and automated Nginx config generation. +- [hervekhg.medium.com: 3 years managing Kubernetes clusters, my 10 lessons](https://hervekhg.medium.com/3-years-managing-kubernetes-clusters-my-10-lessons-b565a5509f0e) ### KubeCon @@ -1117,7 +1119,6 @@ - [medium.com/linux-shots: Find Deprecated API Resources used in a Kubernetes Cluster](https://medium.com/linux-shots/find-deprecated-api-resources-used-in-a-kubernetes-cluster-44756c1126c8) In this article, you will discuss the challenges of how to upgrade clusters with breaking changes and use kube-no-trouble to test the upgrade path. - [blog.jimmyray.io: Discover K8s Through Its APIs](https://blog.jimmyray.io/discover-k8s-through-its-apis-e2f90937a19f) In this article, you will learn how to use the Kubernetes APIs through the Swagger UI. You will learn how to retrieve the full config for the kubelet, as well as how to use gron for easier JSON processing. - #### Multi-Cluster Services API - [thenewstack.io: Extending Kubernetes Services with Multi-Cluster Services API](https://thenewstack.io/extending-kubernetes-services-with-multi-cluster-services-api/) @@ -1208,6 +1209,8 @@ - [wbhegedus.me: Demystifying Kubernetes CPU Limits (and Throttling)](https://wbhegedus.me/understanding-kubernetes-cpu-limits/) In this article, you will discuss a clear example of CPU throttling on Kubernetes and how you could monitor and fix it - [medium.com/@jettycloud: Making Sense of Kubernetes CPU Requests And Limits](https://medium.com/@jettycloud/making-sense-of-kubernetes-cpu-requests-and-limits-390bbb5b7c92) - [loft.sh: How to Set Up Kubernetes Requests and Limits](https://loft.sh/blog/how-to-set-up-kubernetes-requests-and-limits/) +- [dev.to: Impacts Of Not Setting Requests, Limits, and Quotas | Michael Levan](https://dev.to/thenjdevopsguy/impacts-of-not-setting-requests-limits-and-quotas-5f4b) +- [faun.pub: Kubernetes Chronicles:(K8s#04)|K8s Series | POD Resource Request & Limits](https://faun.pub/kubernetes-chronicles-k8s-04-k8s-series-pod-resource-request-limits-49ac0cf67ae6) ### Kubernetes Scheduler. Kube Scheduler @@ -1217,9 +1220,10 @@ - [medium: K8S - Creating a kube-scheduler plugin](https://medium.com/@juliorenner123/k8s-creating-a-kube-scheduler-plugin-8a826c486a1) The k8s scheduler assigns Pods to Nodes. Then, the attempt to schedule a pod is split into two phases: the Scheduling and the Binding cycle. Learn how you can build a Kube-scheduler plugin from scratch! - [faun.pub: Multiple Schedulers in Kubernetes](https://faun.pub/multiple-schedulers-in-kubernetes-a78a7b4fa4b2) -#### Pod rebalancing and allocations +#### Pod rebalancing and allocations. Pod Priorities - [==community.ops.io: Pod rebalancing and allocations in Kubernetes== 🌟](https://community.ops.io/danielepolencic/pod-rebalancing-and-allocations-in-kubernetes-4kim) **Does Kubernetes rebalance your Pods? If there's a node that has more space, does Kubernetes recompute and balance the workloads?** +- [faun.pub: How to utilize priorities in Kubernetes?](https://faun.pub/how-to-use-priorities-in-kubernetes-e1bb1b722b6a) A powerful feature to save the work-life balance of on-call engineers. Priorities is a fundamental concept in Kubernetes and one reason it is powerful. For instance, in your production environment, you don’t want critical services to be evicted because of less important ones. Using priorities, you can tackle this problem. In this blog, we will learn more about priorities and how we can utilize them the most. ### Kubernetes etcd diff --git a/docs/kustomize.md b/docs/kustomize.md index 957d6270..fc3cf176 100644 --- a/docs/kustomize.md +++ b/docs/kustomize.md @@ -37,6 +37,8 @@ - [levelup.gitconnected.com: Helm vs. Kustomize: Navigating Kubernetes Configuration Complexity](https://levelup.gitconnected.com/helm-vs-kustomize-navigating-kubernetes-configuration-complexity-ae86596c3cf2) - [==devopscube.com/kustomize-tutorial: Kustomize Tutorial: Comprehensive Guide For Beginners== 🌟](https://devopscube.com/kustomize-tutorial) - [blog.devgenius.io: Kustomize — K8 manifest patching](https://blog.devgenius.io/kustomize-simple-manifest-manipulation-9330f7f40d5d) In this tutorial, you will learn how to manipulate YAML files using Kustomize +- [faun.pub: How to build a GitOps workflow with ArgoCD, Kustomize and GitHub Actions](https://faun.pub/how-to-build-a-gitops-workflow-with-argocd-kustomize-and-github-actions-f919e7443295) Gain speed and clarity by adopting GitOps for your deployments +- [==techiescamp.com: Kubernetes Kustomize Crash Course==](https://techiescamp.com/courses/kubernetes-kustomize/) In this Kustomize crash course, you will learn all the Kustomize concepts and deploy an application using Kustomize on a Kubernetes cluster. ## Secretize plugin diff --git a/docs/linux.md b/docs/linux.md index 364de834..5f844109 100644 --- a/docs/linux.md +++ b/docs/linux.md @@ -240,6 +240,7 @@ - [itsfoss.com: 5 htop Alternatives to Enhance Your Linux System Monitoring Experience](https://itsfoss.com/htop-alternatives/) - [dev.to: 50 Linux Commands every developer NEED to know with example](https://dev.to/kanani_nirav/50-linux-commands-every-developer-need-to-know-with-example-mc) - [blog.devgenius.io: DevOps in Linux — Systemd Introduction](https://blog.devgenius.io/devops-in-linux-systemd-introduction-db7f49cb566b) +- [difftastic.wilfred.me.uk](https://difftastic.wilfred.me.uk) Difftastic is a CLI diff tool that compares files based on their syntax, not line-by-line. Difftastic produces accurate diffs that are easier for humans to read. ## Makefiles diff --git a/docs/managed-kubernetes-in-public-cloud.md b/docs/managed-kubernetes-in-public-cloud.md index aec1a142..1512483c 100644 --- a/docs/managed-kubernetes-in-public-cloud.md +++ b/docs/managed-kubernetes-in-public-cloud.md @@ -12,8 +12,9 @@ 5. [EKS Distro (EKS-D)](#eks-distro-eks-d) 6. [Testing Kubernetes Canary deployment on EKS](#testing-kubernetes-canary-deployment-on-eks) 6. [AKS Azure Kubernetes Service](#aks-azure-kubernetes-service) - 1. [AKS Lite](#aks-lite) - 2. [Draft 2 on AKS](#draft-2-on-aks) + 1. [AKS Releases](#aks-releases) + 2. [AKS Lite](#aks-lite) + 3. [Draft 2 on AKS](#draft-2-on-aks) 7. [GKE Google Kubernetes Engine](#gke-google-kubernetes-engine) 8. [IKS IBM Cloud Kubernetes Service](#iks-ibm-cloud-kubernetes-service) 9. [Linode Kubernetes Engine LKE](#linode-kubernetes-engine-lke) @@ -226,6 +227,8 @@ - [Eliminate Kubernetes node scaling lag with pod priority and over-provisioning](https://aws.amazon.com/blogs/containers/eliminate-kubernetes-node-scaling-lag-with-pod-priority-and-over-provisioning/) In this post, you'll learn how to over-provision the cluster worker nodes using dummy pods for quicker scaling. The dummy pods contain a pause container that is scheduled by the scheduler according to pod specifications' placements and CPU/memory. - [==itnext.io: Efficient Kubernetes Cluster Deployment: Accelerating Setup with EKS Blueprints==](https://itnext.io/efficient-kubernetes-cluster-deployment-accelerating-setup-with-eks-blueprints-68324b582ec9) - [medium.com/@danielresponda: Testing Spot Reclamation Mechanisms with AWS Node Termination Handler and Kubernetes Autoscaler](https://medium.com/@danielresponda/testing-spot-reclamation-mechanisms-with-aws-node-termination-handler-and-kubernetes-autoscaler-43194d05dae0) What happens if a spot instance is reclaimed, but no more capacity is available in the cluster? In this article, you will learn how to use the AWS Node Termination Handler with Kubernetes Autoscaler to handle spot reclamations seamlessly +- [Amazon EKS introduces EKS Pod Identity](https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-eks-pod-identity) +- [itnext.io: AWS Elastic Kubernetes Service: RBAC Authorization via AWS IAM and RBAC Groups](https://itnext.io/aws-elastic-kubernetes-service-rbac-authorization-via-aws-iam-and-rbac-groups-7b70ded144b5) ### EKS Upgrades @@ -271,6 +274,7 @@ - [learn.microsoft.com: Introduction to Kubernetes on Azure](https://learn.microsoft.com/en-us/training/paths/intro-to-kubernetes-on-azure) - [==azure.github.io/AKS-Construction== 🌟](https://azure.github.io/AKS-Construction/) **AKS Construction Helper** +- [youtube: The AKS Community](https://www.youtube.com/@theakscommunity) - [==the-aks-checklist.com: The Azure Kubernetes Service Checklist== 🌟🌟🌟](https://www.the-aks-checklist.com/) This checklist contains a large set of best practices and some of them may not be relevant to your context and thus the rating may be incorrect in your case. Please choose and apply them wisely. - [docs.microsoft.com: Baseline architecture for an Azure Kubernetes Service (AKS) cluster 🌟](https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/containers/aks/baseline-aks) In this reference architecture, you'll build a baseline infrastructure that deploys an AKS cluster. The article includes recommendations for networking, security, identity, management, and monitoring. - [docs.microsoft.com: Microservices architecture on Azure Kubernetes Service (AKS) 🌟](https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/containers/aks-microservices/aks-microservices) This reference architecture shows a microservices application deployed to Azure Kubernetes Service (AKS). It describes a basic AKS configuration that can be the starting point for most deployments. The architecture consists of the following components: @@ -395,6 +399,12 @@ - [returngis.net: Desplegar AGIC en AKS utilizando workload identity](https://www.returngis.net/2023/05/desplegar-agic-en-aks-utilizando-workload-identity/) - [learn.microsoft.com: Use Application Gateway Ingress Controller (AGIC) with a multitenant Azure Kubernetes Service](https://learn.microsoft.com/en-us/azure/architecture/example-scenario/aks-agic/aks-agic) - [returngis.net: Exponer APIs en AKS a través de Azure API Management](https://www.returngis.net/2023/05/exponer-apis-en-aks-a-traves-de-azure-api-management/) +- [==techcommunity.microsoft.com: A Practical Guide to Zone Redundant AKS Clusters and Storage==](https://techcommunity.microsoft.com/t5/fasttrack-for-azure/a-practical-guide-to-zone-redundant-aks-clusters-and-storage/ba-p/4036254) +- [==learn.microsoft.com: AKS landing zone accelerator==](https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/scenarios/app-platform/aks/landing-zone-accelerator) + +### AKS Releases + +- [dinantpaardenkooper.nl: Microsoft AKS updates 2023 - Q4](https://dinantpaardenkooper.nl/posts/aks23q4/) ### AKS Lite @@ -521,6 +531,8 @@ ## Videos +- [youtube: The AKS Community](https://www.youtube.com/@theakscommunity) +
Click to expand! diff --git a/docs/message-queue.md b/docs/message-queue.md index b001dad6..2818e204 100644 --- a/docs/message-queue.md +++ b/docs/message-queue.md @@ -109,6 +109,8 @@ - [medium.com/event-driven-utopia: Comparing Stateful Stream Processing and Streaming Databases](https://medium.com/event-driven-utopia/comparing-stateful-stream-processing-and-streaming-databases-c8c670f3f4bb) How do these two technologies work? how do they differ, and when is the right time to use them? - [thenewstack.io: How to Get Started with Data Streaming](https://thenewstack.io/how-to-get-started-with-data-streaming/) With Kafka and associated tools, developers can create stream-processing pipelines that transform data for real-time applications. - [linkedin.com: How to Move From a “Wait for it...” Batch-Processing Culture to a “Get It Now” Real-Time Data Culture](https://www.linkedin.com/pulse/how-move-from-wait-batch-processing-culture-get-now-tomsen-bukovec/) +- [dzone: Resilient MultiCloud Messaging](https://dzone.com/articles/messaging-for-multicloud-resilience) Messaging becomes an important technical option when operating solutions span clouds, hybrid deployments, and even inter-application and inter-process communication. +- [juhache.substack.com: From Data Engineer to YAML Engineer](https://juhache.substack.com/p/from-data-engineer-to-yaml-engineer-ed2) ## RPC vs Messaging @@ -489,6 +491,7 @@ comsysto about their usage of Debezium, touching on many details like outbox pat - [blog.devgenius.io: Send information from Databricks to Airflow](https://blog.devgenius.io/send-information-from-databricks-to-airflow-810a7d49ff81) - [==medium.com/apache-airflow: Passing Data Between Tasks with the KubernetesPodOperator in Apache Airflow== 🌟](https://medium.com/apache-airflow/passing-data-between-tasks-with-the-kubernetespodoperator-in-apache-airflow-7ae9e3e6675c) TL;DR: Use the @task.kubernetes decorator! - [medium.com/@piyush_74867: Apache Airflow on Kubernetes at scale — a peak under the hood](https://medium.com/@piyush_74867/apache-airflow-on-kubernetes-at-scale-a-peak-under-the-hood-1eebb9b4769b) +- [medium.com/@alfahreiza: Building an ELT Pipeline: From CSV to BigQuery using dbt](https://medium.com/@alfahreiza/building-an-elt-pipeline-from-csv-to-bigquery-using-dbt-f6e3f30bfc9c) ### Couler diff --git a/docs/mlops.md b/docs/mlops.md index a2b6408e..d05aee90 100644 --- a/docs/mlops.md +++ b/docs/mlops.md @@ -1,22 +1,25 @@ # Machine Learning Ops (MLOps) and Data Science 1. [Introduction. MLOps](#introduction-mlops) -2. [ML Infra](#ml-infra) -3. [Object Detection Libraries](#object-detection-libraries) -4. [MLFlow](#mlflow) -5. [Kubeflow](#kubeflow) -6. [Flyte](#flyte) -7. [Azure ML](#azure-ml) -8. [KServe Cloud Native Model Server](#kserve-cloud-native-model-server) -9. [Data Science](#data-science) -10. [Machine Learning workloads in kubernetes using Nix and NVIDIA](#machine-learning-workloads-in-kubernetes-using-nix-and-nvidia) -11. [Other Tools](#other-tools) -12. [Debugging ML Jobs](#debugging-ml-jobs) -13. [Samples](#samples) -14. [ML Courses](#ml-courses) -15. [ML Competitions and Challenges](#ml-competitions-and-challenges) -16. [Polls](#polls) -17. [Tweets](#tweets) +2. [MLOps Roadmap](#mlops-roadmap) +3. [Blogs](#blogs) +4. [ML Infra](#ml-infra) +5. [Object Detection Libraries](#object-detection-libraries) +6. [MLFlow](#mlflow) +7. [Kubeflow](#kubeflow) +8. [Flyte](#flyte) +9. [AWS ML](#aws-ml) +10. [Azure ML](#azure-ml) +11. [KServe Cloud Native Model Server](#kserve-cloud-native-model-server) +12. [Data Science](#data-science) +13. [Machine Learning workloads in kubernetes using Nix and NVIDIA](#machine-learning-workloads-in-kubernetes-using-nix-and-nvidia) +14. [Other Tools](#other-tools) +15. [Debugging ML Jobs](#debugging-ml-jobs) +16. [Samples](#samples) +17. [ML Courses](#ml-courses) +18. [ML Competitions and Challenges](#ml-competitions-and-challenges) +19. [Polls](#polls) +20. [Tweets](#tweets) ## Introduction. MLOps @@ -57,6 +60,27 @@ - [learn.microsoft.com: Machine Learning operations maturity model 🌟](https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/mlops-maturity-model) - [medium.com/ai-hero: Streamlining Machine Learning Operations (MLOps) with Kubernetes and Terraform](https://medium.com/ai-hero/streamlining-machine-learning-operations-with-kubernetes-and-terraform-41baad37998e) Leveraging Terraform to Simplify AWS EKS Cluster Setup for Exploring Declarative ML Tools - [medium.com/@karanshingde: Machine Learning in Production— Your Comprehensive 101 Practical Guide](https://medium.com/@karanshingde/machine-learning-in-production-your-comprehensive-101-practical-guide-c7de0b5ad011) +- [marvelousmlops.substack.com: CI/CD for MLOps on GitLab (part 1)](https://marvelousmlops.substack.com/p/cicd-for-mlops-on-gitlab-part-1) Code your way to your first CI pipeline +- [medium.com/aiguys: MLOps: Serving AI apps to million users](https://medium.com/aiguys/mlops-serving-ai-to-million-users-c77ed718b7ed) +- [marvelousmlops.substack.com: How to sell MLOps in large Organizations](https://marvelousmlops.substack.com/p/how-to-sell-mlops-in-large-organizations) +- [marvelousmlops.substack.com: MLOps roadmap 2024](https://marvelousmlops.substack.com/p/mlops-roadmap-2024) +- [towardsdatascience.com: Deploying LLM Apps to AWS, the Open-Source Self-Service Way](https://towardsdatascience.com/deploying-llm-apps-to-aws-the-open-source-self-service-way-c54b8667d829) A step-by-step guide on deploying LlamaIndex RAGs to AWS ECS fargate +- [axelmendoza.com: The Ultimate Guide To ML Model Deployment In 2024](https://www.axelmendoza.com/posts/ml-model-deployment/) Explore the top ML model deployment tools of 2024 with this comprehensive guide. Uncover insights on Vertex AI, AWS Sagemaker, Seldon, KServe for successful ML projects. +- [towardsdatascience.com: Build Machine Learning Pipelines with Airflow and Mlflow: Reservation Cancellation Forecasting](https://towardsdatascience.com/build-machine-learning-pipelines-with-airflow-and-mlflow-reservation-cancellation-forecasting-da675d409842) Learn how to create reproducible and ready-for-production Machine Learning pipelines through a Senior Machine Learning assignment +- [marvelousmlops.substack.com: Technical roles in Data Science: Who is doing what?](https://marvelousmlops.substack.com/p/technical-roles-in-data-science-who) +- [marvelousmlops.substack.com: Traceability & Reproducibility](https://marvelousmlops.substack.com/p/traceability-and-reproducibility) +- [marvelousmlops.substack.com: Learn Machine Learning and Neural Networks without Frameworks](https://www.freecodecamp.org/news/learn-machine-learning-and-neural-networks-without-frameworks/) +- [==seattledataguy.substack.com: Data Engineering Vs Machine Learning Pipelines==](https://seattledataguy.substack.com/p/data-engineering-vs-machine-learning) +- [semaphoreci.com: Why Do We Need DevOps for ML Data?](https://semaphoreci.com/blog/devops-ml-data) +- [nannyml.com: Automating post-deployment Data Collection for ML Monitoring](https://www.nannyml.com/blog/sdk-nannyml-data-collection-ml-monitoring) + +## MLOps Roadmap + +- [==roadmap.sh: MLOps roadmap==](https://roadmap.sh/r?id=65a112f2b8633950ffcf38b6) Roadmap to learn about MLOps + +## Blogs + +- [Marvelous MLOps Substack](https://marvelousmlops.substack.com) ## ML Infra @@ -111,6 +135,10 @@ - [mlops.community: MLOps Simplified: orchestrating ML pipelines with infrastructure abstraction. Enabled by Flyte](https://mlops.community/flyte-mlops-simplified/) - [medium.com/@timleonardDS: Who Let the DAGs out? Register an External DAG with Flyte (Chapter 3)](https://medium.com/@timleonardDS/who-lets-the-dags-out-register-an-external-dag-with-flyte-chapter-3-bad0ea781119) +## AWS ML + +- [aws.amazon.com: MLOps foundation roadmap for enterprises with Amazon SageMaker](https://aws.amazon.com/blogs/machine-learning/mlops-foundation-roadmap-for-enterprises-with-amazon-sagemaker/) + ## Azure ML - [docs.microsoft.com: MLflow and Azure Machine Learning](https://docs.microsoft.com/en-us/azure/machine-learning/concept-mlflow) One of the open-source projects that has made #ML better is MLFlow. Microsoft is expanding support for APIs, no-code deployment for MLflow models in real-time/batch managed inference, curated MLflow settings, and CLI v2 integrations. @@ -155,6 +183,7 @@ - [thenewstack.io: 7 Must-Have Python Tools for ML Devs and Data Scientists 🌟](https://thenewstack.io/7-must-have-python-tools-for-ml-devs-and-data-scientists/) Python has an easy learning curve, however there are a range of development tools to consider if you're to use Python to its full potential. - [github.com/SymbioticLab/Oobleck: Oobleck - Resilient Distributed Training Framework](https://github.com/SymbioticLab/Oobleck) - [techxplore.com: Open-source training framework increases the speed of large language model pre-training when failures arise](https://techxplore.com/news/2023-12-open-source-framework-large-language-pre-training.html) - [github.com/CASIA-IVA-Lab/FastSAM](https://github.com/CASIA-IVA-Lab/FastSAM) Fast Segment Anything +- [github.com/VikParuchuri/surya](https://github.com/VikParuchuri/surya) Accurate line-level text detection and recognition (OCR) in any language ## Debugging ML Jobs @@ -165,6 +194,7 @@ ## Samples - [fepegar/vesseg](https://github.com/fepegar/vesseg) Brain vessel segmentation using 3D convolutional neural networks +- [github.com/10tanmay100: MEDICAL-DATA-PROJECT-END2END-WITH-FEW-MLOPS](https://github.com/10tanmay100/MEDICAL-DATA-PROJECT-END2END-WITH-FEW-MLOPS) We are on a mission to transform medical data into actionable insights using the power of machine learning. Whether you are a data scientist, healthcare professional, or an enthusiast in the field, your contributions and ideas are invaluable to us. Join us in making a difference! ## ML Courses diff --git a/docs/ocp4.md b/docs/ocp4.md index b39dabab..3c06ac35 100644 --- a/docs/ocp4.md +++ b/docs/ocp4.md @@ -198,6 +198,7 @@ - [openshift.com: Using VPC Peering to Connect an OpenShift Service on an AWS (ROSA) Cluster to an Amazon RDS MySQL Database in a Different VPC](https://www.openshift.com/blog/using-vpc-peering-to-connect-an-openshift-service-on-an-aws-rosa-cluster-to-an-amazon-rds-mysql-database-in-a-different-vpc) - [blog.vizuri.com: Red Hat OpenShift Service on AWS (ROSA) Positions OpenShift for Mainstream Adoption](https://blog.vizuri.com/red-hat-openshift-service-on-aws-rosa-positions-openshift-for-mainstream-adoption) - [==cloud.redhat.com: Scale your application containers on Red Hat OpenShift Service on AWS (ROSA) clusters using Amazon EFS storage==](https://cloud.redhat.com/blog/scale-your-application-containers-on-red-hat-openshift-service-on-aws-rosa-clusters-using-amazon-efs-storage) +- [redhat.com: Red Hat OpenShift Service on AWS with hosted control planes now available](https://www.redhat.com/en/blog/red-hat-openshift-service-aws-hosted-control-planes-now-available) Having the control plane hosted and managed in a ROSA service AWS account rather than the customer’s individual account provides more effective and efficient use of resources.
[![OCP 4 Architecture](images/ocp4_arch.png)](https://www.openshift.com/blog/enterprise-kubernetes-with-openshift-part-one) diff --git a/docs/project-management-methodology.md b/docs/project-management-methodology.md index 4a53bfa4..844661e5 100644 --- a/docs/project-management-methodology.md +++ b/docs/project-management-methodology.md @@ -97,6 +97,8 @@ - [techrepublic.com: What is Lean Software Development?](https://www.techrepublic.com/article/lean-development/) - [medium.com/@ElizAyer: Meetings *are* the work](https://medium.com/@ElizAyer/meetings-are-the-work-9e429dde6aa3) - [newsletter.pragmaticengineer.com: Engineering Leadership Skill Set Overlaps](https://newsletter.pragmaticengineer.com/p/engineering-leadership-skillset-overlaps) How Staff Engineer, Engineering Manager (EM), Product Manager (PM), Tech Lead Manager (TLM) and Technical Program Manager (TPM) positions overlap in Big Tech and at high-growth startups. **If you are an individual contributor engineer, you really need to print this out and hang it somewhere** +- [hbr.org: What It Takes to Give a Great Presentation](https://hbr.org/2020/01/what-it-takes-to-give-a-great-presentation) +- [inc.com: 27 Years Ago, Steve Jobs Said the Best Employees Focus on Content, Not Process. Research Shows He Was Right](https://www.inc.com/jeff-haden/27-years-ago-steve-jobs-said-best-employees-focus-on-content-not-process-workplace-research-shows-he-was-right.html) According to the Apple co-founder, the best employees are also a pain in the butt to manage. ### Spanish @@ -128,6 +130,7 @@ - [businessinsider.es: Avanzar en la carrera profesional y conseguir ascensos dentro de la empresa será mucho más difícil para las personas que teletrabajan, según el CEO de IBM](https://www.businessinsider.es/teletrabajar-perjudica-carrera-profesional-posibles-ascensos-1240782) - [genbeta.com: Un ex-CEO, sobre el origen de tener gente que ni hace falta en las empresas: “Contratas a alguien, y lo primero que hace es contratar"](https://www.genbeta.com/a-fondo/este-ex-ceo-explica-que-hay-demasiados-empleados-empresas-contratas-a-alguien-primero-que-quiere-contratar) - [businessinsider.es: La brillante explicación de Steve Jobs sobre por qué los buenos empleados renuncian al trabajo](https://www.businessinsider.es/explicacion-steve-jobs-buenos-empleados-renuncian-1137601) +- [openwebinars.net: 13 Errores que cometes como Manager](https://openwebinars.net/blog/13-errores-que-cometes-como-manager) ¿Tu equipo no está funcionando al nivel esperado? Quizás el problema no sea su desempeño, sino ciertas prácticas de gestión. Este artículo identifica 13 errores críticos que muchos managers cometen, para que aprendas a evitarlos y a construir un ambiente de trabajo más productivo y motivador. ### Team Topologies diff --git a/docs/prometheus.md b/docs/prometheus.md index fee5351d..373bb75b 100644 --- a/docs/prometheus.md +++ b/docs/prometheus.md @@ -148,6 +148,7 @@ Thanos Metrics with prometheus in Kubernetes environments. - [medium.com/criteo-engineering: How we reduced our Prometheus infrastructure footprint by a third](https://medium.com/criteo-engineering/how-we-reduced-our-prometheus-infrastructure-footprint-by-a-third-8bf8171e46b1) - [blog.devops.dev: Observability Concept in Prometheus](https://blog.devops.dev/observability-concept-in-prometheus-9f0093fa7495) In This blog, we will talk more about other components of Prometheus that are useful in understanding and in the field of DevOps and SRE. These terms are common in Prometheus also the topics are discussed in PCA certification - [==horovits.medium.com: Prometheus Now Supports OpenTelemetry Metrics==](https://horovits.medium.com/prometheus-now-supports-opentelemetry-metrics-83f85878e46a) +- [==thenewstack.io: 30 Pull Requests Later, Prometheus Memory Use Is Cut in Half==](https://thenewstack.io/30-pull-requests-later-prometheus-memory-use-is-cut-in-half/) Grafana Labs Distinguished Engineer Bryan Boreham detailed at KubeCon how he reduced the memory usage of Prometheus.
[![prometheus architecture](images/prometheus-architecture.png)](https://github.com/prometheus/prometheus) diff --git a/docs/public-cloud-solutions.md b/docs/public-cloud-solutions.md index d46030d1..c58769e4 100644 --- a/docs/public-cloud-solutions.md +++ b/docs/public-cloud-solutions.md @@ -30,6 +30,7 @@ - [medium.com/adeo-tech: Multi-Cloud Kubernetes Survival Guide 🌟](https://medium.com/adeo-tech/multi-cloud-kubernetes-survival-guide-49eee9aa58e2) - [acloudguru.com: Multicloud Fluency: 6 reasons you should learn multiple clouds](https://acloudguru.com/blog/engineering/why-learn-multiple-cloud-platforms) - [digitalisationworld.com: Multicloud: Two truths and a lie](https://digitalisationworld.com/blogs/57435/multicloud-two-truths-and-a-lie) +- [nextgov.com: Why smart multicloud policies are a golden ticket to modernizing IT infrastructure](https://www.nextgov.com/ideas/2023/11/why-smart-multicloud-policies-are-golden-ticket-modernizing-it-infrastructure/392232/) ## Public Cloud Services Comparison @@ -53,6 +54,7 @@ - [simform.com: AWS vs. Azure vs. GCP: A Complete Comparison Guide](https://www.simform.com/blog/aws-vs-azure-vs-gcp/) - [faddom.com: Cloud Computing Costs & Pricing Comparisons for 2023](https://faddom.com/cloud-computing-costs-and-pricing-comparison/) - [thenewstack.io: How to Evaluate Kubernetes Cloud Providers](https://thenewstack.io/how-to-evaluate-kubernetes-cloud-providers/) Companies turn to cloud providers for benefits like scalability, security and high availability, but the offerings are not identical. How can you ensure a good fit? +- [==cloud.google.com: Compare AWS and Azure services to Google Cloud==](https://cloud.google.com/docs/get-started/aws-azure-gcp-service-comparison) ## Openshift as a Service diff --git a/docs/python.md b/docs/python.md index 3e711ab7..2442842b 100644 --- a/docs/python.md +++ b/docs/python.md @@ -263,6 +263,9 @@ - [martinheinz.dev: Boost Your Python Application Performance using Continuous Profiling](https://martinheinz.dev/blog/89) Learn how to use Grafana Phlare and continuous profiling to discover bottlenecks in your code and boost the performance of your Python apps running in Kubernetes - [towardsdatascience.com: Memoizing DataFrame Functions](https://towardsdatascience.com/memoizing-dataframe-functions-7a27dff532f7) Using Hashable DataFrames and Message Digests to Optimize Repeated Calculations - [anaconda.com: Why Data Scientists Should Be Excited About Python in Excel](https://www.anaconda.com/blog/why-data-scientists-should-be-excited-about-python-in-excel) +- [testdriven.io: Clean Code in Python](https://testdriven.io/blog/clean-code-python/) +- [python.plainenglish.io: These 25 Python Commands Are All You Need for Programming Mastery in 2024](https://python.plainenglish.io/these-25-python-commands-are-all-you-need-for-programming-mastery-in-2024-322ebc29c4e1) +- [python.plainenglish.io: REST: A Quick Guide to Building Scalable and Flexible Systems Using HTTP](https://python.plainenglish.io/rest-a-quick-guide-to-building-scalable-and-flexible-systems-using-http-62154841eefd) The characteristics of a RESTful systems, HTTP methods used to interact with resources, and HTTP status codes. ## ReactPy diff --git a/docs/recruitment.md b/docs/recruitment.md index 89a0d9e1..61a49fcb 100644 --- a/docs/recruitment.md +++ b/docs/recruitment.md @@ -63,6 +63,7 @@ - [blogs.elconfidencial.com: Luca de Meo y Lawrence Stroll: por qué el ego es el peor enemigo del gestor en la Fórmula 1](https://blogs.elconfidencial.com/deportes/tribuna/2022-08-03/alpine-aston-martin-lawrence-stroll-luca-de-meo_3470693/) - [blog.robertsimoes.org: Four Wings of a Software Engineer](https://blog.robertsimoes.org/posts/four-wings-of-software-engineers/) Career paths for software engineers - [forbes.com: Hiring Managers Often Lie To Candidates, Here’s How To Spot When They Do](https://www.forbes.com/sites/markmurphy/2023/08/24/hiring-managers-often-lie-to-candidates-heres-how-to-spot-when-they-do/) +- [vice.com: Thousands of Software Engineers Say the Job Market Is Getting Much Worse](https://www.vice.com/en/article/g5y37j/thousands-of-software-engineers-say-the-job-market-is-getting-much-worse) ## Articles in Spanish diff --git a/docs/remote-tech-jobs.md b/docs/remote-tech-jobs.md index dd615abf..a5f1ffaf 100644 --- a/docs/remote-tech-jobs.md +++ b/docs/remote-tech-jobs.md @@ -13,6 +13,7 @@ - [ireviews.com: The Top 60 Remote Work Websites for New Opportunities in 2022](https://www.ireviews.com/the-top-60-remote-work-websites-for-new-opportunities-in-2022/) - [starkephillip.com: The effects of remote work on company culture](https://starkephillip.com/the-effects-of-remote-work-on-company-culture/) - [The remote job guide: job search & productivity working from home](https://resume.io/blog/remote-job-guide) +- [forbes.com: 4 Ways To Combat The Social Isolation Of Remote Working](https://www.forbes.com/sites/drsamanthamadhosingh/2023/12/18/4-ways-to-combat-the-social-isolation-of-remote-working) ## Remote Jobs diff --git a/docs/serverless.md b/docs/serverless.md index c86040f5..74dc98d8 100644 --- a/docs/serverless.md +++ b/docs/serverless.md @@ -150,6 +150,7 @@ - [developers.redhat.com: Build and deploy microservices with Kubernetes and Dapr](https://developers.redhat.com/articles/2021/08/12/build-and-deploy-microservices-kubernetes-and-dapr) - [dev.to: Running Dapr on Kubernetes](https://dev.to/cvitaa11/running-dapr-on-kubernetes-89g) The distributed application runtime, Dapr, is a portable, event-driven runtime that can run on the cloud or any edge infrastructure. It puts together the best practices for building microservice applications into components called building blocks. - [github.com/diagrid-labs/dapr-workflow-demos](https://github.com/diagrid-labs/dapr-workflow-demos) +- [headleysj.medium.com: Building event-driven systems at scale in Kubernetes with Dapr — Part II: How does Dapr work?](https://headleysj.medium.com/building-event-driven-systems-at-scale-in-kubernetes-with-dapr-part-2-how-does-dapr-work-732ba7a0d652) ## Popular Deployment Frameworks for AWS Lambda diff --git a/docs/servicemesh.md b/docs/servicemesh.md index ac1e62c9..9d50e4a5 100644 --- a/docs/servicemesh.md +++ b/docs/servicemesh.md @@ -128,6 +128,7 @@ - [medium.com/@eshiett314: Mutual TLS with Emissary-Ingress and Linkerd](https://medium.com/@eshiett314/mutual-tls-with-emissary-ingress-and-linkerd-4aa3ffe0413f) In this article, you'll learn the meaning of Mutual TLS, why it is needed in Kubernetes and also implement it with Emissary-ingress - [weeraman.com: Getting started with Linkerd](https://weeraman.com/getting-started-with-linkerd-415d6485227f) - [dev.to: Linkerd and GitOps](https://dev.to/thenjdevopsguy/linkerd-and-gitops-115a) +- [buoyant.io: Multi-Cluster, Multi-Region Setup using Linkerd Service Mesh](https://buoyant.io/blog/multi-cluster-multi-region-setup-using-linkerd-service-mesh) This article teaches how to enhance Kubernetes with multi-cluster architecture for improved availability, fault tolerance, and performance with a Service Mesh such as Linkerd ## Maesh Service Mesh diff --git a/docs/terraform.md b/docs/terraform.md index 0ece15d4..be2a4dc3 100644 --- a/docs/terraform.md +++ b/docs/terraform.md @@ -8,7 +8,10 @@ 4. [Blogs and Newsletters](#blogs-and-newsletters) 5. [Terraform](#terraform) 1. [Terraform License](#terraform-license) - 2. [Terraform and GitHub Actions](#terraform-and-github-actions) +6. [OpenTOFU vs Terraform](#opentofu-vs-terraform) +7. [terraform taint](#terraform-taint) + 1. [Terraform and GitHub Actions](#terraform-and-github-actions) + 2. [Terraform and GitLab Pipelines](#terraform-and-gitlab-pipelines) 3. [Terraform Testing](#terraform-testing) 4. [Terraform docs](#terraform-docs) 5. [Private Terraform Registries](#private-terraform-registries) @@ -57,30 +60,30 @@ 31. [Terraform and Apache Kafka](#terraform-and-apache-kafka) 32. [Terraform and JMeter](#terraform-and-jmeter) 33. [Terraform Video Tutorials](#terraform-video-tutorials) -6. [CDK for Terraform](#cdk-for-terraform) -7. [Graph Visualization Software](#graph-visualization-software) -8. [Terraform Modules](#terraform-modules) - 1. [Terraform AWS Modules](#terraform-aws-modules) - 2. [Segment AWS Stack Terraform Modules](#segment-aws-stack-terraform-modules) -9. [Terraform Providers](#terraform-providers) - 1. [Terraform AWS Cloud Control Provider](#terraform-aws-cloud-control-provider) - 2. [Terraform Provider for Elastic Cloud](#terraform-provider-for-elastic-cloud) - 3. [Terraform Vault Provider](#terraform-vault-provider) - 4. [Terraform AzureRM](#terraform-azurerm) -10. [Terraform Code Quality. Terraform Quality Checks](#terraform-code-quality-terraform-quality-checks) -11. [Enforce Policy with Sentinel](#enforce-policy-with-sentinel) -12. [Reverse terraform with Terraformer](#reverse-terraform-with-terraformer) -13. [Terraform Tools](#terraform-tools) -14. [Writing Terraform for unsupported resources with TerraCurl](#writing-terraform-for-unsupported-resources-with-terracurl) -15. [Terraform Frameworks](#terraform-frameworks) +8. [CDK for Terraform](#cdk-for-terraform) +9. [Graph Visualization Software](#graph-visualization-software) +10. [Terraform Modules](#terraform-modules) + 1. [Terraform AWS Modules](#terraform-aws-modules) + 2. [Segment AWS Stack Terraform Modules](#segment-aws-stack-terraform-modules) +11. [Terraform Providers](#terraform-providers) + 1. [Terraform AWS Cloud Control Provider](#terraform-aws-cloud-control-provider) + 2. [Terraform Provider for Elastic Cloud](#terraform-provider-for-elastic-cloud) + 3. [Terraform Vault Provider](#terraform-vault-provider) + 4. [Terraform AzureRM](#terraform-azurerm) +12. [Terraform Code Quality. Terraform Quality Checks](#terraform-code-quality-terraform-quality-checks) +13. [Enforce Policy with Sentinel](#enforce-policy-with-sentinel) +14. [Reverse terraform with Terraformer](#reverse-terraform-with-terraformer) +15. [Terraform Tools](#terraform-tools) +16. [Writing Terraform for unsupported resources with TerraCurl](#writing-terraform-for-unsupported-resources-with-terracurl) +17. [Terraform Frameworks](#terraform-frameworks) 1. [Kubestack Terraform GitOps Framework](#kubestack-terraform-gitops-framework) 2. [Gruntwork Terragrunt](#gruntwork-terragrunt) 3. [Terraspace](#terraspace) -16. [Terraform Associate Certification](#terraform-associate-certification) -17. [ChatGPT](#chatgpt) -18. [Images](#images) -19. [Videos](#videos) -20. [Tweets](#tweets) +18. [Terraform Associate Certification](#terraform-associate-certification) +19. [ChatGPT](#chatgpt) +20. [Images](#images) +21. [Videos](#videos) +22. [Tweets](#tweets)
@@ -108,6 +111,8 @@ ## Blogs and Newsletters - [weekly.tf: Terraform Weekly](https://weekly.tf) +- [build5nines.com](https://build5nines.com) +- [nedinthecloud.com](https://nedinthecloud.com) ## Terraform @@ -157,7 +162,6 @@ - [automateinfra.com: How to Launch multiple EC2 instances on AWS using Terraform count and for_each](https://automateinfra.com/2021/03/22/how-to-launch-multiple-ec2-instances-on-aws-using-terraform/) - [morethancertified.com: More Consistent Terraform Runs With Docker](https://morethancertified.com/terraform-in-docker) - [deloitte.com: Infrastructure as Code (IaC) con Terraform](https://www2.deloitte.com/es/es/blog/todo-tecnologia/2021/infrastructure-as-code-iac-con-terraform.html) Automatización, escalado, optimización y ahorro en tu factura cloud -- [docs.gitlab.com: GitLab managed Terraform State 🌟](https://docs.gitlab.com/ee/user/infrastructure/terraform_state.html) Gitlab Terraform now share tfstate directly on gitlab. - [flowfactor.be: What do you know about Terraform modules?](https://www.flowfactor.be/2021/03/18/what-do-you-know-about-terraform-modules/) - [medium: How to manage infrastructure as code (IaC) with Terraform on AWS? 🌟](https://medium.com/workfall/how-to-manage-infrastructure-as-code-iac-with-terraform-on-aws-1fa6cd6bccfe) - [accurics.com: Terraform Security: Improving IaC Scans with Terraform Plan Output](https://www.accurics.com/blog/terrascan-blog/terraform-security-improving-iac-scans-with-terraform-plan-output) @@ -200,7 +204,6 @@ - [learn.hashicorp.com: Configure Default Tags for AWS Resources 🌟](https://learn.hashicorp.com/tutorials/terraform/aws-default-tags) - [terraform-hcloud-dualstack-k8s: Hetzner Dual-Stack Kubernetes Cluster](https://github.com/tibordp/terraform-hcloud-dualstack-k8s) (Unofficial) Terraform module for a dual-stack Kubernetes cluster on Hetzner Cloud - [hashicorp.com: Beta Support for CRDs in the Terraform Provider for Kubernetes](https://www.hashicorp.com/blog/beta-support-for-crds-in-the-terraform-provider-for-kubernetes) -- [about.gitlab.com: How to use a push-based approach for GitOps with Terraform and AWS ECS and EC2](https://about.gitlab.com/blog/2021/08/10/how-to-agentless-gitops-aws/) - [opensource.com: My top 5 tips for setting up Terraform 🌟](https://opensource.com/article/21/8/terraform-tips) These are the lessons I've learned after five years with Terraform. - [rpadovani.com: How to make Terraform waiting for cloud-init to finish on EC2 without SSH](https://rpadovani.com/terraform-cloudinit) Terraform is a powerful tool. However, it has some limitations: since it uses AWS APIs, it doesn’t have a native way to check if an EC2 instance has completed to run cloud-init before marking it as ready. A possible workaround is asking Terraform to SSH on the instance, and wait until it is able to perform a connection before marking the instance as ready. - [hashicorp.com: Cisco, Citrix, and Fortinet Among New Verified Terraform Providers](https://www.hashicorp.com/blog/cisco-citrix-fortinet-among-new-verified-terraform-providers) @@ -293,12 +296,27 @@ - [medium.com/platform-engineer: 26 Terraform Hacks for Effective Infrastructure Automation (With Examples)](https://medium.com/platform-engineer/26-terraform-hacks-for-effective-infrastructure-automation-with-examples-d6d721c3d5e0) A checklist for Cloud Engineers to live by - [thenewstack.io: Automating Retry for Failed Terraform Launches](https://thenewstack.io/automating-retry-for-failed-terraform-launches) Quali Torque orchestrates YAML files — which can be thought of as blueprints — for application environments directly from the IaC modules defined in Git. - [theburningmonk.com: Making Terraform and Serverless framework work together](https://theburningmonk.com/2019/03/making-terraform-and-serverless-framework-work-together/) +- [build5nines.com: Terraform Workflow Process Explained](https://build5nines.com/terraform-workflow-process-explained) +- [build5nines.com: Terraform: How to Join and Split Strings](https://build5nines.com/terraform-how-to-join-and-split-strings) +- [build5nines.com: Terraform Best Practices for Writing Clean, Readable, and Maintainable Code](https://build5nines.com/terraform-best-practices-for-writing-clean-readable-and-maintainable-code/) +- [build5nines.com: Terraform: Deploy Azure ExpressRoute Circuit with VNet Gateway](https://build5nines.com/terraform-deploy-azure-expressroute-circuit-with-vnet-gateway/) +- [nedinthecloud.com: Replacing The Template Cloudinit Config Data Source](https://nedinthecloud.com/2022/01/18/replacing-the-template_cloudinit_config-data-source/) +- [==hashicorp.com: Testing HashiCorp Terraform==](https://www.hashicorp.com/blog/testing-hashicorp-terraform) +- [==youtube: Stop using shared secrets! CI/CD authentication the proper way==](https://www.youtube.com/watch?v=sd2wuAVush4) ### Terraform License - [opencoreventures.com: HashiCorp switching to BSL shows a need for open charter companies](https://opencoreventures.com/blog/2023-08-23-hashicorp-switching-bsl-shows-need-for-open-charter-companies/) - [medium.com/@hello_9187: Why We Are Not Supporting OpenTF](https://medium.com/@hello_9187/why-we-are-not-supporting-opentf-a46855f52dc4) +## OpenTOFU vs Terraform + +- [nedinthecloud.com: Comparing Open TOFU And Terraform](https://nedinthecloud.com/2024/01/22/comparing-opentofu-and-terraform/) + +## terraform taint + +- ["Have you used the taint command in Terraform yet?"](https://www.youtube.com/watch?v=v_T1fuYGjV0&ab_channel=NedintheCloud) "It marks a resource in the Terraform state data as tainted, meaning the next time you run terraform apply, that resource will be destroyed and recreated. The configuration for the resource will not change, but the resource will be replaced. HashiCorp is trying to move away from imperative commands and towards a declarative model for all operations that affect state. Terraform taint makes direct alterations to state data in an imperative fashion with no way to preview the changes. If you run a terraform taint command, you are altering the state data without making a change to the configuration. In a collaborative environment, this can cause problems." + ### Terraform and GitHub Actions - [learn.hashicorp.com: Automate Terraform with GitHub Actions](https://learn.hashicorp.com/tutorials/terraform/github-actions) Automate infrastructure deployments with CI/CD using Terraform and GitHub Actions @@ -308,6 +326,13 @@ - [medium.com/google-cloud: Terraform on Google Cloud V1.1 — Deploying VM with Github actions](https://medium.com/google-cloud/terraform-on-google-cloud-v1-1-deploying-vm-with-github-actions-446bc1061420) Creating GCP compute engine VM in terraform with Github Actions - [build5nines.com: Terraform: GitHub Actions Automated Deployment](https://build5nines.com/terraform-github-actions-automated-deployment/) - [medium.com/@bijit211987: DevSecOps Approach with Terraform and CI/CD Pipelines](https://medium.com/@bijit211987/devsecops-approach-with-terraform-and-ci-cd-pipelines-f556c2d5b40d) +- [thomasthornton.cloud: Displaying Terraform Plans in GitHub PRs with GitHub Actions](https://thomasthornton.cloud/2024/01/11/displaying-terraform-plans-in-github-prs-with-github-actions/) + +### Terraform and GitLab Pipelines + +- [docs.gitlab.com: GitLab managed Terraform State 🌟](https://docs.gitlab.com/ee/user/infrastructure/terraform_state.html) Gitlab Terraform now share tfstate directly on gitlab. +- [about.gitlab.com: How to use a push-based approach for GitOps with Terraform and AWS ECS and EC2](https://about.gitlab.com/blog/2021/08/10/how-to-agentless-gitops-aws/) +- [squareops.com: Terraform CI/CD Pipelines with Gitlab](https://squareops.com/terraform-pipeline-with-gitlab/) ### Terraform Testing @@ -384,6 +409,7 @@ - [Infracost 🌟](https://github.com/infracost/infracost) If you use Terraform to provision your Kubernetes clusters, you might find infracost interesting. Infracost estimates hourly and monthly costs for a Terraform project. It helps you to see the cost breakdown and compare different deployment options upfront. - [A Guide to Cloud Cost Optimization with HashiCorp Terraform 🌟](https://www.hashicorp.com/blog/a-guide-to-cloud-cost-optimization-with-hashicorp-terraform) The Terraform AWS provider now supports Code Signing for AWS Lambda, which involves digitally signing code artifacts and verifying at deployment. +- [pratapreddypilaka.blogspot.com: Azure FinOps using Terraform and Infracost - Finding the hourly or monthly cost before Azure DevOps Deployments](https://pratapreddypilaka.blogspot.com/2023/11/azure-finops-using-terraform-and.html) ### Awesome Terraform @@ -555,6 +581,11 @@ - [devopscube.com: AWS Terraform Autoscaling Group With ALB Deployment Tutorial](https://devopscube.com/terraform-autoscaling-group/) - [medium.com/cloud-native-daily: How to Securely Manage Terraform State File in AWS Using Terraform](https://medium.com/cloud-native-daily/how-to-securely-manage-terraform-state-file-in-aws-using-terraform-7c20b211c9cb) A step-by-step guide on how to securely manage, as well as share state files in AWS by using Terraform. - [dev.to/monarene: Dynamic Volume Provisioning in Kubernetes with AWS and Terraform](https://dev.to/monarene/dynamic-volume-provisioning-in-kubernetes-with-aws-and-terraform-3m6h) In this article, you'll learn about Persistent Volumes and how they are provisioned, managed, and configured in AWS. You'll compare Static and Dynamic volume provisioning, how they overlap, and which provisioning mechanism you should employ +- [blog.awsfundamentals.com: Mastering AWS Lambda with Terraform: A Comprehensive Guide](https://blog.awsfundamentals.com/aws-lambda-with-terraform) +- [medium.com/@rizkiprass: Beginner Terraform Tutorial: Launching EC2 in AWS using Terraform](https://medium.com/@rizkiprass/beginner-terraform-tutorial-launching-ec2-in-aws-using-terraform-73f6d99e6233) +- [github.com/squareops/terraform-aws-vpc](https://github.com/squareops/terraform-aws-vpc) Terraform Module to create an AWS VPC network with VPN and configure Peering b/w multiple VPCs +- [devxblog.hashnode.dev: Terraform with AWS](https://devxblog.hashnode.dev/terraform-with-aws) +- [dev.to/aws-builders: Deploying a Containerized App to ECS Fargate Using a Private ECR Repo & Terragrunt](https://dev.to/aws-builders/deploying-a-containerized-app-to-ecs-fargate-using-a-private-ecr-repo-terragrunt-5b8a) {== @@ -601,6 +632,7 @@ - [awstip.com: Streamlining AWS EKS Cluster Volume Management with Helm and Terraform: EBS CSI Driver + Self-Managed AddOn Option](https://awstip.com/streamlining-aws-eks-cluster-volume-management-with-helm-and-terraform-ebs-csi-driver-78e1d51532ee) In this tutorial, you will learn how to configure OIDC Provider as Identity Provider in AWS IAM Service and install the EKS EBS CSI Driver as a self-managed add-On using Terraform and Helm - [hewi.blog: Deploying an EKS cluster using Terraform](https://hewi.blog/deploying-an-eks-cluster-using-terraform) In this tutorial, you will learn how to provision an EKS cluster using Terraform and deploy a demo application to test it - [platformwale.blog: Create Amazon EKS Cluster within its VPC using Terraform](https://platformwale.blog/2023/07/15/create-amazon-eks-cluster-within-its-vpc-using-terraform/) +- [medium.com/@ernestkwashie3: Provisioning Amazon Elastic Kubernetes Service (EKS) Cluster using Terraform](https://medium.com/@ernestkwashie3/provisioning-amazon-elastic-kubernetes-service-eks-cluster-using-terraform-5e07f1f0dc32) ==} @@ -615,6 +647,7 @@ - [==aws.amazon.com: New – AWS Control Tower Account Factory for Terraform==](https://aws.amazon.com/blogs/aws/new-aws-control-tower-account-factory-for-terraform/) - [hashicorp.com: HashiCorp Teams with AWS on New Control Tower Account Factory for Terraform](https://www.hashicorp.com/blog/hashicorp-teams-with-aws-on-new-control-tower-account-factory-for-terraform) AWS Control Tower Account Factory for HashiCorp Terraform (AFT), the evolution of Terraform Landing Zones, offers an easy way to set up and govern a secure, multi-account AWS environment. - [==aws.amazon.com: AWS Control Tower==](https://aws.amazon.com/controltower/) The easiest way to set up and govern a secure multi-account AWS environment +- [trek10.com: Control Tower: Then vs Now](https://www.trek10.com/blog/control-tower-then-vs-now) Control Tower today is not the same Control Tower that you may have been introduced to in the past. #### Porsche Official @@ -622,6 +655,7 @@ ### Terraform with Azure +- [build5nines.com: Get Started with Terraform on Azure](https://build5nines.com/get-started-with-terraform-on-microsoft-azure/) - [medium: Using Terraform with Azure — the right way](https://medium.com/01001101/using-terraform-with-azure-the-right-way-35af3b51a6b0) - [github.com/kuhlman-labs/terraform-azurerm-landing-zone](https://github.com/kuhlman-labs/terraform-azurerm-landing-zone) A curated collection of Terraform azurerm modules - [cloudbuild.co.uk: Part 1: Terraform with Azure - How to install Terraform](https://cloudbuild.co.uk/how-to-install-terraform/) @@ -641,6 +675,10 @@ - [azureway.cloud: Azure Container Apps – traffic splitting [part 4]](https://azureway.cloud/azure-container-apps-traffic-splitting-part-4/) - [build5nines.com: Terraform: Deploy Azure Function App with Consumption Plan](https://build5nines.com/terraform-deploy-azure-function-app-with-consumption-plan/) - [hashicorp.com: Building a secure Azure reference architecture with Terraform](https://www.hashicorp.com/blog/building-a-secure-azure-reference-architecture-with-terraform) Learn how to use HashiCorp Terraform to deploy Azure resources using security best practices and policy as code. +- [medium.com/@noelgass: Azure Common Monitoring With Terraform](https://medium.com/@noelgass/azure-common-monitoring-with-terraform-543aee6dd1f1) This article offers a comprehensive guide on creating a universal monitoring baseline for Azure resources within a subscription. The approach involves leveraging the Azure Provider azurerm in Terraform, coupled with metric alert rules tailored for Azure resources. +- [techcommunity.microsoft.com: Simplifying Onboarding to Microsoft Defender for Cloud with Terraform](https://techcommunity.microsoft.com/t5/microsoft-defender-for-cloud/simplifying-onboarding-to-microsoft-defender-for-cloud-with/ba-p/3974789) +- [techcommunity.microsoft.com: Create an Azure OpenAI, LangChain, ChromaDB, and Chainlit chat app in AKS using Terraform](https://techcommunity.microsoft.com/t5/fasttrack-for-azure/create-an-azure-openai-langchain-chromadb-and-chainlit-chat-app/ba-p/4024070) +- [build5nines.com: Terraform: Deploy Azure App Service with Key Vault Secret Integration](https://build5nines.com/terraform-deploy-azure-app-service-with-key-vault-secret-integration) #### Azure Landing Zones with Terraform @@ -730,6 +768,7 @@ - Managing costs - Databases and migrations - Handling static files +- [thomasthornton.cloud: Deploying Azure AKS GitOps Flux extension with Terraform](https://thomasthornton.cloud/2023/12/03/deploying-azure-aks-gitops-flux-extension-with-terraform/) ### Terraform and OCI @@ -803,6 +842,7 @@ - [mitchellh/terraform-provider-multispace](https://github.com/mitchellh/terraform-provider-multispace) Terraform Provider for cascading runs across multiple workspaces. - [kyma-incubator/terraform-provider-kind: Terraform Provider for kind (Kubernetes IN Docker)](https://github.com/kyma-incubator/terraform-provider-kind) The Terraform Provider for kind enables Terraform to provision local Kubernetes clusters on base of Kubernetes IN Docker (kind). - [github.com/circa10a/terraform-provider-mailform](https://github.com/circa10a/terraform-provider-mailform) A terraform provider to send physical mail via https://mailform.io +- [env0.com: How to Use Terraform Providers](https://www.env0.com/blog/how-to-use-terraform-providers) ### Terraform AWS Cloud Control Provider @@ -869,6 +909,8 @@ - [infracloud.io: 5 Tools to Auto-Generate Terraform Configuration Files 🌟](https://www.infracloud.io/blogs/auto-generate-terraform-configuration-files/) - [spacelift.io: 18 Most Useful Terraform Tools to Use in 2023](https://spacelift.io/blog/terraform-tools) - [github.com/idoavrah/terraform-tui: TFTUI - The Terraform textual UI](https://github.com/idoavrah/terraform-tui) TFTUI is a powerful textual UI that empowers users to effortlessly view and interact with their Terraform state. With its latest version you can easily visualize the complete state tree, gaining deeper insights into your infrastructure's current configuration. Additionally, the ability to search the tree and inspect individual resource states allows you to focus on specific details for better analysis and management. It's also possible to select specific resources and perform actions such as tainting, untainting and deleting them. Finally, you are now able to create and apply plans directly from the UI. +- [github.com/jamesw4/confirm-tfvars](https://github.com/jamesw4/confirm-tfvars) Cross platform PowerShell module to validate tfvars files. +- [umeshtyagi829.medium.com: Secure Terrafrom IaC code using Checkov](https://umeshtyagi829.medium.com/secure-terrafrom-iac-code-using-checkov-4a3e1f097f92) ## Writing Terraform for unsupported resources with TerraCurl @@ -930,6 +972,8 @@ + +
## Tweets diff --git a/docs/visual-studio.md b/docs/visual-studio.md index 2d6179bb..3acbb9a9 100644 --- a/docs/visual-studio.md +++ b/docs/visual-studio.md @@ -174,6 +174,7 @@ A simple extension to make indentation more readable - [marketplace.visualstudio.com: CodeSnap](https://marketplace.visualstudio.com/items?itemName=adpyke.codesnap) Take beautiful screenshots of your code - [marketplace.visualstudio.com: GitOps Tools for Flux 🌟](https://marketplace.visualstudio.com/items?itemName=Weaveworks.vscode-gitops-tools) This is a VS Code extension for GitOps automation tool for continuous delivery of Kubernetes and cloud native applications - [marketplace.visualstudio.com: Kubernetes Reference Highlighter 🌟](https://marketplace.visualstudio.com/items?itemName=dag-andersen.kubernetes-reference-highlighter) Kubernetes reference highlighter is a plugin for VS Code that highlights references in your Kubernetes YAML files +- [freecodecamp.org: Increase Your VS Code Productivity](https://www.freecodecamp.org/news/increase-your-vs-code-productivity/) #### More Extensions (Blogs) @@ -331,6 +332,7 @@ A simple extension to make indentation more readable - [Vertical rulers](https://www.youtube.com/shorts/cTE0ec3IurE) - [Time Travel!](https://www.youtube.com/shorts/0h1xNFsEZBU) - [Master Git with Git Graph](https://www.youtube.com/shorts/OfsixF-splk) +- [New VS Code features](https://www.youtube.com/shorts/8iVaeLjzY6s) ## Videos diff --git a/docs/yaml.md b/docs/yaml.md index 7a5fc9d8..0e645fd7 100644 --- a/docs/yaml.md +++ b/docs/yaml.md @@ -129,6 +129,7 @@ - [about.gitlab.com: Tips for productive DevOps workflows: JSON formatting with jq and CI/CD linting automation](https://about.gitlab.com/blog/2021/04/21/devops-workflows-json-format-jq-ci-cd-lint/) - ```jq -C '.' data.json | less -R``` Use jq to pretty print some JSON data with ANSI color coded syntax and use -R in less to process the color. - [github.com/ilyash/show-struct](https://github.com/ilyash/show-struct) Shows possible jq paths in a JSON file +- [github.com/01mf02/jaq](https://github.com/01mf02/jaq) A jq clone focussed on correctness, speed, and simplicity ### JSON Tools