Files
awesome-kubernetes/v2-docs/qa.md

115 lines
16 KiB
Markdown

# QA/TestOps - Continuous Testing. Software Quality Test Automation
!!! info "Architectural Context"
Detailed reference for QA/TestOps - Continuous Testing. Software Quality Test Automation in the context of Platform & Site Reliability.
## Standard Reference
- [Allure 🌟](https://plugins.jenkins.io/allure-jenkins-plugin) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Awesome Test Automation](https://github.com/atinfo/awesome-test-automation) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [softwaretestguideforu.com: What is system testing? How to perform system' testing?](https://www.softwaretestguideforu.com/2020/06/what-is-system-testinghow-to-perform.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [linkedin.com/pulse: Importance of API Automation Testing 🌟](https://www.linkedin.com/pulse/importance-api-automation-testing-manish-saini) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Optimizing App Performance in a Multicloud Stack](https://thenewstack.io/optimizing-app-performance-in-a-multicloud-stack) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: Automation Testing Implementation Guide](https://www.botplayautomation.com/post/what-is-automation-testing-the-need-for-automation-testing-automation-testing-implementation-guide) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: Types of Software Testing](https://www.botplayautomation.com/post/types-of-software-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: Automation & Manual Testing Best Practices](https://www.botplayautomation.com/post/best-practices-to-follow-in-software-testing-manual-and-automation-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: How to write a Software Test Plan?](https://www.botplayautomation.com/post/how-to-write-a-test-plan) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.thundra.io: 4 Software Testing Roles](https://blog.thundra.io/4-software-testing-roles) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: Common mistakes test teams make in automation testing' and how to fix them](https://www.botplayautomation.com/post/common-mistakes-test-teams-make-in-automation-testing-and-how-to-fix-them) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: Automation Test Plan](https://www.botplayautomation.com/post/automation-test-plan) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [devops.com: Continuous Testing Practices (Part 1) 🌟](https://devops.com/continuous-testing-practices-part-1) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [boozangfromthetrenches.com: Root Cause Analysis in Test Automation](https://boozangfromthetrenches.com/root-cause-analysis-in-test-automation/9) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [copyconstruct.medium.com: Testing in Production, the safe way 🌟🌟🌟](https://copyconstruct.medium.com/testing-in-production-the-safe-way-18ca102d0ef1) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.thundra.io: How to Fix Your Failing End-to-End Tests?](https://blog.thundra.io/how-to-fix-your-failing-end-to-end-tests) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [itnext.io: Software Development Is Misunderstood 🌟](https://itnext.io/software-development-is-misunderstood-quality-is-fastest-way-to-get-code-into-production-f1f5a0792c69) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dzone: Checklist for API Verification 🌟](https://dzone.com/articles/checklist-for-api-verification) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: 7 Benefits of Testing in Isolation](https://thenewstack.io/7-benefits-of-testing-in-isolation) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dzone: We Are Testing Software Incorrectly and It's Costly](https://dzone.com/articles/we-are-testing-software-incorrectly-and-its-costly) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Error Handling from Backends to the Frontend](https://thenewstack.io/error-handling-from-backends-to-the-frontend) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [betterprogramming.pub: Why We Quit Unit Testing Classes to Focus On a' Behavioral Approach](https://betterprogramming.pub/quit-unit-testing-classes-and-use-a-behavior-oriented-approach-306a667f9a31) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dev.to: Test-Driven-Development with Django: Unit Testing & Integration' testing with Docker, Flask & Github Actions](https://dev.to/koladev/test-driven-development-with-django-unit-testing-integration-testing-with-docker-flask-github-actions-2047) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [smashingmagazine.com: Testing Pipeline 101 For Frontend Testing](https://www.smashingmagazine.com/2022/02/testing-pipeline-101-frontend-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [infoq.com: Maintaining Software Quality with Microservices](https://www.infoq.com/presentations/microservices-software-quality) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [speakerdeck.com/thockin: Code Review in Kubernetes](https://speakerdeck.com/thockin/code-review-in-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [adequatica.medium.com: Principles of Writing Automated Tests](https://adequatica.medium.com/principles-of-writing-automated-tests-a2b72218264c) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [getxray.app: The top 5 software testing trends of 2022](https://www.getxray.app/blog/the-top-5-software-testing-trends-of-2022) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [linkedin.com: Microservices are testable in isolation 🌟](https://www.linkedin.com/pulse/microservices-testable-isolation-chris-richardson) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dzone: Testing the Untestable and Other Anti-Patterns](https://dzone.com/articles/testing-the-untestable-and-other-anti-patterns) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [softwaretestingsapiens.com: Roadmap to learn API Testing in Just 30 days](https://www.softwaretestingsapiens.com/roadmap-to-learn-api-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [JUnit](https://junit.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [TestNG](https://testng.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Spock Framework](https://spockframework.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [testsvision.com: 6 Popular Automation Testing Frameworks & Tools](https://testsvision.com/6-popular-automation-testing-frameworks-tools) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [opensource.com: Perform unit tests using GoogleTest and CTest](https://opensource.com/article/22/1/unit-testing-googletest-ctest) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [launchdarkly.com: Release Testing Explained 🌟](https://launchdarkly.com/blog/get-a-detailed-explanation-of-release-testing-several) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Chainsaw - The ultimate end to end testing tool for Kubernetes operators](https://github.com/kyverno/chainsaw) <span class='md-tag md-tag--info'>⭐ 569</span> <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [collabnix.com: The Ultimate Docker Tutorial for Automation Testing](https://collabnix.com/the-ultimate-docker-tutorial-for-automation-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Allure Report 🌟](https://github.com/allure-framework/allure2) <span class='md-tag md-tag--info'>⭐ 5400</span> <span class='md-tag md-tag--info'>[ENTERPRISE-STABLE]</span>
- [venturebeat.com: Reflect brings automated no-code web testing to the cloud](https://venturebeat.com/2021/01/22/reflect-brings-automated-no-code-web-testing-to-the-cloud) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Semgrep](https://semgrep.dev) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [testcontainers 🌟](https://github.com/testcontainers) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dzone: Top Microservices Testing Tools Testers Should Know About](https://dzone.com/articles/top-microservices-testing-tools-testers-should-kno) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [SystemTap](https://sourceware.org/systemtap) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [auchenberg/volkswagen](https://github.com/auchenberg/volkswagen) <span class='md-tag md-tag--info'>⭐ 15441</span> <span class='md-tag md-tag--success'>[DE FACTO STANDARD]</span>
- [getxray.app: 7 benefits of using a Test Management App vs. Excel](https://www.getxray.app/blog/7-benefits-of-using-a-test-management-app-vs.-excel) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [google/clusterfuzzlite 🌟](https://github.com/google/clusterfuzzlite) <span class='md-tag md-tag--info'>⭐ 525</span> <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Google Introduces ClusterFuzzLite Security Tool for CI/CD](https://thenewstack.io/google-introduces-clusterfuzzlite-security-tool-for-ci-cd) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [convert.com: Top 10 A/B Testing Tools That Are Good for the Next 5 Years' (Vetted by Features, Privacy, Maturity & Price)](https://www.convert.com/blog/a-b-testing/a-b-testing-tools-2022-beyond) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [circleci.com: Unit testing vs integration testing 🌟](https://circleci.com/blog/unit-testing-vs-integration-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [reviewdog - A code review dog who keeps your codebase healthy.](https://github.com/reviewdog/reviewdog) <span class='md-tag md-tag--info'>⭐ 9315</span> <span class='md-tag md-tag--info'>[ENTERPRISE-STABLE]</span>
- [dzone: Component Tests for Spring Cloud Microservices](https://dzone.com/articles/component-tests-for-spring-cloud-microservices) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [CoolerVoid/codecat: CodeCat - Tool to help in static code analysis](https://github.com/CoolerVoid/codecat) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [beellz.hashnode.dev: Continuous Profiling in Kubernetes Using Pyroscope](https://beellz.hashnode.dev/continuous-profiling-in-kubernetes-using-pyroscope) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [devops.com: Best Practices for Application Performance Testing](https://devops.com/best-practices-for-application-performance-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [softwarequickguide.com: What is performance testing and performance testing' tools](https://softwarequickguide.com/what-is-performance-testing-and-performance-testing-tools) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [sonobuoy](https://github.com/vmware-tanzu/sonobuoy) <span class='md-tag md-tag--info'>⭐ 3039</span> <span class='md-tag md-tag--info'>[ENTERPRISE-STABLE]</span>
- [kubench](https://github.com/vincentserpoul/kubench) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com](https://www.botplayautomation.com) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [botplayautomation.com: Benefits of Codeless (no code) Automation Testing](https://www.botplayautomation.com/post/benefits-of-codeless-automation-testing) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
## Development
### AI-Assisted Coding
#### Static Analysis
- **(2023)** [Metabob](https://metabob.com) <span class='md-tag md-tag--warning'>[PYTHON CONTENT]</span> <span class='md-tag md-tag--critical'>[ADVANCED LEVEL]</span> <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span> — Metabob provides an AI-driven static analysis engine that utilizes deep learning and graph neural networks to isolate complex multi-variable logic errors and hidden security issues that traditional pattern-matching linters routinely miss.
## Security
### CICD Security
#### Jenkins Scanning
- **(2021)** [meetup.com: A single open-source security scanner for most languages on Jenkins](https://www.meetup.com/es-es/jenkins-online-meetup/events/276135789) <span class='md-tag md-tag--warning'>[GROOVY CONTENT]</span> <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span> <span class='md-tag md-tag--secondary'>[GUIDE]</span> — This technical session reviews multi-language open-source security vulnerability scanners integrated into automated Jenkins pipelines. It analyzes best practices for static and dynamic analysis inside enterprise software build cycles to enforce early DevSecOps gates.
## Software Development
### Testing Tools
#### Integration Testing
- **(2025)** [==testcontainers-spring-boot 🌟==](https://github.com/PlaytikaOSS/testcontainers-spring-boot) <span class='md-tag md-tag--info'>⭐ 877</span> <span class='md-tag md-tag--warning'>[JAVA CONTENT]</span> 🌟🌟🌟🌟🌟 <span class='md-tag md-tag--success'>[DE FACTO STANDARD]</span> — An open-source auto-configuration integration that simplifies using Testcontainers inside Spring Boot applications. Eliminates boilerplate bootstrap code for starting, testing, and tearing down containerized dependencies like PostgreSQL, Kafka, and Redis during build pipelines.
## Software Engineering
### Quality Assurance
#### Curated Lists
- **(2026)** [**Awesome Software Quality**](https://github.com/ligurio/sqa-wiki) <span class='md-tag md-tag--info'>⭐ 2311</span> 🌟🌟🌟🌟 <span class='md-tag md-tag--info'>[ENTERPRISE-STABLE]</span> — A comprehensive, curated repository of tools, frameworks, and methodologies focused on software quality assurance, testing automation, and performance analysis. This curated collection serves as an excellent resource for software development teams establishing robust test suites and security scanning checks.
#### Industry Trends
- **(2021)** [lambdatest.com: Top Automation Testing Trends To Look Out In 2021](https://www.testmuai.com/blog/best-test-automation-trends) 🌟🌟🌟 <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span> — Analyzes key movements in test automation, emphasizing AI-assisted test creation, codeless automation platforms, and the 'shift-left' approach of integrating security checks earlier in the delivery pipeline. Contrasts 2021 predictions with today's 2026 landscape, where AI-powered testing has become a standard development practice.
#### Testing Frameworks
- **(2024)** [lambdatest.com: TestNG vs JUnit : Which testing framework should you choose?](https://www.testmuai.com/blog/testng-vs-junit-which-testing-framework-should-you-choose) 🌟🌟🌟 <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span> — An analytical comparison contrasting the features, annotations, and parallel execution capabilities of the TestNG and JUnit testing frameworks in the Java ecosystem. It highlights how each framework scales within modern CI/CD setups, helping developers choose the right tool based on their specific test runner requirements.
## Testing
### Integration Testing (1)
#### Containerized Infrastructure
- **(2023)** [==testcontainers.org==](https://testcontainers.com) <span class='md-tag md-tag--warning'>[JAVA CONTENT]</span> <span class='md-tag md-tag--critical'>[ADVANCED LEVEL]</span> 🌟🌟🌟🌟🌟 <span class='md-tag md-tag--success'>[DE FACTO STANDARD]</span> — Testcontainers has emerged as the industry standard library for provisioning ephemeral, real databases and services inside Docker during integration testing. Backed by Docker (AtomicJar), it ensures developer local environments precisely mirror production-grade dependencies.
---
💡 **Explore Related:** [DevOps](./devops.md) | [Scaffolding](./scaffolding.md) | [Performance Testing With Jenkins And Jmeter](./performance-testing-with-jenkins-and-jmeter.md)