Click any tag below to further narrow down your results
Links
This article introduces Sanctum, a tool that automates user simulation to enhance software testing. It converts real user workflows into tests without setup and provides insights into performance and UX. Integrating with existing tools, Sanctum aims to catch bugs and issues before launch.
This article discusses the development of a Software Factory that leverages AI for non-interactive coding. It focuses on using scenarios instead of traditional tests and introduces the Digital Twin Universe for validating software against behavioral clones of services.
This article describes Telescope, a tool for testing web page performance across different browsers. It provides detailed results, including console output, metrics, and screenshots, and supports various parameters for customization. You can run tests via the command line or integrate it into a Node.js script.
This article introduces Skyramp, a testing platform designed to manage complex software environments. It offers features like automated test generation, execution in containerized setups, and tools for maintaining test suites without manual effort. Skyramp prioritizes testing gaps based on application specifics and adapts to changes in code and user flows.
Aura Inspector is a tool for testing Salesforce Experience Cloud applications. It helps identify misconfigurations, automate testing, and discover accessible records in both guest and authenticated contexts. You can run it in various modes, including unauthenticated and authenticated scenarios.
This article discusses how AI is changing the code review process for both solo developers and teams. It emphasizes the need for evidence of working code, highlights the risks of relying too heavily on AI, and outlines best practices for integrating AI into code reviews while maintaining human oversight.
The article introduces two tools, Showboat and Rodney, designed to help coding agents demonstrate their work and automate browser tasks. Showboat creates Markdown documents to showcase agent-built features, while Rodney handles browser automation for capturing screenshots and executing JavaScript. Both tools aim to enhance the testing and demonstration process in software development.
This article details how QA Wolf improved Drata's regression testing, reducing time from hours to minutes while increasing test coverage. By automating testing, Drata saved over $500,000 annually and allowed developers to focus on new features.
Gotests is a tool that automatically generates table-driven tests for Go functions and methods by analyzing their signatures. It supports filtering, custom templates, and even AI-generated test cases, making it efficient for developers to ensure test coverage.
Codacy introduces a hybrid code review engine that enhances Pull Request feedback by identifying logic gaps, security issues, and code complexity. It automates the review process, letting developers ship code faster and with more confidence.
This article covers how AI test agents enhance voice AI testing by providing tools for autonomous simulation and scalable quality metrics. It details features like multi-speaker analysis, custom dashboards, and automated alerts that help teams improve their voice interactions.
Meticulous is a tool that helps developers monitor application interactions and automatically generates a test suite for their code. By recording sessions and mocking backend responses, it ensures reliable tests without the hassle of setting up mock data. This approach allows teams to identify issues before merging changes.
NativeBridge offers manual and AI-driven mobile app testing to streamline workflows for developers, QAs, and designers. Users can instantly access a variety of devices for real-time testing without needing setups or downloads. The platform emphasizes collaboration and supports multiple OS versions for extensive testing capabilities.
The article explores how AI coding agents, like the Ralph Wiggum loop, automate software development by using clear specifications and robust testing. It highlights Simon Willison's success in creating an HTML5 parser while multitasking, demonstrating the potential of agents to handle complex tasks autonomously. The key lies in defining success criteria and verifying results efficiently.
Skyramp is a testing platform designed to manage complex software applications. It offers features like automated test generation, execution in containerized environments, and intelligent maintenance to keep test suites updated and efficient. The platform focuses on integrating various testing aspects, ensuring reliable coverage and adaptability to changes.
SmartBear AI offers tools for automating software testing and quality assurance. Users can apply for a private beta to experience AI agents that run tests and generate audit reports. The SmartBear MCP server helps teams streamline workflows and improve testing processes without extensive coding knowledge.
This article discusses the benefits and challenges of using AI in programming from the perspective of a senior engineer. It shares practical tips and personal insights on how to effectively integrate AI tools into workflows while addressing common concerns about code quality and understanding.
Momentic is a platform that automates testing for software teams, allowing them to create tests using natural language. It reduces the time needed for test automation, lowers false positives, and improves release cadence. The AI-driven tool adapts to changes in the application, making QA more efficient.
QA Wolf offers an AI-driven testing platform that automates complex tests, from APIs to mobile apps. It provides features like parallel test execution, detailed bug reporting, and seamless integration with CI tools. Users benefit from real-time support and significant time savings in their QA processes.
This article discusses how Catching JiTTests, generated by large language models, streamline the testing process in fast-paced software development. Unlike traditional testing, JiTTests adapt to code changes without the need for ongoing maintenance, focusing on catching serious bugs efficiently.
QA Wolf offers a service that creates and manages automated test plans for your software. They cover a wide range of testing needs, including third-party integrations and API functionality. The service uses Playwright, ensuring you retain your test code even if you discontinue the service.
The author used an AI tool to repeatedly modify a codebase, aiming to enhance its quality through an automated process. While the AI added significant lines of code and tests, many of the changes were unnecessary or unmaintainable, leaving the core functionality largely intact but cluttered. The exercise highlighted the pitfalls of prioritizing quantity over genuine quality improvements.
Quora transformed its QA process for the Poe.com AI chatbot by switching from manual testing to Momentic's automation tool. This change reduced daily test execution time from 7 hours to just 30 minutes, allowing for hundreds of critical test cases to be automated quickly.
This article details Equixly's AI-driven tools that continuously test APIs for vulnerabilities. It highlights features like automated scanning, breach simulations, and compliance tracking to ensure secure code and minimize risks.
Meticulous automates testing by monitoring user interactions and generating a comprehensive test suite. It simplifies the testing process by recording sessions and providing side-effect free tests, allowing developers to see the impact of code changes before merging.
Decipher AI automates end-to-end testing by generating tests from recorded actions or described workflows. It keeps tests updated automatically and alerts teams when users encounter bugs in production, ensuring quick resolutions and minimal disruption.
Signadot provides a platform for agile code validation using isolated sandboxes within Kubernetes. It allows developers and AI agents to quickly test and verify code changes in real-time, ensuring efficient workflows and reducing errors before merging.
QA Wolf automates testing to ensure that over 80% of user flows are covered before deployment, reducing bugs and rework. In just four months, it can set up hundreds or thousands of tests using Playwright for web and Appium for mobile, with the code being open source to avoid vendor lock-in.
The article discusses the future of testing in DevOps, highlighting the trends and technologies expected to shape the landscape by 2025. It emphasizes the importance of automation, continuous testing, and collaboration among teams to enhance software quality and delivery speed. Key insights include the integration of AI and machine learning into testing processes to improve efficiency and effectiveness.
Tusk enhances the CI/CD process by automatically generating verified test cases for pull requests, enabling faster and safer code deployment. Its fully autonomous system maintains test suites and ensures coverage requirements are met without disrupting developer workflows. Users report increased confidence and efficiency in their development cycles through Tusk's capabilities.
Magnitude is an advanced browser automation tool that utilizes vision AI to enable natural language control for tasks such as navigation, interaction, data extraction, and testing. It boasts a high score on WebVoyager and offers a flexible architecture for both high-level and low-level automation, making it suitable for a variety of applications. The tool is designed to be robust and adaptable to complex modern web interfaces.
QA Wolf helps prevent bugs by automating hundreds of tests within four months, ensuring that at least 80% of user flows are tested before deployment. Utilizing Playwright for web and Appium for mobile, the service provides open-source code that eliminates vendor lock-in.
The OpenAI Testing Agent Demo repository showcases how to utilize OpenAI's CUA model with Playwright for automating frontend testing of web applications. It includes three integrated components: a Next.js frontend for test configuration, a Node server for communication with the CUA model, and a sample e-commerce app for demonstration purposes. Users are advised to avoid using the model in production or authenticated environments due to its current preview status.
Manual testing was a bottleneck for a software development team, prompting them to adopt Azure DevOps’ MCP server integration with GitHub Copilot to automate test generation using Playwright. This transition improved test creation speed, coverage, and CI/CD integration, ultimately enhancing their testing process and reducing manual efforts.
An AI-powered tool, sqlmap-ai, enhances SQL injection testing by automating processes such as result analysis and providing step-by-step suggestions tailored to specific database management systems. It supports various AI providers and features adaptive testing, making it user-friendly for both experts and newcomers in cybersecurity.
The article discusses the integration of AI in enhancing application quality through automated test generation. It highlights the benefits of using AI tools to improve testing efficiency and accuracy, ultimately leading to better software performance and user satisfaction. The focus is on how AI can streamline the testing process and reduce the time developers spend on manual testing tasks.
QA Wolf automates the testing process to ensure that at least 80% of user flows are tested before shipping, reducing bugs and rework. In just four months, it can set up hundreds or thousands of tests using open-source code with no vendor lock-in, leveraging Playwright for web and Appium for mobile.
QA Wolf provides a flexible testing service that adapts to changes in your product, ensuring that tests are updated in real-time regardless of the scale of the changes. Their tiered approach includes simple UI updates, larger UX renovations, and complete test rebuilds at no extra charge even for major front-end overhauls.
Modern testing approaches for design systems emphasize the need for comprehensive testing beyond basic checks, utilizing tools like Storybook, Vitest, and Chromatic. By integrating various testing strategies—including unit, snapshot, and screenshot testing—within a single environment, developers can streamline their processes and reduce code duplication. The author shares their experience migrating components to leverage Storybook for both visual and behavioral testing, resulting in improved efficiency and easier maintenance.
The article discusses the methods and practices used to test a web framework, highlighting the importance of automated testing, performance benchmarks, and user feedback in the development process. It emphasizes the need for thorough validation to ensure robust and reliable web applications.
Linux Integration Services Automation (LISA) is a comprehensive system for validating Linux quality, featuring a test framework and customizable test suites. Originally designed for Microsoft Azure and Windows HyperV, LISA now supports various Linux platforms and enables automated environment management for testing. Contributions are welcome as LISA continues to evolve with new features.
A recent experience with a broken demo booking form led to the implementation of an AI browser agent to automatically test the site's functionality. This agent performs tasks like filling out forms and checking for available time slots, ensuring that the user experience is smooth and effective. The setup is quick and provides real-time alerts for any issues, enhancing the overall quality assurance process.
The article discusses the transformative potential of Large Language Models (LLMs) in software development, particularly in generating automated black box tests. By decoupling the generation of code and tests, LLMs can provide unbiased evaluations based solely on input-output specifications, leading to more effective and efficient testing processes.
QA Wolf AI version 4.5 introduces a multi-agent system that generates Playwright tests significantly faster, reducing the time from 29 minutes to just 6 minutes. With specialized agents for outlining, coding, and verifying tests, the system achieves high accuracy and efficiency, enabling engineers to accomplish five times more work in the same period. The transparency of the agents' decision-making process ensures accountability for QA engineers and clients alike.
Chaos Engineering is effective for uncovering risks and preventing outages, but scaling its adoption across organizations presents challenges. To enhance reliability, organizations must standardize testing, automate processes, and establish accountability, ensuring that all services meet the same reliability standards. Gremlin's platform offers tools to facilitate this scalable approach.
The article describes a service that maintains and updates automated tests for software products as they evolve, ensuring compatibility with changes in UI, UX, and overall functionality. It categorizes the types of changes into three tiers: minor UI touch-ups, UX renovations, and total reconstruction, with a commitment to rebuilding tests at no extra charge for significant upgrades.