#10 in AI Testing Alumnium logo

Alumnium

A QA engineer inherits a checkout flow test that breaks every time the UI changes

The test uses dozens of CSS selectors that need constant updates. She rewrites it with Alumnium, replacing "click button with class checkout-btn-v2" with simply "do click the checkout button." When developers redesign…

Alumnium screenshot

A QA engineer inherits a checkout flow test that breaks every time the UI changes. The test uses dozens of CSS selectors that need constant updates. She rewrites it with Alumnium, replacing "click button with class checkout-btn-v2" with simply "do click the checkout button." When developers redesign the page next month, the test keeps running without modification because the AI interprets the natural language against whatever button actually exists.

Alumnium translates plain English test instructions into browser commands. You write what you want the test to do using three commands: 'do' for actions, 'check' for verifications, and 'get' for data extraction. The AI figures out how to execute those instructions by analyzing the application's accessibility tree and taking screenshots. It works with Playwright, Selenium, and Appium, so it fits into existing test infrastructure rather than replacing it.

A test automation engineer at a fintech company needs to verify transaction flows across web and mobile apps. He writes "do enter 500 in the amount field" and "check that confirmation message appears." Alumnium handles both platforms through the same natural language interface. When product adds a currency selector dropdown, he just writes "do select USD from currency" without diving into mobile element locators or web DOM structures.

The philosophy differs from AI tools that generate entire test suites. Alumnium does not write tests. Engineers still design test logic, structure, and assertions. It just handles the tedious part—telling browsers what to click and where to type. A senior test engineer keeps control over test architecture while junior team members can contribute test steps without mastering complex selector strategies.

Support for reasoning models improves accuracy when instructions get ambiguous. The AI can better distinguish between similar buttons or fields when multiple matches exist. Integration with Model Context Protocol means general-purpose AI agents can trigger test runs or extract test data as part of broader workflows.

Currently works with Python test frameworks. JavaScript and Ruby support remains in development, which blocks teams standardized on those languages. A Ruby on Rails shop running RSpec would need to wait or restructure their testing approach. TypeScript support exists, though documentation doesn't specify which frameworks.

Version 0.17 appears free with Alumnium Pro mentioned as a future paid tier. No details around what Pro includes or when it launches.

The MCP Server integration matters for teams using AI-assisted development workflows. A developer using an AI coding assistant could theoretically trigger Alumnium tests directly from their editor, though this requires the assistant to support Model Context Protocol.

Where it breaks: complex conditional logic still needs traditional code. A test that branches based on user state or performs calculations can't express everything in natural language. Alumnium works with integrations like Anthropic, Google, Meta, and OpenAI models, but switching models might change interpretation consistency. An instruction that works reliably with one AI provider could behave differently with another.

Teams fully invested in codeless testing platforms won't find what they need here. This requires writing code and understanding test framework structure. A business analyst creating smoke tests through record-and-playback tools would hit a learning curve.

Don't use this if your team runs tests exclusively in JavaScript or Ruby right now. Wait for language support. Skip it if your organization prohibits sending application screenshots to AI providers for privacy reasons—Alumnium needs visual context to interpret instructions.

Alumnium alternatives

See all →

Frequently asked

7 questions
Does Alumnium work with Playwright and Selenium?
A test automation engineer maintaining a Selenium-based regression suite can add Alumnium without migrating frameworks. It works as a layer on top of Playwright, Selenium, and Appium rather than replacing them. The engineer writes natural language instructions like 'do click the submit button' and Alumnium translates those into actual Selenium commands that execute against the existing browser drivers. Teams running Playwright for modern web apps and Appium for mobile testing use the same natural language syntax across both, which means test engineers don't context-switch between different automation APIs.
Is Alumnium free to use?
A QA team at a startup can download version 0.17 without paying anything. The current release appears free or open source based on available information. Documentation mentions Alumnium Pro as a future paid offering but provides no details about pricing, features, or launch timing. Teams planning budgets for 2024 can't estimate costs since Pro tier capabilities remain undefined.
Can Alumnium write complete test scripts automatically?
A senior test engineer expecting AI-generated test suites will find Alumnium works differently. It does not analyze an application and produce tests. The engineer still writes test structure, decides what to verify, and organizes test files. Alumnium just handles the browser interaction part—translating 'do enter email address' into actual element location and input commands. A team lead designs the test strategy and framework while junior engineers contribute test steps without mastering CSS selectors or XPath expressions.
What languages does Alumnium support for writing tests?
A Python shop using pytest can integrate Alumnium into existing test files immediately. An engineering team standardized on JavaScript with Jest or a Ruby on Rails team running RSpec will hit a wall since those languages remain in development. TypeScript support exists though documentation doesn't clarify which test frameworks work. A company evaluating Alumnium needs to check their current test language—if it's not Python or TypeScript, they either wait for support or rewrite their test infrastructure.
How does Alumnium handle UI changes without breaking tests?
A mobile QA engineer writes a test that says 'do tap the login button' for an app's authentication flow. Developers redesign the login screen three sprints later, moving the button and changing its styling completely. The test keeps working because Alumnium interprets 'login button' against whatever the current UI actually contains rather than relying on a brittle element ID or CSS class. The AI uses the accessibility tree and screenshots to locate elements by purpose instead of technical identifiers, which means typical UI updates don't require test maintenance.
Can Alumnium send test data to AI providers like OpenAI?
A test engineer at a healthcare company working with patient data needs to understand that Alumnium sends screenshots and accessibility information to AI models for interpretation. The tool integrates with Anthropic, Google, Meta, OpenAI, and other providers to translate natural language into browser actions. A company with strict data privacy policies or regulatory requirements around PHI or PII might violate compliance by letting application screenshots leave their infrastructure. Teams in finance, healthcare, or government need legal review before using this on production-like environments with real data.
What are the do, check, and get commands in Alumnium?
A test engineer verifying an e-commerce checkout uses three command types to structure tests. The 'do' command handles actions like 'do click add to cart' or 'do enter shipping address.' The 'check' command verifies conditions like 'check that order total shows correct amount' or 'check that error message appears.' The 'get' command extracts data like 'get order confirmation number' for use in later test steps. This three-command structure keeps test syntax simple while covering the full range of test operations—interacting with the page, asserting expected behavior, and capturing values.

Traffic

Estimated monthly website visits · last 6 months

3.4K visits/mo
Monthly visits
3.4K
↑ 107.6% MoM
Global rank
#9,398,982
US #3,214,436
Category rank
#10
AI Testing
3.4K 2.7K 1.9K 1.1K 327 Dec 2025: 951 visits Dec 2025 Jan 2026: 327 visits Jan 2026 Feb 2026: 647 visits Feb 2026 Mar 2026: 1.1K visits Mar 2026 Apr 2026: 1.7K visits Apr 2026 Aug 2026: 3.4K visits Aug 2026

Reviews (0)

Write review

No reviews yet. Be the first to share your experience.