Test the product, price and handoff as one system.
A configurator can look correct while producing an invalid combination, wrong price, inaccessible interaction or incomplete order. This guide connects rules, 3D, documents, integrations and operations to one versioned test architecture and release evidence pack.
A product configurator joins multiple truths: the catalogue says what exists; rules say what is permitted; 3D communicates the selected state; pricing creates a commercial result; documents communicate an offer; integrations and optional BOM or order outputs move the project into another responsible system. QA proves that these layers agree for known configurations and failure conditions.
A good test names the requirement, product and account fixture, input, expected structured state, visible result, downstream consequence, environment, revisions and evidence. “The quote button works” is weak. “Dealer A configures product revision 12.4, receives account price revision 8, generates quote revision 3 and delivers project ID P-2041 exactly once to CRM” is reproducible.
Testing is therefore a permanent product capability, not a ceremony at launch. The accepted scenarios become the regression pack for new options, prices, assets, translations, integrations, browsers and platform releases. Production observation adds evidence from real conditions while never replacing pre-release prevention.
Interactive QA scope builder
Start with consequence, not test count.
Select the journey, business output and change type. The builder returns the minimum areas an impact review should consider. Replace the generic choices with real product fixtures and responsibilities before release.
Primary journey
Business output
Change type
Suggested release scope
Focused release
Risk-based
Require source revision, targeted regression, presentation review and post-release observation.
01
Account catalogue, price list, customer project and co-branding
02
Cross-account denial and role downgrade
03
Saved project continuation between dealer and customer
04
Known-price ledger and branded document reconciliation
05
Quote revision, validity, language and customer delivery
06
CRM project identity and follow-up status
07
Normal, boundary, invalid and historical configuration fixtures
08
Price, visual, quote and downstream trace for changed logic
09
Targeted plus dependent regression suite
Journey
Dealer sales
Output
Lead + quote
Change
Product logic
Complete quality model
Ten domains define a trustworthy configurator.
Each domain has different owners and evidence. They meet in the same versioned configuration, which is why the test pack must reconcile layers rather than evaluate them as unrelated features.
Is the right product revision being tested?
Catalogue and identity
Verify product families, option groups, stable IDs, labels, markets, languages, availability and saved configuration identity. Test renamed, withdrawn, replaced and effective-dated items—not only the current happy path.
Evidence
Catalogue revision, fixture IDs, expected availability and saved-project results
Can users create only accepted states?
Rules and dimensions
Test defaults, required choices, dependencies, exclusions, substitutions, minimums, maximums, increments, derived values, coupled dimensions, warnings, review conditions and hard stops at boundaries and just outside them.
Evidence
Decision table, boundary fixtures, expected messages and valid-state snapshots
Does the visible product match the structured state?
3D scene and behavior
Trace materials, visibility, modules, transforms, instances and procedural geometry to configuration IDs. Verify scale, pivots, camera, clipping, motion, largest scenes, repeated changes and asset revisions across supported devices.
Evidence
Configuration-to-scene trace, asset manifest, screenshots and device measurements
Can every price be explained and reproduced?
Pricing and commercial context
Reconcile list, dimension, area, component, service, account, market, currency, discount, approval, tax and rounding lines. Include thresholds, effective dates, missing prices, quote-only states and repricing of saved projects.
Evidence
Known-price ledger, source revision, line provenance and approved total
Do outputs represent the accepted revision?
Documents and customer communication
Verify quote identity, configuration snapshot, selections, exclusions, totals, tax, validity, terms, language, brand, 2D or 3D imagery, page flow, accessibility and regeneration after a controlled change.
Evidence
Approved PDF set, structured quote record, comparison and reviewer sign-off
Does the downstream structure reconcile with product truth?
BOM and operational output
Test component IDs, hierarchy, quantity, unit, variable dimensions, effectivity, substitutions, pack or waste logic, documents and review status. A correct picture or total does not prove production output.
Evidence
Expected component structure, quantity calculations and destination acknowledgement
Does data arrive once, completely and traceably?
Integrations and recovery
Test authentication, schema, field mapping, identifiers, idempotency, ordering, timeouts, retries, duplicate events, destination outage, partial failure and reconciliation for CRM, ERP, ecommerce, PIM and other systems.
Evidence
Contract result, correlation IDs, delivery log, recovery and reconciliation record
Can each identity access only permitted objects and actions?
Roles, security and privacy
Test public, customer, dealer, workforce and service identities across accounts, projects, prices, files, exports and privileged actions. Include cross-object denial, role changes, shared links, upload controls, retention and audit reconstruction.
Evidence
Role matrix, negative access results, event records and lifecycle exercise
Can people complete the journey without one input or sensory mode?
Accessibility and alternate operation
Evaluate keyboard order, focus, control names, status announcements, errors, contrast, target size, zoom, reflow, reduced motion, dragging alternatives and an equivalent way to understand and configure the product beyond the canvas.
Evidence
WCAG scope, automated scan, manual assessment, assistive-technology notes and exceptions
Does the accepted experience remain usable in real conditions?
Performance and compatibility
Measure initial page and 3D loading, first useful product view, interaction response, layout stability, memory, sustained frame behavior and recovery on supported browsers, devices, networks and normal plus largest valid scenes.
Evidence
Lab matrix, field measurements, budgets, representative traces and release comparison
Test architecture
Six layers balance speed, confidence and meaning.
Put combinations and calculations in fast model tests. Use end-to-end journeys to prove assembly. Preserve human review for appearance, language, usability, accessibility and operational meaning that automation cannot decide reliably.
01
Model checks
Fastest
Validate data shape, identifiers, units, formulas, rule functions and transformations in isolation.
Limit: Cannot prove that the assembled customer journey or connected systems behave correctly.
02
Contract tests
Fast
Verify a boundary between services, assets or systems without depending on a live external environment.
Examples: API request/response, webhook signature, document payload, asset manifest and ERP field mapping.
Limit: A correct contract does not prove the real endpoint, permissions, data or recovery path.
03
Component and interaction tests
Medium
Exercise user-visible controls and state transitions with controlled product fixtures.
Examples: Dimensions, option dependencies, validation messages, price updates, keyboard behavior and save state.
Limit: Mocked boundaries can hide deployment, authentication and downstream failures.
04
End-to-end journeys
Slower
Verify a real user role completes the most valuable business flow through the assembled application.
Examples: Configure, price, save, request quote, approve, generate document and deliver an order record.
Limit: Broad tests are expensive and harder to diagnose; keep them representative rather than duplicating every rule case.
05
Human and specialist review
Deliberate
Evaluate meaning that automated checks cannot reliably determine.
Examples: Finish credibility, language quality, document clarity, accessibility, usability and production acceptance.
Limit: Review must use recorded criteria and exact revisions or it becomes subjective and irreproducible.
06
Production observation
Continuous
Detect real-user, device, data and dependency behavior that pre-release fixtures cannot fully reproduce.
Examples: Field performance, error rates, failed events, abandoned steps, quote reconciliation and support signals.
Limit: Monitoring finds impact after release; it does not replace pre-release prevention or acceptance.
Release governance
Six gates turn test output into a release decision.
A green automated suite is evidence, not authority. Release acceptance also needs scope, domain ownership, non-functional quality, historical compatibility and operational readiness.
01
Scope complete
Pass evidence
Change record names affected products, markets, roles, systems, saved states, evidence and rollback.
Not enough: The change is described only as a ticket title or visual request.
02
Automated suite
Pass evidence
Required model, contract, component and journey tests pass on the release candidate and accepted fixtures.
Not enough: Failures are rerun until green without explaining flakiness or scope.
03
Domain approval
Pass evidence
Named product, pricing, 3D, document, integration or operations owners approve affected evidence.
Not enough: A general stakeholder approves outputs outside their responsibility.
04
Non-functional evidence
Pass evidence
Accessibility, performance, security, compatibility and recovery checks match the change risk.
Not enough: Functional success is treated as proof of usable, secure and resilient delivery.
05
Historical compatibility
Pass evidence
Supported saved projects, quotes, orders and integrations retain their accepted meaning or follow a documented migration.
Not enough: Only new projects created after the release are tested.
06
Controlled release
Pass evidence
Version, migration, observability, owner, communication, rollout and rollback are ready before publication.
Not enough: Publishing is the first time the complete change is observed in a production-like environment.
Evidence contract
A pass result needs an identity.
The report connects the assertion to exact product, application, price, asset, fixture and environment revisions. That makes the result reproducible and useful when a later release fails.
These tests deliberately cross boundaries. Replace the example product, numbers, identities and outputs with approved fixtures, then apply the same pack to every vendor and every material release.
01
Minimum boundary
Set each primary dimension to the accepted minimum and just below it. Verify product state, explanation, visual geometry, price and downstream behavior.
02
Maximum coupled configuration
Create the largest valid multi-module product with permitted accessories. Verify constraints, scene stability, price, document and output quantities.
03
Dependency and exclusion
Select a required dependency, then attempt a known incompatible option through the UI and direct state input. Confirm one governed result and clear message.
04
Known-price ledger
Run a configuration with approved line-by-line expectations across dimensions, options, services, discounts, tax and rounding; compare sources and total.
05
Visual-to-record trace
Change one material, module, dimension, accessory and moving state. Reconcile node behavior with stable configuration IDs and the saved project.
06
Quote revision
Generate a quote, revise the configuration, reprice and regenerate. Verify revision identity, supersession, snapshot, validity and customer-visible differences.
07
Configured output
Deliver a known configuration to the accepted order or BOM destination. Reconcile IDs, quantities, units, dimensions, revision and acknowledgement.
08
Destination outage
Interrupt one required integration. Verify safe user status, queued or failed state, attributable alert, idempotent retry and final reconciliation.
09
Cross-account denial
Use a valid dealer or customer identity to request another account's project, quote, file, export and event. Confirm denial without content leakage.
10
Keyboard and status
Complete the primary journey without a pointer. Verify focus order, visible focus, control names, errors, progress, price changes and completion status.
11
Mobile sustained session
Load a normal and largest valid configuration on representative phones and networks, then change options repeatedly while measuring response and memory.
12
Saved-project compatibility
Open supported projects created before the release. Verify product revision, mappings, price policy, appearance, documents and intended migration behavior.
QA failure patterns
Eight practices that create false confidence.
The dangerous test suite is not always the red one. It is the green suite that checks the wrong revision, depends on unstable data or never observes the business output.
01
Only the happy path is automated
The demo configuration passes while minimums, maximums, incompatibilities, missing data and historical states remain untested.
Control: Build fixtures from equivalence classes, boundaries, known failures and real support cases.
02
Screenshots replace product assertions
A visual comparison detects pixels but cannot prove option identity, price provenance, BOM quantity or accessible meaning.
Control: Pair visual evidence with structured state, calculation and downstream assertions.
03
The same test data changes underneath the suite
Shared catalogue or account records are edited, making failures irreproducible and expected results uncertain.
Control: Use versioned, isolated fixtures with explicit source revisions and controlled setup.
04
Flaky tests are simply retried
Intermittent synchronization, data and environment failures are hidden until a real customer experiences them.
Control: Classify, quarantine with ownership, diagnose and remove the cause before the test regains release authority.
05
Automation is mistaken for accessibility conformance
A scan passes while keyboard, focus, announcements, canvas alternatives and real assistive-technology journeys fail.
Control: Combine automated detection with manual assessment and inclusive user evaluation.
06
Production is tested with customer data
QA creates real leads, quotes, orders, emails or operational records that cannot be distinguished from business activity.
Control: Use governed test identities and data, safe destinations, clear markers and cleanup or retention rules.
07
Release evidence has no revision
A PDF, screenshot or test report cannot prove which code, catalogue, price list, asset or integration contract was assessed.
Control: Attach release, environment, fixture and dependency revisions plus time and owner to every acceptance result.
08
Monitoring starts after the incident
The team cannot distinguish invalid configurations, pricing errors, delivery failures or performance regressions until users report them.
Control: Define release and business observability alongside the test plan, including owner and response path.
Vendor QA due diligence
Twenty questions before accepting quality claims.
Ask every vendor against the same product and output. Require exact evidence, owners and revision identity instead of “fully tested” or “works on all devices.”
01
Which real product, account and output form the common acceptance fixture?
02
How are product, price, asset, document, environment and integration revisions identified in results?
03
Which tests cover defaults, dependencies, exclusions, dimensional limits and derived values?
04
How are invalid states tested through both the interface and direct API or saved-state input?
05
How are visible 3D parts and materials reconciled with configuration IDs?
06
Which known-price cases are approved line by line and who owns each price source?
07
How are quotes, revisions, validity, tax, language and document snapshots accepted?
08
Which component, quantity, unit and dimension cases prove BOM or order outputs?
09
How are CRM, ERP, ecommerce and webhook failures, retries and duplicates tested?
10
Which roles, tenants, projects, files, exports and privileged actions have negative access tests?
11
What WCAG target and page or journey scope is accepted for accessibility evaluation?
12
Which accessibility checks are automated, manual and user evaluated?
13
Which browsers, devices, networks, products and scene sizes define the compatibility matrix?
14
Which lab and field performance measures are release gates?
15
How are fixtures isolated, reset and protected from uncontrolled changes?
16
How are flaky tests identified, owned, quarantined and restored?
17
Which changes trigger full, targeted or no regression suites, and who decides?
18
How are supported saved projects and earlier quotes tested after changes?
19
What evidence must exist before release, and where is it retained?
20
How are rollout, monitoring, support, rollback and post-release reconciliation tested?
Primary testing references
Use standards and tools without confusing them for complete proof.
These official sources help define accessibility, browser testing, performance, security and 3D asset checks. The product owner still has to define the real catalogue, commercial and operational acceptance criteria.
Direct answers for product, QA and procurement teams.
Product configurator testing verifies that a configurable product remains valid, understandable, correctly visualized, accurately priced, safely stored and correctly delivered through the accepted business workflow. It covers catalogue identity, rules, dimensions, 3D behavior, prices, quotes, BOM or order data, integrations, roles, security, privacy, accessibility, performance, compatibility, saved revisions and release operations. A complete test connects the customer action to structured state and its downstream consequence.
Quality assurance is the broader system used to prevent, detect, review and learn from defects across discovery, design, data preparation, development, release and maintenance. Acceptance testing is the evidence-based decision that a specific requirement or workflow passes agreed criteria on identified revisions and environments. Automated regression, human review, security assessment, performance measurement and production observation can all contribute to QA; only the agreed acceptance owner can accept the result.
Include objectives, scope, audiences, product families, representative fixtures, authoritative sources, environments, roles, browsers, devices, networks, test layers, domain scenarios, expected results, data setup, automation, human review, evidence, defect severity, owners, entry and exit criteria, release gates, rollback and post-release monitoring. Identify exclusions and specialist engineering boundaries so an untested visual result is not mistaken for technical approval.
Convert rule definitions into decision tables, equivalence classes and boundary cases. Test defaults, required choices, dependencies, exclusions, substitutions, ranges, increments, coupled dimensions, derived values, precedence, conflicts, warnings, review states and hard stops. Exercise cases through both user controls and direct structured input so hidden or old saved states cannot bypass validation. Record product-model and rule revisions with every result.
Start with known configuration IDs and trace each material, visible component, replacement module, transform, instance and generated dimension to the scene. Verify scale, origins, pivots, motion, camera, clipping, transparency, loading and the largest valid scene. Change options repeatedly on supported devices, save and reopen the project and reconcile the same state with price, quote and optional BOM. Visual screenshots help review appearance but cannot replace structured assertions.
Use approved known-price fixtures with line-by-line expectations. Cover fixed, length, area, quantity, component, band, matrix, formula, percentage and minimum methods as applicable; include account, market, currency, delivery, installation, discount, approval, tax and rounding context. Test thresholds, missing data, effective dates, quote-only states and saved-project repricing. Preserve price-source and calculation revisions so the result is explainable.
Verify customer and project identity, configuration revision, visible selections, exclusions, imagery, line items, totals, tax, discounts, terms, validity, language, brand, pagination and accessible reading order. Generate a quote, revise the configuration, reprice and regenerate to prove supersession and historical snapshots. Reconcile the structured quote record with the document a customer receives.
Compare a known valid configuration with an approved component structure. Verify component IDs, hierarchy, quantities, units, variable dimensions, effectivity, substitutions, waste or pack rules, documents and review status. Include normal, minimum, maximum, optional, repeated, multi-level and revised cases. Deliver the result to the accepted destination and reconcile its acknowledgement; a downloaded spreadsheet alone does not prove operational acceptance.
Test the accepted request, response or event contract first, then the live integration boundary. Verify identity, authorization, stable record IDs, schema, units, versions, idempotency, ordering, timeouts, retries, duplicates, partial failure, destination outage and reconciliation. Trace one configuration through delivery, acknowledgement and the downstream record. Protect production systems from unmarked test leads, orders and emails.
Define the WCAG version, level and page or journey scope. Combine automated detection with keyboard review, focus and status verification, zoom and reflow, contrast, target size, error handling, reduced motion, dragging alternatives, screen-reader assessment and inclusive user evaluation where appropriate. The 3D canvas needs an equivalent way to understand and operate essential product choices. W3C states that tools alone cannot determine accessibility conformance.
Use representative real phones, browsers and network conditions with a normal and largest valid product. Measure the page and 3D asset path, first useful product view, interaction response, layout stability, memory and sustained behavior after repeated changes. Combine lab traces with field measurement because real users bring devices, data and networks that a controlled environment cannot fully reproduce.
Visual regression compares a current rendered result with an approved baseline to detect unintended pixel differences. It is useful for layout, camera, materials and known scene states when browser, operating system, fonts, graphics and other rendering conditions are controlled. It should be paired with tolerances, human review and structured assertions. A matching image cannot prove that the correct option ID, price, quantity or accessible name produced it.
There is no useful universal count. Coverage should follow product risk, rule boundaries, commercial impact, downstream consequences, user roles, saved history and change frequency. Many fast model cases can cover rule and calculation combinations, while a smaller set of representative end-to-end journeys proves assembly. Track meaningful requirements, fixtures and failure detection rather than celebrating a raw test number.
Run the relevant regression scope whenever catalogue, rules, dimensions, assets, prices, translations, documents, roles, integrations, dependencies, browsers or infrastructure can change accepted behavior. Fast checks can run on every change; broader browser, device, accessibility, security, performance and operational suites can run at risk-based release gates and scheduled intervals. Production monitoring adds continuous evidence but does not replace pre-release testing.
Keep fixtures created against supported historical product, price, asset and application revisions. Reopen them after the change and verify stable identity, migration, rule validity, appearance, price policy, documents, downstream mappings and customer-visible explanation. Decide in advance whether a saved project retains its original meaning, migrates, requires review or can no longer be ordered. Never let a new release silently reinterpret an accepted quote.
Record requirement and test IDs, environment, application release, product and price revisions, asset and binding revisions, integration contract versions, fixture and account identities, steps or input, expected and actual result, status, evidence links, time, tester or automation identity, defect, exception, owner and approval. The report should let another person reproduce the result and prove exactly what release was accepted.
Give every vendor the same representative product, known price, invalid combination, saved revision, role context and expected quote or operational output. Ask them to run normal, boundary, failure and recovery scenarios while exposing structured state and evidence. Compare maintainability, automation, ownership, historical compatibility and release controls—not only an ideal scripted demo or list of supported browsers.
Configurix turns the accepted product catalogue, rules, 3D behavior, pricing, documents, roles, integrations and optional operational outputs into explicit scenarios and evidence. Scope can include model, contract, interaction, end-to-end, accessibility, performance, security and release checks according to the implemented workflow. Representative fixtures and revisions make the acceptance pack reusable as regression coverage after launch, while exact tests and owners are agreed for each customer's product system.