Skip to main content

Engineering · Cross-Domain Verification & Validation

Verification and Validation Services: Strategy, Coverage and Release Evidence

Agnile plans, executes, and argues verification for automotive, aerospace, and embedded software — the V&V strategy across test levels, requirements-based testing, structural coverage to MC/DC, regression, and the release evidence an assessor or certification authority reads. Building and running the MIL, SIL, PIL, and HIL rigs themselves is a separate service: MIL, SIL and HIL testing services.

Reviewed by Shreyansh, Founder & CTO ·

What do verification and validation services cover?

Verification and validation services show, with traceable evidence, that software meets its requirements (verification) and that the system fulfils its intended use (validation). Agnile Technologies defines the V&V strategy across unit, integration, system, and vehicle levels, derives requirements-based test cases, closes structural coverage — statement, branch, or MC/DC as the ASIL or DAL demands — automates regression, and assembles release evidence for ISO 26262, DO-178C, and Automotive SPICE assessments.

Verification & Validation and HIL and SIL testing are two services designed to work together:
DimensionVerification & Validation (this page)MIL, SIL and HIL Testing
The question it answersWhat must be verified, at which level, and how is the argument closed?Which environment runs the test, and is it fit for purpose?
Typical outputsV&V plan, test specifications, coverage reports, traceability, release evidenceRigs, plant models, rest-bus simulation, automation code, execution reports
DomainsAutomotive, aerospace, embedded, and software programmesAutomotive ECUs and ECU networks

System integration testing

What Is System Integration Testing?

System Integration Testing (SIT) is the verification activity that exercises a software or hardware system across its integrated components — module, subsystem, and external- interface levels — to confirm that the interactions between parts behave as specified. In automotive and safety-critical contexts, SIT happens after unit-level Software-in-the-Loop testing and before vehicle-level validation. It is the layer where integration defects — interface mismatches, timing issues, fault propagation, network message drops — surface before they reach production silicon. ISO 26262 Part 6 Clause 10 governs software integration and verification for automotive safety-critical software; DO-178C §6.4.3 covers requirements-based integration testing for airborne software; ASPICE SWE.5 is the process-assessment view of the same activity.

How System Integration Testing is performed

  1. 01

    Identify integration boundaries

    Map the system architecture into integrated components — modules, subsystems, interface contracts, message flows. Each boundary becomes a test target.

  2. 02

    Plan the integration test strategy

    Decide the integration approach — bottom-up, top-down, big-bang, or incremental. For ASIL or DAL programmes this is documented in the Test Strategy aligned to ISO 26262 Part 6 / DO-178C §6.4 rigor targets.

  3. 03

    Author integration test cases

    Design test cases from the integrated software requirements — nominal interactions, abnormal interactions, fault injection, timing and sequencing, message-drop scenarios. Each test case traced back to a requirement.

  4. 04

    Build the integration harness

    Stub or simulate components not yet ready, instrument the integration layer for observability, and configure coverage tooling (VectorCAST, LDRA, GoogleTest, dSPACE, ETAS) to capture structural-coverage results.

  5. 05

    Execute integration tests

    Run the test cases on the integrated system. Capture pass/fail, structural-coverage data, timing measurements, and defect logs. In automotive this frequently runs on HIL benches with real ECU hardware and a simulated plant model.

  6. 06

    Analyse results and close defects

    Triage failures, categorise root cause (interface mismatch, timing issue, requirement defect, test defect), file and track to resolution, re-run after fix and regression.

  7. 07

    Produce integration evidence

    Bundle test specifications, test cases, test results, structural-coverage analysis, and bi-directional traceability into release evidence. For ISO 26262 and DO-178C programmes this becomes part of the certification or Confirmation Review pack.

For the full walkthrough of the MIL, SIL and HIL stages that integration testing sits between, read System Integration Testing in automotive: MIL, SIL and HIL explained.

Verification coverage

Verification Coverage Across Domains

  • Automotive MIL/SIL/PIL/HIL Test Strategy
  • Aerospace Requirements-Based Verification
  • Embedded and IoT Validation
  • Frontend, Backend, and API Testing
  • Regression Automation
  • System Integration Testing
  • Release Reports and Evidence Packages

Capability areas

Verification and Validation Across Systems, Software, and Hardware

Test Strategy & Planning

Verification strategy, test planning, coverage objectives, toolchain selection, traceability planning, and release evidence structure.

MIL / SIL / PIL / HIL Test Strategy

Which requirements are verified at model, software, processor, hardware, or vehicle level — and how the results combine into one coverage argument across embedded software and control systems.

Requirements-Based Testing

Test case design, automation, traceability to requirements, test execution, result analysis, defect logging, and regression support.

Coverage and Release Evidence

Structural coverage, MC/DC support where applicable, fault injection, robustness testing, validation reports, and release evidence packages.

Building the rigs, plant models, and bench automation those levels run on is delivered through our MIL, SIL, PIL and HIL testing services; safety-case integration of the evidence through functional safety engineering.

Process

How a V&V Engagement Runs — Six Steps

Durations are typical. Steps 1 and 2 run once per programme; steps 3 to 6 repeat per release scope, and coverage closure is sized per software item.

  1. Discovery and requirements review Weeks 1–2

    Requirements, architecture, ASIL or DAL allocation, existing tests, tools, and coverage data reviewed; testability and ambiguity issues logged before any test is written.

  2. V&V strategy and test architecture Weeks 3–8

    Which requirement is verified at which level — MIL, SIL, PIL, HIL, or vehicle — with methods, coverage targets, independence, entry and exit criteria, and tool-confidence needs, written into a plan you can fund and an assessor can read.

  3. Requirements-based test design Typically 3–6 weeks per release scope

    Test cases derived with equivalence classes, boundary values, state transitions, and fault-based analysis, each traced to a requirement and reviewed with your engineers.

  4. Execution and regression automation Every build, from the first increment

    Tests implemented in your framework and run in Continuous Integration or on the bench; failures triaged to requirement, code, test, or environment defects and tracked to closure.

  5. Structural coverage closure 4–8 weeks per software item

    Statement, branch, or MC/DC measured as the ASIL or DAL demands; missing tests added where requirements justify them, uncoverable code justified in writing.

  6. Release evidence package 1–2 weeks per release

    Test summary, coverage report, traceability matrix, open problem reports, and deviation rationale assembled per release candidate.

Deliverables

Deliverables and the Evidence They Support

Each artefact is produced in your toolchain and mapped to the standard or assessment it serves, so release evidence is assembled as the work happens rather than reconstructed later.

DeliverableWhat It ContainsEvidence It Supports
V&V strategy and test planTest levels, methods, coverage targets, independence, entry and exit criteria, environments, and toolsISO 26262 Part 8 Clause 9 verification planning; DO-178C Software Verification Plan; ASPICE verification strategy
Test specificationTest cases with preconditions, inputs, expected results, and pass criteria, derived by named methodsISO 26262 Part 6 test-case derivation methods; DO-178C normal-range and robustness test cases
Bidirectional traceability matrixRequirement to test case to result, maintained in your requirements-management toolchainASPICE traceability and consistency; DO-178C trace data; ISO 26262 verification evidence
Structural coverage reportStatement, branch, or MC/DC per unit, with written justification for uncovered codeISO 26262 Part 6 structural coverage; DO-178C §6.4.4.2 structural coverage analysis
Regression resultsPer-build pass/fail trends, flaky-test log, and links to problem reportsChange impact and release decisions; ASPICE regression strategy
Release evidence packageTest summary, coverage, traceability, open problem reports, and deviation rationale per releaseSafety-case and certification inputs — ISO 26262 confirmation measures, Automotive SPICE assessments, DO-178C Software Accomplishment Summary inputs
Tool-confidence inputsTool use cases, potential tool errors, detection measures, and validation evidenceISO 26262 Part 8 Clause 11 tool classification; DO-330 tool qualification inputs

Engagement models

How we engage on Verification & Validation programmes.

A V&V strategy and test architecture, a requirements-based test campaign with CI regression, or coverage closure to MC/DC on a software unit. We scope the actual work on the call.

  • VV-01·6–8 weeks

    V&V Strategy + Test Architecture

    Test strategy across MIL, SIL, PIL, HIL, and vehicle layers. We design what gets tested where, why, and how coverage will be argued. Outcome: a written test architecture aligned to your ASIL / DAL rigor target and ready to fund.

    Engagement flow

    Discovery
    2w
    Architecture Design
    3w
    Reference Set + Handover
    2w

    Deliverables

    • Test Strategy document
    • Test Architecture (across MIL/SIL/HIL)
    • Reference test set + tooling decisions
  • VV-02·8–12 weeks per release scope

    Requirements-Based Test Campaign

    Requirements-based test cases derived for a defined release scope, implemented in your framework, executed, and wired into CI regression — with results, deviations, and traceability your release review can rely on. Need the bench itself? HIL bench builds run through our HIL & SIL testing service.

    Engagement flow

    Test Design
    3w
    Implementation
    4w
    Execution + Report
    3w

    Deliverables

    • Test specification traced to requirements
    • Automated regression suite in CI
    • Test report + traceability matrix
  • VV-03·4–8 weeks per item

    Coverage Closure to MC/DC

    Targeted coverage closure on a software unit under DAL A or ASIL D rigor. We design missing test cases, justify uncoverable code, and bundle the structural-coverage analysis into the certification or Confirmation pack.

    Engagement flow

    Gap Analysis
    1w
    Test Authoring
    4w
    Coverage Closure
    2w

    Deliverables

    • MC/DC test set
    • Uncoverable-code analysis
    • Coverage closure report

Why Agnile

What We Do Differently

  • 01

    We test on the silicon already in your programme. PIL and HIL on AURIX, RH850, S32K, S32G — not host-only environments that hide target-specific bugs.

  • 02

    MC/DC closure on real safety-critical code. Every condition independently affecting the decision outcome — written-rationale uncoverable-code analysis bundled in.

  • 03

    Tool-agnostic — VectorCAST, LDRA, GoogleTest, Unity, dSPACE, ETAS. We integrate into your existing pipeline; we don't ask you to retool.

  • 04

    ASPICE Level 2+ test deliverables. Test specifications, cases, and results bidirectionally traceable to software requirements — ready for assessment.

  • 05

    Release evidence an assessor can read. Test summaries, coverage reports, traceability, and deviation rationale packaged per release — not reconstructed the week before an audit.

Standards depth

Standards we work to.

ISO 26262 Part 6 at ASIL D. DO-178C §6 at DAL A. ASPICE SWE.4–SWE.6 in steady state.

  • ISO 26262 Part 6

    Software-level requirements for ASIL A–D

    Requirements-based testing at software unit, integration, and embedded-software level (Clauses 9–11). Coverage recommendations scale with ASIL — statement coverage highly recommended at A and B, branch coverage at B to D, MC/DC at D.

  • DO-178C §6

    Verification process for airborne software

    DO-178C verification objectives — requirements-based test cases at HLR and LLR, structural coverage analysis with MC/DC at DAL A, robustness testing per §6.4.2.2.

  • MC/DC

    Modified Condition / Decision Coverage

    MC/DC test sets — every condition independently affects the decision outcome — for safety-critical decisions. Uncoverable code justified with written rationale.

  • ASPICE SWE.4–SWE.6

    Software verification processes (Automotive SPICE, VDA QMC)

    SWE.4 unit verification, SWE.5 integration test, and SWE.6 qualification test in ASPICE 3.1 — ASPICE 4.0 renames SWE.5 and SWE.6 to software component verification and integration verification, and software verification. Specifications, results, and bidirectional traceability maintained for assessment.

  • ISO 26262-8 Clause 11

    Confidence in the use of software tools

    Tool use cases, tool impact and error-detection analysis, and validation evidence as inputs to the tool confidence level your safety team sets — and to DO-330 tool qualification on airborne programmes.

  • VectorCAST / LDRA

    Test + coverage tooling

    VectorCAST or LDRA integrated into the build — auto-generate harness code, configure target adapters for AURIX / RH850 / S32K, drive coverage at Statement / Decision / MC/DC.

How we test — the V&V progression

From MIL to vehicle validation

Six stages, each with named methodology and an explicit deliverable. Earlier faults cost less — we push test maturity left in the V-model.

  1. 01

    Test Strategy & Architecture

    ASPICE SWE.4–SWE.6

    We define the test strategy across MIL, SIL, PIL, HIL, and vehicle layers — what gets tested where, why, and how coverage will be argued.

    → Test Strategy + Architecture

  2. 02

    MIL — Model-in-the-Loop

    Earliest verification

    Algorithm-level tests against the Simulink / TargetLink / Stateflow model. Catches numeric and behavioural defects before code generation.

    → MIL test cases + reports

  3. 03

    SIL — Software-in-the-Loop

    Unit + integration

    Generated or hand-written code tested in a host environment — GoogleTest, Unity, VectorCAST. Coverage tooling configured for Statement / Decision / MC/DC.

    → Unit + integration tests

  4. 04

    PIL — Processor-in-the-Loop

    Target-specific behaviour

    Code executed on the target processor with stimuli mirroring the SIL test cases. Catches compiler / runtime / target-specific defects that host environments hide.

    → PIL test reports + delta

  5. 05

    HIL — Hardware-in-the-Loop

    System-level closed-loop

    ECU under test on a dSPACE or ETAS bench with simulated plant model and real CAN/Ethernet stimuli. Closed-loop scenarios, fault injection, robustness testing.

    → HIL bench + scenarios

  6. 06

    Vehicle Validation & Coverage Closure

    Final argument

    Field validation campaigns, edge-case scenarios, and final coverage closure. Independent verification at DAL A / ASIL D. Test report bundle ready for programme acceptance or audit.

    → Coverage closure pack

Case study

What This Looks Like in Practice

Anonymised by request. References available on qualified enquiry.

Anonymised engagement summary. Customer identity and programme details withheld under NDA. Metrics reflect internally documented delivery outcomes.

Indian powertrain programme · ASIL D ECU

MC/DC closure for an ASIL D powertrain function.

Context

An Indian engineering team was preparing for vehicle-programme acceptance on a powertrain ECU classified ASIL D. Their existing structural coverage stood at 87% Branch coverage with no MC/DC argument — sufficient for ASIL B, not ASIL D. They had 6 weeks before submission and 12 kSLOC of safety-relevant code to close.

Approach

Agnile ran a coverage gap analysis, designed targeted MC/DC test cases against the existing requirements, justified uncoverable code with written rationale, and integrated the resulting suite into the team's VectorCAST harness. Coverage closure delivered in 5 weeks, evidence pack in week 6.

What we delivered

  • Coverage gap analysis (12 kSLOC)
  • MC/DC test cases (147 added)
  • Uncoverable-code rationale document
  • Updated VectorCAST harness + CI integration
  • Coverage closure report (ASIL D ready)

What the customer got

  • MC/DC coverage closed in 5 weeks
  • Programme acceptance on first submission
  • Test framework reused on follow-on programmes

ASIL D · 12 kSLOC · MC/DC closed · 5 weeks

FAQ

Verification and Validation Questions

Explore next

Plan verification around your programme

The test-environment service that runs these tests, the safety practice that consumes the evidence, and the guides behind the terms.

Scope Your V&V Programme

A 60-minute call: plan a V&V strategy, scope a requirements-based test campaign, or close MC/DC for a DAL A function. We respond to qualified enquiries within one business day.