Whole-system architecture field guide

Begin with the mission. Prove the whole system works.

Systems Engineering connects stakeholder value to hardware, software, people, procedures, facilities, and evidence across the complete lifecycle.

  • 15connected views
  • 7decision artifacts
  • 1full interview case
mission.se
# Trace every decision to a real need
need = understand(stakeholders, context, lifecycle)
requirements = make_measurable(need)
functions = decompose(what the system must do)
architecture = allocate(functions,
  to=hardware + software + people)

balance(performance, risk, cost, schedule)
verify(built to requirements)
validate(solves the mission)

01 · System context

Draw the boundary before drawing the solution

A context diagram names the system of interest, everything it exchanges, and the environments in which it must survive.

StakeholdersCustomer · owner · regulatorNeeds, policy, acceptance
PeopleUser · operator · maintainerCommands, feedback, procedures
External systemsServices · vehicles · infrastructureData, control, material, energy
System of interestPurpose + behavior + boundaryHardware · software · data · people · procedures · facilities
EnvironmentPhysical · cyber · operationalWeather, terrain, interference, threats
Supply sideSuppliers · production · logisticsParts, tooling, skills, lead time
End of lifeRecovery · disposal · replacementData, materials, safety, continuity
Draw each exchange in its actual direction; use two arrows only when the interface is bidirectional. Every exchange needs an owner, interface, unit, timing rule, failure behavior, and verification method.
Purpose

Why does it exist?

State the outcome in the stakeholder’s language, not a preferred technology.

Mission · value · acceptance
Boundary

What do we own?

Separate the system from users, external services, support equipment, and environment.

Inside · outside · assumptions
Exchange

What crosses it?

Capture matter, energy, information, commands, observations, and responsibility.

Source · destination · contract
Memory hookPurpose → boundary → actors → exchanges → environment → lifecycle. If the boundary changes, revisit requirements and risk.

02 · Concept of Operations

Tell the system’s life as an operational story

A ConOps describes who uses the system, in what situation, across normal, degraded, emergency, support, and retirement scenarios.

  1. 01AcquireBuild, procure, install, register, and accept.
  2. 02ConfigureProvision, calibrate, train operators, and check readiness.
  3. 03StartPower on, self-test, authenticate, and enter a safe state.
  4. 04OperatePerform the mission under expected loads and environments.
  5. 05DegradeDetect faults, preserve critical functions, and communicate limits.
  6. 06RecoverFail over, repair, restore data, and confirm readiness.
  7. 07MaintainInspect, update, replace, recalibrate, and audit.
  8. 08RetireDecommission safely, migrate service, and dispose responsibly.
Nominal scenario

Describe success end to end

  1. 1Trigger
  2. 2Preconditions
  3. 3Actions
  4. 4Outputs
  5. 5Success measure

Ask: who acts, what state changes, what feedback appears, and how the user knows the mission succeeded?

Off-nominal scenario

Describe safe failure and recovery

  1. 1Fault
  2. 2Detection
  3. 3Containment
  4. 4Fallback
  5. 5Recovery

Ask: what remains available, who takes control, what is logged, and what evidence permits return to service?

03 · Requirements and decomposition

Move from need to a fielded, sustained system

Systems Engineering is iterative and recursive. Definition, realization, transition, operation, and retirement inform one another; a discovery at any step can change earlier assumptions, requirements, interfaces, evidence, or plans.

StartWhat mission outcome matters?Capture stakeholders, context, constraints, and measures of effectiveness.
  1. 01
    Stakeholder needs

    Translate viewpoints, pains, policies, and mission goals into agreed expectations.

    Artifact: need statement
  2. 02
    ConOps

    Walk through lifecycle scenarios, users, operating modes, and environments.

    Artifact: scenario set
  3. 03
    Measures

    Define mission success, effectiveness, performance, suitability, and constraints.

    Artifact: quantified targets
  4. 04
    Requirements

    Write necessary, singular, feasible, unambiguous, and verifiable statements.

    Artifact: baselined specification
  5. 05
    Functions

    Decompose what must happen without prematurely choosing components.

    Artifact: logical architecture
  6. 06
    Alternatives

    Create genuinely different solution concepts and define evaluation criteria.

    Artifact: candidate architectures
  7. 07
    Allocate

    Assign functions and requirements to hardware, software, people, and externals.

    Artifact: physical architecture
  8. 08
    Balance

    Resolve interfaces, budgets, risks, cost, schedule, and technical margins.

    Artifact: selected baseline
  9. 09
    Realize

    Build, code, buy, reuse, fabricate, train, and document configuration-controlled elements; qualify inherited evidence for this mission and environment.

    Artifact: as-built / as-coded elements + pedigree
  10. 10
    Integrate

    Assemble in risk-retiring increments, exercise interfaces, and preserve the exact configuration under test.

    Artifact: integrated configuration + interface evidence
  11. 11
    Verify

    Produce objective evidence that the realized and integrated system meets each allocated requirement.

    Artifact: compliance evidence + anomaly status
  12. 12
    Validate

    Evaluate intended use with representative users, missions, and environments; show that the complete system solves the stakeholder need.

    Artifact: mission-fit evidence + limitations
  13. 13
    Transition

    Transfer the verified and validated baseline with training, manuals, facilities, spares, support data, keys, residual risks, and acceptance authority; confirm receiver readiness.

    Artifact: accepted operational baseline
  14. 14
    Operate · sustain · retire

    Monitor mission outcomes and incidents, maintain capability through controlled change, and close service with safe migration, archiving, deprovisioning, recovery, or disposal.

    Artifact: field evidence + change record + retirement closure

Lifecycle anchor: NASA treats Systems Engineering as design, realization, technical management, operations, and retirement, and its product-realization sequence explicitly includes implementation, integration, verification, validation, and transition. NASA Systems Engineering fundamentals ↗ NASA Product Realization ↗

Requirement anatomyMake every “shall” statement traceable and provable.
When operating in [condition], the [system] shall [action] on [object] to [measurable performance] within [constraint].
necessarysingularunambiguousfeasibleboundedverifiabletraceable
Traceability chainStakeholder need system requirement subsystem requirement design element verification evidence validation outcome.

04 · Logical to physical architecture

Decide what must happen, then decide who performs it

Logical architecture organizes behavior. Physical architecture realizes that behavior with concrete elements and interfaces.

Logical · technology independent
Sense environmentAcquire relevant state
Estimate situationFuse observations and uncertainty
Plan actionSelect a safe mission path
Control motionExecute within limits
Report statusInform users and operators
Physical · implementation specific
Sensors + front endCamera, GNSS, IMU, diagnostics
Compute platformProcessor, memory, OS, algorithms
Operator stationHuman authority and procedures
Actuation systemMotors, power electronics, mechanisms
CommunicationsRadio, protocol, cloud services
Allocation is many-to-many: one function may span several elements, and one physical element may implement several functions. The aligned rows are illustrative positions, not one-to-one mappings; the allocation matrix is authoritative.
Example allocation matrix — keep responsibility explicit
FunctionHardwareSoftwareHuman / procedureExternal
Detect obstacleCamera + range sensorPerception modelPreflight lens inspectionMap data
Maintain safe energyBattery monitorEnergy estimatorBattery handling procedureCharging station
Authorize routeSecure elementPolicy + geofence engineOperator approvalAirspace service
Recover from faultRedundant control pathFault managerRemote interventionEmergency services

05 · Interfaces

Make boundary assumptions explicit

Interfaces concentrate assumptions, ownership boundaries, timing, tolerances, and change; many costly integration failures emerge there. Define both sides, the exchange, limits, state, faults, ownership, and compatibility evidence.

Mechanical

Fit and force

Envelope, mounting, alignment, loads, vibration, connectors, access, and tolerances.

mm · N · N·m · Hz
Electrical

Power and signal

Voltage, current, grounding, impedance, transients, isolation, EMC, and protection.

V · A · W · Ω
Thermal

Heat path

Heat generation, conduction, airflow, coolant, allowable temperature, and shutdown.

°C · W · °C/W
Data

Meaning and timing

Protocol, schema, units, rate, latency, ordering, integrity, versioning, and errors.

bit/s · ms · format
Human

Authority and feedback

Controls, displays, alarms, workload, training, accessibility, and handover.

role · mode · response
Operational

Responsibility and process

Ownership, sequencing, service levels, logistics, maintenance, security, and policy.

RACI · SLA · procedure
Interface Control Document checklist
  1. IdentityEndpoints and owner
  2. ExchangeWhat crosses
  3. ContractUnits and limits
  4. BehaviorModes and timing
  5. FailureDetection and fallback
  6. ChangeVersion and approval
  7. EvidenceCompatibility test

06 · Technical budgets

Turn system limits into owned allocations

A budget decomposes a system-level constraint, tracks current estimates, preserves margin, and exposes local changes that threaten the mission.

For additive resourcesΣ(CBE + applicable growth allowance) + unallocated margin ≤ limit
MassWhat must move?

Structure, payload, energy, wiring, fasteners, growth allowance, and center of gravity.

Power + energyWhat demands watts and consumes joules?

Track peak, startup, and continuous demand plus conversion loss in W; track duty-cycle duration, usable capacity, reserve, and degradation in Wh or J. Never add unlike units in one ledger.

ThermalWhere does heat go?

Dissipation by mode, junction limits, path resistance, ambient, and hot spots.

LatencyWhere is time spent?

Sense, transfer, compute, decision, actuation, jitter, and deadline margin.

BandwidthWhat shares the link?

Payload, overhead, burst, retransmission, contention, and degraded modes.

ReliabilityWhat may fail?

Element failure rates, common causes, coverage, redundancy, repair, and mission time.

CostWhat is affordable?

Development, unit, integration, infrastructure, training, operation, and disposal.

ScheduleWhat controls delivery?

Critical path, supplier lead time, test assets, certification, and rework reserve.

CapacityWhat is the ceiling?

Payload, users, storage, missions, ports, spares, maintainers, and future growth.

MarginHow much uncertainty remains?

Track contingency separately; do not hide optimistic estimates inside allocations.

Budget control loopRequirementsets limitAllocationassigns ceilingsEstimateshows expected useGrowth + margincover defined uncertaintyTestupdates the estimate

Keep two ledgers distinct: an estimate-based status uses Σ current best estimates + growth allowances + unallocated system margin ≤ system limit. An allocation-based plan uses Σ subsystem allocations + system reserve ≤ system limit; do not add growth again when it is already inside an allocation. State the denominator, confidence, lifecycle phase, and owner for every margin. The simple resource-use summation applies only to additive quantities such as mass or energy. Reliability needs a probability and fault-dependency model, an RF link uses a signed gain/loss equation in dB, and a schedule uses precedence and critical-path logic; declare the composition model for every budget.

Accounting anchor: NASA technical-margin guidance ↗. Tailor the convention, but keep its terms and sign visible.

07 · Optimization and architecture search

Search the feasible design space before choosing a winner

Optimization is structured search over a declared model. It can expose promising feasible designs and trade-offs, but the decision authority still owns the choice, assumptions, and evidence.

Purpose splitter

Use each tool for the job it actually performs

A strong interview answer separates prediction, search, preference, and proof instead of treating one weighted matrix or solver output as the design decision.

SimulatePredict a specified design

Estimate behavior under declared inputs, modes, and scenarios.

Does not choose the design.
OptimizeSearch a modeled design space

Find feasible candidates that improve one or more objectives.

Does not own stakeholder preference.
TradeEvaluate and recommend with stakeholder value

Compare viable candidates, uncertainty, risk, cost, and reversibility.

The decision authority still chooses.
VerifyProduce objective, configuration-matched evidence

Show that the selected configuration satisfies its baselined requirements.

Does not make the architecture optimal.
The activities iterate: models guide search, tests update models, uncertainty can trigger more learning, and a trade-study decision can reopen when its assumptions or evidence change.
Formal model

Declare what the team controls and what the world controls

choose x ∈ X minimize F_cost(x) maximize F_effectiveness(x) subject to g_i(x, u) ≤ 0 and h_j(x, u) = 0 for each applicable u ∈ U_required
x · design variables
Controllable continuous, integer, binary, or categorical choices and their allowed domains.
u · required cases
Qualification conditions, modes, and scenarios in which mandatory constraints must hold.
F · objectives
Directions, units, lifecycle boundary, and a declared scenario summary such as worst case, expectation, or percentile.
g, h · constraints
Mandatory requirements, physics, policies, interfaces, and resource limits.
Decision package

Report more than “the optimizer says”

  • Scope: model boundary, fidelity, units, data pedigree, and excluded effects.
  • Feasibility: satisfied constraints and remaining margins against the current baseline.
  • Administrative disposition: authorized relief or a baseline change, its decision authority, affected claims, and required re-verification—kept separate from proof of compliance.
  • Search status: solver status, bound or gap when available, seeds, timeout, and repeatability.
  • Trade-space result: search coverage, nondominated set among evaluated feasible candidates, sensitivity, scenarios, and fragile assumptions.
  • Independent check: re-evaluate finalists with a higher-fidelity model, prototype, or test.
  • Governance: decision authority, rationale, configuration baseline, and reopening trigger.

Safety dependency: preliminary hazard and risk analysis runs before and during architecture search so mandatory safety controls become constraints. The later risk section deepens that analysis; a newly discovered hazard, common cause, or control can invalidate a finalist and reopen variables, budgets, and the search.

Alternative generator

Build a morphological box or trade tree, then prune incompatible combinations

A morphological box prevents the team from comparing only its first three ideas. It is a generator—not an instruction to evaluate an infeasible Cartesian product.

Autonomy placement
  • Onboard
  • Supervised hybrid
  • Ground-assisted
Energy architecture
  • Fixed modules
  • Swappable modules
  • Vehicle + pad support
Recovery concept
  • Return to clinic
  • Approved alternate site
  • Immediate safe landing
Route policy
  • Direct corridor
  • Reserve-aware corridor
  • Weather-degraded corridor
Compatibility gateRequirements + physics + interfaces + maturity

Keep the status quo when it is a real option. Remove combinations that violate mandatory constraints, depend on incompatible interfaces, or cannot be supported at the required maturity.

Generate broadly, record why branches were pruned, and preserve materially different feasible concepts for analysis.
Choose the lightest adequate method from the structure of the declared model
Problem signatureUseful first methodEvidence and interview warning
A few named alternativesEnumerate, analyze, and run a trade study.Show coverage and pruning rationale; a solver adds little value.
Continuous variables; linear objective and constraintsLinear programming.Confirm the relationships and feasible region are actually linear.
Binary or integer choices with linear relationshipsMixed-integer linear programming.Report incumbent feasibility, bound or optimality gap, and timeout—not only the best value found.
Logical, temporal, or resource constraints dominateConstraint programming.State the constraint model, schedule/resource feasibility, and search limit.
Flow, assignment, routing, or network structure dominatesSpecialized graph, flow, assignment, or routing model.Exploit the structure before reaching for a general heuristic.
Smooth nonlinear modelAppropriate nonlinear optimization; use multistart to probe multiple basins. Use a validated global method with valid bounds only when a global guarantee is required.A non-convex local solution is not automatically a global optimum.
Expensive black-box simulationDOE and a checked surrogate or response surface, followed by suitable search.Re-evaluate finalists in the original higher-fidelity model; the surrogate is not the system.
Derivatives unavailable; evaluations affordableDerivative-free search may be sufficient.Report search bounds, budget, repeatability, and any lack of global guarantee.
Competing objectivesPareto analysis or an ε-constraint formulation.Pareto efficiency removes dominated options; it does not express stakeholder preference or choose a winner.
Material uncertaintyScenario and sensitivity analysis first; robust or stochastic formulations when their assumptions are defensible.Monte Carlo propagates assumed input distributions and any dependencies explicitly encoded in the joint sampling model. It evaluates uncertainty; it is not an optimizer by itself.

Method-selection anchors: NASA Design Solution Definition ↗ NIST experimental-design selection ↗ Google OR-Tools constraint-optimization guide ↗

Multi-objective view

Keep nondominated designs; do not call all of them acceptable

A design dominates another only when it is no worse on every shown objective and strictly better on at least one.

  1. A · relative order (1 cost, 2 effectiveness)Feasible and nondominated: lower cost, lower effectiveness.
  2. B · relative order (2, 4)Feasible and nondominated: improves effectiveness for more cost.
  3. C · relative order (4, 5)Feasible and nondominated: highest shown effectiveness.
  4. D · relative order (3, 2)Dominated by A, which has the same effectiveness order at lower cost.
  5. E · relative order (5, 4)Dominated by B and C.
  6. X · relative order (1, 5)Excluded before dominance analysis because it violates a mandatory constraint.
Positions show dominance relationships only; they are not cost or performance estimates. Pareto-efficient means “not dominated in the modeled objectives”—not safe, preferred, verified, or approved.

Trade-space anchor: NASA architecture-search and Pareto research ↗. The research page treats Pareto results as decision support and explicitly notes nonlinear, discrete, and local-optimum challenges.

Worked interview formulation

Search the medical-drone architecture without inventing a precise optimum

Use symbolic variables until the interview supplies defensible data. The goal is to expose model structure, feasibility, trade-offs, and the next evidence needed.

Decision vectorx = (nb, a, p, r, v)

Battery-module count; autonomy partition; propulsion/safety architecture; corridor and recovery option; cruise or energy-management policy.

Hard constraintsMust hold before scoring

Takeoff mass, payload integrity, usable-energy reserve, sense-to-actuate latency, thermal limits, the baselined link-loss response, geofence and noise limits, baselined cybersecurity requirements, regulatory limits, and certification-basis constraints.

Objectives and measuresGive every quantity one declared role

Minimize lifecycle cost while maximizing delivery MOE. Classify energy, availability, maintainability, schedule, certification effort, and risk as a hard constraint, objective, or reported measure; never silently exchange mandatory safety for cost.

Cases and uncertaintyDo not mix unlike unknowns

Put cold, wind, ageing, link loss, and maintenance states in U_required when they are declared operating or qualification cases. Treat demand or uncertain parameters separately; handle model-form error through validation and discrepancy evidence.

M(x) ≤ M_max E_remaining,ref(x) = E_initial,ref(x) − E_discharged,ref(x) E_remaining,ref(x) ÷ C_u,ref(x) ≥ R_min only for the controlled full-charge entry: E_initial,ref(x) = C_u,ref(x) L_sense→actuate(x,u) ≤ L_max, ∀u ∈ U_required 0 ≤ t_enter(LINK_LOSS_CONTINGENCY,x,u) − t_declare ≤ T_mode,max, ∀u ∈ U_link_loss 0 ≤ t_reach(RECOVERY_APPROACH_GATE,x,u) − t_declare ≤ T_transit,max(u), ∀u ∈ U_link_loss_entry 0 ≤ t_enter(LANDED_SAFE,x,u) − t_reach(RECOVERY_APPROACH_GATE,x,u) ≤ T_land,max, ∀u ∈ U_landing_applicable The reference-energy terms use the same configuration, condition, integration limits, and sign convention defined later in the worked budget. Other required scenarios need their own configuration-matched entry condition and energy accounting. Here t_declare is the baselined declaration event after confirmed detection; t_enter is the first entry into the named mode or state after its trigger; and t_reach is the first crossing of the assigned approach gate. Bound detection separately. Replace the placeholder deadlines and applicable entry-condition sets with the baselined link-loss response inside its declared envelope.
  1. 01 · FrameDeclare variables, domains, objectives, constraints, scenarios, and authority.
  2. 02 · SearchEnumerate architecture choices; size numeric variables with a suitable model.
  3. 03 · FilterReject infeasible designs; preserve the nondominated set among evaluated feasible candidates.
  4. 04 · StressChallenge finalists across scenarios and re-evaluate their margins outside the search model.
  5. 05 · Hand offGive the trade study the shortlist, uncertainty, evidence gaps, and reopening triggers.
Cloud-only conceptInfeasible—not “low scoring”

Reject it if immediate link-loss safety requires unavailable ground control.

Candidate LLower cost · narrower reserve

Keep it shortlisted while its required-case margins remain feasible; do not call it efficient without comparing every declared objective.

Candidate RHigher cost · broader scenario margin

It is not dominated by Candidate L if robust delivery MOE or another declared objective improves. It belongs to the evaluated nondominated set only if no other evaluated feasible candidate dominates it.

Candidate OMore cost · no modeled gain

If Candidate R is feasible, costs less, and is no worse on every modeled objective, Candidate R dominates this option.

Interview memory hookFrame Formalize Classify Search Pareto-filter Stress Check with separate evidence Decide and record.

Optimization guardrail: do not optimize subsystems independently and assume the whole system is optimal. Preserve coupling through interfaces, budgets, shared failure causes, lifecycle cost, operations, support, and enabling systems. A heuristic, local solver, or surrogate may produce a useful candidate without proving global optimality.

Method anchors: NASA Design Solution Definition ↗ NASA Decision Analysis ↗ SEBoK System Analysis ↗ NIST experimental-design selection ↗

08 · Trade studies

Choose among shortlisted alternatives without hiding judgment

Confirm that the alternative set covers the decision, remove concepts that violate mandatory constraints, then evaluate stakeholder value, uncertainty, risk, and reversibility.

  1. 01 · FrameName the decision

    Set scope, decision owner, deadline, assumptions, and alternatives that are meaningfully different.

    Output: decision statement
  2. 02 · GenerateConfirm alternative coverage

    Use the trade tree, include the status quo when real, and record compatibility pruning.

    Output: covered choice set
  3. 03 · ScreenApply hard constraints

    Reject concepts that cannot meet safety, policy, physical, schedule, or mission minimums.

    Output: viable set
  4. 04 · EvaluateUse anchored stakeholder value

    Map criterion-specific measures to reviewed value scales; record data source, uncertainty, and risk.

    Output: transparent comparison
  5. 05 · StressTest sensitivity and correlation

    Vary weights, value functions, scenarios, and uncertain evidence; audit correlated criteria for double counting.

    Output: stability assessment
  6. 06 · DecideRecord authority and triggers

    Document the rationale, dissent, residual uncertainty, configuration, and evidence that would reopen the choice.

    Output: decision record
Mechanics-only caution — hypothetical unanchored 1–5 labels are not decision-grade value scores
CriterionWeightOnboard onlyCloud assistedHybrid
Safe without link30%515
Perception capability20%355
Energy efficiency15%343
Lifecycle cost15%432
Update flexibility10%254
Certification clarity10%423
Illustrative arithmetic total100%3.753.053.95

Scale and sensitivity warning: arithmetic on unanchored ordinal labels creates apparent precision. For a real selection, define criterion-specific measurable anchors or value functions, confirm their direction and lifecycle boundary, and check preference dependence and double counting before adding weighted values. This compact 1–5 matrix demonstrates mechanics only: hybrid has the highest toy arithmetic total at 3.95 versus onboard-only at 3.75, but there is no decision winner until criterion-specific value functions and evidence are established. Moving ten percentage points of weight from “safe without link” to “lifecycle cost” makes both 3.65. If safe-without-link is mandatory, screen cloud-assisted out before scoring. Otherwise gather better cost evidence, prototype both finalists, and record the trigger that reopens the decision.

Gate 1Mandatory constraints met?

A high weighted score cannot compensate for violating a true must-have.

Gate 2Evidence comparable?

Normalize assumptions, mission scenario, maturity, and lifecycle boundary.

Gate 3Winner stable?

Vary weights, uncertain data, future growth, and failure conditions.

Gate 4Decision reversible?

Record triggers, options, prototypes, and what new evidence would reopen it.

09 · Risk, FMEA, and fault trees

Find failure paths before the system finds them for you

Hazards describe potential harm. Failure modes describe how elements fail. Risk is characterized by a scenario, its likelihood, and its consequence; uncertainty belongs in the likelihood and consequence estimates. Exposure scores may help prioritize work, but they are derived metrics rather than a universal fourth component.

Bottom-up

FMEA: element → effect

  1. 1Item / function
  2. 2Failure mode
  3. 3Local + end effect
  4. 4Detection
  5. 5Control

Use FMEA to review credible component and process failures systematically. Track severity, occurrence or likelihood, detection, owner, action, and residual risk.

Top-down

Fault tree: top event → causes

Use a fault tree to expose combinations that can produce one unacceptable event, including common-cause and independence assumptions.

Example FMEA excerpt — qualitative ratings are placeholders until supported by evidence
FunctionFailure modeEnd effectDetectionDesign controlResidual action
Estimate positionGNSS gives plausible wrong locationRoute deviationCross-check IMU, vision, mapIndependent plausibility monitorTest spoofing and urban canyon cases
Provide thrustOne propulsion unit stopsReduced control authorityCurrent, RPM, attitude residualFault-tolerant layout + safe landingDemonstrate worst-case controllability
Store energyCell voltage collapsesMission power lossCell telemetry + model residualReserve, isolation, return thresholdAgeing and cold-temperature campaign
Risk response choicesPrefer eliminate / avoid, then reduce likelihood or consequence, detect / contain / recover, and accept only the explicit residual risk with accountable authority. Sharing or transferring financial or contractual exposure does not remove the underlying safety hazard; responses may be combined and are not a mandatory sequence.

Risk anchor: NASA Risk Management Handbook ↗. Distinguish performance-risk disposition from safety-hazard control and approval.

10 · Integration and the V-model

Plan the evidence while decomposing the design

The left side refines the problem and architecture. Implementation connects the sides. The right side integrates upward and provides evidence at matching levels.

  1. Need + ConOpsValidation planningHow will users judge mission value?
  2. System requirementsSystem verification planningHow will each system requirement be proved?
  3. Logical architectureFunctional verification planningHow will end-to-end behavior be exercised?
  4. Subsystem designInterface qualification planningHow will elements fit and communicate?
  5. Component designUnit test planningWhat demonstrates implementation correctness?
RealizeBuild · code · procure · train · documentConfiguration control preserves the tested baseline.
  1. Unit evidenceComponent verificationInspect and test implementation.
  2. Interface evidenceSubsystem integrationQualify boundaries and behavior.
  3. Functional evidenceSystem integrationExercise end-to-end functions.
  4. Requirement evidenceSystem verificationProve the specification.
  5. Mission evidenceOperational validationProve fitness for intended use.
Horizontal trace pairs a definition level with its intended evidence. Verification planning begins before implementation. The V is a traceability view, not a waterfall schedule: definition, realization, integration, verification, and validation overlap, iterate, and recur at multiple product levels.
VirtualModels and simulationExplore architecture and edge cases cheaply.
UnitComponent rigsCharacterize performance and limits.
InterfaceContract testsRetire fit, protocol, timing, and tolerance risk.
SubsystemIntegration benchesExercise realistic interactions and faults.
SystemQualification articleVerify requirements in controlled conditions.
OperationalMission trialValidate use with representative people and environment.

11 · Verification and validation

Build the system right—and build the right system

Verification compares the realized system with requirements. Validation evaluates whether it fulfills stakeholder needs in the intended operational context.

Specification question

Verification

Question: Did the system meet each allocated requirement?

Input: baselined requirements, interfaces, acceptance criteria, configuration.

Output: objective evidence, anomalies, compliance status, trace closure.

Mission question

Validation

Question: Does the system solve the real need for intended users and environments?

Input: needs, ConOps, mission scenarios, measures of effectiveness.

Output: operational suitability, acceptance, limitations, improvement needs.

Inspection

Observe attributes

Review construction, markings, documentation, workmanship, configuration, or records without operation.

Good for visible conformance
Analysis

Calculate from evidence

Use models, similarity, simulation, test data, and engineering calculations with justified assumptions.

Good when test is impractical
Demonstration

Show operation

Exercise observable function without precise measurement or detailed instrumentation.

Good for functional behavior
Test

Measure under control

Operate with specified stimulus, equipment, environment, procedure, and quantitative acceptance criteria.

Good for performance evidence
Verification Cross-Reference Matrix — every requirement needs planned, attributable evidence
RequirementMethodLevelAcceptance criterionEvidenceStatus
SYS-PERF-014TestSystemAt maximum gross mass, on the defined dry test surface, and at 8.0 ± 0.2 m/s, reach zero ground speed within 4.0 m after a valid stop command.Calibrated braking test reportPlanned
CMP-ENV-022TestFlight-compute subsystemDuring and after a 60-minute chamber exposure at each declared −10 °C and 45 °C operating corner, the count of uncommanded flight-compute resets is zero.Configuration-specific chamber reportIn work
ALLOC-LAT-023TestFlight-compute subsystemAt each CMP-ENV-022 corner and under workload profile WP-03, p99 navigation-update completion latency is no more than 20.0 ms over the declared sample count.The same chamber run, traced to a separate latency resultIn work
ALLOC-PWR-024Analysis + testFlight-compute subsystemAt each CMP-ENV-022 corner and under workload profile WP-03, 60-second mean input power is no more than 5.0 W using the specified calibrated measurement boundary.The same chamber run plus power uncertainty reportIn work
SYS-OPS-031Demonstration + testSystemAfter handover cue HC-01 in supervised-flight mode, command authority changes to the trained and authenticated operator within 2.0 s.Timestamped representative mission trialPlanned
HMI-OPS-032DemonstrationOperator consoleAfter the SYS-OPS-031 authority change, the console presents the named positive confirmation within 0.1 s.Timestamped console demonstrationPlanned
SYS-OPS-033TestSystemIf the HC-01 authority transfer is not completed within 2.0 s, the vehicle enters the named SUPERVISED_HOLD state within the next 0.5 s.Timed failed-handover injectionPlanned
Evidence ruleRequirement acceptance criterion method level procedure result anomaly closure.

12 · Review-ready evidence package

Make the decision chain auditable

A strong systems answer does not stop at a block diagram. It shows how a stakeholder outcome becomes a controlled baseline, how changes propagate, and which evidence authorizes the next lifecycle decision.

Worked trace · illustrative drone requirement

Carry one mission statement to operational proof

Numbers below are example assumptions, not universal drone requirements. In an interview, label every value as confirmed, assumed, derived, allocated, estimated, or measured.

  1. Need + operational scenarioN-01: deliver the declared payload safely within the service area. Scenario records route, wind, temperature, precipitation, communications, operator role, alternates, and emergency landing behavior.
  2. Measure of effectivenessMOE-01: at least 99% of eligible REF-MISSION-01 missions complete within 25 minutes over the declared operating envelope. REF-MISSION-01 starts at launch authorization, flies from the clinic to an approved delivery pad, releases the package, returns to the clinic, and ends in the named landed safe state; its total ground track is 10 km. Report outbound delivery time, package condition, and safety outcomes separately, define the evaluation window, and control every exclusion.
  3. System requirementSYS-ENERGY-014: with a 2.0 kg payload on REF-MISSION-01, its declared environment, and the configuration-controlled full-charge test-entry condition, the vehicle shall enter LANDED_SAFE with reference reserve fraction Rref = Eremaining,ref ÷ Cu,ref ≥ 20%. Cu,ref is deliverable energy from the verified full-charge condition to the operational cutoff at the baselined end-of-life state of health and minimum qualified battery temperature under the mission power profile.
  4. Estimator + decision ruleSpecify the operational BMS result Rindicated and its allowable estimation error separately from the physical requirement. For an illustrative one-sided two-percentage-point guard band g, accept only when R_indicated − g ≥ 20%, so the indicated threshold is 22%. Derive g from the uncertainty, maximum-permitted-error, coverage, and false-accept-risk policy; the decision rule protects the 20% requirement but does not redefine it.
  5. Allocation + interfacesAllocate mass, energy, thermal, navigation, propulsion, and reserve budgets to elements; record voltage, current, update rate, units, timing, ownership, and degraded behavior at every crossing.
  6. Verification + validationVerify the requirement with calibrated energy instrumentation and environmental test evidence; validate the route, operator workflow, contingency behavior, turnaround, and customer outcome in representative missions.
Connect mission value to technical evidence. All example values are illustrative and require stakeholder agreement.
LevelQuestionDrone exampleHow it is used
NeedWhy does the system exist?Deliver a time-sensitive medical package safely.Frames the outcome and stakeholder, without prescribing a design.
MOEDoes the mission create value?At least 99% of eligible 10 km clinic-to-pad-to-clinic REF-MISSION-01 missions complete within 25 minutes; outbound delivery time and package condition are reported separately.Judged in the operational context; unsuccessful or excluded missions must not be hidden by averaging.
MOPWhich quantitative fielded-system measures enable it?Payload capacity ≥ 2.0 kg; range ≥ 10 km; package temperature remains between 2 and 8 °C; command-link-loss declaration occurs within 0.6 s and contingency-mode entry within 1.0 s after the last authenticated heartbeat; landing reserve ≥ 20% usable energy.Each threshold is measured under the separately declared reference route, wind, ambient temperature, battery age, payload, and operating mode; those conditions are not themselves measures.
TPMIs the developing design converging?Predicted mission energy and landing reserve, takeoff mass, navigation error, thermal margin, and sensor-to-actuator latency.Trend requirement/budget, current estimate, margin, uncertainty, evidence date, and owner across reviews.
Binary reliability evidence-plan selector

Choose the decision first; then choose the sample and model

This overview is scoped to fixed-sample binary success/failure evidence. Declare the population, trial, success rule, operating envelope, configuration, and decision rule before observing outcomes; continuous, count, ordinal, and time-to-event outcomes require their own estimand and model.

Decision 01What must the evidence support?The objective determines the estimand, planning criterion, and acceptable risk.
  • Path A · estimateWhat is the success probability?Choose confidence, interval method, planning value, coverage, and desired half-width.Output: precision-based sample plan
  • Path B · conformanceCan we demonstrate a minimum?Set R₀, a one-sided bound or acceptance number, allowable failures, and consumer and producer risks.Output: acceptance / OC plan
  • Path C · compareWhich candidate is better—or not worse?Set the effect or noninferiority margin, groups, pairing or randomization, multiplicity policy, and power.Output: comparison / power plan
Gate 02 · coverageRepresentative and configuration-matched?

Yes: preserve declared strata and eligibility. No: redesign coverage or narrow the claim; statistics cannot repair selection bias.

Gate 03 · modelIndependent enough with a common success probability inside each modeled stratum?

Yes: the predeclared Bernoulli/binomial plan may fit. No: use a cluster-aware, hierarchical, stratified, time/exposure, or other outcome-appropriate model and recalculate the plan.

  1. 01FreezeClaim, eligibility, exclusions, stopping rule, method, and threshold.
  2. 02ObserveCounts or exposure, strata, missing data, retries, anomalies, and configuration.
  3. 03BoundPoint estimate plus uncertainty from the predeclared model.
  4. 04DecideCompare the bound, effect, or acceptance result with the rule.
  5. 05Audit coverageReport limits, anomalies, model checks, and ungeneralized conditions.
For binary reliability evidence, the objective chooses what to estimate; coverage and probability assumptions determine what can be generalized and whether a binomial model is defensible.
Interview module · statistical evidence

A success percentage is an estimate—not proof by itself

The calculations in this module are illustrative, frequentist binomial examples. They apply only when every trial has a predeclared binary outcome, the fixed sample is representative, and trials can reasonably be treated as independent with the same success probability. Shared vehicles, software versions, routes, operators, weather, or repeated faults can create dependence; in that case, use a design and model that account for clusters, strata, time, and exposure.

  1. Define the claimName the unit of trial, success event, mission and operating envelope, target success probability R0, confidence level 1 − α, evaluation window, and decision rule. “99% reliable” is incomplete without these qualifiers.
  2. Freeze eligibility before observing outcomesPredeclare valid starts, exclusions, abort treatment, retries, software and hardware configuration, environmental strata, and whether multiple missions from one vehicle are independent. A failed eligible mission remains in the denominator.
  3. Plan for the decisionChoose whether the goal is estimation, comparison, or conformance. For estimation, select sample size for desired interval precision. For conformance, predeclare the minimum acceptable lower bound or a binomial acceptance number, together with consumer and producer risks.
  4. Report estimate and uncertaintyShow successes x, eligible trials n, point estimate x/n, the interval method, one- or two-sided confidence, and the resulting bounds. For a minimum-success requirement, compare a predeclared one-sided lower bound with R0; do not compare only x/n.
  5. Check validity and coverageBreak results out across critical route, weather, payload, operator, vehicle, and configuration strata. Record missing data, repeat attempts, stopping rules, anomalies, and model diagnostics. Statistical evidence cannot compensate for an unrepresentative test.
Worked binomial evidence — all results are illustrative and use exact Clopper–Pearson bounds with a fixed sample and no optional stopping.
Observed resultPoint estimate95% evidence statementDecision against R0 = 99%
99 successes / 100 trials99.00%One-sided exact lower bound = 95.34%.Does not demonstrate 99%. The observed percentage equals the target, but uncertainty remains too large.
990 successes / 1,000 trials99.00%One-sided exact lower bound = 98.31%; two-sided exact interval = 98.17% to 99.52%.Does not demonstrate 99%. A larger denominator alone does not make the point estimate a lower-bound claim.
999 successes / 1,000 trials99.90%One-sided exact lower bound = 99.53%.Meets the statistical threshold under the declared binomial assumptions; system acceptance still requires representative coverage and closure of anomalies.
299 successes / 299 trials100.00%One-sided exact lower bound = 99.003%.Meets the statistical threshold for a zero-failure demonstration; it does not prove perfection or reveal failure modes.
Common interview trap

“We passed 99 of 100, so reliability is 99%.”

Correct response: 99% is the point estimate. Under the illustrative independent-binomial model, its one-sided 95% exact lower bound is only 95.34%, so this evidence does not support a claim that the underlying mission success probability is at least 99%.

Next question: were the 100 trials representative, independent, configuration-matched, and selected without outcome-based exclusions?

Planning trap

Confidence alone is not test power

A 299-of-299 plan gives a 95% lower bound just above 99% if it passes. But if the true success probability is exactly 99%, its probability of passing with zero failures is 0.99299 ≈ 4.95%.

Better plan: define an unacceptable reliability, a desirable reliability, consumer risk, producer risk, sample size, and allowable failures; then evaluate the binomial operating characteristic before testing.

Statistical evidence hookClaim → population → trial → success rule → sample plan → uncertainty bound → decision → coverage. Never turn “no observed failure” into “no failure risk.”

Method references: NIST exact binomial confidence intervals ↗, NIST sample-size planning for proportions ↗, and NIST reliability-data limitations ↗.

Requirements that survive review name the subject, action, object, operating condition, measurable threshold or tolerance, and trace identifier.
Weak statementDefectBetter direction
“The system shall be user-friendly.”No observable threshold or context.Keep the intent as a stakeholder need or MOE; derive task-completion time, error rate, workload, accessibility, and training requirements for defined users and tasks.
“The system shall detect and avoid obstacles.”Compound behavior; object class, environment, accuracy, false alarms, separation, and response time are absent.Split perception and avoidance requirements and define their shared operational envelope and interface assumptions.
“The system shall use LiDAR.”Premature implementation unless LiDAR is an externally imposed constraint.State the required range/perception performance; retain the technology choice in the architecture decision record.
“The vehicle shall stop within 4 m.”Initial speed, mass, surface, trigger, environment, and tolerance are missing.Define the initial state and test surface, speed tolerance, valid command, end condition, distance measurement, and applicable operating range.
ICD identityBattery monitor → flight computer

Name producing and consuming elements, responsible owners, pack voltage/current/temperature/state-of-charge semantics, and authority for declaring data invalid.

RepresentationMeaning survives the wire

Define units, range, resolution, sign, byte order, invalid encoding, timestamp basis, sequence, integrity field, schema version, and compatibility policy.

Timing + modesAge is part of correctness

State nominal and worst-case rate, latency, jitter, maximum age, startup/calibration/normal/degraded/reset behavior, and clock-disagreement handling.

Failure evidenceTest believable corruption

Inject frozen-plausible values, stale data, drops, resets, version mismatch, and shared-power loss. A timeout detects silence—not a value that is wrong but plausible.

  1. Change requestIdentify rationale, affected item, supplier/configuration, and urgency.
  2. Trace impactReopen requirements, interfaces, budgets, hazards, procedures, models, and verification credit.
  3. Review + decideTechnical, risk, operations, cybersecurity, and decision authority assess evidence and alternatives.
  4. Update baselineApprove controlled versions before implementation; preserve as-designed and as-built identity.
  5. Regress + accountRecord procedure, environment, tools, calibration, raw results, anomalies, waivers, approvals, and closure.

Configuration-specific proof: trace requirement version → tested item/version/serial → method and procedure revision → stimulus and environment → tool/equipment/calibration → raw data and analysis → pass/fail → anomaly or waiver → corrective action → approval. “Same specification” is not evidence that a replacement supplier part is interchangeable.

SRR

Is the problem ready?

Typical evidence: approved ConOps, stakeholder needs, measurable and feasible requirements, traceability, verification approach, unresolved assumptions, and a credible requirements baseline.

PDR / CDR

Is the solution credible?

Show alternatives, architecture views, allocations, interface control, budgets with margin, analyses, prototypes, risks, producibility, cybersecurity, and evidence that the design can meet the baseline.

TRR

Is the test valid and safe?

Confirm configuration, procedures, trained roles, calibrated equipment, facilities, data capture, acceptance criteria, hazard controls, anomaly rules, and readiness of test articles.

ORR / acceptance

Can the system be operated?

Close critical anomalies; prove procedures, training, support, spares, monitoring, recovery, cybersecurity, regulatory obligations, and the transfer of residual risk to an accountable owner.

13 · Interview practice arena

Design an autonomous delivery drone system

Use the prompts first. Open the coaching only after you have spoken and drawn your answer.

Multidisciplinary case · 55 minutes

Clinic-to-approved-site medical delivery

A healthcare network needs an autonomous electric drone to move small medical packages between a clinic and approved delivery sites. Design the whole system, including vehicle, software, operator, communications, support, and evidence—not only the flight controller.

  • Safety critical
  • Energy limited
  • Intermittent link
  • Weather exposed
  • Human oversight
Target55:00Frame 10 · Architect 15 · Balance 10 · Risk 10 · Prove 7 · Close 3

Illustrative baseline · REF-MISSION-01: carry a 2 kg protected payload over a 10 km clinic-to-pad-to-clinic ground track, starting at launch authorization after the configuration-controlled full-charge entry check establishes Einitial,ref = Cu,ref, releasing the package at the assigned approved pad, returning to the clinic, and entering the named landed safe state within 25 minutes. Assume 1,000 missions/day across 10 sites, controlled delivery pads, supervised autonomy, and no dependence on the command link for immediate flight safety. Measure outbound delivery time separately from full-mission completion time.

In an interview, confirm or replace these assumptions before designing. Regulation, acceptable risk, operating airspace, population exposure, weather, and medical handling rules can change the architecture.

  1. 0–10FrameNeed · ConOps · requirements
  2. 10–25ArchitectFunctions · allocation · interfaces
  3. 25–35BalanceBudgets · one optimization deep dive
  4. 35–45Make safeHazards · faults · recovery
  5. 45–52ProveIntegration · V&V
  6. 52–55Close lifecycleTransition · operate/sustain · retire
01Frame stakeholders, boundary, and ConOpsWho needs what, and across which lifecycle scenarios?

Your turn: name stakeholders, the system boundary, three nominal scenarios, and three off-nominal scenarios.

Coaching: stakeholders include patient/recipient, clinic staff, fleet operator, maintainer, owner, aviation and medical regulators, site owner, public, emergency services, cybersecurity, suppliers, and disposal partners. Put the vehicle, payload container, pad, operator station, fleet service, procedures, training, maintenance tools, and support data inside the product-system boundary; map weather, GNSS, communications carrier, airspace service, hospital systems, and people as externals.

ConOps: order → verify package → load and seal → preflight → authorize route → launch → navigate → detect and avoid → land on approved pad → authenticate recipient → release package → return/recharge → log and inspect. Off-nominal cases include link loss, GNSS degradation, unsafe landing pad, low energy, weather excursion, obstacle, recipient absent, and medical-package temperature alarm.

02Write measurable system requirementsTurn mission language into thresholds and conditions

Your turn: propose functional and quality requirements, each with an acceptance criterion.

Coaching examples:

  • SYS-MISSION-010: in each controlled acceptance execution that satisfies the configuration-controlled REF-TEST-01 entry conditions, the system shall carry a 2.0 kg payload through REF-MISSION-01 and enter LANDED_SAFE within 25 minutes. This deterministic reference test demonstrates capability; derive a separate statistical service-success requirement from MOE-01 with an evaluation window, eligibility/exclusion rules, minimum sample, and confidence rule.
  • SYS-PAYLOAD-011: under the declared environmental and door-open profile, the calibrated payload-chamber reference temperature shall remain from 2.0 °C through 8.0 °C throughout REF-MISSION-01 and the following 30-minute recovery interval.
  • SYS-LINK-021: in an airborne mode, after 0.5 s without an authenticated command heartbeat, the vehicle shall declare COMMAND_LINK_LOST within 0.1 s.
  • SYS-LINK-022: upon declaration of COMMAND_LINK_LOST, the vehicle shall enter the preflight-selected LINK_LOSS_CONTINGENCY mode within 0.4 s.
  • SYS-LINK-023: if the recorded vehicle state satisfies contingency-entry envelope E-LL-01 when COMMAND_LINK_LOST is declared, the vehicle shall, without a remote command, remain inside the associated configuration-controlled contingency corridor and reach the preflight-assigned recovery-site approach gate within the maximum transit time specified for that entry-state bin in RPT-LL-01. Evaluate the entry condition once at declaration; later energy use cannot erase the obligation.
  • SYS-LAND-024: after reaching that approach gate in LINK_LOSS_CONTINGENCY, the vehicle shall enter LANDED_SAFE without a remote command within 90 s, with touchdown position, vertical speed, attitude, and post-touchdown output state satisfying the separately configuration-controlled acceptance limits in LAND-ACC-01.
  • SYS-RELEASE-025: the payload-release actuator enable shall remain deasserted unless the position, pad-identity, and recipient-authorization predicates all pass under the configuration-controlled release-policy version recorded for the mission.
  • Operator-control parent capability—derive before baselining: keep operator tasks and authority in the ConOps, then write separate product-interface requirements for hold, reroute, and flight termination. Each child shall name authentication and authorization, applicable vehicle mode, acceptance/rejection feedback, command-to-response deadline, invalid-command behavior, and the hazard-analysis control that permits the action; do not verify the three commands as one requirement.
  • Parent safety objective—derive, do not verify as one compound requirement: no credible single failure in baselined Hazard Analysis HA-001 may cause uncontrolled descent within the approved operating envelope. Derive one atomic requirement per failure class and mode, naming the required outcome (controlled flight or one specific safe state), detection assumption, transition time, envelope, and verification method; trace each child back to HA-001.

Define measurable availability, dispatch success, delivery success, containment, geofence, detect-and-avoid range, navigation accuracy, noise, turnaround, maintainability, cybersecurity, audit, RTO, and data retention targets. Mark every number as confirmed, assumed, derived, or allocated.

03Decompose functions and operating modesDescribe what happens before selecting boxes

Your turn: draw the mission thread and state machine.

Coaching: decompose into manage mission, authenticate actors and payload, assess readiness, contain payload, generate route, sense environment, estimate state, avoid hazards, control motion, manage energy, communicate status, supervise fleet, recover from faults, maintain configuration, and preserve evidence. Define modes such as unpowered, maintenance, charging, standby, armed, takeoff, cruise, approach, landed, degraded, contingency return, alternate landing, and emergency termination.

For every transition, state guard condition, authority, timeout, entry action, feedback, and safe fallback. This prevents nominal flight logic from being mistaken for a whole-system architecture.

04Allocate the physical architectureHardware, software, humans, support, and externals

Your turn: allocate the critical functions and explain independence boundaries.

Coaching architecture: the air vehicle includes structure, propulsion, battery and power distribution, flight-control computer, independent safety monitor, GNSS/IMU/barometer, detect-and-avoid sensors, communications, payload lock and environment sensors, and flight recorder. Software includes estimation, guidance, control, perception, route/geofence policy, health management, secure update, and mission logging. Ground elements include charging/landing pad, package station, operator console, fleet scheduler, maintenance terminal, key management, maps, and evidence store.

Keep immediate stabilization and contingency behavior onboard. The cloud may optimize routes and fleet utilization but must not be required for millisecond control or safe response to link loss. Separate the independent monitor’s failure path from the primary controller where the safety argument depends on independence.

05Close interfaces and technical budgetsExpose the constraints that couple disciplines

Your turn: identify five critical interfaces and sketch mass, energy, latency, and communication budgets.

Coaching: critical interfaces include battery–power distribution, flight computer–motor controllers, sensors–estimator, primary controller–safety monitor, vehicle–operator, vehicle–pad, container–vehicle, fleet service–airspace service, and maintainer–configuration system. Specify units, update rates, freshness, authority, timeout, degraded behavior, integrity, and versioning.

Illustrative energy budget for REF-MISSION-01: expected use is 570 Wh = 440 Wh cruise + 90 Wh takeoff/landing + 40 Wh avionics/payload. Add 70 Wh contingency consumption and 80 Wh analysis/growth allowance, giving a full consumption allowance of 720 Wh. Define Cu,ref as deliverable energy from the verified full-charge condition to the operational cutoff at the baselined end-of-life state of health and minimum qualified battery temperature under the mission power profile; it is the reserve denominator, not beginning-of-life nameplate capacity. The physical requirement is Rref = Eremaining,ref ÷ Cu,ref ≥ 20%. Keep the illustrative two-percentage-point one-sided guard band in a separate decision rule: R_result − 2 percentage points ≥ 20%, so the corresponding result/design threshold is 22%. Using that conservative 22% threshold gives Cu,ref ≥ 720 ÷ (1 − 0.22) = 923.1 Wh. At that minimum, 203.1 Wh physically remains, or 22% of Cu,ref, leaving the two-point guard band above the 20% requirement. Over explicit integration limits, compute Edischarged,ref [Wh] = ∫t₀t_land V(t) × Idischarge(t) dt ÷ 3600 and Eremaining,ref = Einitial,ref − Edischarged,ref. Only for the verified full-charge entry condition may the worked test substitute Einitial,ref = Cu,ref. If charging or regeneration is possible, integrate signed net battery power instead and declare the sign convention. Validate the separately specified BMS Rindicated result against Rref across the declared operating domain. Derive the guard band from capacity characterization, sensor calibration, timing, integration, estimator, environmental, repeatability, coverage, and false-accept-risk evidence. Select installed nameplate capacity so qualification still provides at least 923.1 Wh usable at the declared age and temperature; do not apply the same ageing or temperature loss again as margin. Track maximum takeoff mass, center of gravity, peak motor power, thermal dissipation, control-loop deadline, sensor-to-actuator latency, link bandwidth, and maintenance time in the same owned way.

Decision-rule context: NIST decision-rule definition ↗ and NASA measurement decision risk and guard-band guidance ↗.

06Search the design space and select finalistsInterviewer-selected deep dive: feasibility, Pareto efficiency, preference, and evidence

Your turn: state the decision variables, domains, hard constraints, objectives, and uncertain scenarios for the autonomy and energy architecture. Generate alternatives, identify one infeasible option and one dominated option, then explain what evidence would distinguish two nondominated finalists.

Coaching: use battery-module count, autonomy placement, propulsion/safety architecture, recovery corridor, and cruise policy as variables. Treat the baselined link-loss response, payload/range, takeoff mass, usable-energy reserve, thermal and latency limits, geofence and noise limits, baselined cybersecurity requirements, regulatory limits, and certification-basis constraints as hard constraints—not soft preferences. Track certification effort or evidence burden separately as a lifecycle measure. Keep lifecycle cost and delivery MOE as separate objectives long enough to expose a Pareto set.

Cloud-only is infeasible if immediate safety depends on the unavailable link. A lower-cost candidate with narrow cold/ageing reserve and a higher-cost candidate with broader scenario margin are both finalists; the higher-cost concept is not dominated by the lower-cost concept only when that margin improves a declared objective, such as robust delivery MOE. It belongs to the evaluated nondominated set only when no other evaluated feasible candidate dominates it. A higher-cost candidate is dominated only when a specific feasible comparator is no worse on every modeled objective and strictly better on at least one. Do not declare a winner until you state stakeholder value, sensitivity, uncertainty, and the prototype or test with the highest decision value.

Trade-study handoff: compare only viable finalists. Define measurable criterion anchors or value functions, audit correlated criteria, test break-even weights and scenarios, then record the authority, rationale, residual uncertainty, and reopening trigger.

07Analyze hazards and make the architecture safeLet failure paths reshape the shortlisted concepts

Your turn: choose three top hazards, trace credible causes, and show how their controls change the architecture or invalidate a finalist.

Coaching: top hazards may include collision with people or aircraft, uncontrolled descent, delivery to an unauthorized person, battery thermal event, and loss of medical-package integrity. Apply elimination and architectural prevention before warning labels or operator procedures.

Analyze propulsion loss, misleading navigation, corrupt commands, stale maps, common power loss, sensor obstruction, link loss, software timing failure, and maintenance error. Each mitigation needs an owner and verification evidence. Re-run feasibility, budgets, and the trade study when a safety control changes mass, power, latency, interfaces, cost, or operating constraints.

08Plan integration, verification, and validationProve requirements and mission fitness at the right levels

Your turn: build an integration sequence and choose evidence for the hardest requirements.

Coaching integration path: models and simulation → software-in-the-loop → processor-in-the-loop → sensor and actuator benches → propulsion and power rigs → hardware-in-the-loop flight-control bench → restrained vehicle tests → controlled field envelope expansion → operational pilot. Use interface simulators early and maintain representative faults, timing, environmental loads, and configuration.

Verification: inspect construction and configuration; analyze structures, reliability, energy, coverage, and thermal limits; test EMC, environment, endurance, braking/landing, navigation, containment, cybersecurity, fault injection, and recovery; demonstrate operator workflows. Validation: conduct representative clinic-to-site missions with actual users, workload, procedures, weather boundaries, package handling, maintenance, and off-nominal decisions. Measure mission effectiveness—not only component compliance.

09Close transition and lifecycle ownershipSummarize acceptance, field ownership, retirement, and remaining uncertainty

Strong close: “I chose supervised hybrid autonomy: immediate safety, stabilization, navigation fallback, geofence, and contingency landing remain onboard; ground services schedule the fleet and optimize routes. The design isolates the safety monitor and preserves safe behavior after link loss. Energy reserve, misleading navigation, common power loss, public exposure, package integrity, and operator workload drive the architecture. Before acceptance I would close receiver readiness, training, manuals, facilities, spares, keys, support data, residual-risk authority, and the operational baseline. Field owners monitor mission outcomes, safety events, energy, availability, maintenance and configuration; controlled evidence reopens requirements and hazards. Retirement has an owner for grounding, migration, credential revocation, protected-data disposition, records, batteries, spares and disposal.”

State residual uncertainty: certified operating envelope, population and airspace exposure, detect-and-avoid performance, regulatory basis, communication coverage, battery ageing, environmental qualification, support staffing, and acceptable mission failure rate. Name what evidence resolves each one.

Follow-up pressure test

Change one assumption and trace the consequences

Link unavailable

Reallocate safety, navigation, maps, logging, authority, and recovery onboard.

Payload doubles

Reopen mass, propulsion, energy, structure, thermal, noise, range, and pad limits.

Urban route

Revisit public risk, airspace, localization, obstacle sensing, noise, and landing containment.

Cold weather

Recalculate battery power, capacity, heating, sensor limits, material behavior, and reserve.

One motor fails

Show detection latency, controllability, common dependencies, landing strategy, and evidence.

Fleet grows 100×

Scale pads, spectrum, operators, maintenance, spares, monitoring, keys, and incident response.

Self-score after speaking

A whole-system answer makes traceability visible

  • MissionDid I frame users, context, modes, and lifecycle?
  • RequirementsDid I quantify success and constraints?
  • ArchitectureDid I separate functions from implementation?
  • AllocationDid I include hardware, software, humans, and support?
  • InterfacesDid I define critical exchanges and failure behavior?
  • BudgetsDid limits and margins influence decisions?
  • OptimizationDid I separate variables, hard constraints, objectives, scenarios, and evidence?
  • RiskDid hazards and common causes shape the architecture?
  • EvidenceDid I distinguish verification from validation?

14 · Authoritative foundations

Use primary guidance, then practice the artifacts

These references establish the lifecycle, process, architecture, and vocabulary behind this visual field guide.

NASA

NASA Systems Engineering Handbook

A practical lifecycle reference for technical processes, system design, product realization, technical management, and crosscutting engineering methods.

Read the official handbook ↗
INCOSE

Systems and Systems Engineering

Authoritative definitions and orientation for the transdisciplinary, integrative approach used to realize and operate successful systems.

Read INCOSE’s overview ↗
SEBoK

Guide to the Systems Engineering Body of Knowledge

A community reference connecting foundations, lifecycle processes, methods, applications, enabling systems, and related disciplines.

Explore the SEBoK ↗
NASA · Design

System Design Processes

Stakeholder expectations, technical requirements, logical decomposition, and design-solution definition as interdependent, iterative work.

Review the process guide ↗
SEBoK · Architecture

Logical and Physical Architecture

Explore how functions, behavior, system elements, allocation, viewpoints, and interfaces form a defensible architecture description.

Study system architecture design ↗
Practice loop

Create evidence, not flashcards alone

For one case, redraw the context, ConOps, requirements tree, allocation, budget, risk path, V-model, and V&V matrix from memory.

Repeat the drone case ↑
NASA · Evidence

Handbook Appendices

Requirement quality checks, verification and validation matrices, functional/timing/state analysis, V&V plan content, interface document outlines, and technical peer-review guidance.

Open the official appendices ↗
NASA · Governance

NPR 7123.1D

NASA’s systems-engineering process requirements, lifecycle expectations, technical reviews, measurement, verification, and tailoring framework. NODIS is the controlled source for the current revision.

Read the current directive in NODIS ↗
SEBoK · Decisions

Decision Management

Frame alternatives, criteria, uncertainty, stakeholder values, analysis methods, and a transparent decision record that can be revisited when evidence changes.

Read the SEBoK article ↗
NASA · Optimization

Design Solution Definition

Connect design parameters, mathematical models, formal optimization, trade-space regions, cost-effectiveness, uncertainty, and design verification.

Study design-solution search ↗
SEBoK · Analysis

System Analysis

Use models, simulation, cost, risk, effectiveness, sensitivity, and progressively refined evidence to assess architectures and technical choices.

Study system analysis ↗
NIST · Experiments

Experimental Design Selection

Select screening, modeling, and response-surface experiments when physical or simulated evaluations are expensive and the influential factors are not yet known.

Open the NIST guidance ↗
SEBoK · Risk

Risk Management

Connect scenarios, likelihood, consequence, handling actions, monitoring, ownership, and residual risk across the lifecycle.

Read the SEBoK article ↗
Weekly loopChoose a missionDraw the boundaryWrite five requirementsAllocate three functionsSearch one design spaceAnalyze one failurePlan the evidence