Skip to the content
FixTheRobot Explore Robotics / UAV / Capstone 4

UAV Systems Engineering · Capstone 4 of 4

Complete GNSS-Denied Autonomous UAV

The systems-engineering capstone: not “does the algorithm work” but “can you show, with evidence, that the whole vehicle meets its requirements, including when parts fail.”

  • Builds on modules 1, 2, 3, 4, 5, 6, 7, 8
  • About 60–100 hours; individual or team
  • Implementation-specific

This project is graded on engineering judgement as much as on running code. You will specify, design, budget, integrate and verify a GNSS-denied UAV, produce the ten documents that a real programme would require, and defend the trade-offs in them.

Mission and scope

Design a UAV for inspection of an industrial site with indoor and outdoor segments: it must fly a 10-minute mission, navigate where GNSS is unavailable or untrusted, map its surroundings, avoid obstacles, respond safely to the failure of any single navigation sensor, and finish with a controlled landing. The vehicle carries a stereo camera, an IMU, a 3D LiDAR, a GNSS receiver, an NVIDIA Jetson-class companion computer, and a PX4 flight controller.

Fix the mission, environment, payload and operational limits in the first document and treat them as requirements. You are encouraged to adapt the scenario (tunnel, warehouse, forest) but must state what changes.

Complete GNSS-denied UAV reference architectureSensors (stereo camera, IMU, 3D LiDAR, GNSS) feed perception on an NVIDIA onboard computer: visual-inertial odometry and LiDAR-inertial odometry. A fusion estimator with monitors feeds a navigation manager and planner. Setpoints go over uXRCE-DDS to the PX4 flight controller, whose EKF2 receives external odometry and whose controllers drive the motors. A GCS link provides telemetry and override.NVIDIA onboard computer (companion) Stereo camera3D LiDARGNSSIMU VIOstereo + IMU LiDAR-inertial odometryFAST-LIO2-class Obstacle mapdepth + LiDAR → ESDF Fusion estimatorEKF / factor graphgating + NIS / NEEShealth monitors Navigation managerconfidence · modes · FDIR Planner + trajectoryMPC / minimum-snap Mission manager · logging · bridge (uXRCE-DDS, odometry) PX4 flight controllerEKF2 · control · mixer Motors / ESCsGCS link / RC
Reference architecture for the final capstone. You must justify every block and interface you keep, add or remove.

What you will implement

  • Requirements and architecture: derive verifiable requirements and decompose them (lessons M8-T1, M8-T2).
  • Sensor selection with a trade study, calibration plan and timing design (lessons M7-T8 to M7-T16).
  • Sensor fusion and state estimation with VIO, LIO and GNSS, honest covariance and consistency monitoring (modules 3 and 4).
  • Localisation, mapping and obstacle perception sufficient for the mission (module 4).
  • Motion planning and flight control: trajectory generation and tracking with PX4 offboard control (modules 5 and 6).
  • Fault detection and degraded navigation: confidence levels, modes and failsafes with timers derived from drift (lessons M2-T16, M8-T9 to M8-T14).
  • System verification: simulation, hardware-in-the-loop where available, ground tests and a flight-test acceptance plan (lessons M8-T3 to M8-T6).

System architecture

The reference architecture above is a starting point. Whatever you build, your architecture document must show: every interface with its message type, rate, frame and owner (the ICD); which computer runs each function and its compute and power share; what happens when each sensor, the companion computer, or the link fails; and where timing and synchronisation are established.

Layers of the final architecture and the lessons that support them
LayerMinimum contentWhere to look
SensorsModels or classes, mounting, field of view, rates, powerM1-T8, M1-T10, M7-T12 to M7-T14
Perception and odometryVIO and LIO, health indicators, covarianceM2-T10 to M2-T14, M4-T4, M4-T8
EstimationFusion estimator, gating, consistencyM3-T4 to M3-T16
Planning and controlTrajectory, tracker, constraintsM5-T8 to M5-T15
Flight softwarePX4, EKF2 external odometry, offboardM6-T5, M6-T10, M6-T11
SafetyFMEA, FDIR, degraded modes, failsafesM8-T7 to M8-T14

Requirements

Capstone requirements and how each is verified
IDRequirementVerification method
SYS-01The vehicle shall complete a 10-minute mission over a 300 m route with GNSS unavailable for the middle 60% of the route.Flight test or simulation of the full route (VT-01)
SYS-02Horizontal position error at the end of the GNSS-denied segment shall not exceed 1.0 m (95th percentile over runs).Test with ground truth; evo analysis (VT-02)
SYS-03The vehicle shall maintain at least 1.0 m clearance from obstacles larger than 0.2 m at speeds up to 2 m/s.Simulation and ground test with obstacles (VT-03)
SYS-04Loss of any single navigation sensor (GNSS, camera, LiDAR) shall not cause loss of control; the vehicle shall continue in a defined degraded mode.Fault-injection in simulation and ground/flight test (VT-04)
SYS-05GNSS spoofing with a position ramp of at least 1 m/s shall be detected within 10 s and GNSS excluded.Replay-injection test (VT-05)
SYS-06On loss of all odometry aiding, the vehicle shall execute a controlled stop within Tmax⁡T_{\max} seconds, derived from the drift rate and the clearance (lesson M8-T11).Test and analysis (VT-06)
SYS-07End-to-end latency from sensor exposure to setpoint shall not exceed 100 ms (p99).Timing measurement (VT-07)
SYS-08Companion computer power, thermal and compute shall stay within the budget at maximum ambient temperature.Bench test under load (VT-08)
SYS-09Loss of the GCS link for 5 s shall trigger the configured link-loss action.Ground and flight test (VT-09)
SYS-10The estimator shall be statistically consistent: mean NIS within the 95% interval for each fused source in nominal conditions.Log analysis (VT-10)

The ten deliverables: what each must contain

The ten deliverables and what each must contain
#DeliverableMust containEvidence of quality
1System requirements documentMission, environment, operating limits, numbered verifiable requirements with rationale; assumptions; out-of-scope itemsEvery requirement is testable and has a verification method; derived requirements trace to parents
2System architecture diagramBlocks, interfaces, frames, rates, compute allocation, power domains, failure containmentA reviewer can find, for every failure mode, where it is detected and handled
3Sensor selection and trade studyCandidate sensors, criteria with weights, vendor-published specifications with sources, sensitivity analysis of the rankingSpecifications are cited, not invented; choice survives changing the weights
4Interface Control DocumentFor each interface: producer, consumer, message type, rate, frame, units, timing (stamp semantics), latency budget, failure behaviour, versionTwo engineers could implement both sides independently from the ICD alone
5Sensor calibration planIntrinsics, camera-IMU and LiDAR-IMU extrinsics, time offsets, IMU noise (Allan), procedures, tolerances, frequency and re-calibration triggersEach parameter has an acceptance tolerance and a check that can be run in the field
6Timing and synchronisation planClock sources, trigger scheme, timestamp semantics, PTP/PPS usage, jitter budget, monitoring of offsetsMeasured offsets and jitter against the budget
7Compute, power and thermal budgetPer-function CPU/GPU/memory use, power per mode, thermal limits at ambient maximum, marginsMeasurements on the target computer under the full pipeline
8FMEANavigation, compute, power, link, actuators; severity-first prioritisation; detection and mitigation per modeEvery severity ≥ 9 mode has a verified mitigation (lesson M8-T7)
9Integration test planTest levels (unit, SIL, HIL, ground, flight), test cases per requirement, pass/fail criteria, environment, toolsRequirements-to-tests traceability matrix with no gaps
10Flight-test acceptance reportTest conditions, results against each requirement, deviations, anomalies, residual risks, operating limitationsStates what was not verified and the resulting limits on operation

Interface Control Document: starter table

Extend this table for every interface in your architecture. The fields shown are the minimum.

Starter ICD (fill every “to be budgeted” from your measurements)
IDFrom → toMessage / mediumRateFrame · unitsTimestamp semanticsLatency budgetOn failure
IF-01IMU → fusionsensor_msgs/ImuIMU-dependent (set from datasheet)FLU · rad/s, m/s2m/s^{2}Acquisition time on the shared clockTo be budgetedEstimator coasts; health flag
IF-02Camera → VIOsensor_msgs/Image + CameraInfoFrom camera modeOptical frame · pixelsExposure start or trigger timeTo be budgetedVIO reports lost; monitor lowers confidence
IF-03LiDAR → LIOsensor_msgs/PointCloud2 with per-point timeFrom LiDAR modeLiDAR frame · mmPer-point time relative to scan startTo be budgetedLIO reports lost
IF-04Fusion → PX4 EKF2px4_msgs/VehicleOdometry on /fmu/in/vehicle_visual_odometryFixed by designNED/FRD · mm, m/stimestamp_sample = acquisition timeTo be budgetedEKF2 falls back per its parameters
IF-05Planner → PX4OffboardControlMode + TrajectorySetpointFixed, above PX4’s minimumNED · mm, m/sPublication timeTo be budgetedPX4 leaves offboard mode
IF-06Fusion → supervisorNavigation state + health record (custom)Estimator rateAny · documentedEstimator timeTo be budgetedSupervisor assumes RED

Verification strategy

  1. Unit and component tests: frame conversions, monitors, state machines (as in the lessons’ runnable examples).
  2. Software-in-the-loop: the full stack with PX4 SITL and a simulated environment; every failure of the FMEA injected at least once (lesson M8-T4); use the GNSS-Denied Failure Simulator to design the scenarios first.
  3. Hardware-in-the-loop and bench: the real companion computer and flight controller with replayed or simulated sensors; timing, power and thermal budgets measured here.
  4. Ground tests: props off, then tethered: sensor health, calibrations, failsafe triggers, link-loss behaviour.
  5. Flight tests: staged from benign to demanding, each with entry criteria, a safety pilot, abort criteria and a written result (lesson M8-T5). Where flight is not possible for you, perform the equivalent in simulation and say so in the acceptance report.

Every requirement in the table above must appear in the traceability matrix with at least one test and the result of that test.

Suggested schedule

A six-phase schedule
PhaseContentOutput
1Mission, requirements, architecture, FMEA first passDocuments 1, 2, 8 (draft)
2Sensor trade study, calibration and timing designDocuments 3, 5, 6
3Estimator and perception in simulation or on datasetsEvaluation reports
4Planner, controller and PX4 integration, ICDDocument 4, closed-loop SIL runs
5Budgets measured, failure injection, degraded modesDocument 7, FMEA update
6Integration test plan executed; acceptance reportDocuments 9 and 10

Deliverables

  1. 1. System requirements document.
  2. 2. System architecture diagram.
  3. 3. Sensor selection and trade study.
  4. 4. Interface Control Document.
  5. 5. Sensor calibration plan.
  6. 6. Timing and synchronisation plan.
  7. 7. Compute, power and thermal budget.
  8. 8. Failure Mode and Effects Analysis.
  9. 9. Integration test plan.
  10. 10. Flight-test acceptance report.

Acceptance criteria and grading rubric

Acceptance criteria
CriterionAcceptableStrong
RequirementsNumbered, verifiable, with verification methodsDerived requirements traced to parents; rationale for each limit
Architecture and ICDComplete interfaces with rate, frame and failure behaviourImplementable independently from the ICD; latency budget closed
Trade studyCited sensor specifications and a weighted comparisonSensitivity analysis; rejected options explained
Calibration and timingPlans with tolerancesMeasured offsets and residual error budgets
BudgetsCompute, power, thermal numbers from measurementsMargins at worst-case ambient with worst-case mode
FMEA and FDIRSeverity-first, each high-risk mode mitigatedMitigations verified by fault injection with detection times
VerificationTraceability matrix without gapsResults with statistics over repeated runs and honest limitations
Acceptance reportRequirement-by-requirement resultOperational limitations derived from what was not verified

Common failure points

  • Choosing sensors from marketing numbers; cite vendor documentation and state test conditions.
  • Writing requirements that cannot be verified (“robust”, “reliable”) instead of measurable limits.
  • An architecture diagram that omits power, time and failure paths.
  • Budgets from datasheet peaks instead of measured load of the full pipeline.
  • An FMEA written once at the end instead of driving the design.
  • Claiming success from the nominal case; the failure cases are the capstone.
  • Reporting only means: report percentiles and worst cases (lesson M7-T6).

References

Record your progress

Capstones are assessed by you against the rubric above, so this records your own sign-off.