Flight Controller Communication Sub-Application Architecture
Overview
The Flight Controller Communication sub-application establishes connection to the flight controller,
retrieves hardware information, downloads parameters and their default values.
This is a critical component that enables the ArduPilot Methodic Configurator to communicate with
ArduPilot-based flight controllers using the MAVLink protocol.
Requirements Analysis
Functional Requirements - Implementation Status
- Connection Management
- ✅ Supports multiple connection types via
discover_connections() (USB, TCP, UDP, serial)
- ✅ Auto-detects available flight controllers using
serial.tools.list_ports and network ports
- ✅ Handles connection establishment via
connect(), maintenance via heartbeat, and termination via disconnect()
- ✅ Supports reconnection after connection loss with retry logic in
__create_connection_with_retry()
- ✅ Validates connection integrity through MAVLink protocol and timeout handling
- Hardware Information Retrieval
- ✅ Identifies flight controller type via
BackendFlightcontrollerInfo class
- ✅ Retrieves firmware version information via
__process_autopilot_version()
- ✅ Detects available sensors through MAVLink AUTOPILOT_VERSION message
- ✅ Reads hardware configuration and board type from autopilot version message
- ✅ Supports multiple ArduPilot vehicle types (Copter, Plane, Rover, etc.) via vehicle type detection
- Parameter Operations
- ✅ Downloads all parameters via
download_params() with both MAVLink and MAVFTP methods
- ✅ Retrieves parameter metadata using
annotate_params.Par class
- ✅ Downloads default parameter values via
download_params_via_mavftp()
- ✅ Handles parameter validation and bounds checking through parameter type validation
- ✅ Supports parameter upload via
set_param() and verification
- Protocol Support
- ✅ Implements MAVLink parameter protocol using
pymavlink.mavutil
- ✅ Supports FTP-over-MAVLink via
MAVFTP class (1656 lines of implementation)
- ✅ Handles protocol version negotiation through mavutil connection
- ✅ Supports heartbeat and keepalive mechanisms built into pymavlink
- ✅ Handles message sequencing and acknowledgments via pymavlink framework
- Error Recovery ⚠️ PARTIALLY IMPLEMENTED
- ✅ Detects and handles communication timeouts via connection timeout parameters
- ✅ Retries failed operations with exponential backoff in
__create_connection_with_retry()
- ⚠️ Partial parameter download recovery (basic retry logic, no resume capability)
- ✅ Recovers from protocol errors gracefully with comprehensive exception handling
- ✅ Maintains connection state awareness through connection status tracking
Non-Functional Requirements - Implementation Status
- Performance
- ✅ Connection establishment completes efficiently with retry mechanism
- ✅ Parameter download handles 1000+ parameters via optimized MAVFTP and MAVLink methods
- ✅ Supports concurrent operations through progress callbacks and non-blocking operations
- ✅ Memory usage optimized for large parameter sets using streaming and chunked operations
- Reliability ⚠️ PARTIALLY IMPLEMENTED
- ✅ Handles unstable connections gracefully with comprehensive error handling
- ✅ Parameter operations include verification via
set_param() confirmation
- ✅ Maintains data integrity during transfers using MAVLink/MAVFTP protocols
- ❌ TODO: No operation resumption after interruption (would need state persistence)
- Compatibility
- ✅ Supports multiple ArduPilot firmware versions via dynamic protocol handling
- ✅ Handles different flight controller hardware variants through auto-detection
- ✅ Adapts to different MAVLink protocol versions via pymavlink compatibility layer
- ✅ Supports legacy and current parameter formats through flexible parameter parsing
- Security ⚠️ PARTIALLY IMPLEMENTED
- ✅ Validates received data through MAVLink protocol validation
- ✅ Protects against malformed messages via pymavlink message validation
- ❌ TODO: No authentication implementation (MAVLink auth not implemented)
- ✅ Parameter modification protection through validation and confirmation
Architecture
Architectural Pattern - Delegation with Specialized Managers
The flight controller communication system uses a delegation pattern where the main
FlightController class acts as a facade, delegating operations to specialized manager classes.
This architecture provides:
- Clear separation of concerns: Each manager handles one specific aspect
- Better testability: Managers can be independently tested and mocked
- Dependency injection support: Protocol definitions enable test doubles
- Single source of truth: Connection manager owns connection state
- No shared mutable state: Managers query each other rather than caching references
Components
Flight Controller Facade
- File:
backend_flightcontroller.py
- Purpose: Main entry point that delegates to specialized managers
- Key Classes:
FlightController: Facade class coordinating all operations
- Key Methods:
connect(): Delegates to connection manager
download_params(): Delegates to params manager
set_param(): Delegates to params manager (returns tuple[bool, str])
test_motor(): Delegates to commands manager
upload_file(): Delegates to files manager
- Delegation Pattern:
- Connection operations →
_connection_manager
- Parameter operations →
_params_manager
- Command execution →
_commands_manager
- File operations →
_files_manager
- Actual Dependencies:
FlightControllerConnection for connection management
FlightControllerParams for parameter operations
FlightControllerCommands for command execution
FlightControllerFiles for file operations
- Protocol definitions for dependency injection
Connection Manager
- File:
backend_flightcontroller_connection.py
- Purpose: Manages flight controller connection lifecycle
- Key Classes:
FlightControllerConnection: Connection establishment and management
FakeSerialForTests: Mock serial class for unit testing
- Key Methods:
connect(): Establishes connection with retry logic
disconnect(): Closes connection gracefully
discover_connections(preserved_connections): Auto-detects available ports and merges caller-supplied
history entries that are not physically present on the bus
register_and_try_connect(): Registers and connects to port
create_connection_with_retry(): Connection with retry logic
- Responsibilities:
- Port discovery (serial and network)
- Connection establishment and retries
- Heartbeat detection and vehicle identification
- Autopilot version and banner retrieval
- Sole mutator of
FlightControllerInfo (single source of truth)
- Actual Dependencies:
pymavlink.mavutil for MAVLink protocol
serial.tools.list_ports for port discovery
FlightControllerInfo for metadata storage
time and logging for operations
Parameters Manager
- File:
backend_flightcontroller_params.py
- Purpose: Manages all parameter-related operations
- Key Classes:
FlightControllerParams: Parameter download, set, and fetch
- Key Methods:
download_params(): Downloads via MAVLink or MAVFTP
set_param(): Sets parameter (returns tuple[bool, str])
fetch_param(): Fetches single parameter with timeout
get_param(): Gets parameter from cache with default
- Responsibilities:
- Parameter downloads (MAVLink and MAVFTP)
- Parameter cache management
- Individual parameter operations
- Default parameter handling
- Query Pattern: Queries connection manager for
master, info, comport_device
- Actual Dependencies:
FlightControllerConnectionProtocol for connection state
MAVFTP for efficient parameter downloads
ParDict for parameter storage
Commands Manager
- File:
backend_flightcontroller_commands.py
- Purpose: Executes MAVLink commands and queries status
- Key Classes:
FlightControllerCommands: Command execution and status queries
- Key Methods:
send_command_and_wait_ack(): Sends command and waits for ACK
test_motor(): Tests individual motor
test_all_motors(): Tests all motors simultaneously
stop_all_motors(): Emergency stop
get_battery_status(): Queries battery telemetry
reset_all_parameters_to_default(): Resets parameters
- Responsibilities:
- Motor testing operations
- Battery status monitoring
- Command acknowledgment handling
- Parameter reset operations
- Query Pattern:
- Queries params manager for parameter values (no caching)
- Queries connection manager for
master connection
- Actual Dependencies:
FlightControllerConnectionProtocol for connection
FlightControllerParamsProtocol for parameters
- Business logic functions for calculations
Files Manager
- File:
backend_flightcontroller_files.py
- Purpose: Handles file operations via MAVFTP
- Key Classes:
FlightControllerFiles: File upload/download operations
- Key Methods:
upload_file(): Uploads file to flight controller
download_last_flight_log(): Downloads latest log file
- Responsibilities:
- File upload via MAVFTP
- File download via MAVFTP
- Directory scanning and log detection
- Query Pattern: Queries connection manager for
master and info
- Actual Dependencies:
FlightControllerConnectionProtocol for connection
MAVFTP for file transfer protocol
Protocol Definitions
Business Logic Functions
- File:
backend_flightcontroller_business_logic.py
- Purpose: Pure functions for calculations and validations
- Key Functions:
calculate_voltage_thresholds(): Battery voltage limits
is_battery_monitoring_enabled(): Battery monitoring check
get_frame_info(): Frame class and type extraction
validate_battery_voltage(): Voltage safety validation
- Benefits:
- Stateless and side-effect-free
- Easily testable without mocks
- Reusable across components
- Clear business rules
MAVFTP Utilities
- File:
backend_flightcontroller_factory_mavftp.py
- Purpose: Factory functions for MAVFTP instances
- Key Functions:
create_mavftp(): Creates MAVFTP instance with error handling
create_mavftp_safe(): Safe creation returning None on failure
- Benefits:
- Centralized MAVFTP creation
- Consistent error handling
- Mockable for testing
MAVLink FTP Backend
- File:
backend_mavftp.py
- Purpose: File transfer operations over MAVLink (1656 lines of implementation)
- Key Classes:
MAVFTP: Complete FTP-over-MAVLink implementation
- Key Operations:
- File upload/download via FTP-over-MAVLink protocol
- Directory operations and file management
- Large file transfer with progress tracking
- CRC32 file verification and burst read operations
- Actual Dependencies:
pymavlink.mavutil for MAVLink message handling
struct for binary data packing/unpacking
random for session ID generation
os and time for file system operations
Flight Controller Info Backend
- File:
data_model_flightcontroller_info.py
- Purpose: Hardware information management and processing
- Key Classes:
BackendFlightcontrollerInfo: Processes and stores FC information
- Responsibilities:
- Hardware type identification via autopilot version processing
- Capability detection from MAVLink messages
- Vehicle type determination and logging
- Firmware version parsing and validation
Flight Controller ID data_model
- File:
data_model_fc_ids.py (Auto-generated)
- Purpose: Flight controller hardware identification mappings
- Key Features:
- Hardware type identification using board IDs
- Capability detection based on hardware database
- Board-specific configuration mapping
- Version compatibility checking against known hardware
Connection Selection UI
- File:
frontend_tkinter_connection_selection.py
- Purpose: User interface for connection management
- Key Classes:
ConnectionSelectionWidgets: Manages connection UI components
ConnectionSelectionWindow: Main window for connection selection
- Key Features:
- Connection type selection via
PairTupleCombobox
- Auto-detection display of available ports
- Manual connection configuration with custom dialogs
- Connection status feedback via progress windows
- 3-second periodic port refresh via
_refresh_ports() that preserves history entries not currently on the bus
- In-memory
_connection_history_cache loaded once at init from ProgramSettings to avoid repeated disk I/O on every refresh cycle;
updated in-memory after each successful connection or manual add
reconnect() persists the user-selected connection string (falling back to the detected device path for auto-connect) rather than
the possibly resolved symlink target (e.g. /dev/ttyACM0)
- Actual Dependencies:
tkinter and tkinter.ttk for GUI components
PairTupleCombobox for connection selection widget
BaseWindow for consistent window behavior
ProgressWindow for connection progress display
ProgramSettings for persistent connection history
Flight Controller Info UI
- File:
frontend_tkinter_flightcontroller_info.py
- Purpose: Display flight controller information and download progress
- Key Classes:
FlightControllerInfoPresenter: Business logic separated from UI
FlightControllerInfoWindow: Main information display window
- Key Features:
- Hardware information display in formatted layout
- Parameter download progress with real-time updates
- Error message presentation via message boxes
- Operation status updates and logging integration
- Actual Dependencies:
tkinter and tkinter.ttk for GUI components
BaseWindow for consistent window behavior
ProgressWindow for parameter download progress
annotate_params.Par for parameter handling
Data Flow
- Application Startup and Connection Initialization
- Called from
__main__.py via connect_to_fc_and_set_vehicle_type() function
FlightController facade created with dependency injection support
- Connection manager initialized with
FlightControllerInfo instance
- Params, commands, and files managers initialized with protocol references
discover_connections() delegates to connection manager for port detection
- If connection fails,
ConnectionSelectionWindow is displayed for manual selection
- Connection Establishment Phase
- User selects connection via GUI or auto-detection attempts first available
FlightController.connect() delegates to connection_manager.connect()
- Connection manager handles retry logic via
create_connection_with_retry()
- Heartbeat detection via
_detect_vehicles_from_heartbeats()
- Autopilot selection via
_select_supported_autopilot()
- Connection manager mutates
FlightControllerInfo (sole mutator)
- Connection validation via heartbeat and banner text reception
- Hardware Information Gathering
- Connection manager requests
AUTOPILOT_VERSION message
_retrieve_autopilot_version_and_banner() processes responses
- Hardware capabilities extracted via
_process_autopilot_version()
- Firmware version, board type, and capabilities stored in
FlightControllerInfo
- Banner text parsed for firmware type via
_extract_firmware_type_from_banner()
- ChibiOS version validated via
_extract_chibios_version_from_banner()
- Parameter Operations Phase
FlightController.download_params() delegates to params manager
- Params manager checks MAVFTP support via
info.is_mavftp_supported
- Attempts MAVFTP download first, falls back to MAVLink if unavailable
- Progress tracking through callbacks to update GUI
- Parameters stored in
params_manager.fc_parameters dictionary
- Default parameters downloaded separately when MAVFTP available
- Commands manager queries params manager for fresh parameter values (no caching)
- Command Execution Flow
FlightController.test_motor() delegates to commands manager
- Commands manager queries params manager for battery parameters
send_command_and_wait_ack() handles MAVLink command protocol
- Battery status retrieved via
get_battery_status() with caching
- Voltage thresholds calculated via business logic functions
- All operations check
master is not None before execution
- UI Updates and Status Reporting
- Real-time progress updates via
ProgressWindow during operations
- Error reporting through
show_no_connection_error() and message boxes
- Connection status feedback via GUI state changes and tooltips
- Final status display in
FlightControllerInfoWindow with formatted information
set_param() now returns tuple[bool, str] for explicit error handling
Integration Points
- Main Application: Integrated via
connect_to_fc_and_set_vehicle_type() in __main__.py
- Parameter Editor: Provides
FlightController object with fc_parameters dict and set_param() method
- File System Backend: Uses
backend_filesystem.py for parameter file storage and metadata management
- Internet Backend: Downloads parameter documentation via
backend_internet.py when needed
- Command Line Interface: Integrates with
common_arguments.py for connection and reboot configuration
- Logging System: Uses Python logging for comprehensive error, debug, and info messages
- GUI Framework: Integrates with
BaseWindow, ProgressWindow, and custom tkinter components
- Configuration System: Connection history persisted to
ProgramSettings (settings.json) and restored on startup
Protocol Implementation
MAVLink Parameter Protocol
- Implements standard MAVLink parameter messages
- Handles parameter request/response cycles
- Manages parameter indexing and naming
- Supports parameter value validation
FTP-over-MAVLink
- Implements file transfer protocol over MAVLink
- Handles large file transfers efficiently
- Provides progress reporting for transfers
- Manages file system operations on flight controller
Error Handling Strategy
- Connection Errors: Retry with different parameters, guide user to solutions
- Timeout Errors: Implement progressive timeout with user notification
- Protocol Errors: Log details, attempt recovery, fall back to basic operations
- Parameter Errors: Validate and sanitize, report specific parameter issues
Testing Strategy
Test Organization and Coverage
The flight controller communication system has comprehensive test coverage organized by testing approach:
Unit Tests (Mocked Dependencies)
- test_backend_flightcontroller.py - Main facade integration tests
- Connection lifecycle workflows (initialization, connection, disconnection)
- Parameter management workflows (download, modify, verify, reset)
- Motor testing workflows (individual, all motors, emergency stop)
- Battery monitoring workflows (enable, check status, verify configuration)
- Error handling and recovery scenarios
- All tests use
@pytest.mark.integration for integration test scenarios
- Uses BDD (Behavior-Driven Development) naming:
test_user_can_*
- GIVEN/WHEN/THEN structure in all test docstrings
- test_backend_flightcontroller_business_logic.py - Pure business logic tests
- Voltage threshold calculations and battery monitoring detection
- Frame information extraction and battery voltage validation
- Battery telemetry conversions and throttle validation
- Motor test duration validation and sequence number calculations
- Zero mocking (pure functions) - fastest test execution
- Comprehensive edge case coverage (boundaries, invalid inputs, missing data)
- test_backend_flightcontroller_connection.py - Connection manager tests
- Connection manager initialization and port discovery
- Connection lifecycle (connect/disconnect/reconnect)
- Baudrate configuration and custom connection strings
- Flight controller info management and property delegation
- 14 tests covering all connection management scenarios
- test_backend_flightcontroller_params.py - Parameters manager tests
- Parameter initialization and setting (with/without connection)
- Parameter fetching from flight controller and cache retrieval
- Cache clearing and constants validation (PARAM_FETCH_POLL_DELAY)
- Property delegation and parameter downloads
- File operations and error handling
- 18 tests covering all parameter operations
- test_backend_flightcontroller_commands.py - Commands manager tests
- Command manager initialization and motor testing
- Battery status requests and parameter reset commands
- Command acknowledgment waiting and timeout handling
- Property delegation to connection manager
- 10 tests covering all command execution scenarios
- test_backend_flightcontroller_files.py - Files manager tests
- Files manager initialization and file uploads via MAVFTP
- Log file downloads and MAVFTP availability handling
- Progress callback support and constants validation
- Property delegation and error handling
- 11 tests covering all file operation scenarios
Integration Tests (Real SITL)
- test_backend_flightcontroller_sitl.py - Real MAVLink protocol tests
- Uses
@pytest.mark.integration and @pytest.mark.sitl markers
- Real TCP connection to ArduCopter SITL simulation
- Actual MAVLink protocol behavior (not mocked)
- Tests validate:
- Real parameter downloads via MAVLink PARAM_REQUEST_LIST/PARAM_VALUE
- Authentic command acknowledgments (COMMAND_ACK with real timing)
- True async communication patterns and timeout behavior
- Actual telemetry streaming (BATTERY_STATUS messages)
- Real parameter persistence in SITL memory
- Genuine retry logic and error conditions
- 12 tests exercising real protocol that mocks cannot simulate
- Comprehensive module docstring explains “why SITL matters”
- Each test documents what real behavior is validated vs mocked tests
Test Quality Metrics
- BDD Compliance: All tests follow GIVEN/WHEN/THEN structure
- User-Centric Naming: Tests named
test_user_can_* describing user workflows
- Minimal Mocking: Only external dependencies mocked, system under test is real
- Test Independence: Each test can run standalone, no shared mutable state
- Integration Markers: Tests marked with
@pytest.mark.integration and/or @pytest.mark.sitl
Running Tests Selectively
# Run all flight controller tests
pytest tests/test_*flightcontroller*.py -v
# Run only unit tests (skip SITL integration tests)
pytest tests/test_*flightcontroller*.py -m "not sitl" -v
# Run only integration tests
pytest -m integration tests/ -v
# Run only SITL integration tests
pytest -m sitl tests/ -v
# Run with coverage for backend flight controller modules
pytest tests/test_*flightcontroller*.py --cov=ardupilot_methodic_configurator.backend_flightcontroller --cov-report=html
# Run specific test file
pytest tests/test_backend_flightcontroller_params.py -v
File Structure
# Facade and coordination
backend_flightcontroller.py # Main facade delegating to managers
# Specialized managers (delegation pattern)
backend_flightcontroller_connection.py # Connection management
backend_flightcontroller_params.py # Parameter operations
backend_flightcontroller_commands.py # Command execution
backend_flightcontroller_files.py # File operations via MAVFTP
# Protocol definitions and utilities
backend_flightcontroller_protocols.py # Protocol interfaces for DI
backend_flightcontroller_business_logic.py # Pure business logic functions
backend_flightcontroller_factory_mavftp.py # MAVFTP factory functions
# Data models and supporting files
data_model_flightcontroller_info.py # Flight controller metadata
backend_mavftp.py # FTP-over-MAVLink implementation
data_model_fc_ids.py # Hardware identification (auto-generated)
# User interface
frontend_tkinter_connection_selection.py # Connection selection GUI
frontend_tkinter_flightcontroller_info.py # Information display GUI
Dependencies
- Python Standard Library:
socket for network connections
serial for USB/serial connections
threading for non-blocking operations
time for timeout handling
struct for binary data packing
- Third-party Libraries:
pymavlink for MAVLink protocol implementation
tkinter for GUI components
pyserial for serial port communication
- ArduPilot Methodic Configurator Modules:
backend_filesystem for parameter file operations
backend_internet for downloading documentation
frontend_tkinter_base_window for GUI base classes
frontend_tkinter_progress_window for progress dialogs