📓 Engineering notebook · derivations · measured results · live simulations

Where GNC meets deep learning

Autonomous systems must know where they are, understand what is around them, and decide what to do. This site works those three problems end to end — classical estimation, modern learned perception, and the sensors and compute that tie both to the physical world.

🛰️ GNC & estimation 🧠 Deep learning 🎮 Reinforcement learning 📡 Sensors & hardware 📐 System studies
Start with estimation → Browse everything See the perception case study
7sections
40+deep-dive pages
55+interactive sims
60+runnable notebooks

The seven sections

Each one is self-contained: an overview page, then focused deep dives. Use the top bar for direct jumps, or press / anywhere to search every page and section on the site.

🛰️

GNC & Estimation

The classical backbone of autonomy: attitude and rotations done right, inertial navigation, the Kalman/EKF family, and the two great absolute references — stars and satellites.

SO(3)IMUEKFStar trackerGNSS
8 pages →
📐

System Analysis

Complete case studies carried from requirements → budgets → sizing → estimator & control → stability → FDIR: ADCS laser pointing, rocket navigation, and a multi-sensor perception stack run on real nuScenes data with a production ROS 2 design.

ADCSrocket navBEVFusiontrackingROS 2
9 pages →
📡

Hardware

What you can actually buy, at datasheet level: every IMU grade from consumer MEMS to navigation-grade HRG, gyroscopes, star trackers, LiDAR, GNSS receivers, and Orin-class edge compute — with the specs that matter once the part is inside a filter.

FOG/RLG/HRGLiDARRTKJetson Orin
6 pages →
🧠

Deep Learning

Model-by-model deep dives into the foundation models behind modern perception and robotics — vision backbones, open-vocabulary detection, promptable segmentation, diffusion, LLMs and VLAs, each backed by runnable notebooks.

DINOv2GroundingDINOSAMDiffusionLLMs
8 pages →
🎮

Reinforcement Learning

A2C, PPO, GRPO and DDPG derived from the policy-gradient theorem, built from scratch and measured on LunarLander over 5 seeds each, with training and inference pseudo-code, rollout videos and the failure modes. Then the same algorithms carried over to LLMs: RLHF, GRPO, Dr. GRPO and DPO.

PPOGRPODDPGon/off-policyRLHF
7 pages →
👁️

Vision-Language Models

A research survey: the model comparison table, the architecture modules everything is assembled from, and deep dives on visual question answering and image editing — with the open problems sorted by what they cost to attempt.

CLIP → FLUXVQAimage editresearch
Open the survey →
🧮

Algorithms

Geometry and SLAM from first principles: robust fitting when half the data is wrong, point-cloud registration, multi-view geometry from stereo to bundle adjustment, and the three structurally different ways to solve SLAM.

RANSACICPSLAMsplattingoptimizersRRT*
15 pages →
🧰

Techniques

Focused navigation-analysis methods: cancelling a bias by rotation instead of estimating it, turning residuals into decisions, predicting performance without Monte Carlo, proving what is unobservable, and screening hardware on the bench.

LinCovFDIobservabilityAllan variance
6 pages →
🎬

Tracking vs ground truth

All 6,019 nuScenes val frames with GT overlaid on the tracker output — every box labelled a hit, a false positive or a miss.

videonuScenesBEVFusion
🚗

Featured: perception stack

The longest study on the site — camera/LiDAR/radar fusion in BEV, an occupancy network, and a Kalman + Hungarian tracker, evaluated on real nuScenes detections and then engineered into a deadline-driven ROS 2 system.

case studymeasuredreal data
Read the study →

The through-line

Spacecraft, launch vehicles, cars and robots all answer the same three questions — and increasingly they answer them with a blend of physics-based estimation and learned models.

Where am I?

Inertial navigation integrates motion and drifts; GNSS and star trackers bound that drift; an EKF fuses them into one estimate carrying an honest covariance.

GNC & estimation →

What's around me?

Cameras, LiDAR and radar feed learned detectors, segmenters and occupancy networks that turn raw returns into a structured, metric scene.

Perception stack →

What do I do?

Tracks, semantics and state estimates drive control and planning — and, increasingly, vision-language-action policies that map perception straight to behaviour.

VLA & robotics →

How these pages are written

Derive it, then run it

Every claim is either derived from first principles or measured. Where intuition is easier to build by playing than by reading, the page carries a simulation that runs locally in your browser — no server, no install, sliders you can push until the estimator breaks.

Prose and results, not code dumps

The deep-learning and perception pages explain each model's ideas, tensor shapes and measured numbers. The full runnable implementations live in the bundled Jupyter notebooks, linked from each page, so the narrative stays readable.

Long pages are paginated

The big studies are split into numbered parts with a pager at the top and bottom, and the left-hand contents marks which part each heading belongs to. Deep links still work — a link into a hidden part opens that part automatically. There is a show all on one page switch for printing or searching.

Everything is reachable in two hops

The top bar carries the full site map, the bar underneath it lists the current section's pages, and every page has its own filterable contents. ⌘K or / opens search over all pages and all headings of the page you are on.

A taste — estimation, live

Here is the single most important idea in inertial navigation: integrated error grows with time, which is exactly why every real system pairs an inertial core with an absolute reference. Turn on a periodic fix and watch the drift collapse.

Full site map

SectionPagesWhat you'll find
GNC & Estimation Attitude · IMU · Filtering · EKF · Star tracker · GNSS · Alt-PNT · NASA practices Derivations plus simulations for the estimation backbone of autonomy
System Analysis ADCS pointing · Rocket navigation · Perception stack · ROS 2 architecture · QoS & real time · Metrics · Model port · FPS & GPUs · Critique Full studies: requirements → budgets → control/estimator → FDIR, with real data and honest failure modes
Hardware IMUs · Gyroscopes · Star trackers · LiDAR · GNSS receivers · Edge compute Grades, specs, part tables and selection guides at datasheet level
Deep Learning DINOv2 · GroundingDINO · RF-DETR · SAM · FastSAM · Stable Diffusion · LLMs · VLA · OpenEMMA Concepts, tensor shapes and measured results, with the notebooks behind every page
Reinforcement Learning On- vs off-policy · A2C · PPO · GRPO · DDPG · PPO & GRPO for LLMs Four methods derived, implemented from scratch and measured on LunarLander, then mapped to RLHF
Nomenclature Every symbol used on the site, by domain, with the overloaded ones called out Start here if an equation uses a letter you do not recognise
Algorithms RANSAC · ICP · Camera model · Stereo · PnP · SfM · Bundle adjustment · Gaussian splatting · EKF-SLAM · FastSLAM · GraphSLAM · Hyperparameter tuning · Optimizers · RRT & RRT* Robust fitting, multi-view geometry, the three flavours of SLAM and sampling-based planning, each derived with its failure modes — plus how to actually train the learned parts
Techniques Gyro bias cancellation · FDI · LinCov · Joint observability · Schuler oscillation · IMU acceptance testing Six different answers to "what do you do about an error you cannot measure directly?"
Suggested reading order. If you are new here, read Attitude & rotations → IMU → EKF to get the estimation vocabulary, then jump to the perception case study to see the same machinery carrying learned detections into tracks under a hard deadline.