One thing they seems to have got working fairly reliably is the lunar landing of the probe using image processing to guide the final approach and touch down. It seems to have worked well in this and the previous mission, there are videos on youtube of that.
The other component is the autonomous docking of the return probe in lunar orbit.
Soviets have done a lunar sample return, but they had a probe that would lift off directly into a earth return trajectory, but that seems to have limited both the liftoff mass and the possible zones in moon from which it can lift off. This seems a much more complex mission than that.
Also some animated videos of the misson show a skip re-entry back to earth, don't know if it is the case during this particular flight.
Martian winds make this more important there than on the Moon. The DIMES system integrates radar, visual images, and IMUs. They did not have a dedicated Doppler radar for horizontal velocity, for technical and cost reasons it was not workable.
From the introduction:
> Some of the challenges were subtler — and one in particular was subtle enough that it wasn’t fully appreciated until mission development was well underway.
> This was the challenge of martian winds. How to detect and compensate for them? In the worst-case scenario, they could tip the vehicle over in the final stages of descent such that the powered thrust intended to eliminate downward velocity might actually drive the platform sideways and down into the surface beyond the safety envelope of the airbag cushions.
> This article tells the story of how this late-understood challenge was addressed successfully — and, as it turned out, critically, for Spirit.
ALHAT/LVS problem seems to be the overly broad requirements, it's overengineered (hence the modularization in LVS) which led to long delays during the development. For comparison, Chang'e 3 TRN solution was dead simple, it was roughly speaking a webcam combined with the specific lighting angle during the landing. Then they iterated on it in subsequent missions, creating a decent system that was less dumb and restrictive than the original.
Weapons guidance systems get to be simpler in many ways.
If you've seen some of the Lunar or Martian landing videos, you'll notice that it's very hard to tell the scale. Especially on the Moon, the lack of atmosphere to disturb the surface makes it fractal-like, which probably really messes with the CV algorithm. It'd work fine when high up, but as you approach for landing, it would probably struggle, especially for, say, estimating how far away the surface is.
Don't they use radar altimeters to get altitude? You don't need to rely only on image processing. You can even pull off stereo using a single camera since you are moving and know the altitude at every point.
They definitely combine several sensors to get a proper height reading, but as we've seen with the American and Japanese landers, getting good readings from the sensors, properly accounting for all factors that might affect sensor readings and being able to properly handle sensor disagreements is quite challenging.
For distance during landing I would be thinking a spatially maximally distributed array of quartz-shielded, thermally-supported laser TOF sensors along nominal extremities, but that's just because they're familiar to me, small, power-efficient, highly linear, relatively accurate, and cheap. Unsure if the IC physics assumptions work in non-atmospheric conditions. Perhaps the output can be re-scaled to obtain cheap and accurate enough readings.
A non-dilettante with an actual physics degree would clearly be desirable ;)
A kalman filter wouldn't account for say, the issue that hit the HAKUTO-R lander, where because the reading on the radar altimeter changed too rapidly, the computer assumed it was faulty, or the IM-1 lander, where they initially had a lot of trouble with altitude sensing (in part because they forgot to remove the covers from the laser rangefinders), managed to work around it, and then failed to fully sense and cancel out the lateral velocity, causing it to skid along the surface, snap a leg and tip over.
The first sounds like bad assumption (hard fault limit).
The second sounds like bad process leading to bad input, at which point it becomes garbage in, garbage out. The workaround was untested and insufficient.
While you are of course correct the filter will not fix these, none of these are the fault of the filter, they are all human process issues that are firmly out of scope.
It is a lot more difficult in space, since you don't have the atmosphere to steer for free and because fuel margins get very expensive. Being familiar with these image processing systems, I could see it being a significant challenge.
https://youtu.be/wUju9-cckKA?si=nZFOCga10mnCA_vs
The other component is the autonomous docking of the return probe in lunar orbit.
Soviets have done a lunar sample return, but they had a probe that would lift off directly into a earth return trajectory, but that seems to have limited both the liftoff mass and the possible zones in moon from which it can lift off. This seems a much more complex mission than that.
Also some animated videos of the misson show a skip re-entry back to earth, don't know if it is the case during this particular flight.