Upvote:3
Here's what the French consulate general has to say:
The foreign spouse of a EU national enter France without visa if holding:
- A valid travel document ;
- A valid UK residence permit with the endors*m*nt "family member of EEA national" (this endors*m*nt is compulsory to be visa exempted);
- and if they are joining or travelling with the EU national.
Attention: To avoid unnecessary problems whilst travelling it is advisable to carry along evidence of family relationship.
It seems to be immaterial that the travel document is not a passport, as long as it is valid.