score:4
The language shouldn't in itself be a source of trouble -- border guards will have access to documentation about how the relevant residence permits of other member states look.
Note, though, that your rights under the Directive only apply when you're traveling with (or traveling to join) the union citizen in question. If you're traveling on your own you can be required to have a visa.