Upvote:1
Unlike the UK, the Schengen area does not issue a separate class of visa for family members of people who qualify for free movement. Once you've got the Schengen visa, you can use it like a normal Schengen visa.
You could be accused of a fraudulent application, though, so if you can document the reason for your change of plans, or that the consulate told you that the visa was okay to use despite your change of plans, or (perhaps best) that you tried to apply for a new visa but the consulate told you not to, then you ought to be able to dispel any such suspicions.