Upvote:4
As long as what you are doing is permitted by the type of visa, there is no problem. By giving you a multiple entry visa they clearly indicated you were permitted (even expected) to use the visa more then once, and that not all the uses were going to be for this conference.
It's just possible you may be asked why you didn't go to the conference, but assuming you have a reasonable reason it will be OK.