Back when I had a Vortex and a single sided Stages power meter I noticed exactly the same thing. Here’s the post i wrote at the time. Follow the link for some graphs:
The bottom line is that, even without power match, the Vortex was requiring too much power at the start of each interval.
As far as I know there’s nothing that you can do about it (other than buy a different trainer…).