I replaced the package restore call with:
<exec
Command="..\.nuget\nuget.exe install "packages.config" -source "https://feedserver/Live/api/v2/" -NoCache -solutionDir "..\ ""
WorkingDirectory="$(projectfolder)" />
I'm not too happy about this, but if it works as a workaround it will do for now.