Toronto has their own Ben in Ross. I don't know that it would make sense for both sides. If Carter isn't currently on a team, I could definitely see him mentoring Ben in Toronto.
Having DeRozan on this team would complicate a lot of things. We'd definitely have to blow up the team a bit. Ex: trade Gay, let go of Rondo, and etc.