That's not justification. Give me some reasons (or justifications) as to why Afflalo should be started.
Are you just playing some sort of Devil's advocate, or do you really think that Afflalo should not start, given our current roster?
As far as justification goes, there are basically four players on our roster who would normally be considered to start at the 2-guard at the beginning of the season (by the end of the season lineups can and should change if play warrants it):
Afflalo, McLemore, Patterson, Richardson, Temple.
Patterson, with a non-guaranteed contract, probably gets cut after training camp.
Richardson has zero NBA experience and is not remotely ready to start.
McLemore is inferior to Afflalo in basically every way on the basketball court outside of youth and athleticism. McLemore's youth and athleticism haven't done him a lot of good so far. There's no reason to start McLemore over Afflalo.
That leaves Temple. There are at least two reasons to start Afflalo over Temple. First, Afflalo is a much better shooter than Temple. Second, at the moment Temple is basically our only backup at the PG position. He will, at this point, play a lot of minutes with the second unit. If we were to start him, then the rotation would get very awkward because Collison would have to sit early so that Temple could play backup PG before getting his own rest. So Temple is a bad call.
That leaves Afflalo. He is basically the best player we have at SG, he ought to get the most minutes, and the only other reasonable option to start at SG is going to be playing a lot of minutes at another position as the roster is currently constructed.
tl;dr
Afflalo is our best SG. What more justification do we need to propose that he be the starter?