Agreed.
To be honest, Perry main strength was his respect and connections around the league.
His actual player personnel moves and talent evaluations (see Orlando) were questionable at best.
I suspect the players picked in the draft and the free agents acquisitions were mostly Vlade decisions.
Furthermore, I would want to keep Vlade as the main decision maker (even if Perry was here), which is why Perry probably decided to leave, so he can that ultimate power in New York.
It hurts to lose such a respected and experienced FO member, but I think if we can find a well connected, experienced and respected replacement, there will be little harm done.
My feeling is that Vlade has always been the main decision maker in all these moves this summer, not Perry.