We work in a two-person team, but I can't work with this person anymore

Is it extremely damaging to my pride to say something like this to my boss??