Life

I’m 24 and my boyfriend is 25. We have been together for 2 years and we share a precious daughter who is 9 months old. I olso have a 4 year old from my previous relationship, her father past away when I was 9 months pregnent. My problem is that my boyfriend won’t accept my 4 year old, he had a step father who didn’t treat him well (could this be the reason why he does not want a  step child? ) I really dont know what to do. I feel so so down because I really Love him and on the other side I Love my 4 year old very much that I am willing to risk everything for her. For more than a year i have been vissiting him on weakends without taking my 4 year old along but taking the 9 month old  ever since she was born until two weaks back when I decided it was time i went with them together. He didn’t talk to me the entire weakend until i forced him to, he then admited that he was angry because my 4 year old was there. It has been two years, So should I stay in the relationship or pack my bags and LEAVE?