Breastfeed

My LO is turning 4 weeks soon and he still have difficulties latching and i feel frustrated with myself. I don't want to end up taking the anger onto him. At times it seems easy even when he's crying out loud. But most of the time i just want to give up. I have no choice but to pump so he still gets breastmilk. I cried after realising that I can't remember the last time he latches on me. Anybody else faces the same issue as me?