Is it true that I could spoil my baby by picking him up every time he cries? It just gets frustrating when he keeps crying.

No, by picking up the baby you're comforting him and developing the trust that mommy is there. Babies usually cry for some reason. Instead of getting frustrated, try to find the reason of his discomfort.