Well perhaps the intonation of voice which is loud will scare off your LO. Hence, highly advice to not scold unnecessarily. They will definitely feel the anger/unhappiness towards them. Everyone has feelings same with baby. They might not understand well enough, but actions,intonation of voice plays a part when we speak.