Not sure if your swaddle is those type zip up or using muslin.If u using the zip up maybe change to muslin coz it is thinner in material or either those Velcro the arm only. You have to try an error to figure out. Or is your room too warm? Or u can try playing white noise to LO to soothe your LO.
Consider getting him a baby rocker/bouncer