Neck & shoulder stiffness: more likely bar height or stem length?

I've started doing longer rides and found that after an hour or two, that I really start noticing stiffness/soreness in my lower neck and shoulder area. Not sharp pains, just an ache from carrying too much tension.

I try to consciously drop my shoulders to relax them, but I naturally fall back...