'Stress Hormone' Tied to Worse Memory in Middle Age