At first, you might barely notice the pain associated with a stress fracture, but it tends to worsen with time. The tenderness usually starts at a specific spot and decreases during rest. You might have swelling around the painful area.