Sheppard threw out his left hip Monday night at his Long Island home, the Yankees said before Tuesday's game against Kansas City. He will miss the three-game series against the Royals and hopes to be back April 21.
"I am very disappointed," Sheppard said in a statement. "I am optimistic that I will return to the stadium for the next homestand."
Bill Hall announced in his place. Sheppard, who became the public-address announcer in 1951, is thought to be in his 90s - he won't give his age.
"The fact that he's been here this long is pretty incredible," Yankees manager Joe Torre said.