Stand-in goalkeeper Julian Cuesta was the hero as Almeria tasted victory in the Primera Division for the first time since September.
New manager Juan Ignacio Martinez was dealt a blow on the eve of their game against Celta Vigo with the news number one Ruben Martinez would be out for up to two months after dislocating his elbow.
But Cuesta ensured Martinez was not missed by saving Nolito's 73rd-minute penalty as Almeria held on to win 1-0, courtesy of Tomer Hemed's 17th-minute header.
It was Almeria's first league victory in 10 games dating back to a 1-0 win over Deportivo La Coruna on September 28 and lifted them out of the bottom three ahead of the rest of the weekend's fixtures.
The result was another miserable one for Celta, though, who have now lost five successive league games without scoring a goal.
The hosts had the better of the early play but it was Almeria who opened the scoring, Hemed heading in from close range.
Cuesta was called into action for the first time in the 19th minute to tip Gustavo Cabral's header round the post as the visitors withstood a spell of Celta pressure.
The visitors were lucky to escape on the hour when Fabian Orellana's 25-yard free-kick beat Cuesta but hit the bar.
Orellana was involved again when Celta were awarded a penalty, the midfielder earning the spot-kick when he was felled by Jonathan Zongo.
But Cuesta proved himself up to the task and it was Almeria who had the best of the late chances, Sergio Alvarez saving Thievy Bifouma's shot.