Ray Montgomerie levelled in the 36th minute with a superb volley and Stranraer came close to taking the lead when Kevin Cawley's shot hit the post.
Steven McKeown tapped home to re-establish Albion's lead and they sealed victory through Paul McLeod.
Rovers are four points adrift of a play-off spot but have two games in hand.
Albion: Ewings, Reid, Benton, O'Byrne, McGowan, Thomson, Gilmartin (McKeown 46), Canning, Ferry, McLauchlin (McFarlane 88), McLeod (Walker 66). Subs Not Used: Gaston, Tyrrell.
Booked: Canning, O'Byrne.
Goals: Ferry 14, McKeown 62, McLeod 65.
Stranraer: David Mitchell, Montgomerie, Glen Mitchell, Bouadji (Scott McManus 80), Sharp, Agnew, Daniel Mitchell, Cawley, Noble, One, Moore. Subs Not Used: Marshall, McInnes, Wilson, Wright.
Booked: One.
Goals: Montgomerie 36.
Att: 252
Ref: K Clancy
Source: BBC Sport
Source: BBC Sport