Ulster hung on for a narrow 19-18 victory over a game Exeter side in Belfast.
A dramatic last couple of minutes saw Paddy Jackson and Gareth Steenson trade drop-goals.
Steenson then missed the chance to snatch the victory when a second attempted drop-goal faded wide at the death.
Sean Reidy scored the only try of the game after an excellent break by Charles Piutau.