Dawn,
It sure could be the Relay, but, maybe the Igniter too ?
This is hard to explain, but to check the Relay, you need to see if the Voltage is being transmitted through the Contacts.
If you have a Voltmeter, you can check the two points where the Voltage comes in the the Common of the Relay, and then on the other side, where it exits and is sent to the Igniter. (across the Terminals)
In other words, when the Relay is closed, there should be no voltage present across the Terminals. (0 Volts).
If the Contact(s) is/are bad, you will see some voltage there.
Gees, I just reread this, and I'm not sure if I understand what I said.

Hopefully you did !
Have a good Day !
S.W.
PS:
You are seeing the Relay engage/close, when you call for heat, right ?