For any who have the same issue, I found a solution:
When writing a number as a constraint, write "=#"
i.e.
SolverAdd CellRef:="$N$5", Relation:=1, Formulatext:="=6"

Thanks to falcad at "Windows Secrets Lounge" for posting this tip back in 2008.