I lived just outside Houston for under a year. Best city I have ever visited/ lived in. IMO 1000% better than Toronto in every way, (unless you like winter).
The heat can be brutal during 2-3 summer months, but it's kind of like January-March here; everyone kind of just hibernates.
The people are so incredibly nice, respectful and friendly, the city is so clean and cost of living was dirt cheap.
I remember when I came back to Toronto; the exact same food products at the grocery store were 3x the price, everyone seemed so utterly miserable and the city looked like a garbage dump in comparison. Toronto has only gone downhill since then.
I definitely think you are making the right move.
The quality of life down there is astoundingly better.