turn check raise spot

Had a weird spot last night in a mid-stakes live game, cash not a tourney. Flopped decent equity with a flush draw, c-bet small in position and got called. Turn brought an overcard and a third suit, and when checked to me, I bet again and instantly got check-raised by the tightest player at the table. Not a huge check-raise but enough to make me uncomfortable.

I see people always say you have to call here if you have "pot odds" or strong equity, but does that really matter if the guy never bluffs and you end up paying off when your draw comes in? I could maybe jam but that seems crazy against this specific player. Just wondering how others approach these spots and if it really makes sense to just use math with no reads. When is it worth ignoring the odds and just folding?