Exactly, it’s not a thing. Let bygones be bygones is the closest saying which means let’s not dwell on the past.
“What’s by is by” is entirely constructed by Steve Yockey for Dean’s reaction to the vocal “what’s bi is bi” – ie BISEXUAL.
Right after being asked about having anal sex and looking oh so awkward about it while denying he knows what it even means sheesh Rowena I’m not that kinda guy! *deep swallow* Ummmm…
I mean this is BARELY even subtext at this point.