Would you get the reference?

If someone trying to class up his language encountered a moment of frustration or disappointment and said, “Fudge…only I didn’t say fudge.”