(Old fashioned) Apology for using a swear word. ‘French’ is playfully used to explain a swear word which proper society people would have never heard, thusly it must be a foreign or French word!