KiCad bom wizard should be able to output the format that you want. If you are happy to create your own template.
For example, by default it will use the internal CSV template located here. If you make a copy of that somewhere in your computer and update it so that the commas are replace with a safe delimiter then that should do it.
After that you just need to pass that template to the plugin like so:
kicad_bom_wizard "%I" "%O.csv" "/PATH_TO_MY_TEMPLATE/CSV"
That said, I wonder if I should update the original CSV template so that it encloses all the values inside quotes by default. That should fix your issue and make it more robust.