Delimiter issue #73
Description
I am reading table from SF using soql:
df = spark.read.format("com.springml.spark.salesforce").option("soql",sql).option("queryAll","true").option("sfObject",sf_table).option("bulk",bulk).option("pkChunking",pkChunking).option("version","51.0").option("timeout","99999999").option("username", login).option("password",password).load()
and whenever there is a combination of double-qoutes and commas in string it messes up my table schema, like so:
in source:
Column A | Column B | Column C
000AB | "text with, comma" | 123XX
read from SF in df :
Column A | Column B | Column C
000AB | ""text with | comma""
Is there any option to avoid such cases when this comma is treated as delimiter?