Help with Delta load pyspark script error.

A

AC (BI)

Script below is from Notebook. Same template has been used for other delta tables successfully - why not this?! Thanks in advance.# Creating my dataframe (source data)dfNewData = spark.read.load('abfss://*** Email address is removed for privacy ***/bronze/C365 compliance/entities/', format='parquet')dfNewData.createOrReplaceTempView('entities')-------------------------------------------------------------------------------------------------------- Using SQL to adopt CETAS approach - creating Delta table if not there.%%sqlCREATE TABLE IF NOT EXISTS C365.entitiesUSING DELTALOCATION 'abfss://root@

Continue reading...
 
Back
Top Bottom