Jan-18-2022, 08:49 AM
(This post was last modified: Jan-18-2022, 10:26 AM by Yoriz.
Edit Reason: Added code tags
)
Hello,
using synapse pipeline, I generate a .parquet file with data in columns such as HoseNo (Which contains numbers), ClientName (which contains text), etc.
In pyspark, I check for the type of the value in each column and it shows as str for every single field.
Do you know why I do not get number columns as integer datatypes?
example:
Thank you
using synapse pipeline, I generate a .parquet file with data in columns such as HoseNo (Which contains numbers), ClientName (which contains text), etc.
In pyspark, I check for the type of the value in each column and it shows as str for every single field.
Do you know why I do not get number columns as integer datatypes?
example:
type(row["HouseNo"])result:
Output:<class 'str'>
p.s. I am unable to placed the above simple python code in code snipt using the button in the thread.Thank you