An Azure service for ingesting, preparing, and transforming data at scale.
How to pass arrays/complex types as Input Columns to Flowlets in Azure Data Factory
Hello everyone!
I've got an issue when trying to pass arrays as Input Columns to Flowlets in ADF.
I'll be attaching images of how Flowlet is called in the Dataflow and the actual error message I see when I try to Validate the Dataflow.
Image 1: how flowlet is called in Dataflow. Input Columns and their types.
My flowlet receives some string parameters and a complex type: string[]
Image 2:
Image 3: Flowlet Input
The input columns are properly linked to the Flowlet expected fields/types. However, when validating/trying to do data preview in Flowlet, I see this error message:
Image 4:
We can see that both input fields are string[], but I am still receiving "Incompatible data type mapping from X to Y" error message. I've only faced this issue with arrays (Although I haven't tried with other complex types).
May I get some help on determining root cause or if this is a known issue?