79291310

Date: 2024-12-18 13:47:49
Score: 0.5
Natty:
Report link

I faced a similar issue while extracting data from a Dataverse table using Data Factory. Columns with null values were not being transferred to the CSV file or SQL Server target table.

Follow below steps for testing the flow and if is it working fine then you can do some automation.

  1. Create one pipeline and add copy activity
  2. Cerate a dataverse dataset(link service created using AD or SPN)
  3. In copy setup source dataverse data set and sink will be csv file.
  4. Create one parameter of the pipeline p_columnmappuing or setup variable and datatype should be string.
  5. Pass that parameter to mapping area in copy activity as below @json(p_columnmapping) Dataverse XML Script(Source Query)
<fetch>  
  <entity name="go_todo">  
    <attribute name="go_appointmentid" /> 
    <attribute name="go_category" /> 
    <attribute name="go_department" /> 
    <attribute name="go_group" /> 
    <attribute name="go_name" /> 
    <attribute name="go_rating" />  
    <attribute name="go_reason_negative_rating" /> 
    <attribute name="go_reason_positive_rating" />
    <attribute name="go_relevance" />  
    <attribute name="go_adaptionstatus" />
  </entity>  
</fetch>



Parameter column mapping:

    {"type":"TabularTranslator","mappings":[{"source":
    {"name":"go_appointmentid","type":"Guid"},"sink":{"name":"go_appointmentid","type":"String"}},{"source":{"name":"go_category","type":"String"},"sink":{"name":"go_category","type":"String"}},{"source":{"name":"go_department","type":"Int32"},"sink":{"name":"go_department","type":"String"}},{"source":{"name":"go_group","type":"String"},"sink":{"name":"go_group","type":"String"}},{"source":{"name":"go_name","type":"String"},"sink":{"name":"go_name","type":"String"}},{"source":{"name":"go_rating","type":"String"},"sink":{"name":"go_rating","type":"String"}},{"source":{"name":"go_reason_negative_rating","type":"Int32"},"sink":{"name":"go_reason_negative_rating","type":"String"}},{"source":{"name":"go_reason_positive_rating","type":"Int32"},"sink":{"name":"go_reason_positive_rating","type":"String"}},{"source":{"name":"go_relevance","type":"String"},"sink":{"name":"go_relevance","type":"String"}},{"source":{"name":"go_adaptionstatus","type":"String"},"sink":{"name":"go_adaptionstatus","type":"String"}}]}

[![enter image description here][1]][1]


  [1]: https://i.sstatic.net/H3EuDC2O.png
Reasons:
  • Blacklisted phrase (1): enter image description here
  • Long answer (-1):
  • Has code block (-0.5):
  • Low reputation (1):
Posted by: Jagdish Wagh