検索
検索

Is there any way to do Custom dynamic mapping of different number of columns in Azure dataflow or any other options to achieve this?

debugcn 投稿 Dev
3
Abuchand

My source (CSV file in ADLS) has header record(3 columns) , detail records(5 columns) and trailer record(2 columns) . The header record has less number of columns than the detail records. When I try to convert this csv file to parquet, i m getting the column count error using copy activity in ADF. So I tried using dataflow to do the mapping but still its considering only three columns and ignoring the other two columns in the detail records. So please let me know how to achieve this using dataflow or any other azure services.

Sample Data

1|~filename|~30122020
2|~Mark|~cse|~378|~2020
2|~John|~|~430|~2019
99|~3
Leon Yue

Data factory will consider the first row as the column schema. Just for now, We can't do that with Data factory actives or Data Flow.

この記事はインターネットから収集されたものであり、転載の際にはソースを示してください。

侵害の場合は、連絡してください[email protected]

編集
0

コメントを追加

0
サインイン

関連記事

分類Dev

Any other way to solve this query?

分類Dev

Delete any number of Columns in 2D dynamic array and resize the matrix size after column deletion

分類Dev

Is there any way to define own options in *.pc files except standard options

分類Dev

Any way to achieve something like overriding an operator in kotlin?

分類Dev

Is there any other way to solve this Mathematical problem in R?

分類Dev

Is there any other way then document.write?

分類Dev

More Pythonic way to turn any number of different lists or tuples into one list

分類Dev

Is there a way to do a select statement and union 2 column, replacing any NULL values in one with information from the other

分類Dev

Mapping custom sidebar template to any document named "index.rst"

分類Dev

Idiomatic way to cast a string to any other primitive type

分類Dev

Is there any way to get props in React class other than in render method?

分類Dev

The correct way to pass the connectionstring from Startup to any other controller

分類Dev

is there any way of trasnfering a application running on one system to other system?

分類Dev

Is there any way to add an object other than CString to a CComboBox in MFC?

分類Dev

Vue multiple v-for loop ... is there any other way

分類Dev

Is there any method to find number of columns having data in pyspark data frame

分類Dev

any efficient way to count binary values in columns of big data table?

分類Dev

Rails: Is there any way to rename columns without modifying the controllers?

分類Dev

Is there any way to mangae large number of (600+) if condition

分類Dev

Is there any way to create buttons in a for loop with the same function but with different attributes?

分類Dev

Is there any way to view current index state in Azure CosmosDB

分類Dev

Pandas - Stack dataframes with different name and number of columns on top of each other

分類Dev

NSPredicate ANY with multiple columns

分類Dev

How do I hide a canvas or any other object?

分類Dev

Dynamic field mapping in Azure Search

分類Dev

How do I replace a whitespace with any number of whitespaces?

分類Dev

Any way to use EmbeddedNativeLibrary?

分類Dev

Any way to delay PaintComponent?

分類Dev

Is there any way to do group-by and count at once in Clojure?

Related 関連記事

  1. 1

    Any other way to solve this query?

  2. 2

    Delete any number of Columns in 2D dynamic array and resize the matrix size after column deletion

  3. 3

    Is there any way to define own options in *.pc files except standard options

  4. 4

    Any way to achieve something like overriding an operator in kotlin?

  5. 5

    Is there any other way to solve this Mathematical problem in R?

  6. 6

    Is there any other way then document.write?

  7. 7

    More Pythonic way to turn any number of different lists or tuples into one list

  8. 8

    Is there a way to do a select statement and union 2 column, replacing any NULL values in one with information from the other

  9. 9

    Mapping custom sidebar template to any document named "index.rst"

  10. 10

    Idiomatic way to cast a string to any other primitive type

  11. 11

    Is there any way to get props in React class other than in render method?

  12. 12

    The correct way to pass the connectionstring from Startup to any other controller

  13. 13

    is there any way of trasnfering a application running on one system to other system?

  14. 14

    Is there any way to add an object other than CString to a CComboBox in MFC?

  15. 15

    Vue multiple v-for loop ... is there any other way

  16. 16

    Is there any method to find number of columns having data in pyspark data frame

  17. 17

    any efficient way to count binary values in columns of big data table?

  18. 18

    Rails: Is there any way to rename columns without modifying the controllers?

  19. 19

    Is there any way to mangae large number of (600+) if condition

  20. 20

    Is there any way to create buttons in a for loop with the same function but with different attributes?

  21. 21

    Is there any way to view current index state in Azure CosmosDB

  22. 22

    Pandas - Stack dataframes with different name and number of columns on top of each other

  23. 23

    NSPredicate ANY with multiple columns

  24. 24

    How do I hide a canvas or any other object?

  25. 25

    Dynamic field mapping in Azure Search

  26. 26

    How do I replace a whitespace with any number of whitespaces?

  27. 27

    Any way to use EmbeddedNativeLibrary?

  28. 28

    Any way to delay PaintComponent?

  29. 29

    Is there any way to do group-by and count at once in Clojure?

ホットタグ

アーカイブ