pandas series or tidy dataframe: index level values to dataframe columns

TNT

I have a tidy Dataframe (which I'm not sure how to produce from scratch) such as:

signal condition  epoch  time value  
0             A      0  -1100  0.12  
1             A      0  -1080  0.09     
2             A      0  -1060  0.08  
...

With several conditions A,B,C. I want to get a DataFrame with multiindex, and the values of value column as values in the new (and only) columns A, B, C so in the end it looks like:

value          A     B     C
epoch time           
0    -1100   0.12   0.23   0.09
     -1080   0.09   0.22   0.10
     -1060   0.08   0.19   0.06
...

I tried to first put everything except value into the index with set_index(['condition','epoch','time']) and then transpose or pivot but can't get it right somehow (transpose gives me hierarchical columns and pivot KeyError) I tried e.g.: df.pivot(('epoch','time'),'condition')

pansen

You were on the right track using pivot which is explicitly designed for such long-to-wide transformations:

# show dummy df 
print(df)

    signal  condition   epoch   time    value
0   0       A           0       -1100   0.12
1   1       A           0       -1080   0.09
2   2       A           0       -1060   0.08
3   0       B           0       -1100   0.42
4   1       B           0       -1080   0.29
5   2       B           0       -1060   0.18
6   0       C           0       -1100   0.32
7   1       C           0       -1080   0.59
8   2       C           0       -1060   0.38

# pivot
pd.pivot_table(df, values="value", columns="condition", index=["epoch", "time"])

condition       A       B       C
epoch   time            
0       -1100   0.12    0.42    0.32
        -1080   0.09    0.29    0.59
        -1060   0.08    0.18    0.38

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

From Dev

Reshaping pandas dataframe, converting values of an existing column into new lower level columns with index ignored

From Dev

Resample a 'tidy' dataframe with pandas

From Dev

Resample a 'tidy' dataframe with pandas

From Java

pandas dataframe groupby index and convert row values into columns

From Dev

Summing values from pandas dataframe columns depending on row index value

From Dev

Summing values from pandas dataframe columns depending on row index value

From Dev

reshape a pandas dataframe index to columns

From Dev

How to convert Series index into two columns as a DataFrame

From Dev

How to convert Series index into two columns as a DataFrame

From Dev

Pandas Divide dataframe by index values

From Dev

Converting a pandas multi-index series to a dataframe by using second index as columns

From Dev

Index DataFrame with list or series of boolean values (not statements)

From Dev

Add Series to DataFrame with additional index values

From Dev

Construct new pandas Dataframe with multi level index

From Dev

Pandas/Python Converting a series with two columns into a dataframe

From Dev

Pandas/Python Converting a series with two columns into a dataframe

From Java

Selecting a row of pandas series/dataframe by integer index

From Dev

Pandas DataFrame fails on index but Series succeeds

From Dev

Multiplying Multi Index Pandas Series and DataFrame

From Dev

Indexing a Pandas Dataframe using the index of a Series

From Dev

Convert pandas series with list values into boolean dataframe

From Dev

Convert pandas Series with categories as values to DataFrame mask

From Dev

Use index values as category values in pandas dataframe

From Dev

How do you use pandas.DataFrame columns as index, columns, and values?

From Dev

Pandas how to get a list of rows that have multiple values for an index level in a Multiindex DataFrame

From Dev

Pandas how to get a list of rows that have multiple values for an index level in a Multiindex DataFrame

From Dev

filter pandas dataframe on one level of a multi level index

From Dev

pandas: Split separated values in a DataFrame column (one Series) into multiple Columns. Elegant solutions?

From Dev

Pandas stacking DataFrame and concatenating name of columns with index

Related Related

  1. 1

    Reshaping pandas dataframe, converting values of an existing column into new lower level columns with index ignored

  2. 2

    Resample a 'tidy' dataframe with pandas

  3. 3

    Resample a 'tidy' dataframe with pandas

  4. 4

    pandas dataframe groupby index and convert row values into columns

  5. 5

    Summing values from pandas dataframe columns depending on row index value

  6. 6

    Summing values from pandas dataframe columns depending on row index value

  7. 7

    reshape a pandas dataframe index to columns

  8. 8

    How to convert Series index into two columns as a DataFrame

  9. 9

    How to convert Series index into two columns as a DataFrame

  10. 10

    Pandas Divide dataframe by index values

  11. 11

    Converting a pandas multi-index series to a dataframe by using second index as columns

  12. 12

    Index DataFrame with list or series of boolean values (not statements)

  13. 13

    Add Series to DataFrame with additional index values

  14. 14

    Construct new pandas Dataframe with multi level index

  15. 15

    Pandas/Python Converting a series with two columns into a dataframe

  16. 16

    Pandas/Python Converting a series with two columns into a dataframe

  17. 17

    Selecting a row of pandas series/dataframe by integer index

  18. 18

    Pandas DataFrame fails on index but Series succeeds

  19. 19

    Multiplying Multi Index Pandas Series and DataFrame

  20. 20

    Indexing a Pandas Dataframe using the index of a Series

  21. 21

    Convert pandas series with list values into boolean dataframe

  22. 22

    Convert pandas Series with categories as values to DataFrame mask

  23. 23

    Use index values as category values in pandas dataframe

  24. 24

    How do you use pandas.DataFrame columns as index, columns, and values?

  25. 25

    Pandas how to get a list of rows that have multiple values for an index level in a Multiindex DataFrame

  26. 26

    Pandas how to get a list of rows that have multiple values for an index level in a Multiindex DataFrame

  27. 27

    filter pandas dataframe on one level of a multi level index

  28. 28

    pandas: Split separated values in a DataFrame column (one Series) into multiple Columns. Elegant solutions?

  29. 29

    Pandas stacking DataFrame and concatenating name of columns with index

HotTag

Archive