Split pandas dataframe into multiple dataframes based on null columns

Yen

I have a pandas dataframe as follows:

        a       b       c
    0   1.0     NaN     NaN
    1   NaN     7.0     5.0
    2   3.0     8.0     3.0
    3   4.0     9.0     2.0
    4   5.0     0.0     NaN

Is there a simple way to split the dataframe into multiple dataframes based on non-null values?

        a   
    0   1.0     

         b      c
    1    7.0    5.0

        a       b       c
    2   3.0     8.0     3.0
    3   4.0     9.0     2.0

        a       b      
    4   5.0     0.0
BEN_YO

Using groupby with dropna

for _, x in df.groupby(df.isnull().dot(df.columns)):
      print(x.dropna(1))

     a    b    c
2  3.0  8.0  3.0
3  4.0  9.0  2.0
     b    c
1  7.0  5.0
     a
0  1.0
     a    b
4  5.0  0.0

We can save them in dict

d = {y : x.dropna(1) for y, x in df.groupby(df.isnull().dot(df.columns))}

More Info using the dot to get the null column , if they are same we should combine them together

df.isnull().dot(df.columns)
Out[1250]: 
0    bc
1     a
2      
3      
4     c
dtype: object

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

From Dev

Split pandas dataframe into multiple dataframes based on null columns

From Dev

Pandas - Split dataframe into multiple dataframes based on dates?

From Dev

Split one dataframe to multiple sub-dataframes based on common columns in Pandas

From Dev

Split a Pandas Dataframe into multiple smaller dataframes based on empty rows

From Dev

Split a Pandas Dataframe into multiple Dataframes based on Triangular Number Series

From Java

split multiple columns in pandas dataframe by delimiter

From Dev

How to split a pandas dataframe into multiple columns

From Dev

Pandas Dataframe - Split string into multiple columns

From Dev

Split list in Pandas dataframe column into multiple columns

From Dev

Split a pandas dataframe into two dataframes efficiently based on some condition

From Dev

Split pandas dataframe into multiple dataframes with equal numbers of rows

From Dev

Filter pandas dataframe based on values in multiple columns

From Dev

Melt multiple columns pandas dataframe based on criteria

From Dev

pandas dataframe column based on row and multiple columns

From Dev

Create a Pandas dataframe with columns based on comparison of other dataframes

From Dev

Split a dataframe column in multiple columns based on multiple occurrences of a separator in R

From Dev

Pandas Split Dataframe into two Dataframes

From Dev

Separating a dataframe into multiple dataframes based on the index value in pandas

From Dev

How to split a dataframe column into multiple columns with a Pandas converter

From Dev

Split a text(with names and values) column into multiple columns in Pandas DataFrame

From Dev

Pandas Dataframe split multiple key values to different columns

From Dev

Need to split variable length data in a pandas dataframe column into multiple columns

From Dev

Merge Multiple Duplicate rows based on multiple columns in Pandas.Dataframe

From Dev

Split a dataframe in multiple columns in R

From Dev

Selecting rows from a Dataframe based on values in multiple columns in pandas

From Dev

Conditional replacement of multiple columns based on column values in pandas DataFrame

From Dev

How to filter pandas dataframe on multiple columns based on a dictionary?

From Dev

select values based on condition on multiple columns for pandas dataframe in python

From Dev

Sorting multiple Pandas Dataframe Columns based on the sorting of one column

Related Related

  1. 1

    Split pandas dataframe into multiple dataframes based on null columns

  2. 2

    Pandas - Split dataframe into multiple dataframes based on dates?

  3. 3

    Split one dataframe to multiple sub-dataframes based on common columns in Pandas

  4. 4

    Split a Pandas Dataframe into multiple smaller dataframes based on empty rows

  5. 5

    Split a Pandas Dataframe into multiple Dataframes based on Triangular Number Series

  6. 6

    split multiple columns in pandas dataframe by delimiter

  7. 7

    How to split a pandas dataframe into multiple columns

  8. 8

    Pandas Dataframe - Split string into multiple columns

  9. 9

    Split list in Pandas dataframe column into multiple columns

  10. 10

    Split a pandas dataframe into two dataframes efficiently based on some condition

  11. 11

    Split pandas dataframe into multiple dataframes with equal numbers of rows

  12. 12

    Filter pandas dataframe based on values in multiple columns

  13. 13

    Melt multiple columns pandas dataframe based on criteria

  14. 14

    pandas dataframe column based on row and multiple columns

  15. 15

    Create a Pandas dataframe with columns based on comparison of other dataframes

  16. 16

    Split a dataframe column in multiple columns based on multiple occurrences of a separator in R

  17. 17

    Pandas Split Dataframe into two Dataframes

  18. 18

    Separating a dataframe into multiple dataframes based on the index value in pandas

  19. 19

    How to split a dataframe column into multiple columns with a Pandas converter

  20. 20

    Split a text(with names and values) column into multiple columns in Pandas DataFrame

  21. 21

    Pandas Dataframe split multiple key values to different columns

  22. 22

    Need to split variable length data in a pandas dataframe column into multiple columns

  23. 23

    Merge Multiple Duplicate rows based on multiple columns in Pandas.Dataframe

  24. 24

    Split a dataframe in multiple columns in R

  25. 25

    Selecting rows from a Dataframe based on values in multiple columns in pandas

  26. 26

    Conditional replacement of multiple columns based on column values in pandas DataFrame

  27. 27

    How to filter pandas dataframe on multiple columns based on a dictionary?

  28. 28

    select values based on condition on multiple columns for pandas dataframe in python

  29. 29

    Sorting multiple Pandas Dataframe Columns based on the sorting of one column

HotTag

Archive