Calculation within Pandas dataframe group

debugcn Published at Dev

renjl0810

I've Pandas Dataframe as shown below. What I'm trying to do is, partition (or groupby) by BlockID, LineID, WordID, and then within each group use current WordStartX - previous (WordStartX + WordWidth) to derive another column, e.g., WordDistance to indicate the distance between this word and previous word.

This post Row operations within a group of a pandas dataframe is very helpful but in my case multiple columns involved (WordStartX and WordWidth).

 *BlockID  LineID  WordID  WordStartX  WordWidth     WordDistance
0        0       0       0         275        150                 0
1        0       0       1         431         96   431-(275+150)=6        
2        0       0       2         642         90   642-(431+96)=115
3        0       0       3         746        104   746-(642+90)=14
4        1       0       0         273         69         ...
5        1       0       1         352        151         ...
6        1       0       2         510         92
7        1       0       3         647         90
8        1       0       4         752        105**

Psidom

The diff() and shift() functions are usually helpful for calculation referring to previous or next rows:

df['WordDistance'] = (df.groupby(['BlockID', 'LineID'])
        .apply(lambda g: g['WordStartX'].diff() - g['WordWidth'].shift()).fillna(0).values)

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at2021-07-22

Comments

0 comments

From Dev

add timedelta data within a group in pandas dataframe

From Dev

Row operations within a group of a pandas dataframe

From Dev

Pandas Dataframe Complex Calculation

From Dev

pandas dataframe aggregate calculation

From Dev

Efficient calculation on a pandas dataframe

From Dev

pandas dataframe aggregate calculation

From Dev

update pandas.DataFrame within a group after .groupby()

From Dev

Pandas Dataframe: get average of first rows of each subgroup within a group

From Dev

How to filter a pandas dataframe to just the rows that show change within a group?

From Dev

Pandas DataFrame matrix based calculation

From Dev

Pandas: extract number from calculation within loop

From Dev

pandas sort within group then aggregation

From Dev

group by in Pandas DataFrame Python

From Dev

Group by fields in pandas dataframe

From Dev

within-group calculation of data.frame in R

From Dev

Calculation between groups in a Pandas multiindex dataframe

From Dev

propagate calculation along pandas dataframe rows

From Dev

Optimal Way to solve a pandas dataframe percentage calculation

From Dev

Pandas, multiple calculation per row of the dataframe

From Dev

reordering data within a pandas dataframe

From Dev

aggregating within multiindex dataframe pandas

From Dev

Converting Lists within Pandas Dataframe into New DataFrame

From Java

Extract the maximum value within each group in a dataframe

From Java

Group pandas dataframe in unusual way

From Dev

pandas dataframe group by uneven timestamp

From Dev

Multiple aggregation in group by in Pandas Dataframe

From Dev

Group by groups to Pandas Series/Dataframe

From Dev

Group by continuous indexes in Pandas DataFrame

From Java

group by pandas dataframe and select latest in each group

Related Related

Article