python: remove duplicate in a specific column
df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')python: remove duplicate in a specific column
df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')python - remove repeted columns in a df
df.loc[:,~df.T.duplicated(keep='first')]drop duplicates pandas first column
import pandas as pd
# making data frame from csv file
data = pd.read_csv("employees.csv")
# sorting by first name
data.sort_values("First Name", inplace = True)
# dropping ALL duplicte values
data.drop_duplicates(subset ="First Name",keep = False, inplace = True)
# displaying data
print(data)remove duplicates based on two columns in dataframe
df.drop_duplicates(['A','B'],keep= 'last')remove duplicate columns python dataframe
df = df.loc[:,~df.columns.duplicated()]pd.merge duplicate columns remove
#Create test data
df1 = pd.DataFrame(np.random.randint(100,size=(1000, 3)),columns=['A','B','C'])
df2 = pd.DataFrame(np.random.randint(100,size=(1000, 3)),columns=['B','C','D'])
pd.merge(df1, df2, how='inner', left_on=['B','C'], right_on=['B','C'])Copyright © 2021 Codeinu
Forgot your account's password or having trouble logging into your Account? Don't worry, we'll help you to get back your account. Enter your email address and we'll send you a recovery link to reset your password. If you are experiencing problems resetting your password contact us
