pandas dataframe to parquet s3
import awswrangler as wr
wr.pandas.to_parquet(
dataframe=df,
path="s3://my-bucket/key/my-file.parquet"
)pandas dataframe to parquet s3
import awswrangler as wr
wr.pandas.to_parquet(
dataframe=df,
path="s3://my-bucket/key/my-file.parquet"
)read parquet from s3 and convert to dataframe
import pyarrow.parquet as pq
import s3fs
dataset = pq.ParquetDataset('s3://<s3_path_to_folder_or_file>',
filesystem=s3fs.S3FileSystem(), filters=[('colA', '=', 'some_value'), ('colB', '>=', some_number)])
table = dataset.read()
df = table.to_pandas()Copyright © 2021 Codeinu
Forgot your account's password or having trouble logging into your Account? Don't worry, we'll help you to get back your account. Enter your email address and we'll send you a recovery link to reset your password. If you are experiencing problems resetting your password contact us
