Skip to content

Issues with s3fs and "/" prefix #52

Open
@holtgrewe

Description

@holtgrewe

It looks like s3fs has issues with S3 and the latest pyfilesystem2? Maybe it's the prefix?

>>> from fs_s3fs import S3FS 
>>> fs = S3FS('my-bucket', aws_access_key_id="XXX", aws_secret_access_key="YYY")                                                                                               
>>>  fs.tree()                                                                                                                                                                                                                           
└── 89cf0ccb-a492-4495-9022-e53dc2ed1461
    └── error (resource '/89cf0ccb-a492-4495-9022-e53dc2ed1461' not found)
>>> import boto3
>>> s3 = boto3.resource('s3', aws_access_key_id="XXX", aws_secret_access_key="YYY") 
>>> my_bucket = s3.Bucket('my-bucket')
>>> list(my_bucket.objects.all())                                                                                                                                                                                                       
[s3.ObjectSummary(bucket_name='my-bucket' key='89cf0ccb-a492-4495-9022-e53dc2ed1461/about.md'),
 s3.ObjectSummary(bucket_name='my-bucket', key='89cf0ccb-a492-4495-9022-e53dc2ed1461/data.h5ad'),
 s3.ObjectSummary(bucket_name='my-bucket', key='89cf0ccb-a492-4495-9022-e53dc2ed1461/markers.csv')]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions