Bugs: Browse | Submit New | Admin

[#26817] Not showing all objects from AMAZON Bucket.

Date:
2009-08-01 10:36
Priority:
3
Submitted By:
Let me Ask (letsask)
Assigned To:
Nobody (None)
Category:
None
State:
Open
Summary:
Not showing all objects from AMAZON Bucket.

Detailed description
Hi all,

I have been facing a little problem while listing objects from Amazon Bucket.
I am using AWS::s3.

Following is the part of my code that lists object names from Particular Bucket.


**********************
$counter=0
objs = AWS::S3::Bucket.objects($BUCKET)
    	objs.each do |o|
		$counter+=1
        	         filename = o.key
		$stderr.puts "[#{Time.new}]:[#{$counter}]#{filename}"
	end
**********************

And on output it prints just first 1000 records though I have around 3000 objects in $BUCKET.

Any help would be appreciated.

Thanks

---LetsAsk

Add A Comment: Notepad

Please login


Followup

Message
Date: 2011-09-07 20:18
Sender: Brian Glusman

This may be related to a bug I just encountered, in which
@bucket["/path/to/object"] fails to return an object
that was present IF @bucket.objects(:prefix =>
"/path/elsewhere/used")  has been accessed more recently
than :prefix => "/path/to/whatever/".  Employing
a workaround of explicitly setting prefix before accessing objects
in other paths.
Date: 2009-08-03 08:45
Sender: Let me Ask

I haven't got this issue fixed but seem to derive something.

This might have happenned either AWS::S3 or Amazon putting 
limit on listing the objects from BUCKETS.
i.e. In case of AWS::S3 the default (or maximum) value for 
parameter :max_keys of AWS::S3::Bucket.objects() seems to 
be 1000.

Please have your ideas.

Attached Files:

Name Description Download
No Files Currently Attached

Changes:

No Changes Have Been Made to This Item