public class GetRecordsRequest extends AmazonWebServiceRequest implements java.io.Serializable
Gets data records from a Kinesis data stream's shard.
Specify a shard iterator using the ShardIterator
parameter. The
shard iterator specifies the position in the shard from which you want to
start reading data records sequentially. If there are no records available in
the portion of the shard that the iterator points to, GetRecords
returns an empty list. It might take multiple calls to get to a portion of
the shard that contains records.
You can scale by provisioning multiple shards per stream while considering
service limits (for more information, see Amazon Kinesis Data Streams Limits in the Amazon Kinesis Data Streams
Developer Guide). Your application should have one thread per shard, each
reading continuously from its stream. To read from a stream continually, call
GetRecords in a loop. Use GetShardIterator to get the shard
iterator to specify in the first GetRecords call. GetRecords
returns a new shard iterator in NextShardIterator
. Specify the
shard iterator returned in NextShardIterator
in subsequent calls
to GetRecords. If the shard has been closed, the shard iterator can't
return more data and GetRecords returns null
in
NextShardIterator
. You can terminate the loop when the shard is
closed, or when the shard iterator reaches the record with the sequence
number or other attribute that marks it as the last record to process.
Each data record can be up to 1 MB in size, and each shard can read up to 2
MB per second. You can ensure that your calls don't exceed the maximum
supported size or throughput by using the Limit
parameter to
specify the maximum number of records that GetRecords can return.
Consider your average record size when determining this limit.
The size of the data returned by GetRecords varies depending on the
utilization of the shard. The maximum size of data that GetRecords can
return is 10 MB. If a call returns this amount of data, subsequent calls made
within the next five seconds throw
ProvisionedThroughputExceededException
. If there is insufficient
provisioned throughput on the stream, subsequent calls made within the next
one second throw ProvisionedThroughputExceededException
.
GetRecords won't return any data when it throws an exception. For this
reason, we recommend that you wait one second between calls to
GetRecords; however, it's possible that the application will get
exceptions for longer than 1 second.
To detect whether the application is falling behind in processing, you can
use the MillisBehindLatest
response attribute. You can also
monitor the stream using CloudWatch metrics and other mechanisms (see Monitoring
in the Amazon Kinesis Data Streams Developer Guide).
Each Amazon Kinesis record includes a value,
ApproximateArrivalTimestamp
, that is set when a stream
successfully receives and stores a record. This is commonly referred to as a
server-side time stamp, whereas a client-side time stamp is set when a data
producer creates or sends the record to a stream (a data producer is any data
source putting data records into a stream, for example with
PutRecords). The time stamp has millisecond precision. There are no
guarantees about the time stamp accuracy, or that the time stamp is always
increasing. For example, records in a shard or across a stream might have
time stamps that are out of order.
Constructor and Description |
---|
GetRecordsRequest() |
Modifier and Type | Method and Description |
---|---|
boolean |
equals(java.lang.Object obj) |
java.lang.Integer |
getLimit()
The maximum number of records to return.
|
java.lang.String |
getShardIterator()
The position in the shard from which you want to start sequentially
reading data records.
|
int |
hashCode() |
void |
setLimit(java.lang.Integer limit)
The maximum number of records to return.
|
void |
setShardIterator(java.lang.String shardIterator)
The position in the shard from which you want to start sequentially
reading data records.
|
java.lang.String |
toString()
Returns a string representation of this object; useful for testing and
debugging.
|
GetRecordsRequest |
withLimit(java.lang.Integer limit)
The maximum number of records to return.
|
GetRecordsRequest |
withShardIterator(java.lang.String shardIterator)
The position in the shard from which you want to start sequentially
reading data records.
|
clone, getCloneRoot, getCloneSource, getGeneralProgressListener, getRequestClientOptions, getRequestCredentials, getRequestMetricCollector, setGeneralProgressListener, setRequestCredentials, setRequestMetricCollector, withGeneralProgressListener, withRequestMetricCollector
public java.lang.String getShardIterator()
The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard.
Constraints:
Length: 1 - 512
The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard.
public void setShardIterator(java.lang.String shardIterator)
The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard.
Constraints:
Length: 1 - 512
shardIterator
- The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard.
public GetRecordsRequest withShardIterator(java.lang.String shardIterator)
The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard.
Returns a reference to this object so that method calls can be chained together.
Constraints:
Length: 1 - 512
shardIterator
- The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard.
public java.lang.Integer getLimit()
The maximum number of records to return. Specify a value of up to 10,000.
If you specify a value that is greater than 10,000, GetRecords
throws InvalidArgumentException
.
Constraints:
Range: 1 - 10000
The maximum number of records to return. Specify a value of up to
10,000. If you specify a value that is greater than 10,000,
GetRecords throws InvalidArgumentException
.
public void setLimit(java.lang.Integer limit)
The maximum number of records to return. Specify a value of up to 10,000.
If you specify a value that is greater than 10,000, GetRecords
throws InvalidArgumentException
.
Constraints:
Range: 1 - 10000
limit
-
The maximum number of records to return. Specify a value of up
to 10,000. If you specify a value that is greater than 10,000,
GetRecords throws InvalidArgumentException
.
public GetRecordsRequest withLimit(java.lang.Integer limit)
The maximum number of records to return. Specify a value of up to 10,000.
If you specify a value that is greater than 10,000, GetRecords
throws InvalidArgumentException
.
Returns a reference to this object so that method calls can be chained together.
Constraints:
Range: 1 - 10000
limit
-
The maximum number of records to return. Specify a value of up
to 10,000. If you specify a value that is greater than 10,000,
GetRecords throws InvalidArgumentException
.
public java.lang.String toString()
toString
in class java.lang.Object
Object.toString()
public int hashCode()
hashCode
in class java.lang.Object
public boolean equals(java.lang.Object obj)
equals
in class java.lang.Object
Copyright © 2018 Amazon Web Services, Inc. All Rights Reserved.