Rockset
  • Loading Data

Ingestion Errors

This page collects all kinds of the ingestion errors a source may hit, classified by source and exception type.

What are the type of exceptions?

You will see exception messages shown on the collection page when ingester errors occur. There are 2 types of exceptions:

  1. Non retryable exception: This is fatal and the source is in an unrecoverable state, for example a source not found exception.
  2. Soft retryable exception: This type of exception will be retried for 2 to 3 hours with a long backoff before entering permanent error state, for example an authentication error.

Below we listed the all the possible exceptions by source type:

Azure Blob Storage

ExceptionTypeMessageError Code
BlobStorageExceptionNon retryableAzure Blob Storage bucket not foundN/A
BlobStorageExceptionSoft retryableAzure Blob Storage bucket does not have list object permissions setN/A
BlobStorageExceptionSoft retryableAzure Blob Storage bucket does not have list object permissions setN/A

Amazon DynamoDB

ExceptionTypeMessageError Code
TrimmedDataAccessExceptionNon retryableReached trimmed data for DynamoDB shardN/A
ResourceNotFoundExceptionNon retryableDynamoDB resource not foundN/A
AmazonDynamoDBExceptionNon retryableExport failed for DynamoDB tableExportConflictException
TableNotFoundExceptionNon retryableDynamoDB resource not foundN/A
AmazonDynamoDBExceptionSoft retryableError occurred while accessing DynamoDB tableUnrecognizedClientException
AmazonDynamoDBExceptionSoft retryableError occurred while accessing DynamoDB tableAccessDeniedException

Google Cloud Storage

ExceptionTypeMessageError Code
StorageExceptionNon retryableGCS bucket not foundN/A
StorageExceptionSoft retryableGCS bucket does not have list object permissions setN/A
StorageExceptionSoft retryableGCS bucket does not have list object permissions setN/A

Kafka

ExceptionTypeMessageError Code
UnsupportedVersionExceptionNon retryableEncountered unsupported version failure when establishing connection to the Kafka clusterN/A
UnknownTopicOrPartitionExceptionNon retryableThe Kafka topic is not known to the brokerN/A
AuthenticationExceptionSoft retryableThe Kafka connection didn't make it through due to authentication failure, please check back your security settingsN/A
AuthorizationExceptionSoft retryableThe Kafka connection didn't make it through due to authorization failure, please check back your security settingsN/A
ConfigExceptionSoft retryableFailed to connect to Kafka due to invalid supplied configurationN/A

Amazon Kinesis

ExceptionTypeMessageError Code
ResourceNotFoundExceptionNon retryableAmazon Kinesis Stream not foundN/A
KMSAccessDeniedExceptionSoft retryableError occurred while accessing Amazon Kinesis StreamN/A
KMSDisabledExceptionSoft retryableError occurred while accessing Amazon Kinesis StreamN/A
KMSInvalidStateExceptionSoft retryableError occurred while accessing Amazon Kinesis StreamN/A
KMSNotFoundExceptionSoft retryableError occurred while accessing Amazon Kinesis StreamN/A
KMSOptInRequiredExceptionSoft retryableError occurred while accessing Amazon Kinesis StreamN/A
AmazonKinesisExceptionSoft retryableInvalid AWS credentials specified for Amazon KinesisUnrecognizedClientException
AmazonKinesisExceptionSoft retryableInvalid AWS credentials specified for Amazon KinesisInvalidSignatureException
AmazonKinesisExceptionSoft retryableError occurred while accessing Amazon Kinesis StreamAccessDeniedException

MongoDB Atlas

ExceptionTypeMessageError Code
MongoConfigurationExceptionNon retryableError configuring the MongoDB clientN/A
MongoSecurityExceptionSoft retryableAuthentication failed to MongoDB hostN/A
MongoTimeoutExceptionSoft retryableUnable to reach MongoDB cluster. Please ensure that you have added Rockset provided IP addresses to IP Access List under Network Access in your clusterN/A

Amazon S3

ExceptionTypeMessageError Code
AmazonS3ExceptionNon retryableS3 bucket not foundNoSuchBucket
AmazonS3ExceptionSoft retryableS3 bucket does not have get objects permission setAccessDenied
AmazonS3ExceptionSoft retryableS3 bucket does not have get objects permission setAllAccessDisabled
AmazonS3ExceptionSoft retryableUnable to get object in S3 bucketInvalidAccessKeyId
AmazonS3ExceptionSoft retryableUnable to access S3 bucket403 Forbidden

Amazon Security Token Service

ExceptionTypeMessageError Code
AWSSecurityTokenServiceExceptionSoft retryableAuthentication failed for AWS cross-account role integrationAccessDenied
AWSSecurityTokenServiceExceptionSoft retryableAuthentication failed for AWS cross-account role integrationAccessDeniedException