Amazon Bedrock Knowledge Bases now supports custom connectors and ingestion of streaming data

Amazon Bedrock Knowledge Bases now supports custom connector and ingestion of streaming data, allowing developers to add, update, or delete data in their knowledge base through direct API calls. Amazon Bedrock Knowledge Bases offers fully-managed, end-to-end Retrieval-Augmented Generation (RAG) workflows to create highly accurate, low latency, secure, and custom GenAI applications by incorporating contextual information from your company's data sources. With this new capability, customers can easily ingest specific documents from custom data sources or Amazon S3 without requiring a full sync, and ingest streaming data without the need for intermediary storage.

This enhancement enables customers to ingest specific documents from any custom data source and reduce latency and operational costs for intermediary storage while ingesting streaming data. For instance, a financial services firm can now keep its knowledge base continuously updated with the latest market data, ensuring that their GenAI applications deliver the most relevant information to end-users. By eliminating time-consuming full syncs and storage steps, customers gain faster access to data, reducing latency, and improving application performance.

Customers can start using this feature either through the console or programmatically via the APIs. In the console, users can select a custom connector as the data source, then add documents, text, or base64 encoded text strings.

This capability is available in all regions where Amazon Bedrock Knowledge Bases is supported. There is no additional cost for using this new custom connector capability.

To learn more, visit Amazon Bedrock Knowledge Bases product documentation.