Tuesday, 21 May 2024

Salesforce Ingestion API

 This Ingestion API will be helpful to send interaction-based data to Data Cloud in near real-time and

this is getting processed every 15 minutes.


Salesforce Ingestion API is a RESTful interface that allows you to load data into Data Cloud programmatically. This API supports two patterns:


Streaming Pattern, which uses JSON as its format and is suitable for loading data in micro-batches through the REST API.

Bulk Pattern, on the other hand, employs the CSV format and loads data using jobs.  


Note :

The streaming pattern accepts incremental updates to a dataset as those changes are captured, while the bulk pattern accepts CSV files in cases where data syncs occur periodically.


When to use Streaming vs Bulk ingestion?


Streaming Ingestion :

When updating small micro-batches of records in near real-time.

When using data source systems that are built on modern streaming architectures.

When creating Change Data Capture events.

When consuming data from webhooks.


Bulk Ingestion :


When moving large volumes of data on a daily, weekly, or monthly schedule.

When using legacy systems, where you can only export data during off-peak hours.

When using a new Data Cloud org that you want to backfill with 30, 60, or 90+ days of data

No comments:

Post a Comment