Monday, 26 August 2024

Data flow into and outside of Data Cloud

 Here is the summary of Data flow into and outside of Data Cloud(DC):


Step 1: Data will flow as a Data Streams into Data cloud in three different ways(Batch,Streaming,Virtual)


 Batch : Sales or Service or Other Salesforce objects will flow into DC from multiple Orgs in every 10mins,B2C Commerce Cloud or Salesforce Marketing Cloud will flow into DC from each Org in every 1 hour or every 1 day.

 Streaming : Experience Cloud or Websites or Mobile Apps through APIs and SDKs from multiple sources into DC in every 2 mins or immediately.

 Virtual : Snowflake Data into DC immediately.


Step 2: The data inside DC gets stored into Data Lake Objects (DLOs)


Step 3: From DLOs we do the Data transformations and Mappings into other DC specific object called Data Model Objects(DMOs).


Step 4: The Data from DMOs takes either of or three different paths:

 Path 1 : The data from DMOs will flow into Calculated Insights(CIs) in every 1 hour. From CIs to Data Actions(DA) in every 1 hour.


 Path 2 : The data from DMOs will flow into Streaming Insights(SIs) in every 5 mins. From SIs to Data Actions(DA) in every 1 hour.


 Path 3 : The data from DMOs will flow into Identity Resolution (IRs) and from IRs to Unified Profiles(UPs) in every 1 day.


Step 5: The Data from the above 2 paths Path 1 and 2 stored in Data Actions will then Transformed and sent into Sales Cloud or Service Cloud or Slack or SFMC Journeys in every 1 hour.


Step 6: The Data from the above path 3 and the Data in SI of path 2 will be sent to Segmentation in every 1 hour. Then to Activation. 


Step 7: The Data from Activation will be sent to SFMC,B2C Commerce Cloud,AWS and other destinations through APIs.


In a nutshell, The data is collected from several sources in multiple formats will be Mapped,Unified, Enriched as a single profile and will be stored back into Target systems for further utilzations.



No comments:

Post a Comment