The different synchronization methods for Data Platforms at Carrefour
About the talk
The largest companies, made up of multiple countries and/or subsidiaries, have several local data platforms. At Carrefour, we have a federated model where each country has its own data platform. As long as the data platforms are used locally, there is no issue. However, when headquarters wishes to consolidate and aggregate data from different platforms to create global applications, analytical dashboards, or centralized operations, many challenges arise.
Beyond governance and data documentation, data synchronization is a real challenge. When should data be retrieved from each platform to cross-reference and aggregate them? Several solutions are possible: using a scheduler, using an orchestrator, or using an event-driven architecture, among others. We will review these solutions, their advantages and disadvantages based on use cases and requirements.
A demo and interactions with participants are planned for this session.