Wesco needed a high-performance data platform capable of continuously processing and integrating raw data flows from its e-commerce architecture. This architecture relies on key technologies such as Kinesis, AWS Glue, and Delta Lake. The goal was to implement a robust system that could quickly extract relevant and essential insights to support strategic decision-making, optimize business operations, and continuously enhance the customer experience.
It was crucial to efficiently interface with the existing system to ensure a seamless integration of new features without disrupting ongoing operations. Identifying key performance indicators (KPIs) and providing relevant data visualization through Looker (GCP) were also essential to facilitate data interpretation and support fast, informed decision-making at all levels of the organization.
Our mission was to implement a modern and high-performance lakehouse for Wesco.
One of the key advantages of this lakehouse is its ability to significantly reduce data processing times and volumes, providing access to faster and more relevant insights.
With the implementation of Wesco’s lakehouse, integrating advanced technologies for data collection, processing, and visualization (Looker), users can now access rich, up-to-date insights, optimizing both operational and strategic processes. The use of Maxwell Daemon at the Log MySQL level, combined with AWS managed pipeline services, has proven to be an effective approach, delivering significant results in reducing pipeline maintenance time and costs while enhancing upstream flow monitoring.
Finally, the consolidated dashboards provide a unified and consistent view of key performance indicators, enabling real-time activity tracking and facilitating faster, more informed decision-making.
A strategic and technical approach to data visualization is essential. The client needs to make informed decisions based on clear and actionable insights.
Maxime ROUSSEAU
Directeur Conseil Smile