Responsibilities & achievements

I joined their most critical project: an analytical platform responsiveness improvement. Users had to wait hours to see their data updated. Also, the AWS bill was huge. Our solution was to migrate the App’s data infra from a 1-run-per-day high-cost NoSQL platform to an event-driven architecture. My part was to implement an update consumption and batch preparation mechanism. My solution could handle approximately 1k RPM on the smallest MWAA deployment option. The overall implementation resulted in a dramatic increase in application responsiveness. The average data update time becomes equal to 15 mins. Overall cost decrease was estimated at 40%.

Responsibilities & achievements

My first project was to bring a single source of truth for customers’ pricing reporting needs. The solution, which was produced within my mentorship of an intern colleague, was able to handle approx 1 TB of data in less than 15 minutes. My second project was to introduce the centralized source of demand and assortment data. I played a leading role in an assortment of reporting parts. My solution could handle the heavy processing of 10 billion data in approximately 30 minutes. While implementing this project also, a Data Quality solution was found, where I played both engineering and technical mentorship roles.

Responsibilities & achievements

My task was to design several ETL and Data Ingestion pipelines. This migration overall helped to reduce the AWS costs to approx 50%, and my pipeline implementations decreased data latency to 40% at least.