English:
Upper Intermediate
Illia K.
Vetted by YouTeam
Ukraine
UTC +02:00
Ukraine/Kyiv
English:
Upper Intermediate
Python data engineer
Python data engineer
Want to hire this engineer?
Check if Illia is availableExpertise
Years of commercial development experience
7 years of experience
Core technologies
Other technologies
Project Highlights
(NDA)
May `22 - Aug `22
3 months
This is an online musical data platform whose mission is to provide the industry with truthful analytical data.
Responsibilities & achievements
I joined their most critical project: an analytical platform responsiveness improvement. Users had to wait hours to see their data updated. Also, the AWS bill was huge. Our solution was to migrate the App’s data infra from a 1-run-per-day high-cost NoSQL platform to an event-driven architecture. My part was to implement an update consumption and batch preparation mechanism. My solution could handle approximately 1k RPM on the smallest MWAA deployment option. The overall implementation resulted in a dramatic increase in application responsiveness. The average data update time becomes equal to 15 mins. Overall cost decrease was estimated at 40%.
(NDA)
Sep `20 - May `22
2 years
The worldwide sportswear producer with obvious heavy Big Data processing needs.
Responsibilities & achievements
My first project was to bring a single source of truth for customers’ pricing reporting needs. The solution, which was produced within my mentorship of an intern colleague, was able to handle approx 1 TB of data in less than 15 minutes. My second project was to introduce the centralized source of demand and assortment data. I played a leading role in an assortment of reporting parts. My solution could handle the heavy processing of 10 billion data in approximately 30 minutes. While implementing this project also, a Data Quality solution was found, where I played both engineering and technical mentorship roles.
(NDA)
May `19 - Aug `20
1 year
A worldwide multimedia hosting company. Their need was to optimize the AWS costs of their BI platform. The solution was to migrate their processing from relational DWH to Data Lake pattern.
Responsibilities & achievements
My task was to design several ETL and Data Ingestion pipelines. This migration overall helped to reduce the AWS costs to approx 50%, and my pipeline implementations decreased data latency to 40% at least.
Education
Higher education in Computer Science
Agency
50-100
GMT+3
Ukraine
Core Expertise
Industries
Education & Science, Business & Productivity, Logistics & Transportation, E-Commerce & Retail, Banking & Finance, Construction & Real estate, Human Resources & Career, Sports & Fitness, Advertising & Marketing, Law & Government, Travel & Tourism, Healthcare & Medicine, Big Data, Internet of Things, SaaS
Want to hire this engineer?
Check if Illia is available