English:
Upper Intermediate
Dmitry L.
Vetted by YouTeam
Poland
UTC +01:00
Europe/Warsaw
English:
Upper Intermediate
Middle Data Engineer
I have accomplished significant achievements in my 3+ years of experience as a Data Engineer, including developing data monitoring, agricultural, and retail analytics platforms. With expertise in Python, DWH modeling, ETL/ELT pipelines, and data visualization, I possess strong skills in writing reusable code and applying DRY and SOLID principles. My knowledge extends to DevOps tools and expert SQL and proficiency in technologies such as Python, PySpark, Power BI, Azure, AWS, and more. With a bachelor's degree in computer science, I am fluent in English.
Want to hire this engineer?
Check if Dmitry is availableExpertise
Years of commercial development experience
3 years of experience
Core technologies
Other technologies
Project Highlights
Under NDA
A retail analytics platform that allows businesses to track and optimize their sales performance. The platform integrates data from various sources, such as point-of-sale, inventory management, and customer loyalty programs. This data is processed through ETL pipelines and stored in a centralized data warehouse. The platform then generates interactive dashboards and visualizations that provide insights into sales trends, inventory levels, customer behavior, and marketing effectiveness.
Responsibilities & achievements
- DWH design development; - Analyzing business requirements and translating them into technical data models; - Dimensional data modeling with Power BI; - Collaborating with business analysts and data architects to ensure that data models align with business needs and data architecture; - Conducting data profiling and analysis to ensure data accuracy, completeness, and consistency; - Building effective end-to-end ETL pipelines using Data Factory; - Transforming data using Azure Data Factory; - Writing and optimizing complex SQL queries; - Setting up backups for Azure SQL databases; - Analyzing data and dealing with missing values with Pandas; - Performing data quality checks including preparing test cases and checklists; - Establishing and organizing systems and database objects for maximum efficiency and functionality; - Exploratory data analysis
iT-O
The largest enterprise for the production of agricultural products, which accounts for more than 50% of the "poultry of industrial production" of the country. The data comes from various systems in which sales and shipments are reported. The task is to synchronize the data to process and build dashboards for businesses based on them. And also give some processed business data through data marts and statistics. Based on the received solution, sales were analyzed, and market development strategies were changed.
Responsibilities & achievements
- Data engineering; - Database administration; - Cleaning and preparing data with Pandas; - Building ETL pipelines using Apache Airflow; - Building Apache Spark pipelines; - Performance optimization; - Ensure data acсuracy and flexibility; - Create partitions on SQL tables; - Writing complex SQL queries, procedures, and triggers for PostgreSQL; - Test SQL databases and perform bug fixes; - Data processing using AWS Databricks; - Implement serverless calculations using AWS Lambda; - Code review and refactoring.
Under NDA
A platform for internal users to monitor, analyze, and troubleshoot various data pipelines in one handy place using many data sources. Displaying as much information as possible quickly was the main priority in building this platform. The platform gives a fantastic ability to understand the system's life status in one look.
Responsibilities & achievements
- Data engineering; - Building ELT pipelines; - Writing SQL queries and procedures; - SQL Database managing; - Help other developers with data modeling; - Organized data and tuned queries for optimal performance; - Provide effective cloud solutions with Azure; - Data processing using Azure Databricks; - Designed orchestration with Azure Data Factory; - Set up storing images on Azure Blob Storage; - Parallelization and optimization of data pipelines; - Filtering data from anomalies; - Manipulations with big datasets; - Dashboards and reports development with Power BI; - Developing bash scripts; - Cleaning data;
Education
Higher education in Computer Science
Agency
100-400
GMT+2
Kyiv/Ukraine, Ukraine/Ukraine
Core Expertise
Industries
Education & Science, Business & Productivity, Logistics & Transportation, E-Commerce & Retail, Banking & Finance, Information services & Technologies, Entertainment & Games, Human Resources & Career, Sports & Fitness, Healthcare & Medicine, Booking & Rent, Electronics & Equipment, Service & Support, Accounting & Auditing, Big Data, Automotive, Games, Gambling & Casinos
Want to hire this engineer?
Check if Dmitry is available