English:
Proficient
Bartosz K.
Vetted by YouTeam
Poland
UTC +01:00
Europe/Warsaw
English:
Proficient
Experience in both development and DevOps areas for cloud-based projects who is always ready to expand knowledge and skills and challenge the status.
Senior Software Engineer (Cloud Engineer) with experience in both development and DevOps areas for cloud-based projects who is always ready to expand knowledge, and skills and challenge the status quo. Successful work on multiple projects proves both a high-level technical background in used technologies and a strong business orientation. Solid knowledge of Python programming language is backed up with strong networking, operating systems (especially Linux), and overall cloud knowledge (AWS & GCP). Currently in project where I use Airflow. Besides that, I used ETL native in AWS using step fuctions and lambda. Besides my experience in the private sector, I am soon to be Ph.D. in ICT at AGH University of Science and Technology in Kraków.
Want to hire this engineer?
Check if Bartosz is availableExpertise
Years of commercial development experience
6 years of experience
Core technologies
Other technologies
Project Highlights
Auction Platform
Jul `23 - Feb `24
7 months
The project encompasses extensive big data processing, with a primary emphasis on real-time data streaming and consumption, alongside the preparation of ETL (Extract, Transform, Load) processes for data warehousing. It is designed as an orchestrated and scalable system utilizing Kubernetes, which ensures efficient management and deployment of containerized applications. For monitoring and logging, the project integrates the ELK (Elasticsearch, Logstash, Kibana) stack, providing a comprehensive suite for data visualization and analysis. Additionally, a robust API layer is developed using FastAPI and Python, serving as the primary interfaces for accessing and consuming the processed data. This setup facilitates efficient data handling and integration, catering to the dynamic requirements of real-time data processing and analysis.
Responsibilities & achievements
Design & development of: ETL workflows, SQL tables, APIs, Communication via Kafka
Tempo Automation
May `21 - Jun `23
2 years
The project covers the end-to-end processing of the Bill of Materials file. Processing consists of a couple of stages which are decoupled as independent microservices. System for intelligent resolving customer Bill of Materials documents(validation & normalization), Part Search, Services for supporting Quotation and Procurement processes. The main goal was to prepare an automated service hosted with the Salesforce Platform to prepare cost and time estimation for PCB board production.
Responsibilities & achievements
Architecture and Design of the System -Responsible for the design of the system's crucial architecture (both software-wise as well as infrastructure-wise) -Responsible for the design of database systems -Responsible for the design of Data Pipelines for ETL processing -Design of the REST API endpoints for multiple backend services (database access, logging system, central storage system, and key-value storage system) -Design of the Traceability and Monitoring system including integration inside AWS service (OpenSearch) and 3rd parties (Datadog). -Design plan for the integration with the Salesforce Platform Development of the product as a Senior Python Developer -Implementation of the normalization & validation service supporting multiple plugins and formats (csv, xlsx, xml) -Implementation of the search service including data transformation and data analysis (3rd part APIs integrations, Data Matching & Data Engineering) -Implementation of the selection service including various algorithms for the selection -API Authorization via token & TLS certificates + certificates rotation -Mentoring -Unit-tests Development of the product as a DevOps Engineer -Design of the networking architecture for the whole system (cross-region architecture) with VPC peering -Design of the production blue/green environments and promotion (domain switching) -Design of the CI system with the usage of GitHub Actions for the code check and delivery (lambda, lambda layers, container images) -Every resource from the Infrastructure written in Terraform, terraform modules pattern used AWS services: Lambda, Step Functions, S3, KMS, SSM, Secrets Manager, API (WebSocket, HTTP v2), Route53, Certificate Manager, CloudWatch, OpenSearch, VPC, Cost Control, DynamoDB, RDS, DMS, IAM, Control Tower, Cognito, EventBridge, SQS, SNS, EC2, ELB, ECS, ECR, ElastiCache.
Pipeline Scan
Apr `20 - Apr `21
1 year
The pipeline scanner is the web API interface to evaluate the security of your application directly within a development pipeline. The pipeline scan directly embeds into a team's development pipelines and provides fast feedback on flaws introduced on new commits
Responsibilities & achievements
- Development of the product as Python Developer - Code review - Design new application architecture (Poetry - migration from pip to poetry, Parallel execution on the single computing instance - multi-core tasks) - Deployment CI/CD (Fully automated deployment via GitLab Pipeline) - Design and implementation REST API - Remote debugging distributed/scale system - Design and develop test framework - Functional release candidate tests, integration tests, performance test (pytest) - Project documentation - R&D for new solutions (Hibernation, Performance evaluation for computing systems, Multi region AWS migration, Python dependency resolver - DepHell, Poetry, AWS Auto-scaling system) Technologies: AWS - lambda, S3, EC2, Auto-scaling, API Gateway, Cloud Watch, KMS, Network, IAM, Cost control, Redis (EC), Redshift GitLab - CI/CD, Integrations (Issues, Vulnerabilities), Maintenance - integration with SonarQube, SourceClear, PipelineScan (Veracode)
Education
Higher education in Computer Science
Agency
400+
GMT+1
Poland
Core Expertise
Want to hire this engineer?
Check if Bartosz is available