English:
Upper Intermediate
Juan Diego G.
Vetted by YouTeam
Colombia
UTC -05:00
America/Bogota
English:
Upper Intermediate
Data Engineer with three years of experience, highly results oriented and specialized in the development of scalable Big Data solutions.
My focus is on making the most of cloud platforms like Azure and Google Cloud Platform to design data pipelines that span the entire process, from acquisition to analysis and visualization. My professional background includes experience designing and implementing robust and scalable data architectures, as well as developing advanced data analysis algorithms. Additionally, I have strong skills in manipulating large volumes of data and creating predictive models to improve business decision making. I am a proactive professional, with skills to work as a team and communicate effectively with different areas within the organization. I am constantly looking for opportunities to learn and grow, as well as stay abreast of the latest trends and technologies in the field of data science and data engineering.
Want to hire this engineer?
Check if Juan Diego is availableExpertise
Years of commercial development experience
3 years of experience
Core technologies
Other technologies
Project Highlights
Data Engineer
Aug `23 - Present
1 year
Secure Ingestion Pipeline: Designed and developed robust pipelines enabling the secure ingestion of encrypted files, ensuring the integrity and confidentiality of data throughout the process.
Responsibilities & achievements
Participation on the creation of Revenue Accounting Data Mart: Creation of a specialized Data Mart focused on Revenue Accounting. This involved active participation in the design of the relational model, ensuring an efficient and scalable structure. • Implementation of Dashboards in Looker Studio: Developed various dashboards in Looker Studio to provide intuitive and insightful visualizations, facilitating stakeholders’ quick and comprehensive access to key Revenue Accounting data.
Data Engineer
Nov `21 - Aug `23
2 years
Google Workflows Development: To orchestrate and monitor parallel executions of Dataflow jobs, BigQuery routines, and other workflows.
Responsibilities & achievements
• Dataflow Development: To efficiently process flat files and transform them into structured data, which is then stored and materialized in BigQuery and Looker Studio. • Data Modeling: Created and optimized routines in BigQuery for consolidating different layers of a relational model, enabling data visualization for users in PowerBI. • Real-time Alert Generation Platform: Utilization of Azure services such as IoT Hub, Azure Functions and Stream Analytics for real-time monitoring and visualization of data associated with the status and staging of industrial production lines. • Intelligent Corporate Knowledge Base: Development of an intelligent corporate knowledge base using Azure Cognitive Services to centralize data and various information sources such as Sharepoint and Azure DevOps with search suggestions and auto-completion. • Bug Fixing and Incident Monitoring: For ETL processes for descriptive and predictive models of a BigData solution previously in production environment. Debugging Databricks Notebooks and Data Factory pipelines. • Actively participated in agile development methodologies and sprint planning to deliver projects within set timelines.
Education
Higher education in Computer Science
Agency
100-400
GMT-5
Rosario/Argentina, Buenos Aires/Argentina, Cartagena/Colombia, Barranquilla/Colombia, Veracruz/Mexico, Monterrey/Mexico, Rio de Janeiro/Brasil
Core Expertise
Industries
Information services & Technologies
Want to hire this engineer?
Check if Juan Diego is available