Summary

Expertise

Project Highlights

Education

Agency

HS

English:

Advanced

Henrique Francisco S.

vetted by Youteam

Vetted by YouTeam

Brazil

UTC -03:00

America/Sao_Paulo

English:

Advanced

Data Engineering Technical Lead

Data Engineering Specialist (MCSA BI, MCSE Analytics by Microsoft) with over 13 years of experience in Data Analysis, Data Modeling, ETL/ELT, Streaming/Batch Data Ingestion, providing business insights, research and process analysis with effective use of data analysis to promote high level of efficiency in the processes and decision making. Able to manage multiple projects simultaneously and to manage people, perform strategic planning to achieve strategic objectives, solve problems, manage and execute critical analyzes of business processes, while recommending improvements in processes. Qualities: proactive, determined, logical thinking, great interpersonal skills, creative and flexible.

Want to hire this engineer?

Check if Henrique Francisco is available

Expertise

Years of commercial development experience

13 years of experience

Core technologies

Python 8 years
pandas 6 years
SQL 7 years
PostgreSQL 7 years

Other technologies

Apache Hadoop
Scala
Spark
Apache Hive
Pig
Hadoop

Project Highlights

icon
Analytics Specialist Consultant

Under NDA

Jul `21 - Present

3 years

Development of Data Lakes, Data Warehouses, Spark Scripts, ingestion end-to-end from external/internal sources using batch/streaming techniques. Technologies used Azure: Data Factory, DataBricks, Synapse Analytics, SQL DW, Stream Analytics, Analytics Services, Data Lake Store, Event Hubs, IoT Hubs, Azure Functions, Azure Batch, Power APP, HD Insights, AKS, Analysis Services, Bicep Scripts. Google Cloud Plataform: Dataflow, Data Fusion, Cloud Storage, Cloud SQL, IA Notebook, VPN (HA, classic , serverless) VPC, VPC Peering, BigQuery, Bigtable, Auto ML, GKE, Pub/Sub, Dataproc, Composer, Apigee, SQL, Cloud Run, Cloud Functions, Spanner, Datastore, Database Migration, Datastream, Data Catalog, Dataprep, Dataflow.

Responsibilities & achievements

- Responsible for the high-quality delivery of solutions and products. - Responsible for delivering first-class consultancy services to our customers. - Directly involved in the development and deployment of innovative enterprise solutions.

AWS
Azure
Cloud Engineer
ETL
Python
Spark
SQL
Data Warehousing
Power Apps
icon
Data Engineering Technical Lead

Under NDA

Jun `20 - Jul `21

1 year

Data Engineer Specialist Leader in Google Cloud Platform, AWS and Azure.

Responsibilities & achievements

- Worked as Data Engineer Consultant Specialist Leader helping GAVB's customers with their goals, helped them orchestrate/ingest data from multiple sources with spark/pyspark scripts, on-prem, cloud, and external (Batch/Streaming) and constructed the Data Architecture. - Helped them to migrate their analytics structures to the public clouds (GCP, Azure, AWS) with IAC (terraform/bicep/Cloud Formation). - Created analytics infrastructure to connect data from on-prem to public clouds (GCP, Azure, AWS) - Supported Data Science team in preparing an environment to develop IA and ML algorithms in GCP, AWS, and Azure.

AWS
ETL
SQL
Apache Spark
Lambda
Apache Airflow
Power BI
icon
Analytics Specialist Leader

Under NDA

Apr `19 - Jun `20

1 year

Developing/leading the team to create spark/pyspark scripts to ingest data from multiple sources with batch/streaming data. Developing/leading the team to create IAC scripts (Bicep/Terraform/Cloud Formation) to deploy an environment to our customers.

Responsibilities & achievements

- Responsible for implementing a business unit in data analytics of Business Intelligence, Web Analytics and Data Science, leading strategic plan to achive goals of company and creating technical/business process to Business Intelligence/Web Analytics/Data Science. - Responsible for managing projects and people/resource worldwide as Adobe Partner to implement Adobe's suite (Adobe Audience Manager, Adobe Analytics, Target, Launch) in Adobe's customers.

Amazon EC2
AWS
Azure
Business Intelligence
Cloud Engineer
ETL
SQL
Amazon Relational Database Service
Apache Spark
Data Warehousing
Apache Airflow
Power Apps
icon
Senior Data Engineer

Under NDA

Oct `17 - Apr `19

1 year

Senior Data Engineer

Senior Data Engineer consultant

Responsibilities & achievements

- As Sr Data Engineer I'm responsible to data architecture, orchestrate and ingestion of pipelines to help the analytics team get data from external and internal sources to analyze. - All of the pipelines are in AWS Glue (Python and Spark) retrieving/loading data from multiple sources (Internal and external) recording into S3 Buckets. Responsible to create ETL process (Python and Spark) to send these data to AWS Redshift (S3 to Redshift). Working closer with Business team to create dashboards in Power BI to help Anchor Loans keep using Data to make decision.

Business Intelligence
ETL
SQL
Apache Spark
Apache Airflow
Power Automate
icon
Analytics Specialist

Under NDA

Dec `15 - Oct `17

2 years

Technical head of the Power BI business unit of Business Intelligence and Business Analytics projects, delivering BI & A solutions to clients

Responsibilities & achievements

- Developed spark/pyspark scripts to ingest data from multiple sources with batch/streaming data to the Convergence's customers. - Developed IAC scripts (Bicep/Terraform/Cloud Formation) to deploy an environment to the Convergence's customers

Azure
ETL
SQL
VPN
Google Cloud Platform
Jupyter Notebook
Apache Airflow
icon
Senior Data Scientist

Under NDA

Jul `15 - Dec `15

5 months

Acting as consultant / coordinator specialist in Business Intelligence, Web Analytics and Data Science serving clients.

Responsibilities & achievements

- Responsible for the creation and coordination of machine learning algorithms in R for classification, clustering, prediction, and association. - Processing / Reading / Streaming of Big Data, using tools like Hadoop, HDInsight, Hive, Pig and Spark. BI Assessment for the Bayer Brasil BI team for the implementation of a Business Intelligence project in the Agro Bayer business unit.

Azure
Business Intelligence
ETL
R
Data Warehousing
VPN
Google Cloud Platform
Data Analyst
Power Apps
icon
Senior Business Intelligence Analyst

Under NDA

Feb `13 - Jul `15

2 years

Analytics systems in Brazil and Latin America. Monitoring revenue performance, assessing opportunities and providing insights for the commercial area in relation to objectives and the market.

Responsibilities & achievements

- Responsible for develop and coordination of machine learning algorithms in R for classification, clustering, prediction, and association. - Datamining and streaming analytics of market information. - Analysis of ROI's (Events of Relationship, Customer Prospecting, Fairs and Digital Campaigns) and coordination in the development of Dashboard's to measure returns. - Responsible for the website of Schmersal Brasil and América Latina (Strategies, Monitoring and Measurement). - Responsible for all digital areas in Schmersal Brasil and Latin America (Coordination, Strategies and Measurement) focused on campaigns for the generation of leads, business opportunities, digital presence and brading, campaigns that we use of: Google Adwords, SEO, emkt's, landing pages. Responsible for ROI analysis of all campaigns.

Azure
ETL
Google Cloud Platform
Power BI
Pyspark
Power Apps

Education

Higher education in Computer Science

Agency

agency #3321

50-100

GMT-3

Dois vizinhos/Brazil

Core Expertise

API
AWS
Azure
Business Intelligence
C#
Database Developer
Data Scientists
Django
ETL
Java
JavaScript
Kotlin
Kubernetes
.NET
Node.js
PostgreSQL
Python
React.js
React Native
Ruby on Rails
TypeScript
UI
UX
Automated Testing
Data Modeling
Data scraping
Data Structures
Data Visualization
Data Warehousing
Database design
Database Modeling
Elasticsearch
Laravel Framework
Product management
QA Management
Redis
Angular 2x
Design Patterns
RabbitMQ
RESTful API
Docker
Vue.js
Business Analysis
Nest
GraphQL
.NET Core
Next.js
Data Analyst

Industries

Education & Science, Logistics & Transportation, Banking & Finance, Construction & Real estate, Travel & Tourism, Healthcare & Medicine, Accounting & Auditing, Big Data, Branding, design, web development, Point-of-Sale

Want to hire this engineer?

Check if Henrique Francisco is available