English:
Advanced
Brazil
UTC -03:00
America/Sao_Paulo
Data Engineering Technical Lead
Data Engineering Specialist (MCSA BI, MCSE Analytics by Microsoft) with over 13 years of experience in Data Analysis, Data Modeling, ETL/ELT, Streaming/Batch Data Ingestion, providing business insights, research and process analysis with effective use of data analysis to promote high level of efficiency in the processes and decision making. Able to manage multiple projects simultaneously and to manage people, perform strategic planning to achieve strategic objectives, solve problems, manage and execute critical analyzes of business processes, while recommending improvements in processes. Qualities: proactive, determined, logical thinking, great interpersonal skills, creative and flexible.
Want to hire this engineer?
Check if Henrique Francisco is availableExpertise
Years of commercial development experience
13 years of experience
Core technologies
Other technologies
Project Highlights
Under NDA
Jul `21 - Present
3 years
Development of Data Lakes, Data Warehouses, Spark Scripts, ingestion end-to-end from external/internal sources using batch/streaming techniques. Technologies used Azure: Data Factory, DataBricks, Synapse Analytics, SQL DW, Stream Analytics, Analytics Services, Data Lake Store, Event Hubs, IoT Hubs, Azure Functions, Azure Batch, Power APP, HD Insights, AKS, Analysis Services, Bicep Scripts. Google Cloud Plataform: Dataflow, Data Fusion, Cloud Storage, Cloud SQL, IA Notebook, VPN (HA, classic , serverless) VPC, VPC Peering, BigQuery, Bigtable, Auto ML, GKE, Pub/Sub, Dataproc, Composer, Apigee, SQL, Cloud Run, Cloud Functions, Spanner, Datastore, Database Migration, Datastream, Data Catalog, Dataprep, Dataflow.
Responsibilities & achievements
- Responsible for the high-quality delivery of solutions and products. - Responsible for delivering first-class consultancy services to our customers. - Directly involved in the development and deployment of innovative enterprise solutions.
Under NDA
Jun `20 - Jul `21
1 year
Data Engineer Specialist Leader in Google Cloud Platform, AWS and Azure.
Responsibilities & achievements
- Worked as Data Engineer Consultant Specialist Leader helping GAVB's customers with their goals, helped them orchestrate/ingest data from multiple sources with spark/pyspark scripts, on-prem, cloud, and external (Batch/Streaming) and constructed the Data Architecture. - Helped them to migrate their analytics structures to the public clouds (GCP, Azure, AWS) with IAC (terraform/bicep/Cloud Formation). - Created analytics infrastructure to connect data from on-prem to public clouds (GCP, Azure, AWS) - Supported Data Science team in preparing an environment to develop IA and ML algorithms in GCP, AWS, and Azure.
Under NDA
Apr `19 - Jun `20
1 year
Developing/leading the team to create spark/pyspark scripts to ingest data from multiple sources with batch/streaming data. Developing/leading the team to create IAC scripts (Bicep/Terraform/Cloud Formation) to deploy an environment to our customers.
Responsibilities & achievements
- Responsible for implementing a business unit in data analytics of Business Intelligence, Web Analytics and Data Science, leading strategic plan to achive goals of company and creating technical/business process to Business Intelligence/Web Analytics/Data Science. - Responsible for managing projects and people/resource worldwide as Adobe Partner to implement Adobe's suite (Adobe Audience Manager, Adobe Analytics, Target, Launch) in Adobe's customers.
Under NDA
Oct `17 - Apr `19
1 year
Senior Data Engineer
Senior Data Engineer consultant
Responsibilities & achievements
- As Sr Data Engineer I'm responsible to data architecture, orchestrate and ingestion of pipelines to help the analytics team get data from external and internal sources to analyze. - All of the pipelines are in AWS Glue (Python and Spark) retrieving/loading data from multiple sources (Internal and external) recording into S3 Buckets. Responsible to create ETL process (Python and Spark) to send these data to AWS Redshift (S3 to Redshift). Working closer with Business team to create dashboards in Power BI to help Anchor Loans keep using Data to make decision.
Under NDA
Dec `15 - Oct `17
2 years
Technical head of the Power BI business unit of Business Intelligence and Business Analytics projects, delivering BI & A solutions to clients
Responsibilities & achievements
- Developed spark/pyspark scripts to ingest data from multiple sources with batch/streaming data to the Convergence's customers. - Developed IAC scripts (Bicep/Terraform/Cloud Formation) to deploy an environment to the Convergence's customers
Under NDA
Jul `15 - Dec `15
5 months
Acting as consultant / coordinator specialist in Business Intelligence, Web Analytics and Data Science serving clients.
Responsibilities & achievements
- Responsible for the creation and coordination of machine learning algorithms in R for classification, clustering, prediction, and association. - Processing / Reading / Streaming of Big Data, using tools like Hadoop, HDInsight, Hive, Pig and Spark. BI Assessment for the Bayer Brasil BI team for the implementation of a Business Intelligence project in the Agro Bayer business unit.
Under NDA
Feb `13 - Jul `15
2 years
Analytics systems in Brazil and Latin America. Monitoring revenue performance, assessing opportunities and providing insights for the commercial area in relation to objectives and the market.
Responsibilities & achievements
- Responsible for develop and coordination of machine learning algorithms in R for classification, clustering, prediction, and association. - Datamining and streaming analytics of market information. - Analysis of ROI's (Events of Relationship, Customer Prospecting, Fairs and Digital Campaigns) and coordination in the development of Dashboard's to measure returns. - Responsible for the website of Schmersal Brasil and América Latina (Strategies, Monitoring and Measurement). - Responsible for all digital areas in Schmersal Brasil and Latin America (Coordination, Strategies and Measurement) focused on campaigns for the generation of leads, business opportunities, digital presence and brading, campaigns that we use of: Google Adwords, SEO, emkt's, landing pages. Responsible for ROI analysis of all campaigns.
Education
Higher education in Computer Science
Agency
50-100
GMT-3
Dois vizinhos/Brazil
Core Expertise
Industries
Education & Science, Logistics & Transportation, Banking & Finance, Construction & Real estate, Travel & Tourism, Healthcare & Medicine, Accounting & Auditing, Big Data, Branding, design, web development, Point-of-Sale
Want to hire this engineer?
Check if Henrique Francisco is available