As a Sr Data Engineer, I solved BIG Data problems, with tools, I write and test Pyspark scripts to do ETL run in Cloudera Cluster our Datalake. I working with huge files, for national risk area, batch risk decision policies motors, some tables have billions of rows, my tech stack is Python, Pyspark, Sql, Hive, shell script, Hadoop, impala hue, jupyter, Linux, window

I was a Senior Data Engineer, working in an agile team, help to deliver LGPD System (GPDR Brazilian Law) and digital transformation project. I wrote scripting to do ingestion from transactional system Sql Server to our data warehouse snowflake schema (fact dimensions) Teradata. Data volume was millions of rows per month. Tech Stack, Python, Sql, Hive, cloudera, shell script, Sql Server, Teradata, Hadoop, Power Bi. Jira, Confluence.

My role is to learn how to give the best technological solutions each day and generate more value to customers, team and company partners. It's a daily learning experience as we test new hypotheses in an agile and simple way, I understand that technology is a means, and our purpose will always be to increase the productivity of the Brazilian industry. Tech Stack: Python, AWS EMR, AWS S3, EC2, GCP, Big Query, Sql, Mysql,