Developing and improving data pipelines in an on-premise(local) Cloudera infrastructure with Hadoop, Hive, Impala, Spark, Sqoop and Kudu. Also, working with the ‘AWS Migration Team’ to help the team to migrate all that local infrastructure to AWS.

I started at Clicksign as a data scientist working mainly with Pandas, Scikit-Learn and other common python data science libraries. Later I assumed the data engineer role. As a data engineer, I'm the data lake project leader and as a leader, I'm becoming an expert on the most powerful technologies (on AWS) like S3, Kinesis, lambda, Airflow, Spark (in EMR), DataViz tools (like Superset) and others.

Logistics expert, focused on data analysis and graphics (using Klipfolio). Development of Machine Learning models (Python and R), for the logistics field. Experience with SQL Server, PostgreSQL, MySQL, and MongoDB. Responsible for Routes and Data analysis. Advisory work to improve logistics operations using B.I. tools like Klipfolio and other graphics tools like ggplot2 for R, matplotlib, and seaborn for Python and Google Data Studio to build dashboards.

Responsible for the implementation and creation of routes through software Roadshow. Analysis of routes, costs, and other variables that may affect the transportation of goods with R. Automation of several tasks using Python