Gustavo F.
Data Engineer

Skills

Airflow

Tableau

Spark

Sql

Python

Microsoft Azure

Amazon Aws

Gustavo is available for hire

Hire Gustavo F.

All Howdy Candidates are vetted for skills and english proficiency.

Bio

A seasoned Data Engineer/Architect with 15 years of IT experience, including a decade in Business Intelligence (BI), Data Analytics, and Data Engineering. Educational background includes a degree in Information Systems from Anhembi Morumbi University and a postgraduate degree in Big Data (Data Science) from FIAP. Currently positioned as a Senior Data Engineer/Specialist, responsible for leading technical project aspects focused on Data & Analytics, Data Migration, Data Governance, and BI. Committed to delivering efficient, scalable, and reusable solutions adhering to industry best practices, facilitating companies in achieving goals and deriving insights through reliable data analysis, key performance indicators, and business-aligned metrics.

Proficiency encompasses over ten years in Data Analytics and ETL processes, comprehensive expertise in relational databases, and eight years with BI tools. Possesses over four years of experience in data engineering and cloud data platforms, with advanced capabilities in Spark and Python, and significant experience in non-relational databases, CI/CD tools, and IaaS platforms. Well-versed in AWS and Azure services for Big Data and Data Analytics.

Technological expertise covers a broad range of tools and platforms, including Alteryx, SSIS, SQL Server, Oracle, Hadoop, Spark (Python), Apache NiFi, Kafka, Airflow, and Microsoft Azure services like Data Lake Storage, Functions, and Synapse Analytics. Competent in AWS services including Athena, DynamoDB, EC2, EMR, Glue, IAM, Kinesis, Lambda, RDS, Redshift, SDLF, SQS, S3, and VPC. Proficient with BI tools such as QlikView, PowerBI, and Tableau, and IaaS solutions like Terraform. Experienced with CI/CD systems including GitHub and Azure DevOps. Dedicated to aiding organizations in improved data governance and fostering a culture that drives innovation through informed decision-making processes, ensuring secure storage and transportation of information.

Data Engineer | Data Architect | Specialist
5/1/2022 - Present

Developed and maintained data platforms in cloud environments, employing diagnostic procedures to identify and improve gaps within the systems. Designed strategies that optimized performance and reduced costs of data solutions and products. Implemented data governance solutions and processes, as well as monitoring solutions and processes for data jobs and pipelines, adhering to best market practices. Ensured alignment of deliverables with technical and business requirements, maintaining high-quality standards. Coordinated with multi-functional squads to gather needs and define the scope of demands. Created and maintained necessary infrastructure for solution implementation and data pipelines. Developed reports and dashboards using BI tools.

Utilized tools and technologies including Airflow, Python, Kafka, AWS (Cognito, DataSync, DynamoDB, EC2, EMR with PySpark, Glue, IAM, EKS, Kinesis, Lambda, RDS, Redshift, SQS, S3, and VPC), Microsoft Azure (Databricks, Data Lake, Data Factory, Synapse Analytics, Azure Functions, and Power BI), and IaaS such as Terraform. Leveraged DevOps and CI/CD tools including GitHub and Azure DevOps.
Data Architect | Expert
4/1/2021 - 1/1/2022

Developed balanced solutions focusing on demand and viability while defining robust methodological frameworks for solution development. Conducted in-depth diagnostics to resolve complex application-related issues and served as a specialist interlocutor with customer counterparts. Conceptualized holistic architectures to ensure adherence to defined requirements. Utilized Airflow, Python, and an array of AWS tools including Athena, DynamoDB, EC2, EMR (PySpark), Glue, IAM, Kinesis, Lambda, RDS, Redshift, SDLF, SQS, Storage Gateway, S3, and VPC. Managed Infrastructure as a Service (IaaS) using Terraform and executed DevOps and CI/CD practices employing GitHub.
Senior Data Engineer
4/1/2020 - 4/1/2021

Led the development and ongoing evolution of the corporate Data Lake while ensuring the robustness of data pipelines through meticulous development and maintenance efforts. Specialized in the creation and upkeep of data streaming applications utilizing Kafka and Spark Streaming. Provided critical support for the Operational Data Store (ODS) database and managed key aspects of the Data Lake (AWS S3) and the Data Warehouse (Redshift). Expertise extended to comprehensive support for the AWS cloud data platform infrastructure. Utilized a range of tools and technologies including Airflow, Python, NiFi, Kafka, and various AWS services such as Athena, DynamoDB, EC2, EMR (PySpark), IAM, RDS, Redshift, S3, and VPC. Employed best practices in DevOps and CI/CD through GitHub to ensure seamless integration and continuous delivery.
Senior Data Engineer
11/1/2018 - 3/1/2020

Developed and maintained ETL pipelines and flows for generating fiscal reports, primarily extracting data from the SAP management system including the MM and FI/AA modules, along with additional data sources such as file systems and relational databases. Transformed and curated data for the construction of analyses and reports related to the fiscal obligations of fixed assets. Created and maintained reports and dashboards using the BI tool Power BI. This role required proficiency with Alteryx, SQL Server, and Power BI to ensure the delivery of reliable, well-structured, and processed data for comprehensive fiscal analyses and reporting.
Senior Data Engineer | BI Consultant
6/1/2015 - 10/1/2018

Assessed client data environments and platforms to identify gaps and propose optimized, efficient architectures and solutions. Developed and maintained data pipelines while defining the scope of demands in collaboration with stakeholders and business areas. Specialized in the development and optimization of Data Marts and models. Created and maintained comprehensive reports and dashboards using BI tools. Acquired extensive technical expertise in SQL Server, Oracle, Hadoop, Hive, Spark, Qlikview, Power BI, and Tableau.
Data Analytics Consultant
4/1/2013 - 4/1/2015

Developed and maintained Data & Analytics applications for accounting audit and business consulting projects, focusing on supporting data analysis needs and report construction for audit and consulting teams. Addressed compliance issues, fraud risks, and other business topics. Utilized SQL Server, ACL, and Excel.
Pre-Sales Analyst
2/1/2011 - 5/1/2012

Pre-sales experience involving an e-procurement technological solution. Conducted meetings with prospects and customers to gain insights into their business contexts, e-procurement processes, and requirements. Demonstrated the solution and defined its initial scope based on client needs. Prepared comprehensive commercial and technical proposals outlining the solution's scope, assumptions, implementation schedule, and pricing.
Technical Support Analyst
2/1/2008 - 2/1/2010

Provided Level II technical support for a technological solution focused on managing the workforce of contact center operations utilizing Workforce Management (WFM) systems. Handled calls and responded to tickets concerning queries, improvement requests, system errors, and failures. Conducted detailed analysis of clients' server infrastructure to assess feasibility for installation and configuration of the WFM solution. Led demonstrations, proof of concept sessions, and user training, ensuring smooth adoption and optimal use of the system.