Luiz F.

Data Engineer

Senior Data Engineer
1/1/2023 - Present

Led the data engineering team, with core responsibilities focusing on managing the cloud infrastructure. Successfully restructured the data area, reformulating the data ingestion to delivery processes, which resulted in achieving a 72% cost saving in service billing. Implemented BigQuery as a data lakehouse, facilitating the processing of millions of data records daily and enabling the transformation of data into actionable insights for over 500 internal users.

Mid-Level Data Engineer
9/1/2021 - 12/1/2022

Developed a new data structure utilizing AWS technologies such as Redshift, S3, EC2, and EMR, significantly enhancing data manipulation capabilities. Led a development team to create a workspace platform using HTML, CSS, PHP, and JavaScript, resulting in a 30% increase in consultant performance. Champions Agile methodology, specifically Scrum, and implemented the G.U.T method for task prioritization, boosting team efficiency and focus. Orchestrated the data architecture process encompassing data capture, ingestion via Stich and Kafka, processing using Spark, and storage with S3, Redshift, PostgreSQL, and Hadoop HDFS. Conducted comprehensive data analyses using R and Python, substantially increasing the speed and accuracy of user decision-making and converting stored data into actionable insights.

Senior Data Engineer
9/1/2021 - Present

Defined innovations and technological choices driving solutions. Led the development team to ensure effective project execution and delivery. Developed complex integration solutions, cloud architecture, and data engineering. Focused on backend development of applications, ensuring they are agile, secure, and scalable.

Junior Data Engineer
11/1/2020 - 9/1/2021

Established a new data division leveraging local resources to create and manage a PostgreSQL database, including conducting comprehensive data modeling for both logical and physical data models. Took responsibility for maintaining and optimizing on-premises Linux server infrastructure, specifically on Ubuntu. Collaborated with the system development team to develop an intranet portal using technologies such as HTML, CSS, PHP, and JavaScript, ensuring seamless integration with the PostgreSQL database.

Appointed as team leader and systems architect, adopting the MVC design pattern to architect new modules and address evolving needs for both portal functionality and data management. Introduced and led the implementation of the Agile methodology, utilizing Scrum practices and the G.U.T. method for efficient task prioritization. As data requirements grew, utilized Google Cloud Platform (GCP) resources to implement a Data Warehouse with BigQuery and enhance storage solutions with Cloud Storage.

Addressed advanced data handling needs by applying data scraping techniques using Python and Selenium, and conducted extensive data mining activities using the R language. Demonstrated a comprehensive skill set in managing data systems, developing web applications, and leading technical teams within an Agile framework.

Junior Systems Analyst
1/1/2020 - 11/1/2020

Developed advanced automation scripts using PowerShell and VBS, and honed SQL programming skills. Provided Level 1 support for Totvs Protheus system. Managed network environments on both Windows Server 2012 and 2016 platforms, as well as on Linux CentOS. Oversaw the management of Firewall SonicWall, switches, and wireless access points, along with the administration of FileServer, Active Directory, and network security. Conducted maintenance of IT equipment and monitored the environment using Zabbix. Handled contract management with IT vendors and managed cloud telephony systems. Ensured IT asset control and provided back office support.

Intern
1/1/2018 - 1/1/2020

Developed proficiency in automation scripts using PowerShell and VBS. Acquired expertise in programming with PL/SQL. Provided Level 1 support for the Totvs Protheus system. Managed network environments utilizing Windows Server 2012 and 2016 platforms, as well as Linux CentOS. Oversaw the management of Firewall Sonicwall, switches, and wireless access points. Administered FileServer, Active Directory, and ensured network security. Conducted routine maintenance of IT equipment and monitored the environment through Zabbix. Managed contracts with IT suppliers and controlled IT assets. Implemented and maintained cloud telephony solutions, and performed various backoffice tasks as needed.

IT Technician
1/1/2013 - 12/1/2017

Provided comprehensive IT support both remotely and on-site, effectively assisting in the implementation of security systems, including CCTV, as well as networks and firewalls. Demonstrated significant expertise in sales of technology equipment, along with the assembly and maintenance of computers and laptops.

Computer Engineering at FIAP
2016 - 2020

Big Data (Data Science) at FIAP
2021 - 2022

Python at FIAP
11/1/2020

Android Development at FIAP
11/1/2020

Negotiation Techniques at FIAP
10/1/2020

Corporate Financial Management at FIAP
10/1/2020

IT Infrastructure Management at FIAP
7/1/2020

Computer Structure at FIAP
7/1/2020

Business Management & IT Services at FIAP
7/1/2020

PowerShell Part 1: Getting Started with Modern Scripting Language at Alura
2/1/2020

LGPD: Knowing and Understanding Its Impacts at Alura
1/1/2020

Excel 2016 - Advanced at Senac
10/1/2019