![Image of Luiz F.](/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2F218g3l3q%2Fproduction%2Fed72432e37710af662a9822d8cdc43690afe8b39-200x200.jpg%3Fw%3D150%26h%3D150%26fit%3Dmax%26auto%3Dformat&w=384&q=75)
Luiz F.Data Engineer
Skills
Specialist in Data Engineering with nearly 11 years of experience spanning IT infrastructure management, full-stack development, and system architecture, focusing currently on Data Engineering. Holds a Bachelor's degree in Computer Engineering and an MBA with a specialization in Big Data/Data Science.
Proficiency spans a wide range of technologies and tools, including data management systems such as Airflow, Apache Spark, Data Factory, Data Flow, Data Lake, Databricks, Flume, Google Big Query, Hadoop, Hive, and Kafka. Skills in programming and analysis involve using Numpy, Pandas, Python, and R. Possesses expertise in database and storage solutions, including PostgreSQL, RedShift, and S3 Bucket. Additional technical proficiencies include TensorFlow, Scala, Spark, Sqoop, and ETL processes.
Senior Data Engineer
1/1/2023 - Present
Led the data engineering team, with core responsibilities focusing on managing the cloud infrastructure. Successfully restructured the data area, reformulating the data ingestion to delivery processes, which resulted in achieving a 72% cost saving in service billing. Implemented BigQuery as a data lakehouse, facilitating the processing of millions of data records daily and enabling the transformation of data into actionable insights for over 500 internal users.Mid-Level Data Engineer
9/1/2021 - 12/1/2022
Developed a new data structure utilizing AWS technologies such as Redshift, S3, EC2, and EMR, significantly enhancing data manipulation capabilities. Led a development team to create a workspace platform using HTML, CSS, PHP, and JavaScript, resulting in a 30% increase in consultant performance. Champions Agile methodology, specifically Scrum, and implemented the G.U.T method for task prioritization, boosting team efficiency and focus. Orchestrated the data architecture process encompassing data capture, ingestion via Stich and Kafka, processing using Spark, and storage with S3, Redshift, PostgreSQL, and Hadoop HDFS. Conducted comprehensive data analyses using R and Python, substantially increasing the speed and accuracy of user decision-making and converting stored data into actionable insights.Senior Data Engineer
9/1/2021 - Present
Defined innovations and technological choices driving solutions. Led the development team to ensure effective project execution and delivery. Developed complex integration solutions, cloud architecture, and data engineering. Focused on backend development of applications, ensuring they are agile, secure, and scalable.Junior Data Engineer
11/1/2020 - 9/1/2021
Established a new data division leveraging local resources to create and manage a PostgreSQL database, including conducting comprehensive data modeling for both logical and physical data models. Took responsibility for maintaining and optimizing on-premises Linux server infrastructure, specifically on Ubuntu. Collaborated with the system development team to develop an intranet portal using technologies such as HTML, CSS, PHP, and JavaScript, ensuring seamless integration with the PostgreSQL database.
Appointed as team leader and systems architect, adopting the MVC design pattern to architect new modules and address evolving needs for both portal functionality and data management. Introduced and led the implementation of the Agile methodology, utilizing Scrum practices and the G.U.T. method for efficient task prioritization. As data requirements grew, utilized Google Cloud Platform (GCP) resources to implement a Data Warehouse with BigQuery and enhance storage solutions with Cloud Storage.
Addressed advanced data handling needs by applying data scraping techniques using Python and Selenium, and conducted extensive data mining activities using the R language. Demonstrated a comprehensive skill set in managing data systems, developing web applications, and leading technical teams within an Agile framework.Junior Systems Analyst
1/1/2020 - 11/1/2020
Developed advanced automation scripts using PowerShell and VBS, and honed SQL programming skills. Provided Level 1 support for Totvs Protheus system. Managed network environments on both Windows Server 2012 and 2016 platforms, as well as on Linux CentOS. Oversaw the management of Firewall SonicWall, switches, and wireless access points, along with the administration of FileServer, Active Directory, and network security. Conducted maintenance of IT equipment and monitored the environment using Zabbix. Handled contract management with IT vendors and managed cloud telephony systems. Ensured IT asset control and provided back office support.Intern
1/1/2018 - 1/1/2020
Developed proficiency in automation scripts using PowerShell and VBS. Acquired expertise in programming with PL/SQL. Provided Level 1 support for the Totvs Protheus system. Managed network environments utilizing Windows Server 2012 and 2016 platforms, as well as Linux CentOS. Oversaw the management of Firewall Sonicwall, switches, and wireless access points. Administered FileServer, Active Directory, and ensured network security. Conducted routine maintenance of IT equipment and monitored the environment through Zabbix. Managed contracts with IT suppliers and controlled IT assets. Implemented and maintained cloud telephony solutions, and performed various backoffice tasks as needed.IT Technician
1/1/2013 - 12/1/2017
Provided comprehensive IT support both remotely and on-site, effectively assisting in the implementation of security systems, including CCTV, as well as networks and firewalls. Demonstrated significant expertise in sales of technology equipment, along with the assembly and maintenance of computers and laptops.
Computer Engineering at FIAP
2016 - 2020Big Data (Data Science) at FIAP
2021 - 2022
Python at FIAP
11/1/2020Android Development at FIAP
11/1/2020Negotiation Techniques at FIAP
10/1/2020Corporate Financial Management at FIAP
10/1/2020IT Infrastructure Management at FIAP
7/1/2020Computer Structure at FIAP
7/1/2020Business Management & IT Services at FIAP
7/1/2020PowerShell Part 1: Getting Started with Modern Scripting Language at Alura
2/1/2020LGPD: Knowing and Understanding Its Impacts at Alura
1/1/2020Excel 2016 - Advanced at Senac
10/1/2019
Luiz is available for hire
Meet Luiz F.All Howdy Candidates are vetted for skills and english proficiency.