Everthon D.

Data Engineer

Data Engineer
5/1/2022 - Present

Developed expertise in handling and analyzing sensitive data, particularly in the field of People Analytics. Skilled in data extraction to support informed decision-making processes. Successfully designed and implemented ETL data pipelines and orchestrated workflows using Apache Airflow. Demonstrated proficiency in programming with Python and Spark (Pyspark) for efficient data handling. Experienced in REST API extraction and integration to enhance data availability. Applied knowledge of data processing within Kubernetes environments, particularly with Azure Kubernetes Service (AKS). Leveraged Microsoft Azure for comprehensive cloud-based data solutions.

Data Engineer
3/1/2022 - 5/1/2022

Designed and implemented data architecture for Delta Lake, focusing on optimizing performance and reliability. Worked extensively on projects related to data solutions, modeling, and data acquisition/extraction, ensuring robust and scalable data systems. Implemented data processing pipelines to streamline and automate data workflows, enhancing efficiency and data consistency across the organization. Developed technical expertise in Delta Lake, data modeling, and ETL processes, ensuring data integrity and accessibility.

Junior Data Engineer
9/1/2021 - 3/1/2022

Developed proficiency in constructing data pipelines using Python and Spark (PySpark) while working with Oracle, MySQL, and MongoDB databases. Created REST APIs for efficient data provisioning and generated dashboards in Tableau. Utilized various tools and services in OCI, including Object Storage, Instance Machines, and Oracle Autonomous Data Warehouse, as well as in AWS, such as S3, Athena, EMR, and EC2. Demonstrated expertise in workflow automation and orchestration with Apache Airflow.

Junior Data Engineer
3/1/2021 - 9/1/2021

Developed expertise in data production solutions, particularly ETL processes and both deterministic and non-deterministic database linking. Executed various tasks involving data manipulation, transformation, and linking across multiple databases, as well as dataset extraction for research purposes. Built data pipelines within a Hadoop HDFS/Spark environment, optimizing data processing workflows. Automated several processes using Shell Script, ensuring efficiency and reducing manual intervention. Created and maintained a comprehensive data dictionary to document database schemas, enhancing data governance and understanding.

Business and Process Analyst I
7/1/2019 - 7/1/2021

Contributed to the technical team overseeing the infrastructure of the Yemoja, Omolu, Ògún, Airis, and Ogbon Data Center and Supercomputing Center. Developed and created reports using the open-source BI tool Metabase, demonstrating proficiency in data visualization and reporting. Acquired substantial knowledge in parallel programming, enhancing the processing efficiency of computational tasks. Implemented and managed a Service Desk using GLPI, which included process management and optimization. Administered Linux RHEL environments, ensuring stable and secure operations. Gained expertise in workload management with SLURM, database management with MySQL, and authentication protocols with LDAP. Leveraged shell scripting skills for automation and streamlining of administrative tasks.

Information Systems at Faculty of Technology and Sciences
2014 - 2019

Astronomer Certification for Apache Airflow Fundamentals at Astronomer
6/1/2022

Data Analyst Bootcamp at Instituto de Gestão e Tecnologia da Informação
5/1/2020

Qlik Sense Data Architecture Certificate at Toccato Tecnologia em Sistemas - Qlik
4/1/2019

Advanced Qlik Sense Architecture at Toccato Tecnologia em Sistemas - Qlik
4/1/2019

Qlik Sense Information Analysis at Toccato Tecnologia em Sistemas - Qlik
4/1/2019

Advanced Qlik Sense Analysis at Toccato Tecnologia em Sistemas - Qlik
4/1/2019