Deyvid M.

Data Engineer

Senior Data Engineer
9/1/2023 - Present

Developed pipelines for ETLs utilizing Java, demonstrating technical expertise with Dataflow on Google Cloud Platform (GCP). Automated workflows using Jenkins and managed scheduling with UC4. Ingestion sources included SyBase, SQL Server, and Oracle, ensuring robust and diverse data integration. Employed Agile methodologies such as Scrum and Kanban for efficient project management. Maintained thorough documentation and monitoring using Jira and Confluence. Created technical drawings, including architectural designs, ERDs, and process flows, leveraging Drawio for comprehensive visual representations.

Senior Data Engineer
7/1/2019 - 8/1/2023

Developed proficiency in leading technical discussions to devise solutions, constructing solution architecture drawings, and conducting proof of concepts (POCs). Successfully executed data solution migration projects while meticulously monitoring costs. Gained extensive experience in creating ETLs, log monitoring, and ensuring performance monitoring of deployed services. Achieved standardization of projects and codes aligned with best practices.

Utilized a wide range of Google Cloud Platform (GCP) tools including BigQuery, Dataflow, Cloud Scheduler, Cloud Run, Cloud SQL, Cloud Functions, Cloud Logging, Compute Engine, Cloud Billing, and Data Fusion. Proficiently used additional tools like Airflow, GitLab for versioning and automation, Docker for containerization, RabbitMQ for messaging, and Azure's Application Insights (APM) for performance monitoring. Developed and maintained shell scripts for various automation tasks.

Managed data ingestion from multiple sources such as Postgres, SQL Server, Oracle, MongoDB, APIs, and messaging systems. Integrated seamlessly with Google Analytics for comprehensive data analysis.

Demonstrated strong capability in using programming languages like Python and Java to meet project requirements. Ensured data availability through the development of Power BI dashboards, Metabase transformations, and REST API deployment using FastAPI.

Applied agile methodologies, namely Scrum and Kanban, for effective project management. Maintained thorough documentation and monitoring using Jira and Confluence.

Crafted detailed technical drawings including architecture designs, Entity Relationship Diagrams (ERDs), and process flows using tools like Draw.io and Miro, facilitating clear communication of complex technical concepts.

Software Engineer
3/1/2017 - 7/1/2019

Gained expertise in the development and maintenance of various systems utilizing key technologies such as Java, JSF, JPA, EJB, and JQuery. Developed an in-depth understanding of deploying and managing applications on web servers like Tomcat and Glassfish. Demonstrated strong skills in database management and optimization with PostgreSQL, ensuring robust and efficient system performance.

Professional Master's in Computer Science
6/1/2014 - 12/1/2016

Concentration in Applied Computing with a research focus on Computational Intelligence. Conducted extensive research leading to the dissertation titled A New Approach Based on Multi-Objective Evolutionary Algorithms Applied to the Bio-Objective Traveling Salesman Problem. Developed proficiency in evolutionary algorithms, particularly their application in solving complex optimization problems. Demonstrated expertise in using computational techniques to address bi-objective optimization tasks. The detailed dissertation can be accessed via the following link: [Dissertation Link](https://repositorio.utfpr.edu.br/jspui/bitstream/1/3237/1/CP_PPGI_M_Moraes%2C%20Deyvid%20Heric%20de_2017.pdf).

Software Engineer
1/1/2012 - 6/1/2014

Demonstrated expertise in the development and maintenance of various enterprise systems using a suite of technologies including Java, JSF, JPA, EJB, and JQuery. Utilized application servers such as Tomcat and Glassfish to ensure robust deployment and performance. Developed and maintained databases with proficiency in PostgreSQL and Oracle. Extended technical skills to mobile development with Android and web development using PHP.

Software Engineer
10/1/2010 - 11/1/2011

Developed physical assessment systems utilizing PHP and Java for server-side logic, and JQuery for enhanced user interface functionality. Implemented robust data management and retrieval solutions using PostgreSQL. Demonstrated strong integration of back-end and front-end technologies to ensure seamless user experience and efficient data processing.

Analysis and Development of Systems at Federal University of Technology - Paraná
2007 - 2011

Applied Computing - Emphasis in Computational Intelligence at Federal University of Technology - Paraná
2015 - 2016