Howdy Logo
Image of Nikolas G.

Nikolas G.
Data Engineer

Spark
Sql
Github
Apache Hadoop
Databricks
Python
Microsoft Azure
Hive
Bio

Currently engaged in postgraduate studies at the University of São Paulo (USP), this data engineer exhibits a strong focus on data ingestion challenges and the comprehensive management of the data lifecycle, with a particular emphasis on data lineage.

  • Data Engineer
    11/1/2022 - Present

    Developed extensive proficiency in Azure Databricks for the development of credit policies in the cloud. Spearheaded the creation of a variable creation library, facilitating streamlined processes for generating variables in the silver layer. Demonstrated advanced skills in ensuring data quality using PyDeequ, contributing significantly to maintaining high standards of data integrity and reliability.

  • Big Data Consultant
    5/1/2021 - 10/1/2022

    Served as a Big Data Consultant within the banking sector, developing and optimizing both batch and online data processing solutions. Gained extensive proficiency in Python and PySpark for data manipulation and transformation. Utilized SQL for database querying and management. Leveraged Hadoop ecosystem tools for distributed data storage and processing. Employed Databricks for collaborative data engineering and analytics. Integrated machine learning models into systems to improve data-driven decision-making processes.

  • Research Student
    9/1/2019 - 8/1/2020

    Executed a scientific initiation project focused on the Comparative Analysis of Ranking Correlation Metrics for Weakly Supervised Learning, leading to the development and proposal of a new metric. The project culminated in a paper that was accepted for publication in the proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP 2021 - Qualis A3). Developed proficiency in research methodologies, analytical thinking, and metric evaluation techniques within the context of Computer Vision and Machine Learning. Utilized various machine learning frameworks and tools for data analysis and model evaluation, enhancing expertise in quantitative research and scientific communication.

  • Computer Science at São Paulo State University Júlio de Mesquita Filho
    2018 - 2021

  • Specialization in Data Engineering and Big Data at Polytechnic School of USP
    2023 - 2024

Nikolas is available for hire

Hire Nikolas G.
Check icon

All Howdy Candidates are vetted for skills and english proficiency.