Ney P.Data Engineer
Skills
Data Scientist and Python Developer with a focus on autonomy, integrity, and analytical quality. Passionate about continuous learning and adaptable to new challenges. Holds a Bachelor's degree in Science and Technology and a postgraduate degree in IT (Business Intelligence and Analytics) with a concentration on data science products. Currently pursuing an MBA in Data Science and Analytics.
Possesses extensive experience in Business Intelligence and Analytics, contributing to significant institutional improvements through AI, automation, and various decision-support solutions. Expertise includes MLOps, machine learning models with natural language processing, data pipeline orchestration, PySpark, and tools on the Google Cloud Platform, such as BigQuery, Cloud Storage, Dataflow, and Dataproc.
Demonstrates a keen interest in aiding organizations to efficiently collect, organize, and explore digital assets while enforcing data quality governance. Adept in interpersonal communication, enhancing stakeholder engagement and fostering professional collaboration on diverse projects.
Business Intelligence | Analytics
4/1/2022 - 11/1/2023
Developed machine learning models utilizing XGBoost and Deep Learning to enhance the court's decision-making process. Created virtual assistants and chatbots to facilitate external public interaction, employing the RASA framework and GPT-3.5 API. Executed a data extraction project from the JFRN website, leveraging Langchain to supply Large Language Models such as GPT-3.5 and GPT-4. Engineered RESTful APIs for model deployment with FastAPI and NodeJS, and designed microservices using Docker, incorporating CI/CD practices on GitLab. Constructed data pipelines for AI projects, incorporating data checks and validations with Great Expectations and Pydantic to ensure data quality. Developed dashboards on the Qlik platform for analyzing and monitoring KPIs related to citizen service chats. Played a key role in implementing new tools and selecting appropriate solutions to foster MLOps and DataOps culture, which included versioning metrics, data, and models. Operated within Agile, self-managed teams that included facilitators acting as project managers to assist with overcoming impediments.Data Engineer Apprentice
1/1/2022 - 4/1/2022
Extracted data from public APIs using Python, executed ETL processes leveraging Pandas and PySpark, and persisted data into MySQL, MongoDB, and Google Cloud Storage. Managed and analyzed data with BigQuery, and enforced data validations using PySpark schemas and Pandera. Developed data pipelines for both Batch and Streaming with Apache Beam on Dataflow, integrating Pub/Sub for messaging. Handled Big Data tasks utilizing Apache Spark on Dataproc and designed interactive dashboards with DataStudio.Research Technician
3/1/2017 - Present
Handled the collection and validation of accounting data from the commerce, industry, and services sectors in Brazil, essential for analyzing economic performance and trends. Contributed to team management by implementing and monitoring key performance indicators (KPIs) to consistently uphold the quality of data collection and professional output. Utilized effective communication skills to interact with various profiles, ensuring clear understanding of research objectives among collaborators and informants. Demonstrated high quality of work and rapid data collection, leading to involvement in the more complex Annual Industrial Survey. Engaged in continuous improvement efforts by providing suggestions and participating in problem-solving activities during weekly teamwork meetings.
Sciences and Technology (Computer Science) at Federal University of Rio Grande do Norte
2011 - 2017Business Administration (Data Science and Analytics) at University of São Paulo
2022 - 2024Information Technology (Business Intelligence and Analytics) at Federal University of Rio Grande do Norte
2022 - 2023
Business English at Pearson College London / IBS Americas
1/1/2024Data Science Applied to Business at Pearson College London / IBS Americas
1/1/2024Life Cycle Canvas® Associate Certified at Life Cycle Canvas
7/1/2022From Data to Insights with Google Cloud Specialization at Coursera
6/1/2022Applying Machine Learning to your Data with Google Cloud at Coursera
6/1/2022Achieving Advanced Insights with BigQuery at Coursera
6/1/2022English Certificate Level C1 Expert – Common European Framework of Reference for Languages (CEFR) at Lingopass
4/1/2022Agile Software Development at LinkedIn
4/1/2022Creating New BigQuery Datasets and Visualizing Insights at Coursera
4/1/2022Perform Foundational Infrastructure Tasks in Google Cloud at Qwiklabs
2/1/2022Create and Manage Cloud Resources at Qwiklabs
2/1/2022Build and Secure Networks in Google Cloud at Qwiklabs
2/1/2022Python Fundamentals for Data Analysis 3.0 at Data Science Academy
11/1/2021Artificial Intelligence Fundamentals 2.0 at Data Science Academy
11/1/2021M001: MongoDB Basics at MongoDB
9/1/2021Web Developer at Universidade Federal do Rio Grande do Norte
3/1/2021
Ney is available for hire
Meet Ney P.
All Howdy Candidates are vetted for skills and english proficiency.
