Alex N.

Data Engineer

Data Engineer | Developer
6/1/2021 - Present

Led the development and maintenance of applications leveraging Python, Django, Flask, and PostgreSQL. Utilized Docker to build consistent and scalable development and production environments. Engineered dynamic user interfaces utilizing HTML, CSS, JavaScript, and Vue.js. Orchestrated the integration of PACS systems with medical image server Orthanc through APIs and cloud storage solutions. Demonstrated proficiency in version control using GitLab and GitHub, managing repositories and facilitating team collaboration. Implemented container orchestration with Kubernetes for managing Spark and Airflow pods, creating robust and scalable workflows. Ingested and processed data from both relational (SQL) and non-relational (NoSQL) databases, developing APIs to render data accessible for data scientists and users. Customarily worked with Azure Databricks clusters for large-scale distributed data processing, optimizing the analysis of extensive data sets. Developed and optimized Spark notebooks for complex data transformations, enhancing performance and efficiency. Delivered scalable data warehouse solutions in Azure Synapse Analytics for high-performance analytics. Configured and managed real-time processing pipelines with Azure Stream Analytics to extract insights from continuous data flows, deploying Stream Analytics queries for real-time pattern and event detection. Assumed responsibility for deploying and managing scalable data storage solutions via Azure Blob Storage to support large volumes of structured and unstructured data. Integrated Azure Data Factory and Azure Stream Analytics data pipelines with Power BI to enable real-time analytics.

Data Engineer (Freelance)
9/2/2020 - 12/1/2021

Managed deployment, maintenance, migration, and administration of SQL Server databases. Specialized in performance tuning of databases and configuring instances to achieve optimal performance and meet specific application needs. Led data consolidation efforts in the ETL process using Visual Studio. Conducted data analysis and processing with Python and Pandas, demonstrating advanced analytical skills and the ability to handle complex datasets.

Data Analyst
6/2/2020 - 6/1/2021

Defined requirements, composed architecture, and implemented solutions centered around identity management, access control, and log centralization using CA tools such as IDM, Provisioning Manager, and API Gateway Policy. Maintained and performed queries via Apache and Insomnia, while also developing data analysis in Python and Pandas for over 100,000 system profiles through files and APIs for ongoing IDM treatment.

Systems Analyst | Developer
8/2/2018 - 6/2/2020

Served as a Database Administrator for a call system, overseeing key database operations. Managed routine Web IIS services and applications on a Windows server, ensuring operational stability and performance. Developed and modified system routines within the database utilizing PL/SQL, enhancing efficiency and functionality. Generated comprehensive reports from the database and created procedures for users to access and interpret system data seamlessly.

VB6 Developer
5/2/2017 - 5/2/2018

Demonstrated expertise in SQL and Visual Basic programming languages. Proficient in generating detailed reports utilizing Crystal Reports. Applied Scrum methodology effectively in software projects, leveraging Team Foundation to enhance team collaboration and project management.

Sales and Marketing Management at Our Lady of Patronage University Center
2006 - 2009

Analysis and Development of Systems at City University of São Paulo
2012 - 2015