Gabriel R.
Data Engineer

Skills

Spark

Python

Amazon Aws

Gabriel is available for hire

Hire Gabriel R.

All Howdy Candidates are vetted for skills and english proficiency.

Bio

Back-end Developer with over three years of experience in developing REST APIs utilizing Java with the Spring Boot framework. Proficient in deploying applications in production environments using AWS cloud infrastructure.

Data Engineer
1/1/2023 - 9/1/2023

Developed proficiency in data engineering with significant expertise in a BigData environment on AWS utilizing PySpark and SQL. Designed and implemented data models, and created robust data pipelines orchestrated and executed through Airflow. Managed the end-to-end process of collecting, transforming, and loading unstructured, semi-structured, and structured data from various sources including files and databases, leveraging Spark for processing. Ensured efficient data storage using Parquet and CSV formats in S3 (AWS), along with data cleaning procedures to maintain quality and enable data sharing across departments.

In analytics, performed comprehensive data analysis using information from payroll loans, FGTS, credit cards, benefits, personal loans, and vehicle financing. Developed strategic indicators and visualizations with Tableau to support data-driven decision-making and insights.
Data Analytics Intern
2/1/2021 - Present

Developed expertise in data analysis utilizing stock market, vehicle financing, and real estate financing data with Python and SQL. Conducted in-depth studies and exploration of internal data for the creation of new products. Excelled in data modeling for new product prototypes using SQL and PySpark within a BigData environment on AWS (Athena, EMR) and on-premises systems such as Hadoop and Hive. Maintained dynamic relationships with various external Stock Exchange clients and collaborated with the Legal department to validate data hypotheses, ensuring compliance with LGPD and contract stipulations. Oversaw and contributed to the development of new products in collaboration with the technology team, utilizing the SAFe agile methodology to craft detailed development stories.