Lucas S.
Data Engineer

Skills

Spark

Scala

Github

Apache Hadoop

Java

Python

C++

Mysql

Elasticsearch

Amazon Aws

Lucas is available for hire

Hire Lucas S.

All Howdy Candidates are vetted for skills and english proficiency.

Bio

Possesses extensive expertise in Python and the broader Data/Big Data ecosystem. Demonstrated proficiency in Python development with a strong focus on maintaining high code quality. Knowledgeable in various technologies, including ElasticSearch, Scala, Spark, SQL, AWS services (Athena, S3, SQS, Lambda), Jenkins, Web Scraping (Crawler), C, and C++. Exhibits dynamism, excellent communication abilities, and a high level of dedication. Open to engaging in discussions where mutual interest exists.

Data Engineer
4/1/2021 - Present

Developed proficiency in Spark and PySpark for managing large datasets with Azure Databricks and Hive. Regularly utilized Python and AWS tools to streamline data processing workflows. Applied SCRUM methodologies to ensure efficient project management and executed ETL processes to facilitate seamless data integration and transformation.
Data Engineer
1/2/2019 - 1/2/2020

Developed and delivered high-performance web applications using Angular, ensuring seamless user experiences across different devices and platforms. Implemented robust backend services with Node.js and Express, optimizing API response times and enhancing system reliability. Utilized MongoDB and MySQL for effective data management, enabling complex queries and efficient data storage. Leveraged Docker for containerization, contributing to streamlined development and deployment processes. Employed Jenkins for continuous integration and delivery, ensuring that code releases were automated, tracked, and made error-free. Applied test-driven development methodologies using Jest and Mocha, significantly reducing bugs and improving software quality. Monitored and troubleshooted applications using New Relic and Graylog, leading to improved performance and reduced downtime. Conducted code reviews and collaborated closely with team members via Git, promoting best practices and ensuring high code quality.