Designed and built the foundational pieces and initial working version of the Ingestion Framework, a modular tool using Python and Pydantic to declaratively define, validate, and run ingestion processes. Included tools such as:
Unzipping and moving files
Setting up tables (including transformations) by reading in files or another table
A CDC preprocess to either incrementally load data from an external table or do a full compare and generate SCD-2 data
Multiple Director-level functions (following the Builder pattern) for generating configuration files according to the user's input
Created new user stories for feature requests for the framework
Managed progress on said user stories, divvying up work to the team and reviewing/approving PRs as work completed
Assisted team members with any Databricks, Python, Spark, or SQL issues encountered
Assisted team with mass ingestion of tables from foreign catalogs (Bronze)
Assisted team with creation and rollout of transformation tables (Silver/Gold) for new projects
Software Engineer II
2024 - 2025
Helped transition during the split where ATLAS was sold off to Crisp
Contributed to many meetings surrounding direction and feasibility of certain paths
Played a large role in translating a reporting system from the previous environment (a C# ETL/reporting application and stored procedures) to Databricks
Proved out feasibility of translating aspects of the old system to the new:
Incorporating user input for reporting
Building temp tables from input that match the results of the old stored procedures 1:1
Generating finished reports as Excel files
Tooling with a UI for a user to submit updates to a table by uploading a file and having the tool validate it
Dug into performance-related functionality, reducing end-to-end pipeline runtime for the above reporting system from 25 minutes to 8 minutes.
Attempted along with another team member to manage the buildout of an ingestion framework by a contracting company's team
ATLAS (Advantage Solutions subsidiary)
Software Engineer II
2022 - 2024
Became one of the primary maintainers of the Python-based data retrieval tool
Helped develop automation for pulling data from two additional retailers
Repaired automation when it broke due to changes on the retailer's side
Began preparatory work toward an overhaul of the automated report retrieval tool
Software Engineer I
2021 - 2022
Assisted in maintenance of ETL application automating data retrieval from Target for various vendors
Created an application/API using Python to assist with determining primary keys and data prioritization for ingestion of new datasets
Contributed additional functionality to an internal command-line-based tool to speed up workflows
Added an internal tool to our suite of tools in Retool
Bruckner Truck Sales
System Administrator
2020 - 2021
Assisted with day-to-day helpdesk duties
Built a Python application for assisting with inventory management (check it out above!)
Implemented a company-wide multi-factor authentication project
Adjusted Microsoft license usage to reduce costs
cat-man-du
Computer Technician
2013 - 2015
Worked with the customer to determine their computer issues
Replaced faulty components after troubleshooting hardware problems
Removed viruses/malware from infected computers
Performed data recovery on failing hard drives when possible
Education
BS - Technology Management
Texas A&M University
Class of 2020
Minors in Business and Cybersecurity