Founding Data Engineer @ Lightbird.ai
Designed & implemented Data Lake for LLM Agent Product, creating multimodal ingestion ETL's in Dagster to supply up to date knowledge documents.
Crafting data solutions and their supporting infrastructure for machine learning with a penchant for innovation.
Designed & implemented Data Lake for LLM Agent Product, creating multimodal ingestion ETL's in Dagster to supply up to date knowledge documents.
end to end machine learning project: scraping, processing, and applying LLMs to News Articles.
I developed an artistic application called Fitstyle, which integrates advanced segmentation and style transfer technology to deliver a unique photo filter. Made with my friend Joel Goncalves.
As a Data Engineer for Titanium Software I developed and improved several ETL pipelines utilizing Python, Logstash, and SQLite. These pipelines effectively enriched and cleansed telecom metadata. I also collaborated with customers to produce customized Kibana security reports for the centralized solution, Titan. Additionally, I proposed and implemented a successful CI/CD pipeline for the product.
As an SRE for the Openshift Dedicated Platform team, I played a key role in enhancing the performance of Openshift Dedicated (RedHat's PAAS offering) by building operators and deploying an Elastic based monitoring solution.
By implementing K-means clustering in Python, Pandas, and Scikit-learn, I generated anomaly detection reports for the CI/CD of RHEL/Fedora, providing valuable data insights to development teams.
Built computer vision application for sensing nutrient deficiencies in plants using Python, scikit-learn, and OpenCv.
Python, GoLang, Java, Groovy, JavaScript
Kubernetes, Openshift, Ansible, Jenkins, Terraform, Docker, Prometheus, Zabbix, Elastic
TensorFlow, PyTorch, Numpy, Pandas, Scikit-learn, OpenCV
Elastic, SQLite, PostGresSQL
Create example projects and guide new developers on their path into the industry. Such as OWID-Notebooks: minimal example for ETL and visualization.
Hiking, Biking, Algebraic Number Theory