Welcome to my domain, where Data Engineering meets the Seven Kingdoms! Just like the great lords and ladies of Westeros, I craft robust and scalable systems to rule over the vast oceans of data. Every byte and pipeline here serves the realm of distributed systems, real-time data processing, and backend development.
- 🔥 House of Data: Forged in the fiery pits of Apache Kafka and Spark, my expertise lies in building real-time pipelines, scalable data lakes, and distributed systems.
- 🌌 Guardian of Infrastructure: Commanding the clouds with AWS and GCP, deploying Terraform, and orchestrating fleets of containers with Kubernetes.
- 🧙 Wizard of Code: Fluent in the sacred tongues of Golang, Scala, and Python to bring order to the chaotic realms of data.
- 🛡️ Protector of Privacy: Ensuring data governance and GDPR compliance with meticulous workflows and automation.
- 🎯 Champion of Challenges: From taming wild streams of real-time data to building fault-tolerant systems, I bring scalable solutions to the throne.
- 🏹 Programming Languages:
- 🏰 Data Engineering:
- 🛡️ Cloud & Orchestration:
- 🔧 Backend Development:
- Data Engineer: Master of ETL/ELT, data modeling, and real-time pipelines.
- Problem Solver: Unwavering in taming unruly systems and conquering data challenges.
- Cloud Architect: Scaling castles in the clouds for high availability and performance.
- Tech Leader: Leading teams to victory, fostering collaboration, and driving impactful solutions.
- A distributed key-value store built with Raft consensus and BadgerDB, ensuring fault tolerance and high availability.
- Repository Link
- Built a local data lake using Apache Hudi and Debezium for efficient CDC processing.
- Repository Link
- Created a powerful tool to generate synthetic data for testing and development purposes.
- Repository Link
- Designed a system to process and analyze financial order book data, enabling real-time trading insights.
- Repository Link
I share my journey through the Seven Kingdoms of Data on Medium. From conquering the Kafka Streams to designing GDPR-compliant architectures, the chronicles are open for all who seek wisdom.
- 🛡️ Portfolio
- ✍️ Medium Blog
"The night is dark and full of data, but with the right pipelines, we bring the light."