Design Challenge: Integrate Kubernetes VPA with Apache Spark

Apache Spark and Kubernetes Apache Spark is a distributed data processing engine that can read data from a range of data sources and make requested computations on that data in a distributed manner. It is a system of program instances running in different physical or virtual nodes. There is a master instance called a “driver” … Read more

Why I switched from Backend Engineer to Big Data Engineer after 10+ years

After over a decade of working as a backend engineer, I switched to a new domain. This post explores my unexpected transition into the world of Big Data and the motivations behind my career shift. My background I’m a software engineer who has worked in several companies for 13 years. For most of my professional … Read more

Practical Clean Coding: Naming

This article is part of the Practical Clean Coding series. There are only two hard things in Computer Science: cache invalidation and naming things. — Phil Karlton We write programs for humans, not computers. Thinking the opposite is a common misconception, or we don’t think hard enough about it. Who is the target audience of … Read more

Practical Clean Coding: A Comprehensive Guide to Maintainable Code

This is the first article in the “Practical Clean Coding” articles series. 1. Introduction: The Art of Writing Code Humans Can Understand “Any fool can write code that a computer can understand. Good programmers write code that humans can understand.” – Martin Fowler. Clean coding is a mindset and a set of practices to achieve … Read more