Design Challenge: Integrate Kubernetes VPA with Apache Spark

Apache Spark and Kubernetes Apache Spark is a distributed data processing engine that can read data from a range of data sources and make requested computations on that data in a distributed manner. It is a system of program instances running in different physical or virtual nodes. There is a master instance called a “driver” … Read more

Why I switched from Backend Engineer to Big Data Engineer after 10+ years

After over a decade of working as a backend engineer, I switched to a new domain. This post explores my unexpected transition into the world of Big Data and the motivations behind my career shift. My background I’m a software engineer who has worked in several companies for 13 years. For most of my professional … Read more

Practical Clean Coding: Naming

This article is part of the Practical Clean Coding series. There are only two hard things in Computer Science: cache invalidation and naming things. — Phil Karlton We write programs for humans, not computers. Thinking the opposite is a common misconception, or we don’t think hard enough about it. Who is the target audience of … Read more