On syncing data2017-07-17-I’m working on an ETL pipeline, which pulls from a REST API, does some transformations, and upserts it into a database. The REST API occasionally has invalid data (e.g. alphabet characters in the zip code, or misspelled US state names), and also occasionally throws HTTP 500 error pages. I’m supposed to stall the entire pipeline … Continue reading "On syncing data"
Lumens vs Candelas vs Lux2017-03-13-Whether you’re growing plants or have an obsession with flashlights, you will encounter the terms candela, lux and lumens. These all refer to measuring light, but what’s the difference? Radiant flux Let’s start from the beginning. Light is composed of photons, which have a specific energy depending on the wavelength. The radiant flux is simply … Continue reading "Lumens vs Candelas vs Lux"