Posts

I Advise On Data Privacy Now

January 17, 2024 | Fabian Stadler | 5 min

In the middle of last year, I was facing a big change, as I had already invested several months of time in starting my own business in July 2023. What started out a little hesitantly...

Two silver, elongated surveillance cameras hang on a wall, connected to two power boxes behind them via pipes and cables. The first camera is tilted slightly downwards to the right, the second camera is tilted slightly higher but also points to the right. Most of the wall is plastered with gray plaster. Only the upper edge of the picture shows gray bricks.

Buildbot as open-source CI/CD alternative

November 21, 2023 | Fabian Stadler | 8 min

CI/CD software has now become a standard for development departments in a wide range of industries. As a result, there are now services from a wide range of providers, all of which more or less...

Screws, shims and nuts on a brown, marbled table.

Pipelines as Code With Delta Live Tables

April 4, 2023 | Fabian Stadler | 10 min

It has now been almost a year since Databricks released a new ETL framework under the name Delta Live Tables. With this, the San Francisco-based company is focusing on the strategy of being able to...

An image of a pressure water line as a metaphor for data pipelines.

Low-code vs. High-code Data Pipelines

April 3, 2023 | Fabian Stadler | 6 min

In the hybrid scenarios that I recently mentioned in my post about the Data Lakehouse and that still dominate the industry, Spark machines are often used in many places to perform data transformations. In this...

A cartoon image of a small plant that is growing out of soil as a metaphor for investment in technological architecture.

Data Lakehouse as Single Source of Truth

April 2, 2023 | Fabian Stadler | 7 min

Over the past few years, the data lake architecture has become the de facto standard for big data use cases. However, many companies still found their data layer on relational databases for BI use cases....

An image of old medieval pipes in a well where water is coming out as a metaphor for data flows.

I Tested GitHub Copilot and This Happened

March 1, 2023 | Fabian Stadler | 15 min

It was in late 2021 that I first heard of Microsoft’s new AI coding tool, GitHub Copilot. It was the first major news for me after the controversial acquisition of GitHub by Microsoft and the...

Observability of Microservices With Datadog

January 28, 2023 | Fabian Stadler | 8 min

In today’s fast-paced and ever-changing software development landscape, deploying microservices to Kubernetes has become a popular and effective way to build and manage large, complex systems. However, as the number of microservices in a system...

An image of a cat with blue eyes as a metaphor for observability.

Becoming Azure Data Engineer in Twenty Days

December 24, 2022 | Fabian Stadler | 5 min

At the beginning of December 2022, I had the spontaneous idea to complete a Microsoft certification for the Azure Platform. I worked for about a year as a data engineer on a project for an...