I wrote a technical article covering how Snowflake uses caching on several layers (virtual warehouses caching data and caching of result sets). In the article I also explain how this works and wha...

I wrote a detailed and technical blog post demonstrating an integration of Spark Structured Streaming with Apache Kafka messages and Snowflake. An overview of the content is: querying Twitter ...

I’ve written a blog post covering in depth the new Clustering Keys feature of Snowflake. In the post I explained the internals of how clustering keys work in a Shared-Disk architecture of Snowflak...

I wrote a blog post demonstrating advanced Spark Structured Streaming topics. An overview of the content is: setting up a Kafka server producing messages with Kafka consuming tweets with S...

I’ve written a blog post explaining in-depth how to create User Defined Aggregate Functions (UDAFs) using Javascript on Snowflake. You can find the blog post here. A small preview:

I’ve written a blog post on sonra.io covering window function features supported by Snowflake data warehouse. I covered these topics: Aggregate and sequencing functions on Snowflake Analytic...

I have been looking for good workflow management software and found Apache Airflow to be superior to other solutions. I’ve taken some time to write a pretty detailed blog post on using Airflow for...

This post is a part of a series on Lambda Architecture consisting of: Introduction to Lambda Architecture Implementing Data Ingestion using Apache Kafka, Tweepy Implementing Batch Layer usi...

This post is a part of a series on Lambda Architecture consisting of: Introduction to Lambda Architecture Implementing Data Ingestion using Apache Kafka, Tweepy Implementing Batch Layer usi...

This post is a part of a series on Lambda Architecture consisting of: Introduction to Lambda Architecture Implementing Data Ingestion using Apache Kafka, Tweepy Implementing Batch Layer usi...