Harsh Daiya

Harsh Daiya

14 followers

Sr. Data Engineer working mostly on Data and Observability problems. Writing mostly about Data and cloud, sometimes productivity and other musings.

Advanced SQL - The next frontier

Pinned
Jan 12, 20235 min read128 views

Advanced SQL is a powerful tool that allows you to retrieve, analyze, and manipulate large amounts of data in a structured and efficient way ยท Advanced...

Advanced SQL - The next frontier

Implementing Real-Time Credit Card Fraud Detection with Apache Flink on AWS

Jan 5, 20244 min read27 views

Credit card fraud is a significant concern for financial institutions, as it can lead to considerable monetary losses and damage customer trust....

Implementing Real-Time Credit Card Fraud Detection with Apache Flink on AWS

Managing keys & environment variables in a python pipeline/app

Oct 31, 20233 min read6 views

In a production ETL (extract, transform, load) pipeline, it is often helpful to manage environment variables to store sensitive information, such as...

Managing keys & environment variables in a python pipeline/app

ScyllaDB - Getting started

Mar 12, 20236 min read1.3K views

Recently I read this article where Discord migrated its messages cluster from Cassandra to ScyllaDB, it reduced message latencies from 200...

ScyllaDB - Getting started

Deploy your data pipelines with Github Actions

Jan 29, 20234 min read226 views

Automate, customize, and execute your software development workflows right in your repository with GitHub Actions. You can discover, create, and share...

Deploy your data pipelines with Github Actions

Apache Cassandra w/ Python

Jan 11, 20235 min read258 views

Apache Cassandra is a highly scalable, high-performance, and fault-tolerant NoSQL database. It is designed to handle large amounts of data across many...

Apache Cassandra w/ Python