Harsh Daiya

Harsh Daiya

12 followers

Sr. Data Engineer working mostly on Data and Observability problems. Writing mostly about Data and cloud, sometimes productivity and other musings.

Advanced SQL - The next frontier

Pinned
Jan 12, 20235 min read 73 views

Advanced SQL is a powerful tool that allows you to retrieve, analyze, and manipulate large amounts of data in a structured and efficient way ยท Advanced...

Advanced SQL - The next frontier

ScyllaDB - Getting started

Mar 12, 20236 min read 519 views

Recently I read this article where Discord migrated its messages cluster from Cassandra to ScyllaDB, it reduced message latencies from 200...

ScyllaDB - Getting started

Deploy your data pipelines with Github Actions

Jan 29, 20234 min read 93 views

Automate, customize, and execute your software development workflows right in your repository with GitHub Actions. You can discover, create, and share...

Deploy your data pipelines with Github Actions

Apache Cassandra w/ Python

Jan 11, 20235 min read 107 views

Apache Cassandra is a highly scalable, high-performance, and fault-tolerant NoSQL database. It is designed to handle large amounts of data across many...

Apache Cassandra w/ Python

Idempotency in Data pipelines - Overview

Jan 11, 20235 min read 452 views

Idempotency is an important concept in data engineering, particularly when working with distributed systems or databases. In simple terms, an...

Idempotency in Data pipelines - Overview

OpenTelemetry + Splunk : A perfect match

Dec 28, 20227 min read 146 views

Introduction: OpenTelemetry is an open-source, vendor-neutral observability platform that enables you to collect, process, and export telemetry data...

OpenTelemetry + Splunk : A perfect match