Medium

Pankaj Jagdale

Pankaj Jagdale

·

Sep 17, 2024

Partition Skew in Spark: Causes, Impacts, and Effective Solutions

Techniques to Handle Skewed Partitions in Apache Spark:

Partition Skew in Spark: Causes, Impacts, and Effective Solutions

Pankaj Jagdale

·

Sep 16, 2024

Understanding Apache Spark Job Execution: From Submission to Execution

Full Spark Job Process: What Happens When You Submit a Spark Job

Understanding Apache Spark Job Execution: From Submission to Execution

Pankaj Jagdale

·

Sep 15, 2024

Distribution keys and Sort keys in Redshift

In Amazon Redshift, distribution keys and sort keys are key concepts that help optimize data distribution, storage, and query performance…

Distribution keys and Sort keys in Redshift

Pankaj Jagdale

·

Sep 15, 2024

Bucketing Vs Partitioning

Bucketing and Partitioning are two important data organization techniques used in distributed data systems (such as Hive, Spark, etc.) to…

Bucketing Vs Partitioning

Pankaj Jagdale

·

Sep 15, 2024

Understanding ACID Properties: Ensuring Reliable Transactions in Databases

ACID properties are fundamental principles in database management systems to ensure reliable transactions. They stand for Atomicity…

Understanding ACID Properties: Ensuring Reliable Transactions in Databases

Pankaj Jagdale

·

Sep 15, 2024

Comparing Serverless SQL Pool and Dedicated SQL Pool in Azure Synapse Analytics

Azure Synapse Analytics offers two distinct query processing engines: Serverless SQL Pool and Dedicated SQL Pool. Both are designed for…

Comparing Serverless SQL Pool and Dedicated SQL Pool in Azure Synapse Analytics

Pankaj Jagdale

·

Sep 15, 2024

Relational Schema in a Database vs Star Schema and Snowflake Schema in Data Warehousing

Example:

Relational Schema in a Database vs Star Schema and Snowflake Schema in Data Warehousing

Pankaj Jagdale

Pankaj Jagdale

Data Engineer specializing in Azure Data Factory and Databricks. Passionate writer on Medium, sharing insights and tips on data engineering.

Following

Help

Status

About

Careers

Press

Blog

Store

Privacy

Rules

Terms

Text to speech