The Battle of the Compressors: Optimizing Spark Workloads with
![](https://miro.medium.com/v2/resize:fit:1200/1*RALn3epg4DmDfURqkKUJVA.png)
Hello! Hope you’re having a wonderful time working with challenging issues around Data and Data Engineering. In this article let’s look at the different compression algorithms Apache Spark offers…
![](https://miro.medium.com/v2/resize:fit:1400/0*b3jEIVWk_m0_J9jH.png)
A gentle introduction to Apache Arrow with Apache Spark and Pandas, by Antonio Cachuan
![](https://miro.medium.com/v2/resize:fit:596/0*yVYpLFj8kxKzbuqt.png)
Spark on Scala: Adobe Analytics Reference Architecture, by Adrian Tanase
![](https://miro.medium.com/v2/resize:fit:748/1*xuLOsfL1GkIrJGjawuHvUw.png)
A gentle introduction to Apache Arrow with Apache Spark and Pandas, by Antonio Cachuan
![](https://miro.medium.com/v2/resize:fit:794/1*S2nDuROgWQGd0_uauGT8EA.png)
Bucketing: Are you leveraging it in a right way ?, by Aditya Sahu, Curious Data Catalog
![](https://miro.medium.com/v2/resize:fit:1400/0*kYVoDa3to-q5Kid7.png)
Data processing with Spark: ACID, by Petrica Leuca
![](https://miro.medium.com/v2/resize:fit:1400/1*z9GE5tzihk3OG56nA-XZLw.png)
Accelerate Your Parquet Data for Athena Queries, by Kevin W
![](https://miro.medium.com/v2/resize:fit:1400/0*Si_9V3INdLpM2ceu.png)
Advanced Spark Tuning, Optimization, and Performance Techniques, by Garrett R Peternel
![](https://miro.medium.com/v2/resize:fit:1266/0*oMxuw9VFV_ui1KtM.png)
Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos
Pyspark — save vs. saveToTable. A cautionary tale of side effects that…, by Ivelina Yordanova
Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos
![](https://miro.medium.com/v2/resize:fit:600/0*LiLR0EmmJys7xqIg.jpg)
Scalable Sparse Matrix Multiplication in Apache Spark, by Unsupervised Blog, Balabit Unsupervised
Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos
Pyspark — save vs. saveToTable. A cautionary tale of side effects that…, by Ivelina Yordanova
![](https://miro.medium.com/v2/resize:fit:1400/1*nNw6jrgM1H_3nvqpFvdyHg.png)
Spark on Scala: Adobe Analytics Reference Architecture, by Adrian Tanase
![](https://miro.medium.com/v2/resize:fit:1400/1*0zqvn9_-TnlEm8rQuuJhHg.png)
Load Data using EMR Spark with Apache Iceberg, by Vishal Khondre