Spark Performance Optimization Series: #1. Skew
![](https://miro.medium.com/v2/resize:fit:600/1*cQVX-3EDgxmob39u_bF29g.jpeg)
In Spark cluster data is typically read in as 128 MB partitions which ensures even distribution of data. However, as the data is transformed (e.g. aggregated), it is possible to have significantly…
![](https://image.slidesharecdn.com/052014danieltomes-190510165131/85/apache-spark-coredeep-diveproper-optimization-40-320.jpg?cb=1693316476)
Apache Spark Core—Deep Dive—Proper Optimization
![](https://sparkbyexamples.com/wp-content/uploads/2020/08/spark-performance-optimization.jpg)
Spark Performance Tuning & Best Practices - Spark By {Examples}
![](https://miro.medium.com/v2/resize:fit:1400/1*v9CuE142uJyURrhxOemNVA.png)
Kubernetes Architecture,Hands On!, by Himansu Sekhar
High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark - Kindle edition by Karau, Holden, Warren, Rachel. Download it once and
![](https://m.media-amazon.com/images/I/51FGUj2c+FL.jpg)
High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark See more 1st Edition1st Edition
![](https://i0.wp.com/rajanieshkaushikk.com/wp-content/uploads/2023/04/Snowflake-Query-Optimization-part-2-2.png?resize=1024%2C875&ssl=1)
Optimizing Snowflake Queries: Boosting Performance - Beyond the Horizon
![](https://miro.medium.com/v2/resize:fit:1400/1*VgumBN4npdn328hl9VMqXA.png)
Spark's Skew Problem —Does It Impact Performance ?, by Aditya Sahu, Curious Data Catalog
![](https://miro.medium.com/v2/resize:fit:1358/1*dq6DDCmiir7N_ZH_jPXb2g.png)
List of cool blogs focussing on Spark performance optimization., by Sukul Mahadik
apache spark Archives - Sync
![](https://miro.medium.com/v2/resize:fit:1400/0*Hylm3y0Kbk4AXOwA.png)
Advanced Spark Tuning, Optimization, and Performance Techniques, by Garrett R Peternel
![](https://miro.medium.com/v2/resize:fit:1400/1*fu4t--uE_l0zafKJe_BkOA.png)
Spark Performance Tuning: Skewness Part 1, by Wasurat Soontronchai
![](https://data-flair.training/blogs/wp-content/uploads/sites/2/2017/05/Spark-SQL-Optimization-2.jpg)
Spark SQL Optimization - Understanding the Catalyst Optimizer - DataFlair
![](https://m.media-amazon.com/images/I/51FGUj2c%2BFL._SR600%2C315_PIWhiteStrip%2CBottomLeft%2C0%2C35_PIStarRatingFOUR%2CBottomLeft%2C360%2C-6_SR600%2C315_ZA86%2C445%2C290%2C400%2C400%2CAmazonEmberBold%2C12%2C4%2C0%2C0%2C5_SCLZZZZZZZ_FMpng_BG255%2C255%2C255.jpg)
High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark 1, Karau, Holden, Warren, Rachel, eBook
![](https://static.wixstatic.com/media/0ae714_29940f58face41b8be666ff75062bdfd~mv2.jpg/v1/fill/w_344,h_193,al_c,lg_1,q_80,enc_auto/0ae714_29940f58face41b8be666ff75062bdfd~mv2.jpg)
Spark Job Optimization: Dealing with Data Skew