From eb628ece2f56869e2ae60872ea247fc67ee3524d Mon Sep 17 00:00:00 2001 From: Chris Oelerich Date: Thu, 10 Oct 2019 10:25:48 -0400 Subject: [PATCH] Fix invalid Kryoserializer buffer config format see documentation here: spark.apache.org/docs/latest/configuration.html --- spark/thirftserver-kyroserialization-exception.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/spark/thirftserver-kyroserialization-exception.md b/spark/thirftserver-kyroserialization-exception.md index d5d1ac4..b694520 100644 --- a/spark/thirftserver-kyroserialization-exception.md +++ b/spark/thirftserver-kyroserialization-exception.md @@ -27,4 +27,4 @@ This exception is caused by the serialization process trying to use more buffer ## Solution -Increase the Kyroserializer buffer value. Add a key named `spark.kryoserializer.buffer.max` and set it to 2048 in spark2 config under "Custom spark2-thrift-sparkconf". \ No newline at end of file +Increase the Kyroserializer buffer value. Add a key named `spark.kryoserializer.buffer.max` and set it to 2048m in spark2 config under "Custom spark2-thrift-sparkconf".