Skip to content

Releases: GoEddie/spark-connect-dotnet

v4.0.0-build.32

08 Jan 10:46
079d1b4
Compare
Choose a tag to compare

Better Arrow handling

v4.0.0-build.31

03 Dec 19:21
b63f65a
Compare
Choose a tag to compare
  • Split which was calling incorrect function
  • First and Last were missing ignoreNull argument
  • Added ability to print out a DataFrame's relations to the console for debugging

v4.0.0-build.30

27 Nov 19:49
380f439
Compare
Choose a tag to compare

Fixes an issue with Spark 3.5.3 where long running requests do not complete and we keep re-calling Execute when we should be calling ReattachExecute because we do not set an initial operation id.

v4.0.0-build.29

22 Nov 08:03
Compare
Choose a tag to compare

v4.0.0-build.28

11 Nov 15:52
53e5964
Compare
Choose a tag to compare

Bug in CreateOrReplace that used the create mode and not createOrReplace mode

v4.0.0-build.27

07 Nov 21:59
4a2e72a
Compare
Choose a tag to compare

Fixes to work better with databricks
Extra functions - IsNotNull on a Column and allow null lit's

v4.0.0-build.26

12 Oct 16:30
bc719ec
Compare
Choose a tag to compare
  • Fix to Variant Data Type

v4.0.0-build.25

12 Oct 14:42
906455b
Compare
Choose a tag to compare
  • First version that supports Spark 4 (is backwards compatible with 3.*).
  • Implements ExecuteReattach for better network connectivity and retries (pretty essential for connecting to Databricks)
  • Re-written Apache Arrow implementation to better handle Arrow responses
  • Variant Type includes in Spark 4.0
  • Spark 4.0 additional functions (such as From_Xml, Parse_Json, etc)

v3.5.1-build.23

26 Jun 18:42
39538f5
Compare
Choose a tag to compare
  • fix planid when creating a new relation in preparation for metrics in spark 4 (parentId on the metrics needs to be set)

v3.5.1-build.22

08 Jun 12:48
ca91280
Compare
Choose a tag to compare

includes all the functions under Spark.Sql.Functions (except udf's)