Releases: GoEddie/spark-connect-dotnet
Releases · GoEddie/spark-connect-dotnet
v4.0.0-build.32
Better Arrow handling
v4.0.0-build.31
Split
which was calling incorrect functionFirst
andLast
were missingignoreNull
argument- Added ability to print out a
DataFrame
's relations to the console for debugging
v4.0.0-build.30
Fixes an issue with Spark 3.5.3 where long running requests do not complete and we keep re-calling Execute when we should be calling ReattachExecute because we do not set an initial operation id.
v4.0.0-build.29
Fixes from https://github.com/tdb108:
v4.0.0-build.28
Bug in CreateOrReplace that used the create mode and not createOrReplace mode
v4.0.0-build.27
Fixes to work better with databricks
Extra functions - IsNotNull on a Column and allow null lit's
v4.0.0-build.26
- Fix to Variant Data Type
v4.0.0-build.25
- First version that supports Spark 4 (is backwards compatible with 3.*).
- Implements ExecuteReattach for better network connectivity and retries (pretty essential for connecting to Databricks)
- Re-written Apache Arrow implementation to better handle Arrow responses
- Variant Type includes in Spark 4.0
- Spark 4.0 additional functions (such as From_Xml, Parse_Json, etc)
v3.5.1-build.23
- fix planid when creating a new relation in preparation for metrics in spark 4 (parentId on the metrics needs to be set)
v3.5.1-build.22
includes all the functions under Spark.Sql.Functions (except udf's)