Release 3.5.0

3.5.0

• Support for Apache Spark 3.5 (SPARKC-704)
• Fix: Projection of Sub Elements (SPARKC-699)

Release 3.4.1

Scala 2.13 support (SPARKC-686)

Release 3.4.0

• Spark 3.4.x support (SPARKC-702)
• Fix complex field extractor after join on CassandraDirectJoinStrategy (SPARKC-700)

Release 3.3.0

• Spark 3.3.x support - Scala 2.12 (SPARKC-693)
• Materialized View read support fix (SPARKC-653)
• Fix Direct Join projection collapse (SPARKC-695)
• Fix mixed case column names in Direct Join (SPARKC-682)

Release 3.2.0 - Spark 3.2 compatible

• Spark 3.2.x support (SPARKC-670)
• Fix: Cassandra Direct Join doesn't quote keyspace and table names (SPARKC-667)
• Fix: The connector can't find a codec for BLOB <-> java.nio.HeapByteBuffer (SPARKC-673)

Release 3.1.0 - Spark 3.1 compatible

• Updated Spark to 3.1.1 and commons-lang to 3.10 (SPARKC-626, SPARKC-646)
• UDTValue performance fix (SPARKC-647)
• update java driver to 4.12.0 (SPARKC-656)

Release 3.0.1

Includes all 2.5.2 changes and one additional fix:

• Fix: repeated metadata refresh with the Spark connector (SPARKC-633)

Release 2.5.2

• C* 4.0-beta compatibility (SPARKC-615)
• Storage Attached Index (SAI) support (SPARKC-621)
• Java Driver upgraded to 4.10 (SPARKC-637)
• Asynchronous page fetching (SPARKC-619)
• Cassandra Direct Join in the Spark SQL (SPARKC-613)
• Fix: ContinuousPaging settings are ignored (SPARKC-606)
• Fix: spark.cassandra.input.readsPerSec doesn't work for CassandraJoinRDD (SPARKC-627)
• Fix: repartitionByCassandraReplica relocates data to the local node only (SPARKC-642)
• Fix: Custom ConnectionFactory properties are ignored in per-cluster setups (SPARKC-635)

Release 3.0.0

• Scala 2.12 release
• Spark 3.0.x support
• Data Source v2 support
• Cassandra 4.0.0-beta support
• Includes all Datastax Specific Features
• Includes shaded version of the main artifact

2.5.1

2.5.1 LTS Release for Spark 2.4

• Include all DS Specific Features
  • Includes CassandraHiveMetastore
  • Structured Streaming Sink Support
  • DirectJoin Catalyst Optimziation
  • Ttl and Writetime functions for Dataframes
  • Astra and Java Driver 4.0 Support
  • InJoin Optimizations
  • Read Throttle
  • Continuous Paging For DSE Clusters
  • More
• Introduce shaded version of the main artifact