YTsaurus Java SDK 1.2.3

• Introduced DiscoveryClient.
• The following types are supported in @Entity fields (use @Column(columnDefinition=“...”) to specify type):
  • enum -> utf8/string;
  • String -> string;
  • Instant -> int64;
  • YsonSerializable -> yson.
• Fixed a bug due to which YTsaurusClient did not terminate.

YTsaurus Python SDK 0.13.15

Features:

• Add respawn in docker functionality
• Fixes in conditional imports and dataclasses for type hint support
• Add option for ignore system py modules while pickling
• Use pickling by value in interactive envs with dill
• Add wide time types
• Add --syntax-version option to client, add composite types member accessors
• Add retries for skiff
• Add consumer type handler for node creation
• Add logic for auto selection of operation layer
• Added an option for not merging rows in select
• Add with-monitoring-descriptor option
• Add missing method in spec builder
• Add table creation in upload parquet
• Optimize skiff dump performance for long dataclasses
• Support parsing type_v1 from yson to schema
• Add enable_replicated_table_tracker argument to alter_table_replica wrapper methods
• Add close property to ResponseStream
• Allow to pass single SortColumn to build_schema_sorted_by

Fixes:

• Fix typo: comitted, commited -> committed
• Fix deprecated utcnow
• Fix ignore of YT_PREFIX by certain commands

YTsaurus Python Yson 0.4.8

• Add table creation in upload parquet
• Reduce bindings .so size

YTsaurus SPYT 1.78.0

• Reverting Spark 3.2.2 fork to its original state
• Support for specifying network name when using direct submit
• Writing all python driver output to stderr when using direct submit
• Several bug fixes

YTsaurus Java SDK 1.2.2

• Supported placeholder values in SelectRowsRequest.
• Supported specifying the proxy network name.
• Supported set(Input/Output)Format in CommandSpec.
• Fixed a bug that caused NoSuchElementException in SyncTableReader.
• Fixed a bug that caused the table to be recreated when writing without "append".

YTsaurus QueryTracker 0.0.6

• Fixed authorization in complex cluster-free YQL queries
• Fixed a bug that caused queries with large queries to never complete
• Fixed a bag caused possibility of SQL injection in query tracker
• Reduced the size of query_tracker docker images

Related issues:

• Problems with QT ACOs

In case of an error when starting query

Access control object "nobody" does not exist

You need to run commands by admin

yt create access_control_object_namespace --attr '{name=queries}'
yt create access_control_object --attr '{namespace=queries;name=nobody}'

YTsaurus QueryTracker 0.0.5

• Added access control to queries
• Added support for the in‑memory DQ engine that accelerates small YQL queries
• Added execution mode setting to query tracker. This allows to run queries in validate and explain modes
• Fixed a bug that caused queries to be lost in query_tracker
• Fixed a bug related to yson parsing in YQL queries
• Reduced the load on the state dyntables by QT
• Improved authentication in YQL queries.
• Added authentication in SPYT queries
• Added reuse of spyt sessions. Speeds up the sequential launch of SPYT queries from a single user
• Changed the build type of QT images from cmake to ya make

NB:

• Compatible only with operator version 0.6.0 and later
• Compatible only with proxies version 23.2 and later
• Before updating, please read the documentation section containing information about the new query access control.

New related issues:

• Problems with QT ACOs

In case of an error when starting query

Access control object "nobody" does not exist

You need to run commands by admin

yt create access_control_object_namespace --attr '{name=queries}'
yt create access_control_object --attr '{namespace=queries;name=nobody}'

YTsaurus SPYT 1.77.0

• Support for Spark Streaming using ordered dynamic tables;
• Support for CREATE TABLE AS, DROP TABLE and INSERT operations;
• Session reuse for QT SPYT engine;
• SPYT compilation using vanilla Spark 3.2.2;
• Minor perfomance optimizations

YTsaurus Python Yson 0.4.7

• Add implementation of upload_parquet
• Fix invalid memory access in YsonStringProxy

YTsaurus Python SDK 0.13.14

Features:

• Added an option for skipping rows merge in select
• Support composite types in QL
• Add preserve_account option to table backup commands
• Expand the list of dynamic table retriable errors
• Enhance table creation with specified append attribute
• Various improvements of maintenance API
• Support upload_parquet command

Fixes:

• Support SortColumn serialization
• Fix file descriptors leak in config parsing
• Fix output stream validation for TypedJobs