Skip to content

Releases: AbsaOSS/py2k

🐛 Bug fix: Kafka Schema now extracted from entire dataframe

04 Oct 15:46
4e28810
Compare
Choose a tag to compare

Bug

  • 🐛 Kafka Schema was not extracted from entire Dataframe. #76 - @vesely-david

v1.9.0

14 May 13:03
1c59c56
Compare
Choose a tag to compare

✨ Added support for dynamic creation from Dataframe to return an iterator. #67 - @vesely-david

  • User can choose whether to return list (from_pandas) or iterator (iter_from_pandas)
  • KafkaWriter was adjusted accordingly to accept any iterable in it's write method

v1.8.2

06 Apr 09:04
Compare
Choose a tag to compare

Changelog

v1.8.2 (2021-04-06)

Bugs

  • Resolved boolean schema not being converted to the correct avro schema values PR #48 - @vesely-david

v1.8.1 (2021-03-31)

Docs

v1.8.0 (2021-03-29)

Fixes

  • Adhering to Kafka and Avro parlance by renaming:
    • models module -> record
    • KafkaModel -> KafkaRecord
    • DynamicPandasModel -> PandasToRecordsTransformer
    • item -> record
  • Move schema knowledge to KafkaRecord
  • Introduce __key_fields__ in KafkaRecord to enable specifying which fields are part of the key
  • Introduce __include_key__ in KafkaRecord to enable specifying whether key_fields should be part of the value message

Big thank you to @vesely-david for this change

V1.7.0 - First Public Release

12 Mar 07:58
f595567
Compare
Choose a tag to compare

Public Go-Live

Our first release of Py2K

features

  • Easily post to Kafka with a high-level Python API
  • Automatic schema creation from Pydantic-like objects
  • Automatic schema creation from pandas DataFrames
  • Automatic serialisation of Pydantic-like objects and pandas DataFrames to Avro