v0.17.1

[0.17.1] - 2024-05-27

Fixed

• Poor performance when writing many small layouts to pxl file (~45x speed-up). This should almost only
  impact test scenarios, since most real components should be large enough for this not to be an issue.

v0.17.0

[0.17.0] - 2024-05-23

Added

• Add rate_diff_transformation function with rate-diff alias as an alternative option for transforming marker counts before colocalization calculation.
• Add local_g function to compute spatial autocorrelation of marker counts per node.
• Add compute_transition_probabilities function to compute transition probabilities for k-step random walks for node pairs in a graph.
• Add QC plot showing UMIs per UPIA vs Tau.
• Add plot functions showing edge rank and cell counts.
• Add 2D and 3D graph plot functions.
• Add heatmap plot functions showing colocalization and differential colocalization.
• Add volcano plot (value difference vs log p-value) function for differential colocalization.
• Add a function to calculate the differential colocalization between two conditions.
• Performance improvements and reduced bundle size in QC report.
• Improved console output in verbose mode.
• Improved logging from multiprocessing jobs.
• Improved runtime for graph creation.
• Added PMDS layout algorithm.
• Add --sample_name option to single-cell amplicon to overwrite the name derived from the input filename.
• Add --skip-input-checks option to single-cell amplicon to make input filename checks warnings instead of errors.
• PixelDataset instances are now written to disk without creating intermediate files on-disk.
• A nice string representation for the Graph class, to let you know how many nodes and edges there are in the current graph object instance.
• Metric to collect molecules (edges) in cells with outlier distributions of antibodies (aggregates).
• Provide typed interfaces for all per-stage report files using pydantic.
• Centralize pixelator intermediate file lookup and access.
• Add a precomputed_layouts property to PixelDataset to allow for loading precomputed layouts.
• Add pixelator single-cell layout stage to pixelator, which allows users to compute layouts for a PXL file that can then be used to visualize the graph in 2D or 3D downstream.
• Add minimum marker count polarization_min_marker_count parameter to calculate Polarity Score.
• Add "log1p" as an alternative for PolarizationNormalizationTypes.
• Add convert_indices_to_integers option when creating graphs.
• Add a feature flag module to aid in the development of new features.

Changed

• Change name and description of Avg. Reads per Cell and Avg. Reads Usable per Cell in QC report.
• The output name of the .pxl file from the annotate step is now *.annotated.dataset.pxl.
• The output name of the .pxl file from the analysis step is now *.analysis.dataset.pxl.
• The term edges in metrics and adata is now replaced with molecules.
• Renaming of variables in per-stage JSON reports.
• Changed name of TCRb to TCRVb5 antibody in human-immunology-panel file and bumped to version 0.5.0.
• Renaming of component metrics in adata.
• Use MPX graph compatible permutation strategy when calculating Moran's I related statistics.
• Marker filtering is now done after count transformation in polarization score calculation.
• Use the input read count at the annotate stage for the fraction_antibody_reads_in_outliers metric denominator instead of the total raw input reads.
• Use common analysis engine to orchestrate running different "per component" analyses, like polarization and colocalization analysis (yielding a roughly 3x speed-up over the previous approach).
• The default transformation for the calculation of the polarity score is now log1p instead of clr.

Fixed

• Fix a bug in how discarded UMIs are calculated and reported.
• Fix deflated counts in the edgelist after collapse.
• Fix a bug where an r1 or r2 in the directory part of a read file would break file name sanity checks.
• Fix a bug where the wrong r1 or r2 in the filename would be removed when multiple matches are present.
• Logging would cause deadlocks in multiprocessing scenarios, this has been resolved by switching to a server/client-based logging system.
• Fix a bug in the amplicon stage where read suffixes were not correctly recognized.
• Ensure deterministic results from pmds_layout (given a set seed).
• Fix an issue with the fraction_antibody_reads_usable_per_cell metric where the denominator read count was not correctly averaged with the cell count.

Removed

• Remove multi-sample processing from all single-cell subcommands.
• Remove --input1_pattern and --input2_pattern from single-cell amplicon command.
• Self-correlations, e.g. CD8 vs CD8 are no longer part of the colocalization results, as these values will always be undefined.
• Remove umi_unique_count and upi_unique_count from edgelist.
• Remove umi and median_umi_degree from component metrics.
• Remove normalized_rel and denoised from obsm in anndata.
• Remove the denoise function.
• Remove cell type selector in QC report for UMAP colored by molecule count plots.
• Remove clr as a transformation option in pixelator analysis.

v0.16.2

[0.16.2] - 2024-03-19

Fixed

• Uninitialized value for --polarization-n-permutations

v0.16.1

[0.16.1] - 2024-01-12

Fixed

• Bug in README shield formatting

v0.16.0

[0.16.0] - 2024-01-12

This release introduces two major change in pixelator:

1. the Graph backend has been switched from using igraph to using networkx
2. the license has been changed from GLP2.0 to MIT

Added

• Experimental 3D heatmap plotting feature.
• Optional caching of layouts to speed up computations in some scenarios.
• experimental mark that can be added to functions that are not yet production ready.
• The underlying graph instance e.g. a networkx Graph instance is exposed as a property called raw from the pixelator Graph class.
• Monte Carlo permutations supported when calculating Moran's I (morans_z_sim) in polarization_scores.

Changed

• The default (and only) graph backend in pixelator is now based on networkx.
• mean_reads and median_reads in adata.obs to mean_reads_per_molecule and median_reads_per_molecule respectively.
• Drop support for python 3.8 and 3.9.
• Change output format of collapse from csv to parquet.
• Change input and output format of graph from csv to parquet.
• Change input format of annotate from csv to parquet.
• Rename the report to "qc report"
• Add a Reads per Molecule frequency figure to the sequencing section of the qc report.
• Remove placeholder warning of missing data for not yet implemented features.
• Change "Median antibody molecules per cell" to "Average antibody molecules per cell" in the qc report.
• Refactoring of the graph backend implementations module.
• Speeding up the amplicon step by roughly 3x.

Fixed

• Nicer error messages when there are no components valid for computing colocalization.
• A bunch of warnings.

Removed

• graph no longer outputs the raw edge list.
• igraph has been dropped as a graph backend for pixelator.

v0.15.2

[0.15.2] - 2023-10-23

Fixed

• Fixed broken pixeldataset aggregation for more than two samples.
• Fixed a bug in graph generation caused by accidentally writing the index to the parquet file. For backwards compatiblity, if there is an column named index in the edgelist, this will be removed and the user will get a warning indicating that this has happened.

v0.15.1

[0.15.1] - 2023-10-18

Fixed

• Fixed a bug in filtering pixeldataset causing it to return the wrong types.
• Fixed a bug in graph layout generation due to incorrect data frame concatenation.

v0.15.0

[0.15.0] - 2023-10-16

Added

• Add support for Python 3.11.
• Add early enablement work for a networkx backend for the graph stage.

Fixed

• Fix report color axis in report figures not updating when selecting markers or cell types.
• Remove placeholder links in report tooltips.
• Fix a bug where aggregating data did not add the correct sample, and unique component columns.

v0.14.0

[0.14.0] - 2023-10-05

Added

• Lazy option for edge list loading (pixeldataset.edgelist_lazy), which returns a
  polars LazyFrame that can be used to operate on the edge list without reading
  all of it into memory.
• Option (ignore_edgelists) to skip the edge lists when aggregating files. This defaults
  to False.

Changed

• Types on the edge list in memory will utilize the pandas category type for string, and
  uint16 for numeric values to lower the memory consumption when working with the
  edge list
• Remove --pbs1 and --pbs2 commandline arguments to pixelator single-cell adapterqc.
• Restructure report figures.
• Improve metric names and tooltips in the report.
• Synchronize zoom level between the scatter plots in cell annotations section of the report.
• Add report placeholder for missing cell annotation data
• Add Fraction of discarded UMIs and Avg. Reads per Molecule metrics to the report.

Fixed

• Fix an issue where pixelator --version would return 0.0.0 when installing in editable mode.

v0.13.1

[0.13.1] - 2023-09-15

Changed

• Unpin igraph dependency to allow for newer versions of igraph to be used.
• Cleanup README and point to the external documentation site.
• Change PyPi package name to pixelgen-pixelator.

Fixed

• Fix an issue where --keep-workdirs option for pytest was not available when running pytest without
  restricting the testdir to tests/integration.
• Fix an issue where pixelator --version would return 0.0.0.