Browsertrix v1.10.0

Major Features

• Introducing new Quality Assurance feature (still in beta): https://docs.browsertrix.com/user-guide/archived-items/#quality-assurance (Requires Browsertrix Crawler 1.1.0 or higher)
• New branding (logo and styles)
• Browsertrix Cloud renamed to Browsertrix
• Helm chart now part of a helm repository

Deployment

This release can be deployed with Helm directly by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix/releases/download/v1.10.0/browsertrix-v1.10.0.tgz

Alternatively, you can add the Browsertrix Helm Chart Repo with:

helm repo add browsertrix https://docs.browsertrix.com/helm-repo/
helm upgrade --install btrix browsertrix/browsertrix --version 1.10.0

See the development guide for more info how to deploy Browsertrix.

What's Changed

• Add new WIP QA Review page by @SuaYoo in #1500
• Deploy dev cluster with values from ops repo by @vnznznz in #1530
• Merge 1.9.2 Release -> main by @ikreymer in #1542
• Archived item nav button quickfix by @emma-sg in #1543
• Add crawl pages and related API endpoints by @tw4l in #1516
• Increase startup probe time to account for long-running migrations by @ikreymer in #1560
• Add crawl errors incrementally during crawl by @tw4l in #1561
• Refactor operator class into module by @ikreymer in #1564
• pages: set page status to 200 if unset and loadState != 0 by @ikreymer in #1563
• Add guide for customizing Helm chart values by @tw4l in #1556
• Temporarily remove pages migration by @tw4l in #1572
• Create ArchivedItemPage and ArchivedItemPageComment types by @emma-sg in #1567
• Add updatable QA reviewStatus field to crawls by @tw4l in #1575
• Merge V1.9.3 changes into main by @ikreymer in #1583
• Bump cryptography from 41.0.1 to 42.0.4 in /ansible by @dependabot in #1574
• Frontend localhost icon fix by @SuaYoo in #1587
• Fix a couple linting issues by @emma-sg in #1565
• Configurable Max Scale for frontend by @ikreymer in #1557
• Browsertrix Cloud → Browsertrix frontend text rename by @Shrinks99 in #1466
• Manually approve pages in QA review by @SuaYoo in #1576
• Frontend: Icon updates! by @Shrinks99 in #1569
• Add QA tab to archived item detail by @SuaYoo in #1590
• Make storage deletion work on more S3 providers by @wvengen in #1600
• Update issue reporting templates by @SuaYoo in #1596
• profile browser fixes: better resource usage + load retry (main) by @ikreymer in #1604
• Docs: Update docs theme by @Shrinks99 in #1594
• Adds favicons! by @Shrinks99 in #1584
• kubernetes api: avoid overriding content-type header in kubernetes-asyncio, pass in via arg instead (main) by @ikreymer in #1605
• Add ESLint rules for import ordering by @emma-sg in #1608
• Fix mismatch in prettier import order config by @emma-sg in #1609
• Fix missing page component imports by @SuaYoo in #1610
• Upgrade Node 16 > 18 by @SuaYoo in #1612
• Fix asset imports in tests by @SuaYoo in #1611
• Update node version mentioned in docs by @emma-sg in #1615
• Add endpoints to read pages from older crawl WACZs into database by @tw4l in #1562
• Clean up ESLint warnings in main by @emma-sg in #1616
• Emit more modern code for browsers by @emma-sg in #1614
• Disable Prettier check in CI by @SuaYoo in #1619
• QA Runs Initial Backend Implementation by @ikreymer in #1586
• Fix intermittent crawl timeout test failure by @tw4l in #1621
• Add additional filters to page list endpoints by @tw4l in #1622
• Give test_crawl_timeout 10 mins to finish by @tw4l in #1627
• MetaController update by @ikreymer in #1630
• Frontend: icon-button Cleanup by @Shrinks99 in #1628
• Add single page QA GET endpoint by @tw4l in #1635
• merge 1.9.5 fixes by @ikreymer in #1637
• Crawler pod memory padding + auto scaling by @ikreymer in #1631
• add horizontal pod autoscaler for backend and frontend via helm charts by @ikreymer in #1633
• operator state fixes (follow up fomr #1639) by @ikreymer in #1640
• Adds documentation for exporting files by @Shrinks99 in #1643
• Frontend: Fixes the "Replay Latest Crawl" button path by @Shrinks99 in #1636
• QA Review UI by @SuaYoo in #1624
• fix issue with incorrect number of total pages if any of the seeds is a redirect by @ikreymer in #1649
• Track failed QA runs and include in list endpoint by @tw4l in #1650
• email templates update + customization + doc update (fixes #1652) by @ikreymer in #1653
• Remove URL prefix dropdown from new browser profile screen by @tw4l in #1660
• Emit eslint errors during webpack builds & during dev by @emma-sg in #1667
• Change crawl.reviewStatus to 1-5 scale int by @tw4l in #1664
• Remove pages from QA Configmap by @ikreymer in #1671
• renumber crawl priority classes: by @ikreymer in #1673
• Improve reliability of backend tests by @vnznznz in #1675
• Add mime field to Page model by @tw4l in #1678
• Add reviewStatus, qaState, and qaRunCount sort options to crawls/all-crawls list endpoints by @tw4l in #1686
• restrict qa runs to a 'min_qa_crawler_image' if set in the chart by @ikreymer in #1685
• Add QA run aggregate stats API endpoint by @tw4l in #1682
• Run crawler and profilebrowser with non-root user by @vnznznz in #1625
• Changes download icons to cloud-download by @Shrinks99 in #1688
• QA page details by @emma-sg in #1656
• Ensure /all-crawls?sortBy=qaState always sorts crawls above uploads by @tw4l in #1691
• Display QA resources as table by @SuaYoo in #1692
• Frontend: App Branding! by @Shrinks99 in #1592
• Add 'activeQAStats' field by @ikreymer in #1694
• Add post load delay to Browsertrix by @tw4l in #1700
• Fix workflow language setting showing HTML code in select element by @emma-sg in #1702
• Frontend QA Polish Changes by @Shrinks99 in #1703
• Ensure dates are formatted with the current app locale (and not browser default) by @emma-sg in #1697
• Update tests with latest crawler by @ikreymer in #1711
• Change resource table to be based on mime type by @tw4l in #1698
• Add Repository Index + Chart Rename + Docs Rename by @ikreymer in #1708
• Support sorting by last QA started time by @ikreymer in #1712
• Fix QA run deletion by @SuaYoo in #1721
• Add QA columns to archived item list by @SuaYoo in #1683
• Frontend QA: show currently sorted heuristic percentages in page list by @emma-sg in #1720
• Ensure QA run WACZs are deleted by @tw4l in #1715
• More Frontend QA Polish Changes by @emma-sg in #1709
• QA UI: Copy updates & beta tag by @emma-sg in #1722
• add best text & screenshot match sorting options by @emma-sg in #1726
• Add QA page analysis chart by @SuaYoo in #1725
• Fix QA navigation by @SuaYoo in #1731
• Poll archived items list by @SuaYoo in #1730
• Hide QA UI from users without crawler role by @SuaYoo in #1733
• Fix QA review comments by @SuaYoo in #1723
• Fix archived item status icon size + minor review UI updates by @SuaYoo in #1734
• allow configuring designated registration org to which new users can register by @ikreymer in #1735
• Quick fix: hoist tooltips in archived item list by @emma-sg in #1738
• quickfix: nginx: have nginx serve the fallback index.html with a 200 instead of a 404 by @ikreymer in #1742
• Redirect if org with slug doesn't exist by @SuaYoo in #1740
• operator: add 'max_crawler_memory' to limit autosizing of crawler pods by @ikreymer in #1746
• Typo Fix: fix typos in setting max crawler memory by @ikreymer in #1747
• Handle registration when user already exists by @ikreymer in #1744
• fix missing settings / typos: by @ikreymer in #1748
• Update index.ts by @white-gecko in #1749
• Fix 'Review Crawl' button disabled state. by @ikreymer in #1751
• Add note on checking browser profiles for scheduled crawls by @Shrinks99 in #1763
• Handle null replicas in browser profile by @SuaYoo in #1765
• Fix misleading upload error notification by @SuaYoo in #1768
• Fix add to collection dropdown by @SuaYoo in #1766
• check that status.lastUpdatedTime is set before attempting to subtract! by @ikreymer in #1754
• Frontend QA dual slider view doesn't correctly show missing images by @emma-sg in #1770
• Fix QA tab loading state by @SuaYoo in #1772
• regression fix: remove 'project' from non-raw crawl object getters, by @ikreymer in #1778
• QA review tooltip + comment improvements by @SuaYoo in #1779
• Update dash and slash icons by @Shrinks99 in #1783
• Fix truncation for long workflow / item names by @Shrinks99 in #1773
• Add emails to the org settings tables by @Shrinks99 in #1785
• Auto-load seed url when replaying seeded crawls by @Shrinks99 in #1786
• Fix browser navigation button usage in QA review by @SuaYoo in #1776
• QA review Replay embed improvements by @SuaYoo in #1775
• [Bug] Collection detail: only update dialog state on close event if close event originates from dialog by @emma-sg in #1793
• Fix needing to go back twice in archived item detail initial load by @emma-sg in #1796
• Allow QA view to be larger than viewport height if necessary by @emma-sg in #1790
• Add plugins directory to frontend Dockerfile by @vnznznz in #1798
• Adds QA features to user docs by @Shrinks99 in #1784
• Allow users to configure offset when viewing crawl queued URLs by @SuaYoo in #1581
• quickfix: fix for additional lint error in updated pylint by @ikreymer in #1805
• frontend build check: build frontend docker image by @ikreymer in #1804
• Reorganize frontend build files by @SuaYoo in #1803
• Allow superadmins to set role when inviting user by @SuaYoo in #1801
• Upgrade Shoelace for UI fixes by @SuaYoo in #1806
• Fix newly created org missing from user's org list by @SuaYoo in #1799
• Custom button cleanup & toolbar button styles by @emma-sg in #1794

New Contributors

• @dependabot made their first contribution in #1574
• @wvengen made their first contribution in #1600
• @white-gecko made their first contribution in #1749

Full Changelog: v1.9.8...v1.10.0