Browsertrix Cloud v1.10.0-beta.0

Major Features

Initial Alpha QA support (requires Browsertrix-Crawler 1.1.0 Beta or higher)

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.10.0-beta.0/browsertrix-cloud-v1.10.0-beta.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Add new WIP QA Review page by @SuaYoo in #1500
• Deploy dev cluster with values from ops repo by @vnznznz in #1530
• Merge 1.9.2 Release -> main by @ikreymer in #1542
• Archived item nav button quickfix by @emma-sg in #1543
• Add crawl pages and related API endpoints by @tw4l in #1516
• Increase startup probe time to account for long-running migrations by @ikreymer in #1560
• Add crawl errors incrementally during crawl by @tw4l in #1561
• Refactor operator class into module by @ikreymer in #1564
• pages: set page status to 200 if unset and loadState != 0 by @ikreymer in #1563
• Add guide for customizing Helm chart values by @tw4l in #1556
• Temporarily remove pages migration by @tw4l in #1572
• Create ArchivedItemPage and ArchivedItemPageComment types by @emma-sg in #1567
• Add updatable QA reviewStatus field to crawls by @tw4l in #1575
• Merge V1.9.3 changes into main by @ikreymer in #1583
• Bump cryptography from 41.0.1 to 42.0.4 in /ansible by @dependabot in #1574
• Frontend localhost icon fix by @SuaYoo in #1587
• Fix a couple linting issues by @emma-sg in #1565
• Configurable Max Scale for frontend by @ikreymer in #1557
• Browsertrix Cloud → Browsertrix frontend text rename by @Shrinks99 in #1466
• Manually approve pages in QA review by @SuaYoo in #1576
• Frontend: Icon updates! by @Shrinks99 in #1569
• Add QA tab to archived item detail by @SuaYoo in #1590
• Make storage deletion work on more S3 providers by @wvengen in #1600
• Update issue reporting templates by @SuaYoo in #1596
• profile browser fixes: better resource usage + load retry (main) by @ikreymer in #1604
• Docs: Update docs theme by @Shrinks99 in #1594
• Adds favicons! by @Shrinks99 in #1584
• kubernetes api: avoid overriding content-type header in kubernetes-asyncio, pass in via arg instead (main) by @ikreymer in #1605
• Add ESLint rules for import ordering by @emma-sg in #1608
• Fix mismatch in prettier import order config by @emma-sg in #1609
• Fix missing page component imports by @SuaYoo in #1610
• Upgrade Node 16 > 18 by @SuaYoo in #1612
• Fix asset imports in tests by @SuaYoo in #1611
• Update node version mentioned in docs by @emma-sg in #1615
• Add endpoints to read pages from older crawl WACZs into database by @tw4l in #1562
• Clean up ESLint warnings in main by @emma-sg in #1616
• Emit more modern code for browsers by @emma-sg in #1614
• Disable Prettier check in CI by @SuaYoo in #1619
• QA Runs Initial Backend Implementation by @ikreymer in #1586
• Fix intermittent crawl timeout test failure by @tw4l in #1621
• Add additional filters to page list endpoints by @tw4l in #1622
• Give test_crawl_timeout 10 mins to finish by @tw4l in #1627
• MetaController update by @ikreymer in #1630
• Frontend: icon-button Cleanup by @Shrinks99 in #1628
• Add single page QA GET endpoint by @tw4l in #1635
• merge 1.9.5 fixes by @ikreymer in #1637
• Crawler pod memory padding + auto scaling by @ikreymer in #1631
• add horizontal pod autoscaler for backend and frontend via helm charts by @ikreymer in #1633
• operator state fixes (follow up fomr #1639) by @ikreymer in #1640
• Adds documentation for exporting files by @Shrinks99 in #1643
• Frontend: Fixes the "Replay Latest Crawl" button path by @Shrinks99 in #1636
• QA Review UI by @SuaYoo in #1624
• fix issue with incorrect number of total pages if any of the seeds is a redirect by @ikreymer in #1649
• Track failed QA runs and include in list endpoint by @tw4l in #1650

New Contributors

• @dependabot made their first contribution in #1574
• @wvengen made their first contribution in #1600

Full Changelog: v1.9.6...v1.10.0-beta.0

Browsertrix Cloud v1.9.6

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.6/browsertrix-cloud-v1.9.6.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• operator fixes: by @ikreymer in #1639

Full Changelog: v1.9.5...v1.9.6

Browsertrix Cloud v1.9.5

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.5/browsertrix-cloud-v1.9.5.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• retry loading profile if initial load fails by @ikreymer in #1629

Full Changelog: v1.9.4...v1.9.5

Browsertrix Cloud v1.9.4

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.4/browsertrix-cloud-v1.9.4.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• profile browser fixes: better resource usage + load retry by @ikreymer in #1599
• kubernetes api: avoid overriding content-type header in kubernetes-asyncio, pass in via arg instead by @ikreymer in #1602
• Don't use access URL for delete by @wvengen in #1603
• Bump ReplayWeb.page to 1.8.15

Full Changelog: v1.9.3...v1.9.4

Browsertrix Cloud v1.9.3

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.3/browsertrix-cloud-v1.9.3.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Archived item nav button quickfix #1543
• Fix execution time checking by keeping lastUpdatedTime in db by @ikreymer in #1573
• Prevent closing tooltips from closing collection share dialog by @SuaYoo in #1579
• Fix pending exclusion pagination by @SuaYoo in #1578
• Fix regex escape in exclusion editor text match by @SuaYoo in #1577

Full Changelog: v1.9.2...v1.9.3

Browsertrix Cloud v1.9.2

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.2/browsertrix-cloud-v1.9.2.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Fix URL List showing scope accidentally by @ikreymer in #1536
• More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. by @ikreymer in #1537
• Disable useSitemap by default in new workflows by @tw4l in #1541

Full Changelog: v1.9.1...v1.9.2

Browsertrix Cloud v1.9.1

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.1/browsertrix-cloud-v1.9.1.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• one hop out: remove errant '|| true' from condition by @ikreymer in #1532

Full Changelog: v1.9.0...v1.9.1

Browsertrix Cloud v1.9.0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.0/browsertrix-cloud-v1.9.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Adds a link to the new ReplayWebpage replay issue form in GitHub by @Shrinks99 in #1404
• Refactor LiteElement into reactive controllers by @SuaYoo in #1423
• Add extra and gifted execution minutes by @tw4l in #1361
• Fix UI not updating after quota is reached by @SuaYoo in #1425
• Fix dashboard usage history off-by-one labels by @tw4l in #1431
• Fix attribute casing & lit-analyzer issues by @emma-sg in #1429
• Add bundle analyzer script by @emma-sg in #1437
• Fix runtime error on log out by @SuaYoo in #1439
• Only load webpack-bundle-analyzer if BUNDLE_ANALYZER env var is present by @emma-sg in #1446
• Fix fetch helper by @SuaYoo in #1442
• Recreate configmaps if missing by @ikreymer in #1444
• Fix redirect to login page by @SuaYoo in #1445
• Use execution duration formatter in table view by @emma-sg in #1449
• Improve frontend event system by @SuaYoo in #1450
• Org settings layout fix + misc styling & consistency improvements by @emma-sg in #1427
• Set runNow to false when editing existing workflows by @tw4l in #1458
• Improvements to collection creation and editing flow by @SuaYoo in #1424
• Remove non-prod & optional dependencies when building frontend in ci by @emma-sg in #1455
• Add API endpoints for crawl statistics by @tw4l in #1461
• Add setup command to btrix helper to copy local config by @tw4l in #1462
• Fix browser profile name in crawl endpoints by @tw4l in #1464
• Adds status information to user documentation by @Shrinks99 in #1459
• Support multiple crawler versions by @tw4l in #1420
• Backend mem usage fix - use fixed MOTOR_MAX_WORKERS + switch to gunicorn by @ikreymer in #1468
• Hotfix: ignore everything in ./tests and playwright.config.ts when checking types during webpack build by @emma-sg in #1470
• Add custom user agent to workflows by @tw4l in #1465
• operator: use 'default' CRAWLER_CHANNEL if none is set by @ikreymer in #1478
• Add migration to fix issues with previous migrations by @tw4l in #1480
• Close sync S3 client by @ikreymer in #1481
• Fix scheduler date input and display by @SuaYoo in #1472
• Update collection archived item lists by @SuaYoo in #1457
• Increase app max width by @SuaYoo in #1484
• Fix archived item crawl settings by @SuaYoo in #1473
• Add scale to CrawlOut by @tw4l in #1487
• Refactor data table to use btrix-table component by @SuaYoo in #1474
• Upgrade to lit 3 by @SuaYoo in #1482
• Unify crawl and archived item list components by @SuaYoo in #1485
• Refactor collections and browser profile data-tables by @SuaYoo in #1505
• ESLint improvements & Typescript upgrade by @emma-sg in #1501
• docs: Explains execution time by @Shrinks99 in #1475
• Ensure linting & formatting runs in CI by @emma-sg in #1512
• Upgrade Prettier to 3 by @emma-sg in #1513
• Docs: Improve relative links by @Shrinks99 in #1476
• Format backend with Black 24 by @tw4l in #1507
• Updates browser profile selector help text by @Shrinks99 in #1510
• Fixes workflow selector keyboard navigation by @Shrinks99 in #1514
• enable screenshots by default + fix py version formatting by @ikreymer in #1518
• storages: use asynccontextmanager instead of sync to close client by @ikreymer in #1521
• Hotfix: Crawls page table click targets not applied to the right elements by @emma-sg in #1524
• enable a few more useful eslint suggestions & correct some more types by @emma-sg in #1517
• better handling of failed redis connection + exec time updates by @ikreymer in #1520
• docs: Adds more details about browser profile capabilities by @Shrinks99 in #1523
• Include leading zero in months when accessing usage and quota data by @emma-sg in #1528
• Add comments I meant to add in #1528 by @emma-sg in #1529

Full Changelog: v1.8.1...v1.9.0

v1.9.0-beta.5

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.0-beta.5/browsertrix-cloud-v1.9.0-beta.5.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Include leading zero in months when accessing usage and quota data by @emma-sg in #1528
• Add comments I meant to add in #1528 by @emma-sg in #1529

Full Changelog: v1.9.0-beta.4...v1.9.0-beta.5

Browsertrix Cloud v1.9.0-beta.4

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.0-beta.4/browsertrix-cloud-v1.9.0-beta.4.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• storages: use asynccontextmanager instead of sync to close client by @ikreymer in #1521
• Hotfix: Crawls page table click targets not applied to the right elements by @emma-sg in #1524
• enable a few more useful eslint suggestions & correct some more types by @emma-sg in #1517
• better handling of failed redis connection + exec time updates by @ikreymer in #1520
• docs: Adds more details about browser profile capabilities by @Shrinks99 in #1523

Full Changelog: v1.9.0-beta.3...v1.9.0-beta.4