Merged PRs between 2022-06-25 and 2023-04-17

Master build failure fixes Add new interim governance commands: {create, answer, verify}-poll Additional check for not-leader slots in LeadershipSchedule tests Allow renamed fields to exist if values the same Update cardano-governance.md workbench: distributed nomad cloud Fix epochLength and securityParam to conform to the formula 10 * k / f Expose SerialiseAsRawBytesError in Cardano.Api Expose UsingRawBytes et al types Replace roundtripCBOR with trippingCbor Integrate latest ledger dependencies #5052 Remove reading protocol parameters from Shelley genesis file Move parsers to reusable location workbench: updates Remove non-round-trippable value TxInsReferenceNone for babbage onwards in generator Workflow dispatch to take inputs Fix import warning Delete duplicate packages sort packages and imports Fix nightly builds Remove last remaining allow-newers Simplify cddl tests Remove unused script workbench: updates use TH-generated plutus scripts New genCardanoKeyWitness function Fix hlint warnings Remove dup of index-state, no longer needed with latest haskell.nix Rename TestEnableDevelopmentHardForkEras and TestEnableDevelopmentNetworkProtocols Bench nomad sub-backends Split serialisation from IO Improve roundtrip functions to report annotations on callsite Small build docs improvements Define Functor instance for FileError Frozen callstack for checkTextEnvelopeFormat function Remove --stake-address option from stake-address build Auto-balance multiasset transactions bench: analysis improvements Remove use of AcquireFailure type Remove unused error constructors Simplify implementation of executeQueryAnyMode Ignore IntelliJ folder and cabal.project.local* Script data serialisation Fix qKesKesKeyExpiry to not always be null Use Haskell variables for passing values. Guard against overflows in Shelley TxIns Use ouroboros-network-0.3.0.2 and ouroboros-network-framework-0.2.0.1 Combinators for TxBodyContent and related types Re-enable kes-period-info test. fix CI not running on bors branches nix: switch to ghc 9.2.7 workbench: Distribute genesis using an intermediate storage service Bump CHaP and remove most constraints from the cabal file Use JSON instances for NodeToNodeVersion & NodeToClientVersion New cardano-cli ping command. Backward compatibility for Prometheus metrics names Upgrade to cabal-3.10.1.0 Straight line code for tx commands Add LedgerStateBabbage and LedgerStateConway pattern synonyms nix: fix deprecation warning for docker images fix cardano-testnet Babbage genesis.json Add missing imports Export fromShelleyBasedScript from Cardano.Api [cardano-api] Add ToJSON/FromJSON instances for ChainPoint Add 'IsScriptWitnessInCtx' link to explorer.cardano.org/relays/topology.json stakeKey registration stake.skey witness not needed Get AcceptedConnectionsLimit from the configuration Remove hint of "string" support for ScriptData Remove unnecessary validation of Data cardano-cli: Add option --stake-address to several subcommands workbench: support Conway Conway hard forks on prot-ver 9 Concurrency for build job In merge summary construct correct pr link Remove concurrency to fix merge queue Downgrade to cabal-3.8.1.0 Script to generate merge summary Fix flake (again) Bench nomad exec Upgrade to actions/checkout@v3 Upgrade to cabal-3.10.1.0 Add socketGroup option to cardano-node-service Document how to convert between hex and bech32 Workaround http2 haddock issue by restricting problematic version Add tulia task that run system tests on PRs Fix byron-to-alonzo/mkfiles.sh script for conway small amendment in stake snapshot docs Clarify the valency setting's description Docs for create-cardano CAD-3928 minor polish Update getting started to include MacOS Remove unnecessary functions Reinstate -Werror for cardano-node and fix errors Detect invalid counter and certificate Reduce number of calls to toLedgerPParams Take all dependencies from Hackage or CHaP [nix] ghc925 -> ghc927 Fix flake setup [cardano-api] Derive Eq instance for AcquiringFailure Fix typos Use officially released binary for stylish-haskell Less verbose node-to-client and node-to-node version logging Fix merge group cancelling issue workbench: analysis updates GHC 9.2.5 -> 9.2.7 Remove error calls in Cardano.CLI.Shelley.Run.Transaction Remove duplicate scripts when building transaction body for Mary, Alonzo and Babbage Remove simple script distinction New build-complete job for required checks Fix path to mkfiles.sh script in documentation Remove protolude from cardano-submit-api Bump haskell.nix Switch away from nix in hlint check Add event.type to concurrency group bump hackage.nix Create and merge_group triggers in Github Actions Preserve ScriptData bytes fix Reduce number of GitHub status notif related to nix builds scripts: drop legacy benchmarking scripts Benchmarking: drop membench & related inputs Only build for Mac and Windows on ghc-9.2.5 Limit CI concurrency for Linux CI. Remove n counter in build matrix Limit concurrency of CI workflows Implement separate linux github action Check CLI argument bounds Add slotsInEpoch and slotsToEpochEnd to query tip command Tip hash metrics Remove ci/pr/required-check from bors.toml Fix key non extended key for StakeExtendedVerificationKeyShelley_ed25519_bip32 envelope Deploy Haddock for merge to master only hydra: only build pr jobset to avoid duplicates builds Bump future from 0.18.2 to 0.18.3 in /doc/.sphinx Handle pipes Added features to tracing Update cardano-cli banner Preserve ScriptData bytes with HashableScriptData adding a "make check" to the libsodium and secp256k1 install process Filter out duplicate collateral inputs in transaction build commands Update changelog with PR4788 changes Update docs for simple transaction Fix some markdown links Nix improvements backports for 1.35 workbench | tx-generator: SECP benchmarking coot/ouroboros network 0.3.0.1 devops shell: don't include build tools for all hasPkgs workbench: updates Remove use of multiline literals Re-add support for decoding GenesisExtendedKey text envelope Remove usage of nixWrapped. Refactor genesis create command usage in cardano testnet Disallow empty cost model for create update proposal Markdown links CI check Remove NoImplicitPrelude Date ranges for copyright Simplify SerialiseAsRawBytes type class Fix recursion in flake inputs. workbench: drop cabalWrapped workbench: make shell-nix use Nix-built binaries PLT-106: Add encoder and decoder for LedgerState Revert #4855 Remove cardano-cli's dependency on cardano-node Refactor code using onLeft and onNothing Add script evaluation events to LedgerEvent Add support for ghc-9.2 and partial support for CHaP Cardano Node 1.35.6 aka Single Relay P2P release Modify constructBalancedTx to take LedgerEpochInfo workbench: restore the default trace config Optimized trace-dispatcher and tracing system Implement ADR-2: Restructure modules for generators Fix how changed files are selected in stylish-haskell CI check Node 1.35.5 Remove reconfigure-hlint.sh script update tullia to get fix in cue lib workbench: publish analysis tullia jobs: use generic gitrev for PRs Remove hlint from nix required CI Stylish Haskell in CI Remove Robert from CODEOWNERS Small Byron genesis refactor in cardano-testnet UTxO-HD: Make devops-shell compile again and fix cli parser Fix Data.Aeson.Types import Remove NoImplicitPrelude from cardano-api Nix fixes - 1.35 Fix hlint warnings bump hackage.nix for the new index-state Better error message for query utxo without oops Add cardanoMaxSupply :: Word64 field to CardanoTestnetOptions Consolidate two fields of CardanoTestnetOptions Add ReaderT of NodeToClientVersion to LocalStateQueryExpr New query stake-snapshot integration test New NodeToClientVersionOf typeclass Use hoistMaybe nix: optimize caching by delaying setGitRev and other nix fixes Multiple pools support in query stake snapshot Implement signArbitraryBytesKes for use in Mithril backport to 1.35: add flake outputs that cicero expects modernize CI Straight line error handling Revert skip doc in ci Skip CI on doc only changes Skip CI if only changes are documentation Update install.md workbench: towards a cloud nomad backend Add comment about local development Export cardano-testnet API from Cardano.Testnet Build all of cardano-node in CI Check cabal files in CI Fix bug in hash computation in 'cardano-cli genesis create-cardano'. Export SubmitResult from Cardano.Api Filter out duplicate collateral inputs in transaction build and build-raw Update cardano-governance.md cardano-cli | create-staked: fix UTxO size distribution Make leadership-schedule test less flaky tx-generator: add capability for PlutusV2 scripts Fix hedgehog-extras sha hash Update hegehog-extras bounds Optimise query stake-snapshot command Optimise query stake snapshot command GitHub token fix Allow assembling transactions with no witnesses Infer protocol params in transaction build Delete obsolete scripts Use SECURITY.md published in Cardano Engineering Handbook Use setup-haskell action Use Github Action to install libsecp256k1 Update index state and hedgehog-extras. hlint: fix failures Cleaned cabal files Add cache versioning Cache secp256k1 Improved error message for failed asset name decode Add aarch64-darwin to nix-shell Optimise query leadership schedule command Cardano governance documentation Use cabal-cache build(deps): bump certifi from 2020.4.5.2 to 2022.12.7 in /doc/.sphinx Move style guide to wiki Update cabal.project Remove cardano-cli address build-script Add fix and test for foldBlocks Move signing key reading to cardano-api Only run chairman test on latest era Update GitHub actions CI Open Source Readiness Update plutus-apps workbench: get rid of some unnecessary complications Fixed format of network changelog item [cardano-api] Add an Ord ChainPoint instance Replace Data.Map with Data.Map.Strict Append tx output in cli transaction build command Update Error messages for TxValidityUpperBoundValidationError and TxFeeValidationError Update ouroboros-network and cardano-ledger dependencies Move implementation inside runTransactionCmd to toplevel definitions. remove hydra.iohk.io as substituter fix pure nix evaluation Update cli's help to indicate that Babbage is the default era [CI] Fix haddock builds Bench nomad workbench: small fixes & UX improvements workbench & analysis: assorted fixes Fix Windows CI flake.nix: make cardano-tracer-test non-mandatory on Windows Remove error calls in renderShelleyTxCmdError Implement Cardano.Api.DeserialiseAnyOf Add a native tokens tutorial and exercises to a newly created MA folder Expose TextEnvelopeCddl from Cardano.Api tx-generator: reusable API and library fix nix impurity Fix missing trace-forward messages Export TxTotalAndReturnCollateralSupportedInEra from Cardano.Api Expose txScriptValidityToScriptValidity in Cardano.Api cardano-api module reshuffle New p2p topology file format Update building-the-node-using-nix.md Document how to disable ledger peers Add Ord instance for AddressInEra export RawBytesHexError Use environment files in Github Actions Windows CI builds Update release changelog Restore --cddl-format Disable Alonzo leadership schedule test Create CODE-OF-CONDUCT.md Reorder module hierarchy Community contributions 2022-10-27 Refactor CODEOWNERS file Remove testnet subdir Reduce exposed modules in cardano-api add cicero CI actions Add link to troubleshooting page in the wiki Enable stale bot Improve test output Add Plutus minting script doc cardano-testnet: add single entrypoint for starting testnets Condense Read and Validation modules in cardano-cli Trace changes Export TxIns type alias Upgrade to cabal-3.8.1.0 Update the issue templates Add ToJSON and FromJSON instances for Address Fix haddock for ScriptDataSupportedInEra submit-api: add tx_submit_fail_count metric submit-api: add tx_submit_fail_count metric Switch to internal haskell package repository Release 1.35.4 cardano-api: Export more generators Changed severity of 'DiffusionErrored' log message export IsPlutusScriptLanguage Add tx-mempool command to CLI Return Lovelace for calculateMinimumUTxO Fix query era mismatch bug in transaction build command when using flag --calculate-plutus-script-cost Fix CODEOWNERS errors Bump CHaP again, account for re-release of existing packages Fix team patterns in CODEOWNERS cardano-tracer: RTView logs live view Bump CHaP and remove ekg-json s-r-p Separate IO from txBuild and txBuildRaw functions Removed a debug message Fix MacOS GHA CI partially monomorphise & de-generify Env cardano-tracer: optional state dir for RTView GHC 9.2.4 preparations Fix Windows Github Actions Workflow for building Haskell Fix the workbench shell Switch to Cardano haskell package repository tx-generator trace forwarding cardano-tracer-service: more configuration control bench: nixos service fixes & analysis improvements Fix 4493 bug - TxWitness text envelope format does not roundtrip in Shelley era trace-dispatcher: optional EKG.Store. Added changelogs for releases between 1.34.0 and 1.35.3 Separate validation and creation of transaction bodies Fix transaction build command era backwards incompatibility Update error message for incorrectly witnessed collateral inputs tx-generator: Use distinct keys/addresses for benchmarking phases Switch default era to Babbage Add Carlos to CODEOWNERS Deprecate intermediate txbody format Refactor transaction build command Add Robert to CODEOWNERS tx-generator: Fix self-test. workbench: changes needed to support a new backend Minimise config tx-generator: reusable API and library tx-generator: Fix multi-threaded use of tx-streams. New user facing feature template tx-generator: more declarative interface Abstract some options to multiple instances RTView: fix nodes columns markup Add V2 script context equivalence test shell scripts Fix byron-to-alonzo.sh Allow reading/writing text envelopes from pipes Updating cabal version on master to 1.36.0 Update README.rst Update docker-compose.yml iohkNix: add new environments Update docs README: document package localisation cardano-node: provide default node name CODEOWNERS: restore status quo for Nix and workbench code ownership Update link to environments config files Bench nix refactoring 2 tx-generator cleanups coot/small changes Remove unused dependency from cardano-testnet Use openFileBlocking for reading signing keys cardano-node: sync percent fixed. Append change instead of prepending it Configurable metrics port in submit-api RTView: node type. RTView: extended epoch info. Update create-staked with the ability to specify relays for all created stake pools cardano-node: on startup, trace the configuration through the tracing system Bench nix refactoring tx-generator cleanups cardano-tracer: more strictness. RTView: improve UI. Update build command to automatically calculate the total and return collateral values RTView: important fixes workbench: template-based benchmark reporting & fixes Update changelogs with 1.35.3 Bump block header protocol version Added FromJSON instance for 'EraInMode BabbageEra CardanoMode' update ledger to the tip of release/1.0.0 tx-generator: fix a bug Render reference script hashes when using --calculate-plutus-script-cost option More memory efficient query ledger-state command Expose toTxOutInAnyEra and readProtocolParametersSourceSpec from cardano-cli Transaction build in any alonzo era when on babbage testnet Script ToJSON instances serialises the full script cardano-tracer: refactoring bump babbage to report it supports 7.1 in block header Improve json fail message for TraceNodeIsLeader Add utxoCostPerByte protocol parameter Release 1.35.2 Fix building of Alonzo transaction in Babbage era. Use patched aeson from hackage Use pkg-config for LMDB Document cold.counter breaking changes for babbage Fix register-and-delegate-script-staking-address.sh RTView: fix logs buttons. Expose AcquireFailure and SystemStart from Cardano.Api.Shelley cardano-tracer: improve documentation RTView: history backup, MVP Fix error messages in Cardano.Api.ProtocolParameters Fix TraceNodeIsLeader JSON parser New query pool-state command Rework Windows CI to use MSYS2 UTxO-HD: Rework Windows CI to use MSYS2 Add documentation for total collateral and return collateral. Fix help message for --script-invalid option of build/build-raw RTView: a link from tracer's README, quick start Expose Key interface in Cardano.Api.Shelley tx-generator: remove mutable state CAD-4728 Change the units for the LMDB mapsize option to GB and let the parameter be a number CAD-4727 Change the default UTxO HD backend to InMemory. Reduce memory usage of create staked command Fix unresolved conflicts in traces_doc_generated.md RTView: fix end date of epoch. RTView: fix Mem metric name. RTView: MVP Restructure the namespace Added changelogs and updated cabal files for 1.35.1 Fix leadership schedule for current on babbage Update ledger to tip of release/1.0.0 Adding changelogs for 1.35.0 workbench: fixes [CAD-4406] UTxO-HD: Make CI pass again CAD-4437 Include UTxO HD installation/usage instructions in READMEs Give myself and John permission to merge any PR Update cardano-ledger and ouroboros-network dependencies Update index state to 2022-07-01T00:00:00Z workbench: fixes workbench: direct CDF dumps for gnuplot consumption Update getting-started installation dependencies Fix for: metric tracing crashes node #4076 Fix query protocol-state Disable development eras configuration flag