1.57.0rc1

87 files changed, 123 insertions, 86 deletions

diff --git a/CHANGES.md b/CHANGES.md
index 518781f931..114b1e94ea 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -1,3 +1,119 @@
+Synapse 1.57.0rc1 (2022-04-12)
+==============================
+
+This version includes a [change](https://github.com/matrix-org/synapse/pull/12209)
+to the way transaction IDs are managed for application services. If your
+deployment uses a dedicated worker for application service traffic, **it must
+be stopped** when the database is upgraded (which normally happens when the
+main process is upgraded), to ensure the change is made safely without any risk
+of reusing transaction IDs.
+
+See the [upgrade notes](https://github.com/matrix-org/synapse/blob/develop/docs/upgrade.md#upgrading-to-v1570) for more details.
+
+Features
+--------
+
+- Send device list changes to application services as specified by [MSC3202](https://github.com/matrix-org/matrix-spec-proposals/pull/3202), using unstable prefixes. The `msc3202_transaction_extensions` experimental homeserver config option must be enabled and `org.matrix.msc3202: true` must be present in the application service registration file for device list changes to be sent. The "left" field is currently always empty. ([\#11881](https://github.com/matrix-org/synapse/issues/11881))
+- Optimise fetching large quantities of missing room state over federation. ([\#12040](https://github.com/matrix-org/synapse/issues/12040))
+- Offload the `update_client_ip` background job from the main process to the background worker, when using Redis-based replication. ([\#12251](https://github.com/matrix-org/synapse/issues/12251))
+- Move `update_client_ip` background job from the main process to the background worker. ([\#12252](https://github.com/matrix-org/synapse/issues/12252))
+- Add a module callback to react to new 3PID (email address, phone number) associations. ([\#12302](https://github.com/matrix-org/synapse/issues/12302))
+- Add a configuration option to remove a specific set of rooms from sync responses. ([\#12310](https://github.com/matrix-org/synapse/issues/12310))
+- Add a module callback to react to account data changes. ([\#12327](https://github.com/matrix-org/synapse/issues/12327))
+- Allow setting user admin status using the module API. Contributed by Famedly. ([\#12341](https://github.com/matrix-org/synapse/issues/12341))
+- Reduce overhead of restarting synchrotrons. ([\#12367](https://github.com/matrix-org/synapse/issues/12367), [\#12372](https://github.com/matrix-org/synapse/issues/12372))
+- Update `/messages` to use historic pagination tokens if no `from` query parameter is given. ([\#12370](https://github.com/matrix-org/synapse/issues/12370))
+- Add a module API for reading and writing global account data. ([\#12391](https://github.com/matrix-org/synapse/issues/12391))
+- Support the stable `v1` endpoint for `/relations`, per [MSC2675](https://github.com/matrix-org/matrix-doc/pull/2675). ([\#12403](https://github.com/matrix-org/synapse/issues/12403))
+- Include bundled aggregations in search results 
+  ([MSC3666](https://github.com/matrix-org/matrix-spec-proposals/pull/3666)). ([\#12436](https://github.com/matrix-org/synapse/issues/12436))
+
+
+Bugfixes
+--------
+
+- Fix a long-standing bug that updating the server notices user profile (display name/avatar URL) in the configuration would not be applied to pre-existing rooms. Contributed by Jorge Florian. ([\#12115](https://github.com/matrix-org/synapse/issues/12115))
+- Fix a long-standing bug where events from ignored users were still considered for bundled aggregations. ([\#12235](https://github.com/matrix-org/synapse/issues/12235), [\#12338](https://github.com/matrix-org/synapse/issues/12338))
+- Fix non-member state events not resolving for historical events when used in [MSC2716](https://github.com/matrix-org/matrix-spec-proposals/pull/2716) `/batch_send` `state_events_at_start`. ([\#12329](https://github.com/matrix-org/synapse/issues/12329))
+- Fix a long-standing bug affecting URL previews that would generate a 500 response instead of a 403 if the previewed URL includes a port that isn't allowed by the relevant blacklist. ([\#12333](https://github.com/matrix-org/synapse/issues/12333))
+- Default to `private` room visibility rather than `public` when a client does not specify one, according to spec. ([\#12350](https://github.com/matrix-org/synapse/issues/12350))
+- Fix a spec compliance issue where requests to the `/publicRooms` federation API would specify `limit` as a string. ([\#12364](https://github.com/matrix-org/synapse/issues/12364), [\#12410](https://github.com/matrix-org/synapse/issues/12410))
+- Fix a bug introduced in Synapse 1.49.0 which caused the `synapse_event_persisted_position` metric to have invalid values. ([\#12390](https://github.com/matrix-org/synapse/issues/12390))
+
+
+Updates to the Docker image
+---------------------------
+
+- Bundle locked versions of dependencies into the Docker image. ([\#12385](https://github.com/matrix-org/synapse/issues/12385))
+
+
+Improved Documentation
+----------------------
+
+- Clarify documentation for running SyTest against Synapse, including use of Postgres and worker mode. ([\#12271](https://github.com/matrix-org/synapse/issues/12271))
+- Document the behaviour of `LoggingTransaction.call_after` and `LoggingTransaction.call_on_exception` methods when transactions are retried. ([\#12315](https://github.com/matrix-org/synapse/issues/12315))
+- Update dead links in `check-newsfragment.sh` to point to the correct documentation URL. ([\#12331](https://github.com/matrix-org/synapse/issues/12331))
+- Upgrade the version of `mdbook` in CI to 0.4.17. ([\#12339](https://github.com/matrix-org/synapse/issues/12339))
+- Updates to the Room DAG concepts development document to clarify that we mark events as outliers because we don't have any state for them. ([\#12345](https://github.com/matrix-org/synapse/issues/12345))
+- Update the link to Redis pub/sub documentation in the workers documentation.. ([\#12369](https://github.com/matrix-org/synapse/issues/12369))
+- Remove documentation for converting a legacy structured logging configuration to the new format. ([\#12392](https://github.com/matrix-org/synapse/issues/12392))
+
+
+Deprecations and Removals
+-------------------------
+
+- Remove the unused and unstable `/aggregations` endpoint which was removed from [MSC2675](https://github.com/matrix-org/matrix-doc/pull/2675). ([\#12293](https://github.com/matrix-org/synapse/issues/12293))
+
+
+Internal Changes
+----------------
+
+- Remove lingering unstable references to MSC2403 (knocking). ([\#12165](https://github.com/matrix-org/synapse/issues/12165))
+- Avoid trying to calculate the state at outlier events. ([\#12191](https://github.com/matrix-org/synapse/issues/12191), [\#12316](https://github.com/matrix-org/synapse/issues/12316), [\#12330](https://github.com/matrix-org/synapse/issues/12330), [\#12332](https://github.com/matrix-org/synapse/issues/12332), [\#12409](https://github.com/matrix-org/synapse/issues/12409))
+- Omit sending "offline" presence updates to application services after they are initially configured. ([\#12193](https://github.com/matrix-org/synapse/issues/12193))
+- Switch to using a sequence to generate AS transaction IDs. Contributed by Nick Beeper. If running synapse with a dedicated appservice worker, this MUST be stopped before upgrading the main process and database. ([\#12209](https://github.com/matrix-org/synapse/issues/12209))
+- Add missing type hints for storage. ([\#12267](https://github.com/matrix-org/synapse/issues/12267))
+- Add missing type definitions for scripts in docker folder. Contributed by Jorge Florian. ([\#12280](https://github.com/matrix-org/synapse/issues/12280))
+- Move [MSC2654](https://github.com/matrix-org/matrix-doc/pull/2654) support behind an experimental configuration flag. ([\#12295](https://github.com/matrix-org/synapse/issues/12295))
+- Update docstrings to explain how to decipher live and historic pagination tokens. ([\#12317](https://github.com/matrix-org/synapse/issues/12317))
+- Add ground work for speeding up device list updates for users in large numbers of rooms. ([\#12321](https://github.com/matrix-org/synapse/issues/12321))
+- Fix typechecker problems exposed by signedjson 1.1.2. ([\#12326](https://github.com/matrix-org/synapse/issues/12326))
+- Remove the `tox` packaging job: it will be redundant once #11537 lands. ([\#12334](https://github.com/matrix-org/synapse/issues/12334))
+- Ignore `.envrc` for `direnv` users. ([\#12335](https://github.com/matrix-org/synapse/issues/12335))
+- Remove the (broadly unused, dev-only) dockerfile for pg tests. ([\#12336](https://github.com/matrix-org/synapse/issues/12336))
+- Remove redundant `get_success` calls in test code. ([\#12346](https://github.com/matrix-org/synapse/issues/12346))
+- Add type annotations for `tests/unittest.py`. ([\#12347](https://github.com/matrix-org/synapse/issues/12347))
+- Move single-use methods out of `TestCase`. ([\#12348](https://github.com/matrix-org/synapse/issues/12348))
+- Remove broken and unused development scripts. ([\#12349](https://github.com/matrix-org/synapse/issues/12349), [\#12351](https://github.com/matrix-org/synapse/issues/12351), [\#12355](https://github.com/matrix-org/synapse/issues/12355))
+- Convert `Linearizer` tests from `inlineCallbacks` to async. ([\#12353](https://github.com/matrix-org/synapse/issues/12353))
+- Update docstrings for `ReadWriteLock` tests. ([\#12354](https://github.com/matrix-org/synapse/issues/12354))
+- Refactor `Linearizer`, convert methods to async and use an async context manager. ([\#12357](https://github.com/matrix-org/synapse/issues/12357))
+- Fix a long-standing bug where `Linearizer`s could get stuck if a cancellation were to happen at the wrong time. ([\#12358](https://github.com/matrix-org/synapse/issues/12358))
+- Make `StreamToken.from_string` and `RoomStreamToken.parse` propagate cancellations instead of replacing them with `SynapseError`s. ([\#12366](https://github.com/matrix-org/synapse/issues/12366))
+- Add type hints to tests files. ([\#12371](https://github.com/matrix-org/synapse/issues/12371))
+- Allow specifying the Postgres database's port when running unit tests with Postgres. ([\#12376](https://github.com/matrix-org/synapse/issues/12376))
+- Remove temporary pin of signedjson<=1.1.1 that was added in Synapse 1.56.0. ([\#12379](https://github.com/matrix-org/synapse/issues/12379))
+- Add opentracing spans to calls to external cache. ([\#12380](https://github.com/matrix-org/synapse/issues/12380))
+- Lay groundwork for using `poetry` to manage Synapse's dependencies. ([\#12381](https://github.com/matrix-org/synapse/issues/12381))
+- Make missing `importlib_metadata` dependency explicit. ([\#12384](https://github.com/matrix-org/synapse/issues/12384), [\#12400](https://github.com/matrix-org/synapse/issues/12400))
+- Update type annotations for compatiblity with prometheus_client 0.14. ([\#12389](https://github.com/matrix-org/synapse/issues/12389))
+- Remove support for the unstable identifiers specified in [MSC3288](https://github.com/matrix-org/matrix-doc/pull/3288). ([\#12398](https://github.com/matrix-org/synapse/issues/12398))
+- Add missing type hints to configuration classes. ([\#12402](https://github.com/matrix-org/synapse/issues/12402))
+- Add files used to build the Docker image used for complement testing into the Synapse repository. ([\#12404](https://github.com/matrix-org/synapse/issues/12404))
+- Fix up healthcheck generation for workers docker image. ([\#12405](https://github.com/matrix-org/synapse/issues/12405))
+- Run the olddeps CI job using Poetry. ([\#12407](https://github.com/matrix-org/synapse/issues/12407))
+- Do not include groups in the sync response when disabled. ([\#12408](https://github.com/matrix-org/synapse/issues/12408))
+- Run the CI portdb script in the locked poetry environment. ([\#12412](https://github.com/matrix-org/synapse/issues/12412))
+- Improve type hints related to HTTP query parameters. ([\#12415](https://github.com/matrix-org/synapse/issues/12415))
+- Run the CI export-data script in the locked poetry environment. ([\#12418](https://github.com/matrix-org/synapse/issues/12418))
+- Stop maintaining a list of lint targets. ([\#12420](https://github.com/matrix-org/synapse/issues/12420))
+- Make `synapse._scripts` pass type checks. ([\#12421](https://github.com/matrix-org/synapse/issues/12421), [\#12422](https://github.com/matrix-org/synapse/issues/12422))
+- Add some type hints to datastore. ([\#12423](https://github.com/matrix-org/synapse/issues/12423))
+- Enable certificate checking during complement tests. ([\#12435](https://github.com/matrix-org/synapse/issues/12435))
+- Bundle locked versions of dependencies into the Docker image. ([\#12439](https://github.com/matrix-org/synapse/issues/12439))
+- Explicitly specify the `tls` extra for Twisted dependency. ([\#12444](https://github.com/matrix-org/synapse/issues/12444))
+
+
 Synapse 1.56.0 (2022-04-05)
 ===========================
 
diff --git a/changelog.d/11881.feature b/changelog.d/11881.feature
deleted file mode 100644
index 392294ffc3..0000000000
--- a/changelog.d/11881.feature
+++ /dev/null
@@ -1 +0,0 @@
-Send device list changes to application services as specified by [MSC3202](https://github.com/matrix-org/matrix-spec-proposals/pull/3202), using unstable prefixes. The `msc3202_transaction_extensions` experimental homeserver config option must be enabled and `org.matrix.msc3202: true` must be present in the application service registration file for device list changes to be sent. The "left" field is currently always empty.
\ No newline at end of file
diff --git a/changelog.d/12040.feature b/changelog.d/12040.feature
deleted file mode 100644
index 0a88c6e80c..0000000000
--- a/changelog.d/12040.feature
+++ /dev/null
@@ -1 +0,0 @@
-Optimise fetching large quantities of missing room state over federation.
diff --git a/changelog.d/12115.bugfix b/changelog.d/12115.bugfix
deleted file mode 100644
index eff842b2a5..0000000000
--- a/changelog.d/12115.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug that updating the server notices user profile (display name/avatar URL) in the configuration would not be applied to pre-existing rooms. Contributed by Jorge Florian.
diff --git a/changelog.d/12165.misc b/changelog.d/12165.misc
deleted file mode 100644
index 4b80b0562e..0000000000
--- a/changelog.d/12165.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove lingering unstable references to MSC2403 (knocking).
diff --git a/changelog.d/12191.misc b/changelog.d/12191.misc
deleted file mode 100644
index 9f333e718a..0000000000
--- a/changelog.d/12191.misc
+++ /dev/null
@@ -1 +0,0 @@
-Avoid trying to calculate the state at outlier events.
diff --git a/changelog.d/12193.misc b/changelog.d/12193.misc
deleted file mode 100644
index a721254d22..0000000000
--- a/changelog.d/12193.misc
+++ /dev/null
@@ -1 +0,0 @@
-Omit sending "offline" presence updates to application services after they are initially configured.
\ No newline at end of file
diff --git a/changelog.d/12209.misc b/changelog.d/12209.misc
deleted file mode 100644
index d145b5eb04..0000000000
--- a/changelog.d/12209.misc
+++ /dev/null
@@ -1 +0,0 @@
-Switch to using a sequence to generate AS transaction IDs. Contributed by Nick Beeper. If running synapse with a dedicated appservice worker, this MUST be stopped before upgrading the main process and database.
diff --git a/changelog.d/12235.bugfix b/changelog.d/12235.bugfix
deleted file mode 100644
index b5d2bede67..0000000000
--- a/changelog.d/12235.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug where events from ignored users were still considered for bundled aggregations.
diff --git a/changelog.d/12251.feature b/changelog.d/12251.feature
deleted file mode 100644
index ba9ede03c6..0000000000
--- a/changelog.d/12251.feature
+++ /dev/null
@@ -1 +0,0 @@
-Offload the `update_client_ip` background job from the main process to the background worker, when using Redis-based replication.
diff --git a/changelog.d/12252.feature b/changelog.d/12252.feature
deleted file mode 100644
index 82b9e82f86..0000000000
--- a/changelog.d/12252.feature
+++ /dev/null
@@ -1 +0,0 @@
-Move `update_client_ip` background job from the main process to the background worker.
\ No newline at end of file
diff --git a/changelog.d/12267.misc b/changelog.d/12267.misc
deleted file mode 100644
index e43844d44a..0000000000
--- a/changelog.d/12267.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add missing type hints for storage.
diff --git a/changelog.d/12271.doc b/changelog.d/12271.doc
deleted file mode 100644
index d9696fc5d5..0000000000
--- a/changelog.d/12271.doc
+++ /dev/null
@@ -1 +0,0 @@
-Clarify documentation for running SyTest against Synapse, including use of Postgres and worker mode.
\ No newline at end of file
diff --git a/changelog.d/12280.misc b/changelog.d/12280.misc
deleted file mode 100644
index bdc00b821a..0000000000
--- a/changelog.d/12280.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add missing type definitions for scripts in docker folder. Contributed by Jorge Florian.
diff --git a/changelog.d/12293.removal b/changelog.d/12293.removal
deleted file mode 100644
index 25214a4b49..0000000000
--- a/changelog.d/12293.removal
+++ /dev/null
@@ -1 +0,0 @@
-Remove the unused and unstable `/aggregations` endpoint which was removed from [MSC2675](https://github.com/matrix-org/matrix-doc/pull/2675).
diff --git a/changelog.d/12295.misc b/changelog.d/12295.misc
deleted file mode 100644
index 9c34e16909..0000000000
--- a/changelog.d/12295.misc
+++ /dev/null
@@ -1 +0,0 @@
-Move [MSC2654](https://github.com/matrix-org/matrix-doc/pull/2654) support behind an experimental configuration flag.
diff --git a/changelog.d/12302.feature b/changelog.d/12302.feature
deleted file mode 100644
index 603fa2d23a..0000000000
--- a/changelog.d/12302.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add a module callback to react to new 3PID (email address, phone number) associations.
diff --git a/changelog.d/12310.feature b/changelog.d/12310.feature
deleted file mode 100644
index f3fbb298f7..0000000000
--- a/changelog.d/12310.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add a configuration option to remove a specific set of rooms from sync responses.
diff --git a/changelog.d/12315.doc b/changelog.d/12315.doc
deleted file mode 100644
index ed72f55cba..0000000000
--- a/changelog.d/12315.doc
+++ /dev/null
@@ -1 +0,0 @@
-Document the behaviour of `LoggingTransaction.call_after` and `LoggingTransaction.call_on_exception` methods when transactions are retried.
diff --git a/changelog.d/12316.misc b/changelog.d/12316.misc
deleted file mode 100644
index 9f333e718a..0000000000
--- a/changelog.d/12316.misc
+++ /dev/null
@@ -1 +0,0 @@
-Avoid trying to calculate the state at outlier events.
diff --git a/changelog.d/12317.misc b/changelog.d/12317.misc
deleted file mode 100644
index 1dfee496d8..0000000000
--- a/changelog.d/12317.misc
+++ /dev/null
@@ -1 +0,0 @@
-Update docstrings to explain how to decipher live and historic pagination tokens.
diff --git a/changelog.d/12321.misc b/changelog.d/12321.misc
deleted file mode 100644
index 200e7c44fe..0000000000
--- a/changelog.d/12321.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add ground work for speeding up device list updates for users in large numbers of rooms.
diff --git a/changelog.d/12326.misc b/changelog.d/12326.misc
deleted file mode 100644
index 2d2a00e571..0000000000
--- a/changelog.d/12326.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix typechecker problems exposed by signedjson 1.1.2.
diff --git a/changelog.d/12327.feature b/changelog.d/12327.feature
deleted file mode 100644
index 4fe294f1b1..0000000000
--- a/changelog.d/12327.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add a module callback to react to account data changes.
diff --git a/changelog.d/12329.bugfix b/changelog.d/12329.bugfix
deleted file mode 100644
index aef4117343..0000000000
--- a/changelog.d/12329.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix non-member state events not resolving for historical events when used in [MSC2716](https://github.com/matrix-org/matrix-spec-proposals/pull/2716) `/batch_send` `state_events_at_start`.
diff --git a/changelog.d/12330.misc b/changelog.d/12330.misc
deleted file mode 100644
index 9f333e718a..0000000000
--- a/changelog.d/12330.misc
+++ /dev/null
@@ -1 +0,0 @@
-Avoid trying to calculate the state at outlier events.
diff --git a/changelog.d/12331.doc b/changelog.d/12331.doc
deleted file mode 100644
index ec0ca3ea95..0000000000
--- a/changelog.d/12331.doc
+++ /dev/null
@@ -1 +0,0 @@
-Update dead links in `check-newsfragment.sh` to point to the correct documentation URL.
diff --git a/changelog.d/12332.misc b/changelog.d/12332.misc
deleted file mode 100644
index 9f333e718a..0000000000
--- a/changelog.d/12332.misc
+++ /dev/null
@@ -1 +0,0 @@
-Avoid trying to calculate the state at outlier events.
diff --git a/changelog.d/12333.bugfix b/changelog.d/12333.bugfix
deleted file mode 100644
index 2c073a77d5..0000000000
--- a/changelog.d/12333.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug affecting URL previews that would generate a 500 response instead of a 403 if the previewed URL includes a port that isn't allowed by the relevant blacklist.
diff --git a/changelog.d/12334.misc b/changelog.d/12334.misc
deleted file mode 100644
index 10a57e23b3..0000000000
--- a/changelog.d/12334.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove the `tox` packaging job: it will be redundant once #11537 lands.
diff --git a/changelog.d/12335.misc b/changelog.d/12335.misc
deleted file mode 100644
index 39ea361159..0000000000
--- a/changelog.d/12335.misc
+++ /dev/null
@@ -1 +0,0 @@
-Ignore `.envrc` for `direnv` users.
diff --git a/changelog.d/12336.misc b/changelog.d/12336.misc
deleted file mode 100644
index 0aecd543f9..0000000000
--- a/changelog.d/12336.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove the (broadly unused, dev-only) dockerfile for pg tests.
diff --git a/changelog.d/12338.bugfix b/changelog.d/12338.bugfix
deleted file mode 100644
index b5d2bede67..0000000000
--- a/changelog.d/12338.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug where events from ignored users were still considered for bundled aggregations.
diff --git a/changelog.d/12339.doc b/changelog.d/12339.doc
deleted file mode 100644
index cdbd55bb34..0000000000
--- a/changelog.d/12339.doc
+++ /dev/null
@@ -1 +0,0 @@
-Upgrade the version of `mdbook` in CI to 0.4.17.
diff --git a/changelog.d/12341.feature b/changelog.d/12341.feature
deleted file mode 100644
index ebb96ee486..0000000000
--- a/changelog.d/12341.feature
+++ /dev/null
@@ -1 +0,0 @@
-Allow setting user admin status using the module API. Contributed by Famedly.
diff --git a/changelog.d/12345.doc b/changelog.d/12345.doc
deleted file mode 100644
index 0dcf836e68..0000000000
--- a/changelog.d/12345.doc
+++ /dev/null
@@ -1 +0,0 @@
-Updates to the Room DAG concepts development document to clarify that we mark events as outliers because we don't have any state for them.
diff --git a/changelog.d/12346.misc b/changelog.d/12346.misc
deleted file mode 100644
index 6561b3be82..0000000000
--- a/changelog.d/12346.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove redundant `get_success` calls in test code.
diff --git a/changelog.d/12347.misc b/changelog.d/12347.misc
deleted file mode 100644
index 1f6f584e6d..0000000000
--- a/changelog.d/12347.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add type annotations for `tests/unittest.py`.
diff --git a/changelog.d/12348.misc b/changelog.d/12348.misc
deleted file mode 100644
index 2bfeadb7f8..0000000000
--- a/changelog.d/12348.misc
+++ /dev/null
@@ -1 +0,0 @@
-Move single-use methods out of `TestCase`.
diff --git a/changelog.d/12349.misc b/changelog.d/12349.misc
deleted file mode 100644
index b2d83a7f78..0000000000
--- a/changelog.d/12349.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove broken and unused development scripts.
diff --git a/changelog.d/12350.bugfix b/changelog.d/12350.bugfix
deleted file mode 100644
index 9cbdc28038..0000000000
--- a/changelog.d/12350.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Default to `private` room visibility rather than `public` when a client does not specify one, according to spec.
\ No newline at end of file
diff --git a/changelog.d/12351.misc b/changelog.d/12351.misc
deleted file mode 100644
index b1dd1e2696..0000000000
--- a/changelog.d/12351.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove broken and unused development scripts.
\ No newline at end of file
diff --git a/changelog.d/12353.misc b/changelog.d/12353.misc
deleted file mode 100644
index 1d681fb0e3..0000000000
--- a/changelog.d/12353.misc
+++ /dev/null
@@ -1 +0,0 @@
-Convert `Linearizer` tests from `inlineCallbacks` to async.
diff --git a/changelog.d/12354.misc b/changelog.d/12354.misc
deleted file mode 100644
index e3b8950faa..0000000000
--- a/changelog.d/12354.misc
+++ /dev/null
@@ -1 +0,0 @@
-Update docstrings for `ReadWriteLock` tests.
diff --git a/changelog.d/12355.misc b/changelog.d/12355.misc
deleted file mode 100644
index b1dd1e2696..0000000000
--- a/changelog.d/12355.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove broken and unused development scripts.
\ No newline at end of file
diff --git a/changelog.d/12357.misc b/changelog.d/12357.misc
deleted file mode 100644
index d571ae034c..0000000000
--- a/changelog.d/12357.misc
+++ /dev/null
@@ -1 +0,0 @@
-Refactor `Linearizer`, convert methods to async and use an async context manager.
diff --git a/changelog.d/12358.misc b/changelog.d/12358.misc
deleted file mode 100644
index fcacbcba5c..0000000000
--- a/changelog.d/12358.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug where `Linearizer`s could get stuck if a cancellation were to happen at the wrong time.
diff --git a/changelog.d/12364.bugfix b/changelog.d/12364.bugfix
deleted file mode 100644
index d042425d20..0000000000
--- a/changelog.d/12364.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a spec compliance issue where requests to the `/publicRooms` federation API would specify `limit` as a string.
\ No newline at end of file
diff --git a/changelog.d/12366.misc b/changelog.d/12366.misc
deleted file mode 100644
index 33d8e6c712..0000000000
--- a/changelog.d/12366.misc
+++ /dev/null
@@ -1 +0,0 @@
-Make `StreamToken.from_string` and `RoomStreamToken.parse` propagate cancellations instead of replacing them with `SynapseError`s.
diff --git a/changelog.d/12367.feature b/changelog.d/12367.feature
deleted file mode 100644
index 34bb60e966..0000000000
--- a/changelog.d/12367.feature
+++ /dev/null
@@ -1 +0,0 @@
-Reduce overhead of restarting synchrotrons.
diff --git a/changelog.d/12369.doc b/changelog.d/12369.doc
deleted file mode 100644
index c34271b2ce..0000000000
--- a/changelog.d/12369.doc
+++ /dev/null
@@ -1 +0,0 @@
-Update the link to Redis pub/sub documentation in the workers documentation..
\ No newline at end of file
diff --git a/changelog.d/12370.feature b/changelog.d/12370.feature
deleted file mode 100644
index 2c695ddaa0..0000000000
--- a/changelog.d/12370.feature
+++ /dev/null
@@ -1 +0,0 @@
-Update `/messages` to use historic pagination tokens if no `from` query parameter is given.
diff --git a/changelog.d/12371.misc b/changelog.d/12371.misc
deleted file mode 100644
index c5b6356799..0000000000
--- a/changelog.d/12371.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add type hints to tests files.
\ No newline at end of file
diff --git a/changelog.d/12372.feature b/changelog.d/12372.feature
deleted file mode 100644
index 34bb60e966..0000000000
--- a/changelog.d/12372.feature
+++ /dev/null
@@ -1 +0,0 @@
-Reduce overhead of restarting synchrotrons.
diff --git a/changelog.d/12376.misc b/changelog.d/12376.misc
deleted file mode 100644
index 191f84bbd4..0000000000
--- a/changelog.d/12376.misc
+++ /dev/null
@@ -1 +0,0 @@
-Allow specifying the Postgres database's port when running unit tests with Postgres.
\ No newline at end of file
diff --git a/changelog.d/12379.misc b/changelog.d/12379.misc
deleted file mode 100644
index b55778577d..0000000000
--- a/changelog.d/12379.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove temporary pin of signedjson<=1.1.1 that was added in Synapse 1.56.0.
diff --git a/changelog.d/12380.misc b/changelog.d/12380.misc
deleted file mode 100644
index 178a00321a..0000000000
--- a/changelog.d/12380.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add opentracing spans to calls to external cache.
diff --git a/changelog.d/12381.misc b/changelog.d/12381.misc
deleted file mode 100644
index a1d8d60ebb..0000000000
--- a/changelog.d/12381.misc
+++ /dev/null
@@ -1 +0,0 @@
-Lay groundwork for using `poetry` to manage Synapse's dependencies.
\ No newline at end of file
diff --git a/changelog.d/12384.misc b/changelog.d/12384.misc
deleted file mode 100644
index 8a60f32876..0000000000
--- a/changelog.d/12384.misc
+++ /dev/null
@@ -1 +0,0 @@
-Make missing `importlib_metadata` dependency explicit.
\ No newline at end of file
diff --git a/changelog.d/12385.docker b/changelog.d/12385.docker
deleted file mode 100644
index abe2127ea0..0000000000
--- a/changelog.d/12385.docker
+++ /dev/null
@@ -1 +0,0 @@
-Bundle locked versions of dependencies into the Docker image.
\ No newline at end of file
diff --git a/changelog.d/12389.misc b/changelog.d/12389.misc
deleted file mode 100644
index 00e3a5d758..0000000000
--- a/changelog.d/12389.misc
+++ /dev/null
@@ -1 +0,0 @@
-Update type annotations for compatiblity with prometheus_client 0.14.
diff --git a/changelog.d/12390.bugfix b/changelog.d/12390.bugfix
deleted file mode 100644
index 159c6b3c0f..0000000000
--- a/changelog.d/12390.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug introduced in Synapse 1.49.0 which caused the `synapse_event_persisted_position` metric to have invalid values.
diff --git a/changelog.d/12391.feature b/changelog.d/12391.feature
deleted file mode 100644
index 9a064ec8be..0000000000
--- a/changelog.d/12391.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add a module API for reading and writing global account data.
diff --git a/changelog.d/12392.doc b/changelog.d/12392.doc
deleted file mode 100644
index 6a2f522bf6..0000000000
--- a/changelog.d/12392.doc
+++ /dev/null
@@ -1 +0,0 @@
-Remove documentation for converting a legacy structured logging configuration to the new format.
diff --git a/changelog.d/12398.misc b/changelog.d/12398.misc
deleted file mode 100644
index f94054bdaa..0000000000
--- a/changelog.d/12398.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove support for the unstable identifiers specified in [MSC3288](https://github.com/matrix-org/matrix-doc/pull/3288).
diff --git a/changelog.d/12400.misc b/changelog.d/12400.misc
deleted file mode 100644
index 8a60f32876..0000000000
--- a/changelog.d/12400.misc
+++ /dev/null
@@ -1 +0,0 @@
-Make missing `importlib_metadata` dependency explicit.
\ No newline at end of file
diff --git a/changelog.d/12402.misc b/changelog.d/12402.misc
deleted file mode 100644
index 51ed8ad44e..0000000000
--- a/changelog.d/12402.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add missing type hints to configuration classes.
diff --git a/changelog.d/12403.feature b/changelog.d/12403.feature
deleted file mode 100644
index 5b55e86ecb..0000000000
--- a/changelog.d/12403.feature
+++ /dev/null
@@ -1 +0,0 @@
-Support the stable `v1` endpoint for `/relations`, per [MSC2675](https://github.com/matrix-org/matrix-doc/pull/2675).
diff --git a/changelog.d/12404.misc b/changelog.d/12404.misc
deleted file mode 100644
index 00100fdfef..0000000000
--- a/changelog.d/12404.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add files used to build the Docker image used for complement testing into the Synapse repository.
diff --git a/changelog.d/12405.misc b/changelog.d/12405.misc
deleted file mode 100644
index 697b36c2c9..0000000000
--- a/changelog.d/12405.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix up healthcheck generation for workers docker image.
diff --git a/changelog.d/12407.misc b/changelog.d/12407.misc
deleted file mode 100644
index 896da9b74d..0000000000
--- a/changelog.d/12407.misc
+++ /dev/null
@@ -1 +0,0 @@
-Run the olddeps CI job using Poetry.
\ No newline at end of file
diff --git a/changelog.d/12408.misc b/changelog.d/12408.misc
deleted file mode 100644
index e09a6b8423..0000000000
--- a/changelog.d/12408.misc
+++ /dev/null
@@ -1 +0,0 @@
-Do not include groups in the sync response when disabled.
diff --git a/changelog.d/12409.misc b/changelog.d/12409.misc
deleted file mode 100644
index 9f333e718a..0000000000
--- a/changelog.d/12409.misc
+++ /dev/null
@@ -1 +0,0 @@
-Avoid trying to calculate the state at outlier events.
diff --git a/changelog.d/12410.bugfix b/changelog.d/12410.bugfix
deleted file mode 100644
index d042425d20..0000000000
--- a/changelog.d/12410.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a spec compliance issue where requests to the `/publicRooms` federation API would specify `limit` as a string.
\ No newline at end of file
diff --git a/changelog.d/12412.misc b/changelog.d/12412.misc
deleted file mode 100644
index 03c90c556a..0000000000
--- a/changelog.d/12412.misc
+++ /dev/null
@@ -1 +0,0 @@
-Run the CI portdb script in the locked poetry environment.
\ No newline at end of file
diff --git a/changelog.d/12415.misc b/changelog.d/12415.misc
deleted file mode 100644
index 87a5bae572..0000000000
--- a/changelog.d/12415.misc
+++ /dev/null
@@ -1 +0,0 @@
-Improve type hints related to HTTP query parameters.
\ No newline at end of file
diff --git a/changelog.d/12418.misc b/changelog.d/12418.misc
deleted file mode 100644
index d4b333ce81..0000000000
--- a/changelog.d/12418.misc
+++ /dev/null
@@ -1 +0,0 @@
-Run the CI export-data script in the locked poetry environment.
diff --git a/changelog.d/12420.misc b/changelog.d/12420.misc
deleted file mode 100644
index e1965b0713..0000000000
--- a/changelog.d/12420.misc
+++ /dev/null
@@ -1 +0,0 @@
-Stop maintaining a list of lint targets.
diff --git a/changelog.d/12421.misc b/changelog.d/12421.misc
deleted file mode 100644
index 3a7cbc34e7..0000000000
--- a/changelog.d/12421.misc
+++ /dev/null
@@ -1 +0,0 @@
-Make `synapse._scripts` pass type checks.
diff --git a/changelog.d/12422.misc b/changelog.d/12422.misc
deleted file mode 100644
index 3a7cbc34e7..0000000000
--- a/changelog.d/12422.misc
+++ /dev/null
@@ -1 +0,0 @@
-Make `synapse._scripts` pass type checks.
diff --git a/changelog.d/12423.misc b/changelog.d/12423.misc
deleted file mode 100644
index e793d08e5e..0000000000
--- a/changelog.d/12423.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add some type hints to datastore.
\ No newline at end of file
diff --git a/changelog.d/12435.misc b/changelog.d/12435.misc
deleted file mode 100644
index 3a68452573..0000000000
--- a/changelog.d/12435.misc
+++ /dev/null
@@ -1 +0,0 @@
-Enable certificate checking during complement tests.
diff --git a/changelog.d/12436.feature b/changelog.d/12436.feature
deleted file mode 100644
index 883ac15574..0000000000
--- a/changelog.d/12436.feature
+++ /dev/null
@@ -1,2 +0,0 @@
-Include bundled aggregations in search results 
-([MSC3666](https://github.com/matrix-org/matrix-spec-proposals/pull/3666)).
diff --git a/changelog.d/12439.misc b/changelog.d/12439.misc
deleted file mode 100644
index 43bc64ed55..0000000000
--- a/changelog.d/12439.misc
+++ /dev/null
@@ -1 +0,0 @@
-Bundle locked versions of dependencies into the Docker image.
diff --git a/changelog.d/12444.misc b/changelog.d/12444.misc
deleted file mode 100644
index 4643a155a9..0000000000
--- a/changelog.d/12444.misc
+++ /dev/null
@@ -1 +0,0 @@
-Explicitly specify the `tls` extra for Twisted dependency.
diff --git a/debian/changelog b/debian/changelog
index 903d98af02..67215aa080 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,3 +1,9 @@
+matrix-synapse-py3 (1.57.0~rc1) stable; urgency=medium
+
+  * New synapse release 1.57.0~rc1.
+
+ -- Synapse Packaging team <packages@matrix.org>  Tue, 12 Apr 2022 13:36:25 +0100
+
 matrix-synapse-py3 (1.56.0) stable; urgency=medium
 
   * New synapse release 1.56.0.
diff --git a/synapse/__init__.py b/synapse/__init__.py
index 2e6510537f..7cdd921366 100644
--- a/synapse/__init__.py
+++ b/synapse/__init__.py
@@ -68,7 +68,7 @@ try:
 except ImportError:
     pass
 
-__version__ = "1.56.0"
+__version__ = "1.57.0rc1"
 
 if bool(os.environ.get("SYNAPSE_TEST_PATCH_LOG_CONTEXTS", False)):
     # We import here so that we don't have to install a bunch of deps when