Merge tag 'v1.58.0rc2' into develop

Synapse 1.58.0rc2 (2022-04-26)
==============================

This release candidate fixes bugs related to Synapse 1.58.0rc1's logic for handling device list updates.

Bugfixes
--------

- Fix a bug introduced in Synapse 1.58.0rc1 where the main process could consume excessive amounts of CPU and memory while handling sentry logging failures. ([\#12554](https://github.com/matrix-org/synapse/issues/12554))
- Fix a bug introduced in Synapse 1.58.0rc1 where opentracing contexts were not correctly sent to whitelisted remote servers with device lists updates. ([\#12555](https://github.com/matrix-org/synapse/issues/12555))

Internal Changes
----------------

- Reduce unnecessary work when handling remote device list updates. ([\#12557](https://github.com/matrix-org/synapse/issues/12557))

51 files changed, 0 insertions, 52 deletions

diff --git a/changelog.d/11398.feature b/changelog.d/11398.feature
deleted file mode 100644
index a910f4da14..0000000000
--- a/changelog.d/11398.feature
+++ /dev/null
@@ -1 +0,0 @@
-Implement [MSC3383](https://github.com/matrix-org/matrix-spec-proposals/pull/3383) for including the destination in server-to-server authentication headers. Contributed by @Bubu and @jcgruenhage for Famedly GmbH.
diff --git a/changelog.d/12213.bugfix b/changelog.d/12213.bugfix
deleted file mode 100644
index 9278e3a9c1..0000000000
--- a/changelog.d/12213.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Prevent a sync request from removing a user's busy presence status.
diff --git a/changelog.d/12319.bugfix b/changelog.d/12319.bugfix
deleted file mode 100644
index a50191feaa..0000000000
--- a/changelog.d/12319.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix bug with incremental sync missing events when rejoining/backfilling. Contributed by Nick @ Beeper.
diff --git a/changelog.d/12337.feature b/changelog.d/12337.feature
deleted file mode 100644
index 6c4444c707..0000000000
--- a/changelog.d/12337.feature
+++ /dev/null
@@ -1 +0,0 @@
-Use poetry to manage Synapse's dependencies.
\ No newline at end of file
diff --git a/changelog.d/12340.doc b/changelog.d/12340.doc
deleted file mode 100644
index 8354f2259e..0000000000
--- a/changelog.d/12340.doc
+++ /dev/null
@@ -1 +0,0 @@
-Fix rendering of the documentation site when using the 'print' feature.
diff --git a/changelog.d/12344.removal b/changelog.d/12344.removal
deleted file mode 100644
index ecefa76d8e..0000000000
--- a/changelog.d/12344.removal
+++ /dev/null
@@ -1 +0,0 @@
-The groups/communities feature in Synapse has been disabled by default.
diff --git a/changelog.d/12365.feature b/changelog.d/12365.feature
deleted file mode 100644
index 642dea966c..0000000000
--- a/changelog.d/12365.feature
+++ /dev/null
@@ -1 +0,0 @@
-Enable processing of device list updates asynchronously.
diff --git a/changelog.d/12368.doc b/changelog.d/12368.doc
deleted file mode 100644
index 62e4cb2c7e..0000000000
--- a/changelog.d/12368.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add a manual documenting config file options.
\ No newline at end of file
diff --git a/changelog.d/12382.removal b/changelog.d/12382.removal
deleted file mode 100644
index eb91186340..0000000000
--- a/changelog.d/12382.removal
+++ /dev/null
@@ -1 +0,0 @@
-Remove unstable identifiers from [MSC3440](https://github.com/matrix-org/matrix-doc/pull/3440).
diff --git a/changelog.d/12394.misc b/changelog.d/12394.misc
deleted file mode 100644
index 69109fcc37..0000000000
--- a/changelog.d/12394.misc
+++ /dev/null
@@ -1 +0,0 @@
-Preparation for faster-room-join work: start a background process to resynchronise the room state after a room join.
diff --git a/changelog.d/12395.misc b/changelog.d/12395.misc
deleted file mode 100644
index 0a2123b294..0000000000
--- a/changelog.d/12395.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove an unstable identifier from [MSC3083](https://github.com/matrix-org/matrix-doc/pull/3083).
diff --git a/changelog.d/12399.misc b/changelog.d/12399.misc
deleted file mode 100644
index cd2e09626d..0000000000
--- a/changelog.d/12399.misc
+++ /dev/null
@@ -1 +0,0 @@
-Preparation for faster-room-join work: Implement a tracking mechanism to allow functions to wait for full room state to arrive.
diff --git a/changelog.d/12425.misc b/changelog.d/12425.misc
deleted file mode 100644
index 3b076be0bd..0000000000
--- a/changelog.d/12425.misc
+++ /dev/null
@@ -1 +0,0 @@
-Run twisted trunk CI job in the locked poetry environment.
diff --git a/changelog.d/12427.feature b/changelog.d/12427.feature
deleted file mode 100644
index e6913c8c09..0000000000
--- a/changelog.d/12427.feature
+++ /dev/null
@@ -1 +0,0 @@
-Implement [MSC2815](https://github.com/matrix-org/matrix-spec-proposals/pull/2815) to allow room moderators to view redacted event content. Contributed by @tulir.
diff --git a/changelog.d/12434.misc b/changelog.d/12434.misc
deleted file mode 100644
index 88dab428d2..0000000000
--- a/changelog.d/12434.misc
+++ /dev/null
@@ -1 +0,0 @@
-Run lints under poetry in CI, and remove corresponding tox lint jobs.
diff --git a/changelog.d/12438.misc b/changelog.d/12438.misc
deleted file mode 100644
index f2c07a56da..0000000000
--- a/changelog.d/12438.misc
+++ /dev/null
@@ -1 +0,0 @@
-Run "main" trial tests under `poetry`.
diff --git a/changelog.d/12441.misc b/changelog.d/12441.misc
deleted file mode 100644
index c2619f1654..0000000000
--- a/changelog.d/12441.misc
+++ /dev/null
@@ -1 +0,0 @@
-Bump twisted version in `poetry.lock` to work around [pip bug #9644](https://github.com/pypa/pip/issues/9644).
diff --git a/changelog.d/12445.misc b/changelog.d/12445.misc
deleted file mode 100644
index 954248115a..0000000000
--- a/changelog.d/12445.misc
+++ /dev/null
@@ -1 +0,0 @@
-Change Mutual Rooms' `unstable_features` flag to `uk.half-shot.msc2666.mutual_rooms` which matches the current MSC iteration.
\ No newline at end of file
diff --git a/changelog.d/12449.misc b/changelog.d/12449.misc
deleted file mode 100644
index 03e08aace4..0000000000
--- a/changelog.d/12449.misc
+++ /dev/null
@@ -1 +0,0 @@
-Use `poetry` to manage the virtualenv in debian packages.
diff --git a/changelog.d/12450.misc b/changelog.d/12450.misc
deleted file mode 100644
index 4b1c8cba87..0000000000
--- a/changelog.d/12450.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix typo in the release script help string.
diff --git a/changelog.d/12451.doc b/changelog.d/12451.doc
deleted file mode 100644
index c8b23c1285..0000000000
--- a/changelog.d/12451.doc
+++ /dev/null
@@ -1 +0,0 @@
-Update documentation to reflect that both the `run_background_tasks_on` option and the options for moving stream writers off of the main process are no longer experimental.
diff --git a/changelog.d/12454.misc b/changelog.d/12454.misc
deleted file mode 100644
index cb7ff74b4c..0000000000
--- a/changelog.d/12454.misc
+++ /dev/null
@@ -1 +0,0 @@
-Limit length of device_id to less than 512 characters.
diff --git a/changelog.d/12455.misc b/changelog.d/12455.misc
deleted file mode 100644
index 9b19945673..0000000000
--- a/changelog.d/12455.misc
+++ /dev/null
@@ -1 +0,0 @@
-Reintroduce the list of targets to the linter script, to avoid linting unwanted local-only directories during development.
diff --git a/changelog.d/12457.doc b/changelog.d/12457.doc
deleted file mode 100644
index a4871622cf..0000000000
--- a/changelog.d/12457.doc
+++ /dev/null
@@ -1 +0,0 @@
-Update worker documentation and replace old `federation_reader` with `generic_worker`.
\ No newline at end of file
diff --git a/changelog.d/12464.misc b/changelog.d/12464.misc
deleted file mode 100644
index 7a8cc6ba51..0000000000
--- a/changelog.d/12464.misc
+++ /dev/null
@@ -1 +0,0 @@
-Dockerfile-workers: reduce the amount we install in the image.
diff --git a/changelog.d/12465.feature b/changelog.d/12465.feature
deleted file mode 100644
index 642dea966c..0000000000
--- a/changelog.d/12465.feature
+++ /dev/null
@@ -1 +0,0 @@
-Enable processing of device list updates asynchronously.
diff --git a/changelog.d/12466.misc b/changelog.d/12466.misc
deleted file mode 100644
index b0c2c950fe..0000000000
--- a/changelog.d/12466.misc
+++ /dev/null
@@ -1 +0,0 @@
-Dockerfile-workers: give the master its own log config.
diff --git a/changelog.d/12467.misc b/changelog.d/12467.misc
deleted file mode 100644
index fbf415f707..0000000000
--- a/changelog.d/12467.misc
+++ /dev/null
@@ -1 +0,0 @@
-complement-synapse-workers: factor out separate entry point script.
diff --git a/changelog.d/12468.misc b/changelog.d/12468.misc
deleted file mode 100644
index 3d5d25247f..0000000000
--- a/changelog.d/12468.misc
+++ /dev/null
@@ -1 +0,0 @@
-Update `delay_cancellation` to accept any awaitable, rather than just `Deferred`s.
diff --git a/changelog.d/12472.misc b/changelog.d/12472.misc
deleted file mode 100644
index ed306209cc..0000000000
--- a/changelog.d/12472.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add a CI job which tests Synapse against the latest version of all dependencies.
diff --git a/changelog.d/12474.misc b/changelog.d/12474.misc
deleted file mode 100644
index 5292108b39..0000000000
--- a/changelog.d/12474.misc
+++ /dev/null
@@ -1 +0,0 @@
-Back out experimental implementation of [MSC2314](https://github.com/matrix-org/matrix-spec-proposals/pull/2314).
diff --git a/changelog.d/12475.doc b/changelog.d/12475.doc
deleted file mode 100644
index f4481d0613..0000000000
--- a/changelog.d/12475.doc
+++ /dev/null
@@ -1 +0,0 @@
-Strongly recommend `poetry` for development.
diff --git a/changelog.d/12476.bugfix b/changelog.d/12476.bugfix
deleted file mode 100644
index 9ad6a71abd..0000000000
--- a/changelog.d/12476.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug which incorrectly caused `GET /_matrix/client/r3/rooms/{roomId}/event/{eventId}` to return edited events rather than the original.
diff --git a/changelog.d/12478.misc b/changelog.d/12478.misc
deleted file mode 100644
index 061a604a1e..0000000000
--- a/changelog.d/12478.misc
+++ /dev/null
@@ -1 +0,0 @@
-Use poetry-core instead of setuptools to build wheels.
diff --git a/changelog.d/12483.misc b/changelog.d/12483.misc
deleted file mode 100644
index 88c6e3e465..0000000000
--- a/changelog.d/12483.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix grammatical error in federation error response when the room version of a room is unknown.
diff --git a/changelog.d/12492.doc b/changelog.d/12492.doc
deleted file mode 100644
index 4a3e2f4f06..0000000000
--- a/changelog.d/12492.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add some example configurations for workers and update architectural diagram.
diff --git a/changelog.d/12495.doc b/changelog.d/12495.doc
deleted file mode 100644
index afa0111675..0000000000
--- a/changelog.d/12495.doc
+++ /dev/null
@@ -1 +0,0 @@
-Fix a broken link in `README.rst`.
diff --git a/changelog.d/12496.bugfix b/changelog.d/12496.bugfix
deleted file mode 100644
index a68df7c96a..0000000000
--- a/changelog.d/12496.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix bug where the admin API for [deleting forward extremities](https://github.com/matrix-org/synapse/blob/erikj/fix_delete_event_response_count/docs/admin_api/rooms.md#deleting-forward-extremities) would always return a count of 1 no matter how many extremities were deleted. Broke in v1.27.0.
diff --git a/changelog.d/12497.misc b/changelog.d/12497.misc
deleted file mode 100644
index 17a661ec61..0000000000
--- a/changelog.d/12497.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix a minor typo in the Debian changelogs generated by the release script.
diff --git a/changelog.d/12501.doc b/changelog.d/12501.doc
deleted file mode 100644
index 278193a69a..0000000000
--- a/changelog.d/12501.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add HAProxy delegation example with CORS headers to docs.
diff --git a/changelog.d/12510.bugfix b/changelog.d/12510.bugfix
deleted file mode 100644
index d5856e982a..0000000000
--- a/changelog.d/12510.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug where the image thumbanils embedded into email notifications were broken.
diff --git a/changelog.d/12511.misc b/changelog.d/12511.misc
deleted file mode 100644
index a314bedfc4..0000000000
--- a/changelog.d/12511.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove unnecessary configuration overrides in tests.
diff --git a/changelog.d/12514.misc b/changelog.d/12514.misc
deleted file mode 100644
index 061a604a1e..0000000000
--- a/changelog.d/12514.misc
+++ /dev/null
@@ -1 +0,0 @@
-Use poetry-core instead of setuptools to build wheels.
diff --git a/changelog.d/12519.misc b/changelog.d/12519.misc
deleted file mode 100644
index 9c023d8e3e..0000000000
--- a/changelog.d/12519.misc
+++ /dev/null
@@ -1 +0,0 @@
-Refactor the relations code for clarity.
diff --git a/changelog.d/12520.bugfix b/changelog.d/12520.bugfix
deleted file mode 100644
index c73005fde8..0000000000
--- a/changelog.d/12520.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug in the implementation of MSC3202 where Synapse would use the field name `device_unused_fallback_keys`, rather than `device_unused_fallback_key_types`.
\ No newline at end of file
diff --git a/changelog.d/12522.bugfix b/changelog.d/12522.bugfix
deleted file mode 100644
index 2220f05ceb..0000000000
--- a/changelog.d/12522.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug introduced in Synapse 0.99.3 which could cause Synapse to consume large amounts of RAM when back-paginating in a large room.
diff --git a/changelog.d/12527.doc b/changelog.d/12527.doc
deleted file mode 100644
index e6907321e7..0000000000
--- a/changelog.d/12527.doc
+++ /dev/null
@@ -1,2 +0,0 @@
-Add an index to the configuration manual.
-
diff --git a/changelog.d/12528.misc b/changelog.d/12528.misc
deleted file mode 100644
index f64b5d24b0..0000000000
--- a/changelog.d/12528.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add type hints so `docker` and `stubs` directories pass `mypy --disallow-untyped-defs`.
diff --git a/changelog.d/12529.misc b/changelog.d/12529.misc
deleted file mode 100644
index 5427108742..0000000000
--- a/changelog.d/12529.misc
+++ /dev/null
@@ -1 +0,0 @@
-Handle cancellation in `EventsWorkerStore._get_events_from_cache_or_db`.
diff --git a/changelog.d/12533.doc b/changelog.d/12533.doc
deleted file mode 100644
index 2c15488111..0000000000
--- a/changelog.d/12533.doc
+++ /dev/null
@@ -1 +0,0 @@
-Remove extraneous comma in User Admin API's device deletion section so that the example JSON is actually valid and works. Contributed by @olmari.
\ No newline at end of file
diff --git a/changelog.d/12543.misc b/changelog.d/12543.misc
deleted file mode 100644
index eed7a6973c..0000000000
--- a/changelog.d/12543.misc
+++ /dev/null
@@ -1 +0,0 @@
-Build debian packages for Ubuntu 22.04 "Jammy Jellyfish".