Merge branch 'develop' of github.com:matrix-org/synapse into matrix-org-hotfixes

79 files changed, 32 insertions, 48 deletions

diff --git a/changelog.d/5742.feature b/changelog.d/5742.feature
deleted file mode 100644
index de10302275..0000000000
--- a/changelog.d/5742.feature
+++ /dev/null
@@ -1 +0,0 @@
-Allow admin to create or modify a user. Contributed by Awesome Technologies Innovationslabor GmbH.
diff --git a/changelog.d/6621.doc b/changelog.d/6621.doc
deleted file mode 100644
index 6722ccfda3..0000000000
--- a/changelog.d/6621.doc
+++ /dev/null
@@ -1 +0,0 @@
-Fix a typo in the configuration example for purge jobs in the sample configuration file.
diff --git a/changelog.d/6624.doc b/changelog.d/6624.doc
deleted file mode 100644
index bc9a022db2..0000000000
--- a/changelog.d/6624.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add complete documentation of the message retention policies support.
diff --git a/changelog.d/6654.bugfix b/changelog.d/6654.bugfix
deleted file mode 100644
index fed35252db..0000000000
--- a/changelog.d/6654.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Correctly proxy HTTP errors due to API calls to remote group servers.
diff --git a/changelog.d/6655.misc b/changelog.d/6655.misc
deleted file mode 100644
index 01e78bc84e..0000000000
--- a/changelog.d/6655.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add `local_current_membership` table for tracking local user membership state in rooms.
diff --git a/changelog.d/6656.doc b/changelog.d/6656.doc
deleted file mode 100644
index 9f32da1a88..0000000000
--- a/changelog.d/6656.doc
+++ /dev/null
@@ -1 +0,0 @@
-No more overriding the entire /etc folder of the container in docker-compose.yaml. Contributed by Fabian Meyer.
diff --git a/changelog.d/6663.doc b/changelog.d/6663.doc
deleted file mode 100644
index 83b9c1626a..0000000000
--- a/changelog.d/6663.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add some helpful tips about changelog entries to the github pull request template.
\ No newline at end of file
diff --git a/changelog.d/6664.bugfix b/changelog.d/6664.bugfix
deleted file mode 100644
index 8c6a6fa1c8..0000000000
--- a/changelog.d/6664.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix media repo admin APIs when using a media worker.
diff --git a/changelog.d/6665.doc b/changelog.d/6665.doc
deleted file mode 100644
index bc9a022db2..0000000000
--- a/changelog.d/6665.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add complete documentation of the message retention policies support.
diff --git a/changelog.d/6666.misc b/changelog.d/6666.misc
deleted file mode 100644
index e79c23d2d2..0000000000
--- a/changelog.d/6666.misc
+++ /dev/null
@@ -1 +0,0 @@
-Port `synapse.replication.tcp` to async/await.
diff --git a/changelog.d/6667.misc b/changelog.d/6667.misc
deleted file mode 100644
index 227f80a508..0000000000
--- a/changelog.d/6667.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fixup `synapse.replication` to pass mypy checks.
diff --git a/changelog.d/6675.removal b/changelog.d/6675.removal
deleted file mode 100644
index 95df9a2d83..0000000000
--- a/changelog.d/6675.removal
+++ /dev/null
@@ -1 +0,0 @@
-Synapse no longer supports versions of SQLite before 3.11, and will refuse to start when configured to use an older version. Administrators are recommended to migrate their database to Postgres (see instructions [here](docs/postgres.md)).
diff --git a/changelog.d/6681.feature b/changelog.d/6681.feature
deleted file mode 100644
index 5cf19a4e0e..0000000000
--- a/changelog.d/6681.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add new quarantine media admin APIs to quarantine by media ID or by user who uploaded the media.
diff --git a/changelog.d/6682.bugfix b/changelog.d/6682.bugfix
deleted file mode 100644
index d48ea31477..0000000000
--- a/changelog.d/6682.bugfix
+++ /dev/null
@@ -1,2 +0,0 @@
-Fix "CRITICAL" errors being logged when a request is received for a uri containing non-ascii characters.
-
diff --git a/changelog.d/6685.doc b/changelog.d/6685.doc
deleted file mode 100644
index 7cf750fe3f..0000000000
--- a/changelog.d/6685.doc
+++ /dev/null
@@ -1 +0,0 @@
-Clarify the `account_validity` and `email` sections of the sample configuration.
\ No newline at end of file
diff --git a/changelog.d/6686.misc b/changelog.d/6686.misc
deleted file mode 100644
index 4070f2e563..0000000000
--- a/changelog.d/6686.misc
+++ /dev/null
@@ -1 +0,0 @@
-Allow additional_resources to implement IResource directly.
diff --git a/changelog.d/6687.misc b/changelog.d/6687.misc
deleted file mode 100644
index deb0454602..0000000000
--- a/changelog.d/6687.misc
+++ /dev/null
@@ -1 +0,0 @@
-Allow REST endpoint implementations to raise a RedirectException, which will redirect the user's browser to a given location.
diff --git a/changelog.d/6688.misc b/changelog.d/6688.misc
deleted file mode 100644
index 2a9f28ce5c..0000000000
--- a/changelog.d/6688.misc
+++ /dev/null
@@ -1 +0,0 @@
-Updates and extensions to the module API.
\ No newline at end of file
diff --git a/changelog.d/6689.misc b/changelog.d/6689.misc
deleted file mode 100644
index 17f15e73a8..0000000000
--- a/changelog.d/6689.misc
+++ /dev/null
@@ -1 +0,0 @@
-Updates to the SAML mapping provider API.
diff --git a/changelog.d/6690.bugfix b/changelog.d/6690.bugfix
deleted file mode 100644
index 30ce1dc9f7..0000000000
--- a/changelog.d/6690.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug where we would assign a numeric userid if somebody tried registering with an empty username.
diff --git a/changelog.d/6691.misc b/changelog.d/6691.misc
deleted file mode 100644
index 104e9ce648..0000000000
--- a/changelog.d/6691.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove redundant RegistrationError class.
diff --git a/changelog.d/6697.misc b/changelog.d/6697.misc
deleted file mode 100644
index 5650387804..0000000000
--- a/changelog.d/6697.misc
+++ /dev/null
@@ -1 +0,0 @@
-Don't block processing of incoming EDUs behind processing PDUs in the same transaction.
diff --git a/changelog.d/6698.doc b/changelog.d/6698.doc
deleted file mode 100644
index 5aba51252d..0000000000
--- a/changelog.d/6698.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add more endpoints to the documentation for Synapse workers.
diff --git a/changelog.d/6702.misc b/changelog.d/6702.misc
deleted file mode 100644
index f7bc98409c..0000000000
--- a/changelog.d/6702.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove duplicate check for the `session` query parameter on the `/auth/xxx/fallback/web` Client-Server endpoint.
\ No newline at end of file
diff --git a/changelog.d/6706.misc b/changelog.d/6706.misc
deleted file mode 100644
index 1ac11cc04b..0000000000
--- a/changelog.d/6706.misc
+++ /dev/null
@@ -1 +0,0 @@
-Attempt to retry sending a transaction when we detect a remote server has come back online, rather than waiting for a transaction to be triggered by new data.
diff --git a/changelog.d/6711.bugfix b/changelog.d/6711.bugfix
deleted file mode 100644
index c70506bd88..0000000000
--- a/changelog.d/6711.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix `purge_room` admin API.
diff --git a/changelog.d/6712.feature b/changelog.d/6712.feature
deleted file mode 100644
index 2cce0ecf88..0000000000
--- a/changelog.d/6712.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add org.matrix.e2e_cross_signing to unstable_features in /versions as per [MSC1756](https://github.com/matrix-org/matrix-doc/pull/1756).
diff --git a/changelog.d/6714.bugfix b/changelog.d/6714.bugfix
deleted file mode 100644
index 410516694f..0000000000
--- a/changelog.d/6714.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug causing Synapse to not always purge quiet rooms with a low `max_lifetime` in their message retention policies when running the automated purge jobs.
diff --git a/changelog.d/6715.misc b/changelog.d/6715.misc
deleted file mode 100644
index 8876b0446d..0000000000
--- a/changelog.d/6715.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add StateMap type alias to simplify types.
diff --git a/changelog.d/6716.misc b/changelog.d/6716.misc
deleted file mode 100644
index 319aaa4acb..0000000000
--- a/changelog.d/6716.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add a `DeltaState` to track changes to be made to current state during event persistence.
diff --git a/changelog.d/6717.misc b/changelog.d/6717.misc
deleted file mode 100644
index a2a7776126..0000000000
--- a/changelog.d/6717.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add more logging around message retention policies support.
diff --git a/changelog.d/6718.bugfix b/changelog.d/6718.bugfix
deleted file mode 100644
index 23b23e3ed8..0000000000
--- a/changelog.d/6718.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug causing the `synapse_port_db` script to return 0 in a specific error case.
diff --git a/changelog.d/6720.feature b/changelog.d/6720.feature
deleted file mode 100644
index dfc1b74d62..0000000000
--- a/changelog.d/6720.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add a new admin API to list and filter rooms on the server.
\ No newline at end of file
diff --git a/changelog.d/6723.misc b/changelog.d/6723.misc
deleted file mode 100644
index 17f15e73a8..0000000000
--- a/changelog.d/6723.misc
+++ /dev/null
@@ -1 +0,0 @@
-Updates to the SAML mapping provider API.
diff --git a/changelog.d/6724.misc b/changelog.d/6724.misc
deleted file mode 100644
index 5256be75fa..0000000000
--- a/changelog.d/6724.misc
+++ /dev/null
@@ -1 +0,0 @@
-When processing a SAML response, log the assertions for easier configuration.
diff --git a/changelog.d/6728.misc b/changelog.d/6728.misc
deleted file mode 100644
index 01e78bc84e..0000000000
--- a/changelog.d/6728.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add `local_current_membership` table for tracking local user membership state in rooms.
diff --git a/changelog.d/6729.misc b/changelog.d/6729.misc
new file mode 100644
index 0000000000..5537355bea
--- /dev/null
+++ b/changelog.d/6729.misc
@@ -0,0 +1 @@
+Record room versions in the `rooms` table.
diff --git a/changelog.d/6730.bugfix b/changelog.d/6730.bugfix
deleted file mode 100644
index beb444ca66..0000000000
--- a/changelog.d/6730.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix changing password via user admin API.
diff --git a/changelog.d/6731.bugfix b/changelog.d/6731.bugfix
deleted file mode 100644
index 21f6e15cbd..0000000000
--- a/changelog.d/6731.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix `/events/:event_id` deprecated API.
diff --git a/changelog.d/6732.misc b/changelog.d/6732.misc
deleted file mode 100644
index 8edd767405..0000000000
--- a/changelog.d/6732.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fixup `synapse.rest` to pass mypy.
diff --git a/changelog.d/6733.misc b/changelog.d/6733.misc
deleted file mode 100644
index bf048c0be2..0000000000
--- a/changelog.d/6733.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fixup synapse.api to pass mypy.
diff --git a/changelog.d/6734.bugfix b/changelog.d/6734.bugfix
new file mode 100644
index 0000000000..79c6bab4d1
--- /dev/null
+++ b/changelog.d/6734.bugfix
@@ -0,0 +1 @@
+Warn if postgres database has a non-C locale, as that can cause issues when upgrading locales (e.g. due to upgrading OS).
diff --git a/changelog.d/6742.bugfix b/changelog.d/6742.bugfix
deleted file mode 100644
index ca2687c8bb..0000000000
--- a/changelog.d/6742.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix monthly active user limiting support for worker mode, fixes [#4639](https://github.com/matrix-org/synapse/issues/4639).
diff --git a/changelog.d/6747.bugfix b/changelog.d/6747.bugfix
deleted file mode 100644
index c98107e741..0000000000
--- a/changelog.d/6747.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix bug when setting `account_validity` to an empty block in the config. Thanks to @Sorunome for reporting.
diff --git a/changelog.d/6748.misc b/changelog.d/6748.misc
new file mode 100644
index 0000000000..de320d4cd9
--- /dev/null
+++ b/changelog.d/6748.misc
@@ -0,0 +1 @@
+Propagate cache invalidates from workers to other workers.
diff --git a/changelog.d/6749.misc b/changelog.d/6749.misc
deleted file mode 100644
index 9fa13cb1d4..0000000000
--- a/changelog.d/6749.misc
+++ /dev/null
@@ -1 +0,0 @@
-Allow streaming cache 'invalidate all' to workers.
diff --git a/changelog.d/6751.misc b/changelog.d/6751.misc
new file mode 100644
index 0000000000..7222520528
--- /dev/null
+++ b/changelog.d/6751.misc
@@ -0,0 +1 @@
+Remove some unnecessary admin handler abstraction methods.
\ No newline at end of file
diff --git a/changelog.d/6753.bugfix b/changelog.d/6753.bugfix
deleted file mode 100644
index 5dfde793e1..0000000000
--- a/changelog.d/6753.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix `AttributeError: 'NoneType' object has no attribute 'get'` in `hash_password` when configuration has an empty `password_config`. Contributed by @ivilata.
diff --git a/changelog.d/6754.misc b/changelog.d/6754.misc
deleted file mode 100644
index 0a955e47e6..0000000000
--- a/changelog.d/6754.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove unused CI docker compose files.
diff --git a/changelog.d/6756.feature b/changelog.d/6756.feature
deleted file mode 100644
index 6328c868f2..0000000000
--- a/changelog.d/6756.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add new quarantine media admin APIs to quarantine by media ID or by user who uploaded the media.
\ No newline at end of file
diff --git a/changelog.d/6757.misc b/changelog.d/6757.misc
new file mode 100644
index 0000000000..a50c5e974a
--- /dev/null
+++ b/changelog.d/6757.misc
@@ -0,0 +1 @@
+Add some debugging for media storage providers.
diff --git a/changelog.d/6761.bugfix b/changelog.d/6761.bugfix
new file mode 100644
index 0000000000..1c664c02df
--- /dev/null
+++ b/changelog.d/6761.bugfix
@@ -0,0 +1 @@
+Minor fixes to `PUT /_synapse/admin/v2/users` admin api.
diff --git a/changelog.d/6764.misc b/changelog.d/6764.misc
deleted file mode 100644
index 8edd767405..0000000000
--- a/changelog.d/6764.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fixup `synapse.rest` to pass mypy.
diff --git a/changelog.d/6767.bugfix b/changelog.d/6767.bugfix
new file mode 100644
index 0000000000..63c7c63315
--- /dev/null
+++ b/changelog.d/6767.bugfix
@@ -0,0 +1 @@
+Validate `client_secret` parameter using the regex provided by the Client-Server API, temporarily allowing `:` characters for older clients. The `:` character will be removed in a future release.
diff --git a/changelog.d/6771.bugfix b/changelog.d/6771.bugfix
new file mode 100644
index 0000000000..623ba24acb
--- /dev/null
+++ b/changelog.d/6771.bugfix
@@ -0,0 +1 @@
+Fix persisting redaction events that have been redacted (or otherwise don't have a redacts key).
diff --git a/changelog.d/6775.doc b/changelog.d/6775.doc
new file mode 100644
index 0000000000..c6078ef82d
--- /dev/null
+++ b/changelog.d/6775.doc
@@ -0,0 +1 @@
+Clarify documentation related to `user_dir` and `federation_reader` workers.
diff --git a/changelog.d/6776.misc b/changelog.d/6776.misc
new file mode 100644
index 0000000000..4f9a4ac7a5
--- /dev/null
+++ b/changelog.d/6776.misc
@@ -0,0 +1 @@
+Detect unknown remote devices and mark cache as stale.
diff --git a/changelog.d/6786.misc b/changelog.d/6786.misc
new file mode 100644
index 0000000000..94c692e53a
--- /dev/null
+++ b/changelog.d/6786.misc
@@ -0,0 +1 @@
+Attempt to resync remote users' devices when detected as stale.
diff --git a/changelog.d/6787.feature b/changelog.d/6787.feature
new file mode 100644
index 0000000000..df9e4b77ab
--- /dev/null
+++ b/changelog.d/6787.feature
@@ -0,0 +1 @@
+Implement updated authorization rules for aliases events, from [MSC2260](https://github.com/matrix-org/matrix-doc/pull/2260).
diff --git a/changelog.d/6788.misc b/changelog.d/6788.misc
new file mode 100644
index 0000000000..5537355bea
--- /dev/null
+++ b/changelog.d/6788.misc
@@ -0,0 +1 @@
+Record room versions in the `rooms` table.
diff --git a/changelog.d/6790.feature b/changelog.d/6790.feature
new file mode 100644
index 0000000000..df9e4b77ab
--- /dev/null
+++ b/changelog.d/6790.feature
@@ -0,0 +1 @@
+Implement updated authorization rules for aliases events, from [MSC2260](https://github.com/matrix-org/matrix-doc/pull/2260).
diff --git a/changelog.d/6792.misc b/changelog.d/6792.misc
new file mode 100644
index 0000000000..fa31d509b3
--- /dev/null
+++ b/changelog.d/6792.misc
@@ -0,0 +1 @@
+Delete current state from the database when server leaves a room.
diff --git a/changelog.d/6794.feature b/changelog.d/6794.feature
new file mode 100644
index 0000000000..df9e4b77ab
--- /dev/null
+++ b/changelog.d/6794.feature
@@ -0,0 +1 @@
+Implement updated authorization rules for aliases events, from [MSC2260](https://github.com/matrix-org/matrix-doc/pull/2260).
diff --git a/changelog.d/6795.bugfix b/changelog.d/6795.bugfix
new file mode 100644
index 0000000000..d1585653b1
--- /dev/null
+++ b/changelog.d/6795.bugfix
@@ -0,0 +1 @@
+Fix outbound federation request metrics.
diff --git a/changelog.d/6796.bugfix b/changelog.d/6796.bugfix
new file mode 100644
index 0000000000..206a157311
--- /dev/null
+++ b/changelog.d/6796.bugfix
@@ -0,0 +1 @@
+Fix bug where querying a remote user's device keys that weren't cached resulted in only returning a single device.
diff --git a/changelog.d/6797.misc b/changelog.d/6797.misc
new file mode 100644
index 0000000000..e9127bac51
--- /dev/null
+++ b/changelog.d/6797.misc
@@ -0,0 +1 @@
+When a client asks for a remote user's device keys check if the local cache for that user has been marked as potentially stale.
diff --git a/changelog.d/6799.bugfix b/changelog.d/6799.bugfix
new file mode 100644
index 0000000000..322a2758af
--- /dev/null
+++ b/changelog.d/6799.bugfix
@@ -0,0 +1 @@
+Fix race in federation sender worker that delayed sending of device updates.
diff --git a/changelog.d/6800.bugfix b/changelog.d/6800.bugfix
new file mode 100644
index 0000000000..322a2758af
--- /dev/null
+++ b/changelog.d/6800.bugfix
@@ -0,0 +1 @@
+Fix race in federation sender worker that delayed sending of device updates.
diff --git a/changelog.d/6801.bugfix b/changelog.d/6801.bugfix
new file mode 100644
index 0000000000..f401fa5d69
--- /dev/null
+++ b/changelog.d/6801.bugfix
@@ -0,0 +1 @@
+Fix bug where Synapse didn't invalidate cache of remote users' devices when Synapse left a room.
diff --git a/changelog.d/6802.misc b/changelog.d/6802.misc
new file mode 100644
index 0000000000..a77ba1d7a5
--- /dev/null
+++ b/changelog.d/6802.misc
@@ -0,0 +1 @@
+Add background update to clean out left rooms from current state.
diff --git a/changelog.d/6803.misc b/changelog.d/6803.misc
new file mode 100644
index 0000000000..08aa80bcd9
--- /dev/null
+++ b/changelog.d/6803.misc
@@ -0,0 +1 @@
+Refactoring work in preparation for changing the event redaction algorithm.
diff --git a/changelog.d/6805.misc b/changelog.d/6805.misc
new file mode 100644
index 0000000000..08aa80bcd9
--- /dev/null
+++ b/changelog.d/6805.misc
@@ -0,0 +1 @@
+Refactoring work in preparation for changing the event redaction algorithm.
diff --git a/changelog.d/6806.misc b/changelog.d/6806.misc
new file mode 100644
index 0000000000..08aa80bcd9
--- /dev/null
+++ b/changelog.d/6806.misc
@@ -0,0 +1 @@
+Refactoring work in preparation for changing the event redaction algorithm.
diff --git a/changelog.d/6807.misc b/changelog.d/6807.misc
new file mode 100644
index 0000000000..08aa80bcd9
--- /dev/null
+++ b/changelog.d/6807.misc
@@ -0,0 +1 @@
+Refactoring work in preparation for changing the event redaction algorithm.
diff --git a/changelog.d/6810.misc b/changelog.d/6810.misc
new file mode 100644
index 0000000000..5537355bea
--- /dev/null
+++ b/changelog.d/6810.misc
@@ -0,0 +1 @@
+Record room versions in the `rooms` table.
diff --git a/changelog.d/6811.bugfix b/changelog.d/6811.bugfix
new file mode 100644
index 0000000000..361f2fc2e8
--- /dev/null
+++ b/changelog.d/6811.bugfix
@@ -0,0 +1 @@
+Fix waking up other workers when remote server is detected to have come back online.
diff --git a/changelog.d/6816.misc b/changelog.d/6816.misc
new file mode 100644
index 0000000000..a77ba1d7a5
--- /dev/null
+++ b/changelog.d/6816.misc
@@ -0,0 +1 @@
+Add background update to clean out left rooms from current state.
diff --git a/changelog.d/6819.misc b/changelog.d/6819.misc
new file mode 100644
index 0000000000..4f9a4ac7a5
--- /dev/null
+++ b/changelog.d/6819.misc
@@ -0,0 +1 @@
+Detect unknown remote devices and mark cache as stale.
diff --git a/changelog.d/6820.misc b/changelog.d/6820.misc
new file mode 100644
index 0000000000..08aa80bcd9
--- /dev/null
+++ b/changelog.d/6820.misc
@@ -0,0 +1 @@
+Refactoring work in preparation for changing the event redaction algorithm.