1.28.0rc1

45 files changed, 73 insertions, 46 deletions

diff --git a/CHANGES.md b/CHANGES.md
index a2aa919ebe..a25951031a 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -1,5 +1,5 @@
-Synapse 1.xx.0 (2021-xx-xx)
-===========================
+Synapse 1.28.0rc1 (2021-02-18)
+==============================
 
 Note that this release drops support for ARMv7 in the official Docker images, due to repeated problems building for ARMv7 (and the associated maintenance burden this entails).
 
@@ -17,6 +17,76 @@ Please check if you're using any scripts which use the admin API and replace
 `GET /_synapse/admin/v1/users/<user_id>` with `GET /_synapse/admin/v2/users`.
 
 
+Features
+--------
+
+- New API /_synapse/admin/rooms/{roomId}/context/{eventId}. ([\#9150](https://github.com/matrix-org/synapse/issues/9150))
+- Further improvements to the user experience of registration via single sign-on. ([\#9300](https://github.com/matrix-org/synapse/issues/9300), [\#9301](https://github.com/matrix-org/synapse/issues/9301))
+- Add hook to spam checker modules that allow checking file uploads and remote downloads. ([\#9311](https://github.com/matrix-org/synapse/issues/9311))
+- Add support for receiving OpenID Connect authentication responses via form `POST`s rather than `GET`s. ([\#9376](https://github.com/matrix-org/synapse/issues/9376))
+- Add the shadow-banning status to the display user admin API. ([\#9400](https://github.com/matrix-org/synapse/issues/9400))
+
+
+Bugfixes
+--------
+
+- Fix long-standing bug where sending email push would fail for rooms that the server had since left. ([\#9257](https://github.com/matrix-org/synapse/issues/9257))
+- Fix bug in Synapse 1.27.0rc1 which meant the "session expired" error page during SSO registration was badly formatted. ([\#9296](https://github.com/matrix-org/synapse/issues/9296))
+- Assert a maximum length for some parameters for spec compliance. ([\#9321](https://github.com/matrix-org/synapse/issues/9321), [\#9393](https://github.com/matrix-org/synapse/issues/9393))
+- Fix additional errors when previewing URLs: "AttributeError 'NoneType' object has no attribute 'xpath'" and "ValueError: Unicode strings with encoding declaration are not supported. Please use bytes input or XML fragments without declaration.". ([\#9333](https://github.com/matrix-org/synapse/issues/9333))
+- Fix a bug causing Synapse to impose the wrong type constraints on fields when processing responses from appservices to `/_matrix/app/v1/thirdparty/user/{protocol}`. ([\#9361](https://github.com/matrix-org/synapse/issues/9361))
+- Fix bug where Synapse would occaisonally stop reconnecting after the connection was lost. ([\#9391](https://github.com/matrix-org/synapse/issues/9391))
+- Fix a long-standing bug when upgrading a room: "TypeError: '>' not supported between instances of 'NoneType' and 'int'". ([\#9395](https://github.com/matrix-org/synapse/issues/9395))
+- Reduce the amount of memory used when generating the URL preview of a file that is larger than the `max_spider_size`. ([\#9421](https://github.com/matrix-org/synapse/issues/9421))
+- Fix a long-standing bug in the deduplication of old presence, resulting in no deduplication. ([\#9425](https://github.com/matrix-org/synapse/issues/9425))
+- The `ui_auth.session_timeout` configuration setting can now be specified in terms of number of seconds/minutes/etc/. Contributed by Rishabh Arya. ([\#9426](https://github.com/matrix-org/synapse/issues/9426))
+- Fix a bug introduced in v1.27.0: "TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType." related to the user directory. ([\#9428](https://github.com/matrix-org/synapse/issues/9428))
+
+
+Updates to the Docker image
+---------------------------
+
+- Drop support for ARMv7 in Docker images. ([\#9433](https://github.com/matrix-org/synapse/issues/9433))
+
+
+Improved Documentation
+----------------------
+
+- Reorganizing CHANGELOG.md. ([\#9281](https://github.com/matrix-org/synapse/issues/9281))
+- Add note to `auto_join_rooms` config option explaining existing rooms must be publicly joinable. ([\#9291](https://github.com/matrix-org/synapse/issues/9291))
+- Correct name of Synapse's service file in TURN howto. ([\#9308](https://github.com/matrix-org/synapse/issues/9308))
+- Fix the braces in the `oidc_providers` section of the sample config. ([\#9317](https://github.com/matrix-org/synapse/issues/9317))
+- Update installation instructions on Fedora. ([\#9322](https://github.com/matrix-org/synapse/issues/9322))
+- Add HTTP/2 support to the nginx example configuration. Contributed by David Vo. ([\#9390](https://github.com/matrix-org/synapse/issues/9390))
+- Update docs for using Gitea as OpenID provider. ([\#9404](https://github.com/matrix-org/synapse/issues/9404))
+- Document that pusher instances are shardable. ([\#9407](https://github.com/matrix-org/synapse/issues/9407))
+- Fix erroneous documentation from v1.27.0 about updating the SAML2 callback URL. ([\#9434](https://github.com/matrix-org/synapse/issues/9434))
+
+
+Deprecations and Removals
+-------------------------
+
+- Deprecate old admin API `GET /_synapse/admin/v1/users/<user_id>`. ([\#9429](https://github.com/matrix-org/synapse/issues/9429))
+
+
+Internal Changes
+----------------
+
+- Fix 'object name reserved for internal use' errors with recent versions of SQLite. ([\#9003](https://github.com/matrix-org/synapse/issues/9003))
+- Add experimental support for running Synapse with PyPy. ([\#9123](https://github.com/matrix-org/synapse/issues/9123))
+- Deny access to additional IP addresses by default. ([\#9240](https://github.com/matrix-org/synapse/issues/9240))
+- Update the `Cursor` type hints to better match PEP 249. ([\#9299](https://github.com/matrix-org/synapse/issues/9299))
+- Add debug logging for SRV lookups. Contributed by @Bubu. ([\#9305](https://github.com/matrix-org/synapse/issues/9305))
+- Improve logging for OIDC login flow. ([\#9307](https://github.com/matrix-org/synapse/issues/9307))
+- Share the code for handling required attributes between the CAS and SAML handlers. ([\#9326](https://github.com/matrix-org/synapse/issues/9326))
+- Clean up the code to load the metadata for OpenID Connect identity providers. ([\#9362](https://github.com/matrix-org/synapse/issues/9362))
+- Convert tests to use `HomeserverTestCase`. ([\#9377](https://github.com/matrix-org/synapse/issues/9377), [\#9396](https://github.com/matrix-org/synapse/issues/9396))
+- Update the version of black used to 20.8b1. ([\#9381](https://github.com/matrix-org/synapse/issues/9381))
+- Allow OIDC config to override discovered values. ([\#9384](https://github.com/matrix-org/synapse/issues/9384))
+- Remove some dead code from the acceptance of room invites path. ([\#9394](https://github.com/matrix-org/synapse/issues/9394))
+- Clean up an unused method in the presence handler code. ([\#9408](https://github.com/matrix-org/synapse/issues/9408))
+
+
 Synapse 1.27.0 (2021-02-16)
 ===========================
 
diff --git a/changelog.d/9003.misc b/changelog.d/9003.misc
deleted file mode 100644
index 557c8b2353..0000000000
--- a/changelog.d/9003.misc
+++ /dev/null
@@ -1 +0,0 @@
-Fix 'object name reserved for internal use' errors with recent versions of SQLite.
diff --git a/changelog.d/9123.misc b/changelog.d/9123.misc
deleted file mode 100644
index 329600c40c..0000000000
--- a/changelog.d/9123.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add experimental support for running Synapse with PyPy.
diff --git a/changelog.d/9150.feature b/changelog.d/9150.feature
deleted file mode 100644
index 48a8148dee..0000000000
--- a/changelog.d/9150.feature
+++ /dev/null
@@ -1 +0,0 @@
-New API /_synapse/admin/rooms/{roomId}/context/{eventId}.
diff --git a/changelog.d/9240.misc b/changelog.d/9240.misc
deleted file mode 100644
index 850201f6cd..0000000000
--- a/changelog.d/9240.misc
+++ /dev/null
@@ -1 +0,0 @@
-Deny access to additional IP addresses by default.
diff --git a/changelog.d/9257.bugfix b/changelog.d/9257.bugfix
deleted file mode 100644
index 5d0bd88dce..0000000000
--- a/changelog.d/9257.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix long-standing bug where sending email push would fail for rooms that the server had since left.
diff --git a/changelog.d/9281.doc b/changelog.d/9281.doc
deleted file mode 100644
index 4dea375f80..0000000000
--- a/changelog.d/9281.doc
+++ /dev/null
@@ -1 +0,0 @@
-Reorganizing CHANGELOG.md.
\ No newline at end of file
diff --git a/changelog.d/9291.doc b/changelog.d/9291.doc
deleted file mode 100644
index 422acd3891..0000000000
--- a/changelog.d/9291.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add note to `auto_join_rooms` config option explaining existing rooms must be publicly joinable.
diff --git a/changelog.d/9296.bugfix b/changelog.d/9296.bugfix
deleted file mode 100644
index d723f8c5bd..0000000000
--- a/changelog.d/9296.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix bug in Synapse 1.27.0rc1 which meant the "session expired" error page during SSO registration was badly formatted.
diff --git a/changelog.d/9299.misc b/changelog.d/9299.misc
deleted file mode 100644
index c883a677ed..0000000000
--- a/changelog.d/9299.misc
+++ /dev/null
@@ -1 +0,0 @@
-Update the `Cursor` type hints to better match PEP 249.
diff --git a/changelog.d/9300.feature b/changelog.d/9300.feature
deleted file mode 100644
index a2d0b27da4..0000000000
--- a/changelog.d/9300.feature
+++ /dev/null
@@ -1 +0,0 @@
-Further improvements to the user experience of registration via single sign-on.
diff --git a/changelog.d/9301.feature b/changelog.d/9301.feature
deleted file mode 100644
index a2d0b27da4..0000000000
--- a/changelog.d/9301.feature
+++ /dev/null
@@ -1 +0,0 @@
-Further improvements to the user experience of registration via single sign-on.
diff --git a/changelog.d/9305.misc b/changelog.d/9305.misc
deleted file mode 100644
index 456bfbfdd7..0000000000
--- a/changelog.d/9305.misc
+++ /dev/null
@@ -1 +0,0 @@
-Add debug logging for SRV lookups. Contributed by @Bubu.
diff --git a/changelog.d/9307.misc b/changelog.d/9307.misc
deleted file mode 100644
index 2f54d1ad07..0000000000
--- a/changelog.d/9307.misc
+++ /dev/null
@@ -1 +0,0 @@
-Improve logging for OIDC login flow.
diff --git a/changelog.d/9308.doc b/changelog.d/9308.doc
deleted file mode 100644
index 847f2908af..0000000000
--- a/changelog.d/9308.doc
+++ /dev/null
@@ -1 +0,0 @@
-Correct name of Synapse's service file in TURN howto.
diff --git a/changelog.d/9311.feature b/changelog.d/9311.feature
deleted file mode 100644
index 293f2118e5..0000000000
--- a/changelog.d/9311.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add hook to spam checker modules that allow checking file uploads and remote downloads.
diff --git a/changelog.d/9317.doc b/changelog.d/9317.doc
deleted file mode 100644
index f4d508e090..0000000000
--- a/changelog.d/9317.doc
+++ /dev/null
@@ -1 +0,0 @@
-Fix the braces in the `oidc_providers` section of the sample config.
diff --git a/changelog.d/9321.bugfix b/changelog.d/9321.bugfix
deleted file mode 100644
index f1c882b13c..0000000000
--- a/changelog.d/9321.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Assert a maximum length for some parameters for spec compliance.
diff --git a/changelog.d/9322.doc b/changelog.d/9322.doc
deleted file mode 100644
index c393a3a299..0000000000
--- a/changelog.d/9322.doc
+++ /dev/null
@@ -1 +0,0 @@
-Update installation instructions on Fedora.
diff --git a/changelog.d/9326.misc b/changelog.d/9326.misc
deleted file mode 100644
index 768c18d27e..0000000000
--- a/changelog.d/9326.misc
+++ /dev/null
@@ -1 +0,0 @@
-Share the code for handling required attributes between the CAS and SAML handlers.
diff --git a/changelog.d/9333.bugfix b/changelog.d/9333.bugfix
deleted file mode 100644
index c34ba378c5..0000000000
--- a/changelog.d/9333.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix additional errors when previewing URLs: "AttributeError 'NoneType' object has no attribute 'xpath'" and "ValueError: Unicode strings with encoding declaration are not supported. Please use bytes input or XML fragments without declaration.".
diff --git a/changelog.d/9361.bugfix b/changelog.d/9361.bugfix
deleted file mode 100644
index 4d0477f033..0000000000
--- a/changelog.d/9361.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug causing Synapse to impose the wrong type constraints on fields when processing responses from appservices to `/_matrix/app/v1/thirdparty/user/{protocol}`.
diff --git a/changelog.d/9362.misc b/changelog.d/9362.misc
deleted file mode 100644
index c75cfeb2a4..0000000000
--- a/changelog.d/9362.misc
+++ /dev/null
@@ -1 +0,0 @@
-Clean up the code to load the metadata for OpenID Connect identity providers.
diff --git a/changelog.d/9376.feature b/changelog.d/9376.feature
deleted file mode 100644
index 68ea21dbdd..0000000000
--- a/changelog.d/9376.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add support for receiving OpenID Connect authentication responses via form `POST`s rather than `GET`s.
diff --git a/changelog.d/9377.misc b/changelog.d/9377.misc
deleted file mode 100644
index df1348ec42..0000000000
--- a/changelog.d/9377.misc
+++ /dev/null
@@ -1 +0,0 @@
-Convert tests to use `HomeserverTestCase`.
diff --git a/changelog.d/9381.misc b/changelog.d/9381.misc
deleted file mode 100644
index 5688166120..0000000000
--- a/changelog.d/9381.misc
+++ /dev/null
@@ -1 +0,0 @@
-Update the version of black used to 20.8b1.
diff --git a/changelog.d/9384.misc b/changelog.d/9384.misc
deleted file mode 100644
index 9db61f44db..0000000000
--- a/changelog.d/9384.misc
+++ /dev/null
@@ -1 +0,0 @@
-Allow OIDC config to override discovered values.
diff --git a/changelog.d/9390.doc b/changelog.d/9390.doc
deleted file mode 100644
index 8ed2aa8b6a..0000000000
--- a/changelog.d/9390.doc
+++ /dev/null
@@ -1 +0,0 @@
-Add HTTP/2 support to the nginx example configuration. Contributed by David Vo.
diff --git a/changelog.d/9391.bugfix b/changelog.d/9391.bugfix
deleted file mode 100644
index b5e68e2ac7..0000000000
--- a/changelog.d/9391.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix bug where Synapse would occaisonally stop reconnecting after the connection was lost.
diff --git a/changelog.d/9393.bugfix b/changelog.d/9393.bugfix
deleted file mode 100644
index f1c882b13c..0000000000
--- a/changelog.d/9393.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Assert a maximum length for some parameters for spec compliance.
diff --git a/changelog.d/9394.misc b/changelog.d/9394.misc
deleted file mode 100644
index b3e90143cc..0000000000
--- a/changelog.d/9394.misc
+++ /dev/null
@@ -1 +0,0 @@
-Remove some dead code from the acceptance of room invites path.
\ No newline at end of file
diff --git a/changelog.d/9395.bugfix b/changelog.d/9395.bugfix
deleted file mode 100644
index d45cc4ffb9..0000000000
--- a/changelog.d/9395.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug when upgrading a room: "TypeError: '>' not supported between instances of 'NoneType' and 'int'".
diff --git a/changelog.d/9396.misc b/changelog.d/9396.misc
deleted file mode 100644
index df1348ec42..0000000000
--- a/changelog.d/9396.misc
+++ /dev/null
@@ -1 +0,0 @@
-Convert tests to use `HomeserverTestCase`.
diff --git a/changelog.d/9400.feature b/changelog.d/9400.feature
deleted file mode 100644
index 3067c3907b..0000000000
--- a/changelog.d/9400.feature
+++ /dev/null
@@ -1 +0,0 @@
-Add the shadow-banning status to the display user admin API.
\ No newline at end of file
diff --git a/changelog.d/9404.doc b/changelog.d/9404.doc
deleted file mode 100644
index aa2e63f2f6..0000000000
--- a/changelog.d/9404.doc
+++ /dev/null
@@ -1 +0,0 @@
-Update docs for using Gitea as OpenID provider.
diff --git a/changelog.d/9407.doc b/changelog.d/9407.doc
deleted file mode 100644
index 36979bc0d8..0000000000
--- a/changelog.d/9407.doc
+++ /dev/null
@@ -1 +0,0 @@
-Document that pusher instances are shardable.
diff --git a/changelog.d/9408.misc b/changelog.d/9408.misc
deleted file mode 100644
index 600bacbfe7..0000000000
--- a/changelog.d/9408.misc
+++ /dev/null
@@ -1 +0,0 @@
-Clean up an unused method in the presence handler code.
\ No newline at end of file
diff --git a/changelog.d/9421.bugfix b/changelog.d/9421.bugfix
deleted file mode 100644
index b73ed5664c..0000000000
--- a/changelog.d/9421.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Reduce the amount of memory used when generating the URL preview of a file that is larger than the `max_spider_size`.
diff --git a/changelog.d/9425.bugfix b/changelog.d/9425.bugfix
deleted file mode 100644
index f5b8857cdb..0000000000
--- a/changelog.d/9425.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a long-standing bug in the deduplication of old presence, resulting in no deduplication.
\ No newline at end of file
diff --git a/changelog.d/9426.bugfix b/changelog.d/9426.bugfix
deleted file mode 100644
index a852a315ad..0000000000
--- a/changelog.d/9426.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-The `ui_auth.session_timeout` configuration setting can now be specified in terms of number of seconds/minutes/etc/. Contributed by Rishabh Arya.
diff --git a/changelog.d/9428.bugfix b/changelog.d/9428.bugfix
deleted file mode 100644
index 132e35440a..0000000000
--- a/changelog.d/9428.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix a bug introduced in v1.27.0: "TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType." related to the user directory.
diff --git a/changelog.d/9429.removal b/changelog.d/9429.removal
deleted file mode 100644
index 1ff9089a20..0000000000
--- a/changelog.d/9429.removal
+++ /dev/null
@@ -1 +0,0 @@
-Deprecate old admin API `GET /_synapse/admin/v1/users/<user_id>`.
\ No newline at end of file
diff --git a/changelog.d/9433.docker b/changelog.d/9433.docker
deleted file mode 100644
index cbe3a674d3..0000000000
--- a/changelog.d/9433.docker
+++ /dev/null
@@ -1 +0,0 @@
-Drop support for ARMv7 in Docker images.
diff --git a/changelog.d/9434.doc b/changelog.d/9434.doc
deleted file mode 100644
index fd334136c2..0000000000
--- a/changelog.d/9434.doc
+++ /dev/null
@@ -1 +0,0 @@
-Fix erroneous documentation from v1.27.0 about updating the SAML2 callback URL.
diff --git a/synapse/__init__.py b/synapse/__init__.py
index 359276427f..2e70f46186 100644
--- a/synapse/__init__.py
+++ b/synapse/__init__.py
@@ -48,7 +48,7 @@ try:
 except ImportError:
     pass
 
-__version__ = "1.27.0"
+__version__ = "1.28.0rc1"
 
 if bool(os.environ.get("SYNAPSE_TEST_PATCH_LOG_CONTEXTS", False)):
     # We import here so that we don't have to install a bunch of deps when