summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* Add logging to diagnose a suspicion github/rei/librepush.net-stcache rei/librepush.net-stcacheOlivier Wilkinson (reivilibre)2021-12-201-7/+17
|
* Bypass caching from the old systemOlivier Wilkinson (reivilibre)2021-12-201-25/+27
|
* Bleh logbugfixOlivier Wilkinson (reivilibre)2021-12-201-1/+1
|
* Change things aroundOlivier Wilkinson (reivilibre)2021-12-201-24/+25
|
* Log a little bit moreOlivier Wilkinson (reivilibre)2021-12-201-7/+6
|
* Add some logging and validation to help determine whether this all works or ↵Olivier Wilkinson (reivilibre)2021-12-201-0/+106
| | | | not :)
* Newsfile github/rei/p/stcache rei/p/stcacheOlivier Wilkinson (reivilibre)2021-12-201-0/+1
| | | | Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
* Iterate over in-flight requests in descending orderOlivier Wilkinson (reivilibre)2021-12-201-4/+6
|
* Use sorted dictsOlivier Wilkinson (reivilibre)2021-12-201-2/+5
| | | | Note that they are sorted in ascending size order, so this needs further touch-ups.
* Define a comparator for StateFiltersOlivier Wilkinson (reivilibre)2021-12-201-0/+20
|
* NewsfileOlivier Wilkinson (reivilibre)2021-12-201-0/+1
| | | | Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
* Shunt out with StateFilter.all() if many requests are made to the same groupOlivier Wilkinson (reivilibre)2021-12-201-0/+14
|
* Fix up misunderstanding (fixes tests)Olivier Wilkinson (reivilibre)2021-12-201-1/+1
|
* Merge branch 'develop' into rei/gsfg_1Olivier Wilkinson (reivilibre)2021-12-20440-6205/+18302
|\
| * Add type hints to `synapse/tests/rest/admin` (#11590)Dirk Klimpel2021-12-167-57/+74
| |
| * Add type hints to `synapse/storage/databases/main/transactions.py` (#11589)Dirk Klimpel2021-12-163-25/+29
| |
| * Add MSC2716 and MSC3030 to `/versions` -> `unstable_features` (#11582)Eric Eastwood2021-12-163-1/+6
| | | | | | | | As suggested in https://github.com/matrix-org/matrix-react-sdk/pull/7372#discussion_r769523369
| * Add type hints to `synapse/storage/databases/main/room.py` (#11575)Sean Quah2021-12-155-77/+108
| |
| * Require Collections as the parameters for simple_* methods. (#11580)Patrick Cloke2021-12-153-40/+12
| | | | | | | | Instead of Iterable since the generators are not allowed due to the potential for their re-use.
| * Convert EventStreamResult to attrs. (#11574)Patrick Cloke2021-12-153-9/+24
| |
| * Add experimental support for MSC3202: allowing application services to ↵reivilibre2021-12-155-14/+162
| | | | | | | | masquerade as specific devices. (#11538)
| * Add type hints to `synapse/storage/databases/main/e2e_room_keys.py` (#11549)Sean Quah2021-12-146-79/+188
| |
| * Add missing type hints to `synapse.logging.context` (#11556)Sean Quah2021-12-1413-122/+215
| |
| * Add missing type hints to `synapse.appservice` (#11360)Patrick Cloke2021-12-147-93/+148
| |
| * Merge branch 'master' into developOlivier Wilkinson (reivilibre)2021-12-143-3/+27
| |\
| | * Merge tag 'v1.49.0'Olivier Wilkinson (reivilibre)2021-12-143-3/+27
| | |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.49.0 (2021-12-14) =========================== No significant changes since version 1.49.0rc1. Support for Ubuntu 21.04 ends next month on the 20th of January --------------------------------------------------------------- For users of Ubuntu 21.04 (Hirsute Hippo), please be aware that [upstream support for this version of Ubuntu will end next month][Ubuntu2104EOL]. We will stop producing packages for Ubuntu 21.04 after upstream support ends. [Ubuntu2104EOL]: https://lists.ubuntu.com/archives/ubuntu-announce/2021-December/000275.html The wiki has been migrated to the documentation website ------------------------------------------------------- We've decided to move the existing, somewhat stagnant pages from the GitHub wiki to the [documentation website](https://matrix-org.github.io/synapse/latest/). This was done for two reasons. The first was to ensure that changes are checked by multiple authors before being committed (everyone makes mistakes!) and the second was visibility of the documentation. Not everyone knows that Synapse has some very useful information hidden away in its GitHub wiki pages. Bringing them to the documentation website should help with visibility, as well as keep all Synapse documentation in one, easily-searchable location. Note that contributions to the documentation website happen through [GitHub pull requests](https://github.com/matrix-org/synapse/pulls). Please visit [#synapse-dev:matrix.org](https://matrix.to/#/#synapse-dev:matrix.org) if you need help with the process! Synapse 1.49.0rc1 (2021-12-07) ============================== Features -------- - Add [MSC3030](https://github.com/matrix-org/matrix-doc/pull/3030) experimental client and federation API endpoints to get the closest event to a given timestamp. ([\#9445](https://github.com/matrix-org/synapse/issues/9445)) - Include bundled relation aggregations during a limited `/sync` request and `/relations` request, per [MSC2675](https://github.com/matrix-org/matrix-doc/pull/2675). ([\#11284](https://github.com/matrix-org/synapse/issues/11284), [\#11478](https://github.com/matrix-org/synapse/issues/11478)) - Add plugin support for controlling database background updates. ([\#11306](https://github.com/matrix-org/synapse/issues/11306), [\#11475](https://github.com/matrix-org/synapse/issues/11475), [\#11479](https://github.com/matrix-org/synapse/issues/11479)) - Support the stable API endpoints for [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946): the room `/hierarchy` endpoint. ([\#11329](https://github.com/matrix-org/synapse/issues/11329)) - Add admin API to get some information about federation status with remote servers. ([\#11407](https://github.com/matrix-org/synapse/issues/11407)) - Support expiry of refresh tokens and expiry of the overall session when refresh tokens are in use. ([\#11425](https://github.com/matrix-org/synapse/issues/11425)) - Stabilise support for [MSC2918](https://github.com/matrix-org/matrix-doc/blob/main/proposals/2918-refreshtokens.md#msc2918-refresh-tokens) refresh tokens as they have now been merged into the Matrix specification. ([\#11435](https://github.com/matrix-org/synapse/issues/11435), [\#11522](https://github.com/matrix-org/synapse/issues/11522)) - Update [MSC2918 refresh token](https://github.com/matrix-org/matrix-doc/blob/main/proposals/2918-refreshtokens.md#msc2918-refresh-tokens) support to confirm with the latest revision: accept the `refresh_tokens` parameter in the request body rather than in the URL parameters. ([\#11430](https://github.com/matrix-org/synapse/issues/11430)) - Support configuring the lifetime of non-refreshable access tokens separately to refreshable access tokens. ([\#11445](https://github.com/matrix-org/synapse/issues/11445)) - Expose `synapse_homeserver` and `synapse_worker` commands as entry points to run Synapse's main process and worker processes, respectively. Contributed by @Ma27. ([\#11449](https://github.com/matrix-org/synapse/issues/11449)) - `synctl stop` will now wait for Synapse to exit before returning. ([\#11459](https://github.com/matrix-org/synapse/issues/11459), [\#11490](https://github.com/matrix-org/synapse/issues/11490)) - Extend the "delete room" admin api to work correctly on rooms which have previously been partially deleted. ([\#11523](https://github.com/matrix-org/synapse/issues/11523)) - Add support for the `/_matrix/client/v3/login/sso/redirect/{idpId}` API from Matrix v1.1. This endpoint was overlooked when support for v3 endpoints was added in Synapse 1.48.0rc1. ([\#11451](https://github.com/matrix-org/synapse/issues/11451)) Bugfixes -------- - Fix using [MSC2716](https://github.com/matrix-org/matrix-doc/pull/2716) batch sending in combination with event persistence workers. Contributed by @tulir at Beeper. ([\#11220](https://github.com/matrix-org/synapse/issues/11220)) - Fix a long-standing bug where all requests that read events from the database could get stuck as a result of losing the database connection, properly this time. Also fix a race condition introduced in the previous insufficient fix in Synapse 1.47.0. ([\#11376](https://github.com/matrix-org/synapse/issues/11376)) - The `/send_join` response now includes the stable `event` field instead of the unstable field from [MSC3083](https://github.com/matrix-org/matrix-doc/pull/3083). ([\#11413](https://github.com/matrix-org/synapse/issues/11413)) - Fix a bug introduced in Synapse 1.47.0 where `send_join` could fail due to an outdated `ijson` version. ([\#11439](https://github.com/matrix-org/synapse/issues/11439), [\#11441](https://github.com/matrix-org/synapse/issues/11441), [\#11460](https://github.com/matrix-org/synapse/issues/11460)) - Fix a bug introduced in Synapse 1.36.0 which could cause problems fetching event-signing keys from trusted key servers. ([\#11440](https://github.com/matrix-org/synapse/issues/11440)) - Fix a bug introduced in Synapse 1.47.1 where the media repository would fail to work if the media store path contained any symbolic links. ([\#11446](https://github.com/matrix-org/synapse/issues/11446)) - Fix an `LruCache` corruption bug, introduced in Synapse 1.38.0, that would cause certain requests to fail until the next Synapse restart. ([\#11454](https://github.com/matrix-org/synapse/issues/11454)) - Fix a long-standing bug where invites from ignored users were included in incremental syncs. ([\#11511](https://github.com/matrix-org/synapse/issues/11511)) - Fix a regression in Synapse 1.48.0 where presence workers would not clear their presence updates over replication on shutdown. ([\#11518](https://github.com/matrix-org/synapse/issues/11518)) - Fix a regression in Synapse 1.48.0 where the module API's `looping_background_call` method would spam errors to the logs when given a non-async function. ([\#11524](https://github.com/matrix-org/synapse/issues/11524)) Updates to the Docker image --------------------------- - Update `Dockerfile-workers` to healthcheck all workers in the container. ([\#11429](https://github.com/matrix-org/synapse/issues/11429)) Improved Documentation ---------------------- - Update the media repository documentation. ([\#11415](https://github.com/matrix-org/synapse/issues/11415)) - Update section about backward extremities in the room DAG concepts doc to correct the misconception about backward extremities indicating whether we have fetched an events' `prev_events`. ([\#11469](https://github.com/matrix-org/synapse/issues/11469)) Internal Changes ---------------- - Add `Final` annotation to string constants in `synapse.api.constants` so that they get typed as `Literal`s. ([\#11356](https://github.com/matrix-org/synapse/issues/11356)) - Add a check to ensure that users cannot start the Synapse master process when `worker_app` is set. ([\#11416](https://github.com/matrix-org/synapse/issues/11416)) - Add a note about postgres memory management and hugepages to postgres doc. ([\#11467](https://github.com/matrix-org/synapse/issues/11467)) - Add missing type hints to `synapse.config` module. ([\#11465](https://github.com/matrix-org/synapse/issues/11465)) - Add missing type hints to `synapse.federation`. ([\#11483](https://github.com/matrix-org/synapse/issues/11483)) - Add type annotations to `tests.storage.test_appservice`. ([\#11488](https://github.com/matrix-org/synapse/issues/11488), [\#11492](https://github.com/matrix-org/synapse/issues/11492)) - Add type annotations to some of the configuration surrounding refresh tokens. ([\#11428](https://github.com/matrix-org/synapse/issues/11428)) - Add type hints to `synapse/tests/rest/admin`. ([\#11501](https://github.com/matrix-org/synapse/issues/11501)) - Add type hints to storage classes. ([\#11411](https://github.com/matrix-org/synapse/issues/11411)) - Add wiki pages to documentation website. ([\#11402](https://github.com/matrix-org/synapse/issues/11402)) - Clean up `tests.storage.test_main` to remove use of legacy code. ([\#11493](https://github.com/matrix-org/synapse/issues/11493)) - Clean up `tests.test_visibility` to remove legacy code. ([\#11495](https://github.com/matrix-org/synapse/issues/11495)) - Convert status codes to `HTTPStatus` in `synapse.rest.admin`. ([\#11452](https://github.com/matrix-org/synapse/issues/11452), [\#11455](https://github.com/matrix-org/synapse/issues/11455)) - Extend the `scripts-dev/sign_json` script to support signing events. ([\#11486](https://github.com/matrix-org/synapse/issues/11486)) - Improve internal types in push code. ([\#11409](https://github.com/matrix-org/synapse/issues/11409)) - Improve type annotations in `synapse.module_api`. ([\#11029](https://github.com/matrix-org/synapse/issues/11029)) - Improve type hints for `LruCache`. ([\#11453](https://github.com/matrix-org/synapse/issues/11453)) - Preparation for database schema simplifications: disambiguate queries on `state_key`. ([\#11497](https://github.com/matrix-org/synapse/issues/11497)) - Refactor `backfilled` into specific behavior function arguments (`_persist_events_and_state_updates` and downstream calls). ([\#11417](https://github.com/matrix-org/synapse/issues/11417)) - Refactor `get_version_string` to fix-up types and duplicated code. ([\#11468](https://github.com/matrix-org/synapse/issues/11468)) - Refactor various parts of the `/sync` handler. ([\#11494](https://github.com/matrix-org/synapse/issues/11494), [\#11515](https://github.com/matrix-org/synapse/issues/11515)) - Remove unnecessary `json.dumps` from `tests.rest.admin`. ([\#11461](https://github.com/matrix-org/synapse/issues/11461)) - Save the OpenID Connect session ID on login. ([\#11482](https://github.com/matrix-org/synapse/issues/11482)) - Update and clean up recently ported documentation pages. ([\#11466](https://github.com/matrix-org/synapse/issues/11466))
| | | * Restructure changelog v1.49.0Olivier Wilkinson (reivilibre)2021-12-141-2/+9
| | | |
| | | * 1.49.0Olivier Wilkinson (reivilibre)2021-12-143-1/+18
| | | |
| | * | Revert "Revert accidental fast-forward merge from v1.49.0rc1"Olivier Wilkinson (reivilibre)2021-12-14165-2708/+7720
| | | | | | | | | | | | | | | | This reverts commit 158d73ebdd61eef33831ae5f6990acf07244fc55.
| | * | Revert accidental fast-forward merge from v1.49.0rc1Sean Quah2021-12-07165-7720/+2708
| | |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Revert "Sort internal changes in changelog" Revert "Update CHANGES.md" Revert "1.49.0rc1" Revert "Revert "Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505) (#11527)" Revert "Refactors in `_generate_sync_entry_for_rooms` (#11515)" Revert "Correctly register shutdown handler for presence workers (#11518)" Revert "Fix `ModuleApi.looping_background_call` for non-async functions (#11524)" Revert "Fix 'delete room' admin api to work on incomplete rooms (#11523)" Revert "Correctly ignore invites from ignored users (#11511)" Revert "Fix the test breakage introduced by #11435 as a result of concurrent PRs (#11522)" Revert "Stabilise support for MSC2918 refresh tokens as they have now been merged into the Matrix specification. (#11435)" Revert "Save the OIDC session ID (sid) with the device on login (#11482)" Revert "Add admin API to get some information about federation status (#11407)" Revert "Include bundled aggregations in /sync and related fixes (#11478)" Revert "Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505)" Revert "Update backward extremity docs to make it clear that it does not indicate whether we have fetched an events' `prev_events` (#11469)" Revert "Support configuring the lifetime of non-refreshable access tokens separately to refreshable access tokens. (#11445)" Revert "Add type hints to `synapse/tests/rest/admin` (#11501)" Revert "Revert accidental commits to develop." Revert "Newsfile" Revert "Give `tests.server.setup_test_homeserver` (nominally!) the same behaviour" Revert "Move `tests.utils.setup_test_homeserver` to `tests.server`" Revert "Convert one of the `setup_test_homeserver`s to `make_test_homeserver_synchronous`" Revert "Disambiguate queries on `state_key` (#11497)" Revert "Comments on the /sync tentacles (#11494)" Revert "Clean up tests.storage.test_appservice (#11492)" Revert "Clean up `tests.storage.test_main` to remove use of legacy code. (#11493)" Revert "Clean up `tests.test_visibility` to remove legacy code. (#11495)" Revert "Minor cleanup on recently ported doc pages (#11466)" Revert "Add most of the missing type hints to `synapse.federation`. (#11483)" Revert "Avoid waiting for zombie processes in `synctl stop` (#11490)" Revert "Fix media repository failing when media store path contains symlinks (#11446)" Revert "Add type annotations to `tests.storage.test_appservice`. (#11488)" Revert "`scripts-dev/sign_json`: support for signing events (#11486)" Revert "Add MSC3030 experimental client and federation API endpoints to get the closest event to a given timestamp (#9445)" Revert "Port wiki pages to documentation website (#11402)" Revert "Add a license header and comment. (#11479)" Revert "Clean-up get_version_string (#11468)" Revert "Link background update controller docs to summary (#11475)" Revert "Additional type hints for config module. (#11465)" Revert "Register the login redirect endpoint for v3. (#11451)" Revert "Update openid.md" Revert "Remove mention of OIDC certification from Dex (#11470)" Revert "Add a note about huge pages to our Postgres doc (#11467)" Revert "Don't start Synapse master process if `worker_app` is set (#11416)" Revert "Expose worker & homeserver as entrypoints in `setup.py` (#11449)" Revert "Bundle relations of relations into the `/relations` result. (#11284)" Revert "Fix `LruCache` corruption bug with a `size_callback` that can return 0 (#11454)" Revert "Eliminate a few `Any`s in `LruCache` type hints (#11453)" Revert "Remove unnecessary `json.dumps` from `tests.rest.admin` (#11461)" Revert "Merge branch 'master' into develop" This reverts commit 26b5d2320f62b5eb6262c7614fbdfc364a4dfc02. This reverts commit bce4220f387bf5448387f0ed7d14ed1e41e40747. This reverts commit 966b5d0fa0893c3b628c942dfc232e285417f46d. This reverts commit 088d748f2cb51f03f3bcacc0fb3af1e0f9607737. This reverts commit 14d593f72d10b4d8cb67e3288bb3131ee30ccf59. This reverts commit 2a3ec6facf79f6aae011d9fb6f9ed5e43c7b6bec. This reverts commit eccc49d7554d1fab001e1fefb0fda8ffb254b630. This reverts commit b1ecd19c5d19815b69e425d80f442bf2877cab76. This reverts commit 9c55dedc8c4484e6269451a8c3c10b3e314aeb4a. This reverts commit 2d42e586a8c54be1a83643148358b1651c1ca666. This reverts commit 2f053f3f82ca174cc1c858c75afffae51af8ce0d. This reverts commit a15a893df8428395df7cb95b729431575001c38a. This reverts commit 8b4b153c9e86c04c7db8c74fde4b6a04becbc461. This reverts commit 494ebd7347ba52d702802fba4c3bb13e7bfbc2cf. This reverts commit a77c36989785c0d5565ab9a1169f4f88e512ce8a. This reverts commit 4eb77965cd016181d2111f37d93526e9bb0434f0. This reverts commit 637df95de63196033a6da4a6e286e1d58ea517b6. This reverts commit e5f426cd54609e7f05f8241d845e6e36c5f10d9a. This reverts commit 8cd68b8102eeab1b525712097c1b2e9679c11896. This reverts commit 6cae125e20865c52d770b24278bb7ab8fde5bc0d. This reverts commit 7be88fbf48156b36b6daefb228e1258e7d48cae4. This reverts commit b3fd99b74a3f6f42a9afd1b19ee4c60e38e8e91a. This reverts commit f7ec6e7d9e0dc360d9fb41f3a1afd7bdba1475c7. This reverts commit 5640992d176a499204a0756b1677c9b1575b0a49. This reverts commit d26808dd854006bd26a2366c675428ce0737238c. This reverts commit f91624a5950e14ba9007eed9bfa1c828676d4745. This reverts commit 16d39a5490ce74c901c7a8dbb990c6e83c379207. This reverts commit 8a4c2969874c0b7d72003f2523883eba8a348e83. This reverts commit 49e1356ee3d5d72929c91f778b3a231726c1413c. This reverts commit d2279f471ba8f44d9f578e62b286897a338d8aa1. This reverts commit b50e39df578adc3f86c5efa16bee9035cfdab61b. This reverts commit 858d80bf0f9f656a03992794874081b806e49222. This reverts commit 435f04480728c5d982e1a63c1b2777784bf9cd26. This reverts commit f61462e1be36a51dbf571076afa8e1930cb182f4. This reverts commit a6f1a3abecf8e8fd3e1bff439a06b853df18f194. This reverts commit 84dc50e160a2ec6590813374b5a1e58b97f7a18d. This reverts commit ed635d32853ee0a3e5ec1078679b27e7844a4ac7. This reverts commit 7b62791e001d6a4f8897ed48b3232d7f8fe6aa48. This reverts commit 153194c7717d8016b0eb974c81b1baee7dc1917d. This reverts commit f44d729d4ccae61bc0cdd5774acb3233eb5f7c13. This reverts commit a265fbd397ae72b2d3ea4c9310591ff1d0f3e05c. This reverts commit b9fef1a7cdfcc128fa589a32160e6aa7ed8964d7. This reverts commit b0eb64ff7bf6bde42046e091f8bdea9b7aab5f04. This reverts commit f1795463bf503a6fca909d77f598f641f9349f56. This reverts commit 70cbb1a5e311f609b624e3fae1a1712db639c51e. This reverts commit 42bf0204635213e2c75188b19ee66dc7e7d8a35e. This reverts commit 379f2650cf875f50c59524147ec0e33cfd5ef60c. This reverts commit 7ff22d6da41cd5ca80db95c18b409aea38e49fcd. This reverts commit 5a0b652d36ae4b6d423498c1f2c82c97a49c6f75. This reverts commit 432a174bc192740ac7a0a755009f6099b8363ad9. This reverts commit b14f8a1baf6f500997ae4c1d6a6d72094ce14270, reversing changes made to e713855dca17a7605bae99ea8d71bc7f8657e4b8.
| * | Remove redundant `COALESCE()`s around `COUNT()`s in database queries (#11570)Sean Quah2021-12-149-21/+20
| | | | | | | | | | | | | | | `COUNT()` never returns `NULL`. A `COUNT(*)` over 0 rows is 0 and a `COUNT(NULL)` is also 0.
| * | Add missing type hints to synapse.http. (#11571)Patrick Cloke2021-12-148-51/+76
| | |
| * | checks for generators in database functions (#11564)Richard van der Hoff2021-12-133-7/+49
| | | | | | | | | | | | | | | A couple of safety-checks to hopefully stop people doing what I just did, and create a storage function which only works the first time it is called (and not when it is re-run due to a database concurrency error or similar).
| * | Move HTML parsing to a separate file for URL previews. (#11566)Patrick Cloke2021-12-136-401/+432
| | | | | | | | | | | | | | | | | | | | | * Splits the logic for parsing HTML from the resource handling code. * Fix a circular import in the oEmbed code (which uses the HTML parsing code). * Renames some of the HTML parsing methods to: * Make it clear which methods are "internal" to the module. * Clarify what the methods do.
| * | Type hint the constructors of the data store classes (#11555)Sean Quah2021-12-1335-87/+351
| | |
| * | Add type hints to `synapse/storage/databases/main/end_to_end_keys.py` (#11551)Sean Quah2021-12-134-69/+150
| | |
| * | Add type hints to `synapse/storage/databases/main/account_data.py` (#11546)Sean Quah2021-12-134-33/+87
| | |
| * | Make `get_device` return None if the device doesn't exist rather than ↵reivilibre2021-12-136-13/+20
| | | | | | | | | | | | | | | raising an exception. (#11565) Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>
| * | Allow events to be created with no `prev_events` (MSC2716) (#11243)Eric Eastwood2021-12-104-7/+124
| | | | | | | | | | | | | | | The event still needs to have `auth_events` defined to be valid. Split out from https://github.com/matrix-org/synapse/pull/11114
| * | Test to ensure we share the same `state_group` across the whole historical ↵Eric Eastwood2021-12-102-0/+181
| | | | | | | | | | | | | | | | | | | | | | | | batch (MSC2716) (#11487) Part of MSC2716: https://github.com/matrix-org/matrix-doc/pull/2716 We did some work on making sure the `state_groups` were shared in https://github.com/matrix-org/synapse/pull/10975
| * | Adjust _get_rooms_changed comments (#11550)David Robertson2021-12-102-22/+30
| | | | | | | | | C.f. https://github.com/matrix-org/synapse/pull/11494#pullrequestreview-827780886
| * | skip some dict munging in event persistence (#11560)Richard van der Hoff2021-12-103-60/+114
| | | | | | | | | | | | | | | | | | Create a new dict helper method `simple_insert_many_values_txn`, which takes raw row values, rather than {key=>value} dicts. This saves us a bunch of dict munging, and makes it easier to use generators rather than creating intermediate lists and dicts.
| * | Stop populating `state_events.prev_state` (#11558)Richard van der Hoff2021-12-103-5/+5
| | | | | | | | | this field is never read, so we may as well stop populating it.
| * | Ensure emails are canonicalized before fetching associated user. (#11547)Patrick Cloke2021-12-105-4/+11
| | | | | | | | | | | | This should fix pushers with an email in non-canonical form is used as the pushkey.
| * | Do not allow cross-room relations, per MSC2674. (#11516)Patrick Cloke2021-12-096-17/+161
| | |
| * | Additional type hints for the config module, part 2. (#11480)Patrick Cloke2021-12-095-19/+28
| | |
| * | Use HTTPStatus constants in place of literals in `synapse.http` (#11543)Dirk Klimpel2021-12-094-19/+47
| | |
| * | Support unprefixed versions of fallback key property names. (#11541)Hubert Chathi2021-12-094-6/+32
| | |
| * | Add missing `errcode` to `parse_string` and `parse_boolean` (#11542)Dirk Klimpel2021-12-096-12/+13
| | |
| * | Allow guests to send state events (#11378)Robert Long2021-12-092-1/+2
| | |
| * | Add a constant for receipt types (m.read). (#11531)Patrick Cloke2021-12-089-45/+87
| | | | | | | | | And expand some type hints in the receipts storage module.
| * | Clean up `synapse.rest.admin` (#11535)Dirk Klimpel2021-12-0815-165/+96
| | |
| * | Document the usage of refresh tokens. (#11427)reivilibre2021-12-083-0/+141
| | | | | | | | | Co-authored-by: David Robertson <davidr@element.io>
| * | Use HTTPStatus constants in place of literals in ↵reivilibre2021-12-082-47/+88
| | | | | | | | | | | | `tests.rest.client.test_auth`. (#11520)
| * | Improve log messages for stream ids (#11536)Richard van der Hoff2021-12-083-4/+7
| | | | | | | | | | | | Somehow I'd managed to get my database in a pickle with stream ids. These changes were useful to debug.
| * | Send and handle cross-signing messages using the stable prefix. (#10520)Hubert Chathi2021-12-084-5/+13
| | |
| * | Fix case in `wait_for_background_updates` where `self.store` does not exist ↵Andrew Morgan2021-12-072-7/+5
| |/ | | | | | | | | | | (#11331) Pull the DataStore from the HomeServer instance, which always exists.
| * Sort internal changes in changelog v1.49.0rc1Sean Quah2021-12-071-16/+16
| |
| * Update CHANGES.mdSean Quah2021-12-071-30/+26
| |
| * 1.49.0rc1Sean Quah2021-12-0765-63/+87
| |
| * Revert "Move `glob_to_regex` and `re_word_boundary` to ↵Sean Quah2021-12-078-12/+124
| | | | | | | | | | | | `matrix-python-common` (#11505) (#11527) This reverts commit a77c36989785c0d5565ab9a1169f4f88e512ce8a.
| * Refactors in `_generate_sync_entry_for_rooms` (#11515)David Robertson2021-12-073-46/+79
| | | | | | | | | | | | | | | | * Move sync_token up to the top * Pull out _get_ignored_users * Try to signpost the body of `_generate_sync_entry_for_rooms` * Pull out _calculate_user_changes Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| * Correctly register shutdown handler for presence workers (#11518)David Robertson2021-12-072-1/+2
| | | | | | Fixes #11517
| * Fix `ModuleApi.looping_background_call` for non-async functions (#11524)Sean Quah2021-12-072-3/+3
| | | | | | | | | | | | After #10847, `looping_background_call` would print an error in the logs every time a non-async function was called. Since the error would be caught and ignored immediately, there were no other side effects.
| * Fix 'delete room' admin api to work on incomplete rooms (#11523)Richard van der Hoff2021-12-075-37/+33
| | | | | | | | | | If, for some reason, we don't have the create event, we should still be able to purge a room.
| * Correctly ignore invites from ignored users (#11511)David Robertson2021-12-072-5/+7
| |
| * Fix the test breakage introduced by #11435 as a result of concurrent PRs ↵reivilibre2021-12-072-1/+2
| | | | | | | | (#11522)
| * Stabilise support for MSC2918 refresh tokens as they have now been merged ↵reivilibre2021-12-066-44/+115
| | | | | | | | into the Matrix specification. (#11435)
| * Save the OIDC session ID (sid) with the device on login (#11482)Quentin Gliech2021-12-0615-65/+370
| | | | | | As a step towards allowing back-channel logout for OIDC.
| * Add admin API to get some information about federation status (#11407)Dirk Klimpel2021-12-067-0/+783
| |
| * Include bundled aggregations in /sync and related fixes (#11478)Patrick Cloke2021-12-0610-101/+169
| | | | | | | | | | | | | | | | Due to updates to MSC2675 this includes a few fixes: * Include bundled aggregations for /sync. * Do not include bundled aggregations for /initialSync and /events. * Do not bundle aggregations for state events. * Clarifies comments and variable names.
| * Move `glob_to_regex` and `re_word_boundary` to `matrix-python-common` (#11505)Sean Quah2021-12-068-123/+13
| |
| * Update backward extremity docs to make it clear that it does not indicate ↵Eric Eastwood2021-12-032-9/+8
| | | | | | | | | | | | | | whether we have fetched an events' `prev_events` (#11469) Spawning from https://github.com/matrix-org/synapse/pull/9445#discussion_r758958181 Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * Support configuring the lifetime of non-refreshable access tokens separately ↵reivilibre2021-12-035-3/+221
| | | | | | | | to refreshable access tokens. (#11445)
| * Add type hints to `synapse/tests/rest/admin` (#11501)Dirk Klimpel2021-12-0311-228/+257
| |
| * Revert accidental commits to develop.Olivier Wilkinson (reivilibre)2021-12-035-195/+185
| |
| * NewsfileOlivier Wilkinson (reivilibre)2021-12-031-0/+1
| | | | | | | | Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
| * Give `tests.server.setup_test_homeserver` (nominally!) the same behaviourOlivier Wilkinson (reivilibre)2021-12-031-0/+3
| | | | | | | | | | | | | | | | | | | | by calling into `make_test_homeserver_synchronous`. The function *could* have been inlined at this point but the function is big enough and it felt fine to leave it as is. At least there isn't a confusing name clash anymore!
| * Move `tests.utils.setup_test_homeserver` to `tests.server`Olivier Wilkinson (reivilibre)2021-12-034-177/+188
| | | | | | | | | | | | | | It had no users. We have just taken the identity of a previous function but don't provide the same behaviour, so we need to fix this in the next commit...
| * Convert one of the `setup_test_homeserver`s to ↵Olivier Wilkinson (reivilibre)2021-12-031-8/+3
| | | | | | | | | | | | | | | | `make_test_homeserver_synchronous` and pass in the homeserver rather than calling a same-named function to ask for one. Later commits will jiggle things around to make this sensible.
| * Disambiguate queries on `state_key` (#11497)Richard van der Hoff2021-12-027-16/+21
| | | | | | | | | | We're going to add a `state_key` column to the `events` table, so we need to add some disambiguation to queries which use it.
| * Comments on the /sync tentacles (#11494)David Robertson2021-12-023-43/+129
| | | | | | | | | | This mainly consists of docstrings and inline comments. There are one or two type annotations and variable renames thrown in while I was here. Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| * Clean up tests.storage.test_appservice (#11492)reivilibre2021-12-022-177/+169
| |
| * Clean up `tests.storage.test_main` to remove use of legacy code. (#11493)reivilibre2021-12-022-17/+11
| |
| * Clean up `tests.test_visibility` to remove legacy code. (#11495)reivilibre2021-12-023-203/+40
| |
| * Minor cleanup on recently ported doc pages (#11466)Shay2021-12-025-46/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * move wiki pages to synapse/docs and add a few titles where necessary * update SUMMARY.md with added pages * add changelog * move incorrectly located newsfragment * update changelog number * snake case added files and update summary.md accordingly * update issue/pr links * update relative links to docs * update changelog to indicate that we moved wiki pages to the docs and state reasoning * requested changes to admin_faq.md * requested changes to database_maintenance_tools.md * requested changes to understanding_synapse_through_graphana_graphs.md * add changelog * fix leftover merge errata * fix unwanted changes from merge * use two spaces between entries * outdent code blocks
| * Add most of the missing type hints to `synapse.federation`. (#11483)Patrick Cloke2021-12-0210-49/+84
| | | | | | This skips a few methods which are difficult to type.
| * Avoid waiting for zombie processes in `synctl stop` (#11490)Sean Quah2021-12-022-3/+17
| |
| * Fix media repository failing when media store path contains symlinks (#11446)Sean Quah2021-12-023-45/+180
| |
| * Add type annotations to `tests.storage.test_appservice`. (#11488)reivilibre2021-12-025-53/+98
| |
| * `scripts-dev/sign_json`: support for signing events (#11486)Richard van der Hoff2021-12-023-1/+43
| |
| * Add MSC3030 experimental client and federation API endpoints to get the ↵Eric Eastwood2021-12-0213-31/+674
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | closest event to a given timestamp (#9445) MSC3030: https://github.com/matrix-org/matrix-doc/pull/3030 Client API endpoint. This will also go and fetch from the federation API endpoint if unable to find an event locally or we found an extremity with possibly a closer event we don't know about. ``` GET /_matrix/client/unstable/org.matrix.msc3030/rooms/<roomID>/timestamp_to_event?ts=<timestamp>&dir=<direction> { "event_id": ... "origin_server_ts": ... } ``` Federation API endpoint: ``` GET /_matrix/federation/unstable/org.matrix.msc3030/timestamp_to_event/<roomID>?ts=<timestamp>&dir=<direction> { "event_id": ... "origin_server_ts": ... } ``` Co-authored-by: Erik Johnston <erik@matrix.org>
| * Port wiki pages to documentation website (#11402)Shay2021-12-019-0/+483
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * move wiki pages to synapse/docs and add a few titles where necessary * update SUMMARY.md with added pages * add changelog * move incorrectly located newsfragment * update changelog number * snake case added files and update summary.md accordingly * update issue/pr links * update relative links to docs * update changelog to indicate that we moved wiki pages to the docs and state reasoning * revert unintentional change to CHANGES.md * add link Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com> * Update CHANGES.md Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com> Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| * Add a license header and comment. (#11479)Patrick Cloke2021-12-012-0/+16
| |
| * Clean-up get_version_string (#11468)Patrick Cloke2021-12-012-57/+26
| |
| * Link background update controller docs to summary (#11475)Brendan Abolivier2021-12-012-0/+2
| |
| * Additional type hints for config module. (#11465)Patrick Cloke2021-12-0115-99/+129
| | | | | | | | This adds some misc. type hints to helper methods used in the `synapse.config` module.
| * Register the login redirect endpoint for v3. (#11451)Patrick Cloke2021-12-013-3/+4
| | | | | | As specified for Matrix v1.1.
| * Update openid.mdRichard van der Hoff2021-12-011-1/+1
| | | | | | fix header level
| * Remove mention of OIDC certification from Dex (#11470)Etienne Dysli Metref2021-12-011-1/+1
| | | | | | | | | | | | | | Dex isn't yet [1,2] a certified OpenID Provider implementation. As of today, it's not on the list maintained by the OpenID Foundation. [3] [1] https://github.com/dexidp/dex/issues/42 [2] https://github.com/dexidp/dex/issues/262 [3] https://openid.net/certification/
| * Add a note about huge pages to our Postgres doc (#11467)Shay2021-11-302-0/+4
| | | | | | | | | | * Add note to postgres doc about hugepages * Newsfragment
| * Don't start Synapse master process if `worker_app` is set (#11416)Shay2021-11-303-0/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add check to catch syanpse master process starting when workers are configured * add test to verify that starting master process with worker config raises error * newsfragment * specify config.worker.worker_app in check * update test * report specific config option that triggered the error Co-authored-by: reivilibre <oliverw@matrix.org> * clarify error message Co-authored-by: reivilibre <oliverw@matrix.org> Co-authored-by: reivilibre <oliverw@matrix.org>
| * Expose worker & homeserver as entrypoints in `setup.py` (#11449)Maximilian Bosch2021-11-303-1/+12
| | | | | | Co-authored-by: reivilibre <oliverw@matrix.org>
| * Bundle relations of relations into the `/relations` result. (#11284)Patrick Cloke2021-11-304-6/+130
| | | | | | | | | | Per updates to MSC2675 which now states that bundled aggregations should be included from the `/relations` endpoint.
| * Fix `LruCache` corruption bug with a `size_callback` that can return 0 (#11454)Sean Quah2021-11-303-1/+17
| | | | | | | | | | | | | | | | | | | | | | When all entries in an `LruCache` have a size of 0 according to the provided `size_callback`, and `drop_from_cache` is called on a cache node, the node would be unlinked from the LRU linked list but remain in the cache dictionary. An assertion would be later be tripped due to the inconsistency. Avoid unintentionally calling `__len__` and use a strict `is None` check instead when unwrapping the weak reference.
| * Eliminate a few `Any`s in `LruCache` type hints (#11453)Sean Quah2021-11-304-19/+32
| |
| * Remove unnecessary `json.dumps` from `tests.rest.admin` (#11461)Dirk Klimpel2021-11-302-41/+21
| | | | | | | | | | The tests helpers automatically convert dictionaries to JSON payloads, no need to do it manually for each test.
| * Merge branch 'master' into developBrendan Abolivier2021-11-3072-71/+101
| |\
| | * Merge trust_identity_server_for_password_resets PRs v1.48.0Brendan Abolivier2021-11-301-2/+1
| | |
| | * Move notices upBrendan Abolivier2021-11-301-5/+4
| | |
| | * Fixup changelogBrendan Abolivier2021-11-301-1/+1
| | |
| | * 1.48.0Brendan Abolivier2021-11-303-1/+13
| | |
| | * Fix docker hub name v1.48.0rc1Brendan Abolivier2021-11-251-1/+1
| | |
| | * Incorporate review from synapse-devBrendan Abolivier2021-11-251-10/+12
| | |
| | * Fixup changelogBrendan Abolivier2021-11-251-13/+12
| | |
| | * 1.48.0rc1Brendan Abolivier2021-11-2572-71/+90
| | |
| * | Add missing copyright header. (#11460)Patrick Cloke2021-11-302-0/+15
| | |
| * | synctl stop: wait for processes to exit (#11459)Richard van der Hoff2021-11-302-25/+15
| | | | | | | | | | | | | | | If you're trying to shut down Synapse, it's rather handy if it *actually* shuts down before you move on.
| * | Improved push typing (#11409)Marcus2021-11-307-36/+210
| | | | | | | | | Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>
| * | Convert status codes to `HTTPStatus` in `tests.rest.admin` (#11455)Dirk Klimpel2021-11-3012-557/+887
| | |
| * | Convert status codes to `HTTPStatus` in `synapse.rest.admin` (#11452)Dirk Klimpel2021-11-2912-171/+276
| | |
| * | Refactor `backfilled` into specific behavior function arguments ↵Eric Eastwood2021-11-293-21/+57
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (`_persist_events_and_state_updates`) (#11417) Part of https://github.com/matrix-org/synapse/issues/11300 Call stack: - `_persist_events_and_state_updates` (added `use_negative_stream_ordering`) - `_persist_events_txn` - `_update_room_depths_txn` (added `update_room_forward_stream_ordering`) - `_update_metadata_tables_txn` - `_store_room_members_txn` (added `inhibit_local_membership_updates`) Using keyword-only arguments (`*`) to reduce the mistakes from `backfilled` being left as a positional argument somewhere and being interpreted wrong by our new arguments.
| * | Support the stable /hierarchy endpoint from MSC2946 (#11329)Patrick Cloke2021-11-2911-51/+134
| | | | | | | | | | | | | | | | | | This also makes additional updates where the implementation had drifted from the approved MSC. Unstable endpoints will be removed at a later data.
| * | Make background updates controllable via a plugin (#11306)Erik Johnston2021-11-2912-61/+407
| | | | | | | | | Co-authored-by: Brendan Abolivier <babolivier@matrix.org>
| * | Return the stable `event` field from `/send_join` per MSC3083. (#11413)Patrick Cloke2021-11-295-4/+19
| | | | | | | | | | | | | | | This does not remove the unstable field and still parses both. Handling of the unstable field will need to be removed in the future.
| * | Update the media repository documentation (#11415)Sean Quah2021-11-292-19/+71
| | |
| * | Add type annotations to some of the configuration surrounding refresh ↵reivilibre2021-11-293-2/+11
| | | | | | | | | | | | tokens. (#11428)
| * | Fix perspectives requests for multiple keys for the same server (#11440)Richard van der Hoff2021-11-293-11/+91
| | | | | | | | | | | | | | | If we tried to request multiple keys for the same server, we would end up dropping some of those requests.
| * | Fix using MSC2716 batch sending with event persistence workers (#11220)Tulir Asokan2021-11-293-0/+8
| | | | | | | | | | | | Signed-off-by: Tulir Asokan <tulir@beeper.com>
| * | disallow-untyped-defs for the module_api (#11029)David Robertson2021-11-293-30/+59
| | |
| * | Fix changelog filename in #11441David Robertson2021-11-291-0/+0
| | |
| * | Add a test case for the SendJoinParser (#11441)David Robertson2021-11-293-0/+55
| | | | | | | | | This would have caught the bug #11438 introduced in #11217 and fixed in #11439.
| * | Bump ijson dependency to 3.1 (#11438) (#11439)Daniel Molkentin2021-11-262-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Since e81fa9264873369653171157514ff68226491fff, Synapse depends on the use_float flag which has been introduced in ijson 3.1 and is not available in 3.0. This is known to cause runtime errors with send_join. Signed-off-by: Daniel Molkentin <danimo@infra.run> Co-authored-by: Daniel Molkentin <danimo@infra.run>
| * | Update MSC2918 refresh token support to confirm with the latest revision: ↵reivilibre2021-11-264-22/+58
| | | | | | | | | | | | accept the `refresh_tokens` parameter in the request body rather than in the URL parameters. (#11430)
| * | Add type hints to `synapse/storage/databases/main/events_worker.py` (#11411)Sean Quah2021-11-2613-171/+255
| | | | | | | | | | | | Also refactor the stream ID trackers/generators a bit and try to document them better.
| * | Support expiry of refresh tokens and expiry of the overall session when ↵reivilibre2021-11-268-54/+338
| | | | | | | | | | | | refresh tokens are in use. (#11425)
| * | Create healthcheck script for synapse-workers container (#11429)Michael Kaye2021-11-264-0/+23
| | | | | | | | | | | | | | | The intent is to iterate through all the worker ports and only report healthy when all are healthy, starting with the main process.
| * | Track ongoing event fetches correctly (again) (#11376)Sean Quah2021-11-263-43/+251
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The previous fix for the ongoing event fetches counter (8eec25a1d9d656905db18a2c62a5552e63db2667) was both insufficient and incorrect. When the database is unreachable, `_do_fetch` never gets run and so `_event_fetch_ongoing` is never decremented. The previous fix also moved the `_event_fetch_ongoing` decrement outside of the `_event_fetch_lock` which allowed race conditions to corrupt the counter.
| * | Annotate string constants in `synapse.api.constants` with `Final` (#11356)Sean Quah2021-11-252-98/+101
| |/ | | | | | | | | | | | | | | | | | | This change makes mypy complain if the constants are ever reassigned, and, more usefully, makes mypy type them as `Literal`s instead of `str`s, allowing code of the following form to pass mypy: ```py def do_something(membership: Literal["join", "leave"], ...): ... do_something(Membership.JOIN, ...) ```
| * Improve performance of `remove_{hidden,deleted}_devices_from_device_inbox` ↵Brendan Abolivier2021-11-254-148/+84
| | | | | | | | | | (#11421) Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * Lower minumum batch size to 1 for background updates (#11422)Brendan Abolivier2021-11-244-13/+23
| | | | | | Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * Rename unstable `access_token_lifetime` configuration option to ↵reivilibre2021-11-236-16/+36
| | | | | | | | `refreshable_access_token_lifetime` to make it clear it only concerns refreshable access tokens. (#11388)
| * Add missing type hints to config base classes (#11377)Patrick Cloke2021-11-2313-109/+184
| |
| * Remove code invalidated by deprecated config flag ↵Shay2021-11-234-41/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 'trust_identity_servers_for_password_resets' (#11395) * remove background update code related to deprecated config flag * changelog entry * update changelog * Delete 11394.removal Duplicate, wrong number * add no-op background update and change newfragment so it will be consolidated with associated work * remove unused code * Remove code associated with deprecated flag from legacy docker dynamic config file Co-authored-by: reivilibre <oliverw@matrix.org>
| * Merge branch 'master' into developSean Quah2021-11-238-51/+513
| |\
| | * Merge tag 'v1.47.1'Sean Quah2021-11-238-51/+513
| | |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.47.1 (2021-11-23) =========================== This release fixes a security issue in the media store, affecting all prior releases of Synapse. Server administrators are encouraged to update Synapse as soon as possible. We are not aware of these vulnerabilities being exploited in the wild. Server administrators who are unable to update Synapse may use the workarounds described in the linked GitHub Security Advisory below. Security advisory ----------------- The following issue is fixed in 1.47.1. - **[GHSA-3hfw-x7gx-437c](https://github.com/matrix-org/synapse/security/advisories/GHSA-3hfw-x7gx-437c) / [CVE-2021-41281](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-41281): Path traversal when downloading remote media.** Synapse instances with the media repository enabled can be tricked into downloading a file from a remote server into an arbitrary directory, potentially outside the media store directory. The last two directories and file name of the path are chosen randomly by Synapse and cannot be controlled by an attacker, which limits the impact. Homeservers with the media repository disabled are unaffected. Homeservers configured with a federation whitelist are also unaffected. Fixed by [91f2bd090](https://github.com/matrix-org/synapse/commit/91f2bd090).
| | | * Add CVE number v1.47.1Sean Quah2021-11-191-1/+1
| | | |
| | | * Refer to 1.47.1 without the vSean Quah2021-11-191-1/+1
| | | |
| | | * Update 1.47.1 release date in CHANGES.mdSean Quah2021-11-191-1/+1
| | | |
| | | * 1.47.1Sean Quah2021-11-193-1/+30
| | | |
| | | * Prevent the media store from writing outside of the configured directorySean Quah2021-11-195-50/+483
| | | | | | | | | | | | | | | | | | | | Also tighten validation of server names by forbidding invalid characters in IPv6 addresses and empty domain labels.
| * | | Refactor the code to inject bundled relations during serialization. (#11408)Patrick Cloke2021-11-238-73/+92
| | | |
| * | | Add config for customizing the claim used for JWT logins. (#11361)Kostas2021-11-226-35/+57
| | | | | | | | | | | | | | | | | | | | Allows specifying a different claim (from the default "sub") to use when calculating the localpart of the Matrix ID used during the JWT login.
| * | | Store arbitrary relations from events. (#11391)Patrick Cloke2021-11-226-45/+193
| | | | | | | | | | | | | | | | | | | | Instead of only known relation types. This also reworks the background update for thread relations to crawl events and search for any relation type, not just threaded relations.
| * | | Update README.mdShay2021-11-191-2/+4
| | | |
| * | | Add an admin API to run background jobs. (#11352)Dirk Klimpel2021-11-199-43/+280
| | | | | | | | | | | | | | | | | | | | | | | | Instead of having admins poke into the database directly. Can currently run jobs to populate stats and to populate the user directory.
| * | | Fix checking whether a room can be published on creation. (#11392)Patrick Cloke2021-11-194-56/+95
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | If `room_list_publication_rules` was configured with a rule with a non-wildcard alias and a room was created with an alias then an internal server error would have been thrown. This fixes the error and properly applies the publication rules during room creation.
| * | | Remove dead code from acme support. (#11393)Patrick Cloke2021-11-192-50/+1
| | | |
| * | | Remove msc2716 from the list of tests for complement. (#11389)Patrick Cloke2021-11-192-1/+2
| | | | | | | | | | | | As the tests are currently failing and not run in CI.
| * | | Keep fallback key marked as used if it's re-uploaded (#11382)Hubert Chathi2021-11-193-12/+72
| | | |
| * | | Publish a `develop` docker image (#11380)Richard van der Hoff2021-11-192-1/+5
| | | | | | | | | | | | | | | | I'd find it helpful to have a docker image corresponding to current develop, without having to build my own.
| * | | Fix verification of objects signed with old local keys (#11379)Richard van der Hoff2021-11-193-31/+95
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes a bug introduced in #11129: objects signed by the local server, but with keys other than the current one, could not be successfully verified. We need to check the key id in the signature, and track down the right key.
| * | | Prevent historical state from being pushed to an application service via ↵Eric Eastwood2021-11-184-2/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | `/transactions` (MSC2716) (#11265) Mark historical state from the MSC2716 `/batch_send` endpoint as `historical` which makes it `backfilled` and have a negative `stream_ordering` so it doesn't get queried by `/transactions`. Fix https://github.com/matrix-org/synapse/issues/11241 Complement tests: https://github.com/matrix-org/complement/pull/221
| * | | Remove legacy code related to deprecated ↵Shay2021-11-185-47/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | `trust_identity_server_for_password_resets` config flag (#11333) * remove code legacy code related to deprecated config flag "trust_identity_server_for_password_resets" from synapse/config/emailconfig.py * remove legacy code supporting depreciated config flag "trust_identity_server_for_password_resets" from synapse/config/registration.py * remove legacy code supporting depreciated config flag "trust_identity_server_for_password_resets" from synapse/handlers/identity.py * add tests to ensure config error is thrown and synapse refuses to start when depreciated config flag is found * add changelog * slightly change behavior to only check for deprecated flag if set to 'true' * Update changelog.d/11333.misc Co-authored-by: reivilibre <oliverw@matrix.org> Co-authored-by: reivilibre <oliverw@matrix.org>
| * | | Add dedicated admin API for blocking a room (#11324)Dirk Klimpel2021-11-186-0/+404
| | | |
| * | | Add/Unerase annotations to Module API (#11341)reivilibre2021-11-182-23/+135
| | | |
| * | | Rename `get_refresh_token_for_user_id` to `create_refresh_token_for_user_id` ↵reivilibre2021-11-183-3/+4
| | | | | | | | | | | | | | | | (#11370)
| * | | Use auto_attribs for RefreshTokenLookupResult (#11386)reivilibre2021-11-182-7/+8
| | | |
| * | | Do not allow MSC3440 threads to fork threads (#11161)Patrick Cloke2021-11-184-8/+176
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Adds validation to the Client-Server API to ensure that the potential thread head does not relate to another event already. This results in not allowing a thread to "fork" into other threads. If the target event is unknown for some reason (maybe it isn't visible to your homeserver), but is the target of other events it is assumed that the thread can be created from it. Otherwise, it is rejected as an unknown event.
| * | | Docs: Quote wildcard `federation_certificate_verification_whitelist` (#11381)Nicolai Søborg2021-11-183-4/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Otherwise I get this beautiful stacktrace: ``` python3 -m synapse.app.homeserver --config-path /etc/matrix/homeserver.yaml Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "/root/synapse/synapse/app/homeserver.py", line 455, in <module> main() File "/root/synapse/synapse/app/homeserver.py", line 445, in main hs = setup(sys.argv[1:]) File "/root/synapse/synapse/app/homeserver.py", line 345, in setup config = HomeServerConfig.load_or_generate_config( File "/root/synapse/synapse/config/_base.py", line 671, in load_or_generate_config config_dict = read_config_files(config_files) File "/root/synapse/synapse/config/_base.py", line 717, in read_config_files yaml_config = yaml.safe_load(file_stream) File "/root/synapse/env/lib/python3.8/site-packages/yaml/__init__.py", line 125, in safe_load return load(stream, SafeLoader) File "/root/synapse/env/lib/python3.8/site-packages/yaml/__init__.py", line 81, in load return loader.get_single_data() File "/root/synapse/env/lib/python3.8/site-packages/yaml/constructor.py", line 49, in get_single_data node = self.get_single_node() File "/root/synapse/env/lib/python3.8/site-packages/yaml/composer.py", line 36, in get_single_node document = self.compose_document() File "/root/synapse/env/lib/python3.8/site-packages/yaml/composer.py", line 55, in compose_document node = self.compose_node(None, None) File "/root/synapse/env/lib/python3.8/site-packages/yaml/composer.py", line 84, in compose_node node = self.compose_mapping_node(anchor) File "/root/synapse/env/lib/python3.8/site-packages/yaml/composer.py", line 133, in compose_mapping_node item_value = self.compose_node(node, item_key) File "/root/synapse/env/lib/python3.8/site-packages/yaml/composer.py", line 82, in compose_node node = self.compose_sequence_node(anchor) File "/root/synapse/env/lib/python3.8/site-packages/yaml/composer.py", line 110, in compose_sequence_node while not self.check_event(SequenceEndEvent): File "/root/synapse/env/lib/python3.8/site-packages/yaml/parser.py", line 98, in check_event self.current_event = self.state() File "/root/synapse/env/lib/python3.8/site-packages/yaml/parser.py", line 379, in parse_block_sequence_first_entry return self.parse_block_sequence_entry() File "/root/synapse/env/lib/python3.8/site-packages/yaml/parser.py", line 384, in parse_block_sequence_entry if not self.check_token(BlockEntryToken, BlockEndToken): File "/root/synapse/env/lib/python3.8/site-packages/yaml/scanner.py", line 116, in check_token self.fetch_more_tokens() File "/root/synapse/env/lib/python3.8/site-packages/yaml/scanner.py", line 227, in fetch_more_tokens return self.fetch_alias() File "/root/synapse/env/lib/python3.8/site-packages/yaml/scanner.py", line 610, in fetch_alias self.tokens.append(self.scan_anchor(AliasToken)) File "/root/synapse/env/lib/python3.8/site-packages/yaml/scanner.py", line 922, in scan_anchor raise ScannerError("while scanning an %s" % name, start_mark, yaml.scanner.ScannerError: while scanning an alias in "/etc/matrix/homeserver.yaml", line 614, column 5 expected alphabetic or numeric character, but found '.' in "/etc/matrix/homeserver.yaml", line 614, column 6 ``` Signed-off-by: Nicolai Søborg <git@xn--sb-lka.org>
| * | | Add type annotations to `synapse.metrics` (#10847)Sean Quah2021-11-1712-85/+173
| | | |
| * | | Add support for `/_matrix/media/v3` APIs (#11371)Aaron R2021-11-176-51/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add support for `/_matrix/media/v3` APIs Signed-off-by: Aaron Raimist <aaron@raim.ist> * Update `workers.md` to use v3 client and media APIs Signed-off-by: Aaron Raimist <aaron@raim.ist> * Add changelog Signed-off-by: Aaron Raimist <aaron@raim.ist>
| * | | Merge branch 'master' into developDavid Robertson2021-11-175-3/+15
| |\| |
| | * | Merge remote-tracking branch 'origin/release-v1.47'David Robertson2021-11-17168-1293/+4113
| | |\|
| | | * 1.47.0 v1.47.0David Robertson2021-11-173-1/+13
| | | |
| | * | Correct target of link to the modules page from the Password Auth Providers ↵reivilibre2021-11-121-1/+1
| | | | | | | | | | | | | | | | page (#11309)
| | * | Wrong DTLS port in "Troubleshooting" (#11268)jmcparland2021-11-081-1/+1
| | | | | | | | | | | | Port 5349, not 5479.
| * | | Rename `get_access_token_for_user_id` method to ↵reivilibre2021-11-177-15/+16
| | | | | | | | | | | | | | | | `create_access_token_for_user_id` (#11369)
| * | | Fix running complement.sh script. (#11368)Patrick Cloke2021-11-172-3/+4
| | | | | | | | | | | | | | | | By reverting changes from #11166 in this script. Specifically commit 13f084eb58c379b2fc073680818d5931e94626f4.
| * | | Fix incorrect return value in tests. (#11359)Patrick Cloke2021-11-162-1/+2
| | | |
| * | | Merge tag 'v1.47.0rc3' into developDavid Robertson2021-11-166-21/+103
| |\ \ \ | | | |/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.47.0rc3 (2021-11-16) ============================== Bugfixes -------- - Fix a bug introduced in 1.47.0rc1 which caused worker processes to not halt startup in the presence of outstanding database migrations. ([\#11346](https://github.com/matrix-org/synapse/issues/11346)) - Fix a bug introduced in 1.47.0rc1 which prevented the 'remove deleted devices from `device_inbox` column' background process from running when updating from a recent Synapse version. ([\#11303](https://github.com/matrix-org/synapse/issues/11303), [\#11353](https://github.com/matrix-org/synapse/issues/11353))
| | * | fix up changelog language v1.47.0rc3Andrew Morgan2021-11-161-1/+1
| | | |
| | * | mark the migration file migration as a bugAndrew Morgan2021-11-161-6/+1
| | | |
| | * | 1.47.0rc3Andrew Morgan2021-11-166-4/+22
| | | |
| | * | Rename `remove_deleted_devices_from_device_inbox` to ensure it is always run ↵Andrew Morgan2021-11-162-1/+14
| | | | | | | | | | | | | | | | | | | | (#11353) Co-authored-by: reivilibre <oliverw@matrix.org>
| | * | Run _upgrade_existing_database on workers if at current schema_version (#11346)Andrew Morgan2021-11-153-19/+74
| | | | | | | | | | | | Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| | * | Move sql file for `remove_deleted_devices_from_device_inbox` into v65 (#11303)Dirk Klimpel2021-11-152-1/+2
| | | |
| * | | Avoid sharing room hierarchy responses between users (#11355)Sean Quah2021-11-163-2/+65
| | | | | | | | | | | | | | | | | | | | Different users may be allowed to see different rooms within a space, so sharing responses between users is inadvisable.
| * | | Add support for `/_matrix/client/v3` APIs (#11318)Aaron R2021-11-164-3/+5
| | | | | | | | | | | | | | | | | | | | This is one of the changes required to support Matrix 1.1 Signed-off-by: Aaron Raimist <aaron@raim.ist>
| * | | Add most missing type hints to synapse.util (#11328)Patrick Cloke2021-11-1610-165/+161
| | | |
| * | | Properly register all callback hooks for legacy password authentication ↵reivilibre2021-11-162-13/+14
| | | | | | | | | | | | | | | | | | | | providers (#11340) Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| * | | Add ability to un-shadow-ban via the admin API. (#11347)Patrick Cloke2021-11-165-12/+53
| | | |
| * | | Misc typing fixes for tests, part 2 of N (#11330)David Robertson2021-11-165-29/+66
| | | |
| * | | change 'Home Server' to one word 'homeserver' (#11320)Ashwin Nair2021-11-164-15/+16
| | | | | | | | | | | | Signed-off-by: Ashwin S. Nair <58840757+Ashwin-exe@users.noreply.github.com>
| * | | Database storage profile passes mypy (#11342)David Robertson2021-11-154-8/+21
| | | | | | | | | | | | | | | | | | | | | | | | It already seems to pass mypy. I wonder what changed, given that it was on the exclusion list. So this commit consists of me ensuring `--disallow-untyped-defs` passes and a minor fixup to a function that returned either `True` or `None`.
| * | | Get directory db file to pass mypy (#11339)David Robertson2021-11-154-7/+11
| | | |
| * | | Add support for the stable version of MSC2778 (#11335)Tulir Asokan2021-11-154-4/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add support for the stable version of MSC2778 Signed-off-by: Tulir Asokan <tulir@maunium.net> * Expect m.login.application_service in login and password provider tests Signed-off-by: Tulir Asokan <tulir@maunium.net>
| * | | Remove unused tables `room_stats_historical` and `user_stats_historical` ↵Shay2021-11-123-1/+24
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (#11280) * remove unused tables room_stats_historical and user_stats_historical * update changelog number * Bump schema compat version comment * make linter happy * Update comment to give more info Co-authored-by: reivilibre <oliverw@matrix.org> Co-authored-by: reivilibre <oliverw@matrix.org>
| * | | Annotations for state_deltas.py (#11316)David Robertson2021-11-123-4/+17
| | | | | | | | | | | | | | | | | | | | I was sad that I couldn't do better for `_curr_state_delta_stream_cache`. At least it's explicitly called out in a comment with #TODO.
| * | | Rollback #11322 due to wrong syntax in mypy.ini. (#11332)Patrick Cloke2021-11-122-2/+15
| | | | | | | | | | | | | | | | This was only checking the __init__ files in modules instead of all files in a module, which don't pass yet.
| * | | Test room alias deletion (#11327)David Robertson2021-11-125-31/+91
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Prefer `HTTPStatus` over plain `int` This is an Opinion that no-one has seemed to object to yet. * `--disallow-untyped-defs` for `tests.rest.client.test_directory` * Improve synapse's annotations for deleting aliases * Test case for deleting a room alias * Changelog
| * | | Change display names/avatar URLs to None if they contain null bytes before ↵Shay2021-11-123-4/+56
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | storing in DB (#11230) * change display names/avatar URLS to None if they contain null bytes * add changelog * add POC test, requested changes * add a saner test and remove old one * update test to verify that display name has been changed to None * make test less fragile
| * | | Add type hints to media repository storage module (#11311)Patrick Cloke2021-11-124-62/+89
| | | |
| * | | Attempt to annotate events_forward_extremities (#11314)David Robertson2021-11-124-8/+17
| | | | | | | | | | | | | | | | | | | | | | | | * Make DataStore inherit from EventForwardExtremitiesStore before CacheInvalidationWorkerStore the former implicitly inherits from the latter, so they should be ordered like this when used.
| * | | Misc typing fixes for `tests`, part 1 of N (#11323)David Robertson2021-11-127-29/+53
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Annotate HomeserverTestCase.servlets * Correct annotation of federation_auth_origin * Use AnyStr custom_headers instead of a Union This allows (str, str) and (bytes, bytes). This disallows (str, bytes) and (bytes, str) * DomainSpecificString.SIGIL is a ClassVar
| * | | Generalize the disallowed_untyped_defs in mypy.ini (#11322)Patrick Cloke2021-11-122-14/+3
| | | |
| * | | Add more type hints to synapse.util. (#11321)Patrick Cloke2021-11-123-15/+24
| | | |
| * | | Suggest using `/etc/matrix-synapse/conf.d/` for configuration with Debian ↵reivilibre2021-11-122-0/+7
| | | | | | | | | | | | | | | | packages (#11281)
| * | | Convert delete room admin API to async endpoint (#11223)Dirk Klimpel2021-11-129-91/+1317
| | | | | | | | | | | | Signed-off-by: Dirk Klimpel dirk@klimpel.org
| * | | Annotations for user_erasure_store (#11313)David Robertson2021-11-113-5/+9
| | | | | | | | | | | | | | | | I'm not sure why this was excluded---it seemed to be passing for me. But it's easy enough to fixup.
| * | | Get db signatures file to pass mypy (#11312)David Robertson2021-11-114-10/+8
| | | |
| * | | Correct type hint for room_batch.py (#11310)David Robertson2021-11-113-11/+12
| | | | | | | | | | | | Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| * | | Move sql file for `remove_deleted_devices_from_device_inbox` into v65 (#11303)Dirk Klimpel2021-11-112-1/+2
| | | |
| * | | Add type hints to some storage classes (#11307)Patrick Cloke2021-11-119-54/+116
| | | |
| * | | Fix error in thumbnail generation (#11288)Neeeflix2021-11-102-4/+5
| | | | | | | | | | | | Signed-off-by: Jonas Zeunert <jonas@zeunert.org>
| * | | Add missing type hints to `synapse.app`. (#11287)Patrick Cloke2021-11-1017-190/+223
| | | |
| * | | Add type hints to synapse._scripts (#11297)Patrick Cloke2021-11-105-20/+30
| | | |
| * | | Add documentation page stubs for Single Sign-On, SAML and CAS pages (#11298)Andrew Morgan2021-11-105-3/+25
| | | |
| * | | Remove redundant parameters on `_check_event_auth` (#11292)Richard van der Hoff2021-11-103-12/+1
| | | | | | | | | | | | as of #11012, these parameters are unused.
| * | | Merge tag 'v1.47.0rc2' into developOlivier Wilkinson (reivilibre)2021-11-1060-60/+101
| |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.47.0rc2 (2021-11-10) ============================== This fixes an issue with publishing the Debian packages for 1.47.0rc1. It is otherwise identical to 1.47.0rc1.
| | * | Changelog tweak from feedback v1.47.0rc2Olivier Wilkinson (reivilibre)2021-11-101-1/+1
| | | |
| | * | Move Debian changelog entries to rc2 since rc1 was not publishedOlivier Wilkinson (reivilibre)2021-11-101-7/+4
| | | |
| | * | 1.47.0rc2Olivier Wilkinson (reivilibre)2021-11-103-1/+14
| | | |
| | * | Correct the Debian changelogOlivier Wilkinson (reivilibre)2021-11-101-1/+1
| | | |
| | * | Update __init__.py v1.47.0rc1Olivier Wilkinson (reivilibre)2021-11-091-1/+1
| | | |
| | * | Changelog tweaks from reviewOlivier Wilkinson (reivilibre)2021-11-091-5/+5
| | | |
| | * | Make Deprecations and Removals more prominentOlivier Wilkinson (reivilibre)2021-11-091-7/+7
| | | |
| | * | Changelog tweaksOlivier Wilkinson (reivilibre)2021-11-091-6/+6
| | | |
| | * | 1.47.0rc1Olivier Wilkinson (reivilibre)2021-11-0959-59/+90
| | | |
| * | | Fix typos in the `username_available` admin API documentation. (#11286)Stanislav Motylkov2021-11-092-1/+2
| | | |
| * | | Split out federated PDU retrieval into a non-cached version (#11242)Eric Eastwood2021-11-092-22/+59
| | | | | | | | | | | | | | | | Context: https://github.com/matrix-org/synapse/pull/11114/files#r741643968
| * | | Ignore missing imports for parameterized. (#11285)Patrick Cloke2021-11-092-0/+4
| | | | | | | | | | | | | | | | This was due to a conflict between #11282, which changed mypy configuration, and #11228, a normal change.
| * | | Require mypy for synapse/ & tests/ unless excluded (#11282)Dan Callahan2021-11-093-77/+168
| | | | | | | | | | | | Signed-off-by: Dan Callahan <danc@element.io>
| * | | Clarifications and small fixes to to-device related code (#11247)Andrew Morgan2021-11-096-17/+78
| | | | | | | | | | | | Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| * | | Allow admins to proactively block rooms (#11228)David Robertson2021-11-096-21/+103
| | | | | | | | | | | | | | | | Co-authored-by: Dirk Klimpel <5740567+dklimpel@users.noreply.github.com> Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| * | | Support filtering by relations per MSC3440 (#11236)Patrick Cloke2021-11-0915-110/+680
| | | | | | | | | | | | | | | | Adds experimental support for `relation_types` and `relation_senders` fields for filters.
| * | | Fix typo in `RelationAggregationPaginationServlet` error response (#11278)Andrew Morgan2021-11-092-1/+4
| |/ /
| * | Include cross-signing signatures when syncing remote devices for the first ↵Erik Johnston2021-11-093-86/+277
| | | | | | | | | | | | | | | | | | | | | time (#11234) When fetching remote devices for the first time, we did not correctly include the cross signing keys in the returned results. c.f. #11159
| * | Require body for read receipts with user-agent exceptions (#11157)rogersheu2021-11-093-3/+40
| | | | | | | | | Co-authored-by: reivilibre <olivier@librepush.net>
| * | Rename to more clear `get_insertion_event_id_by_batch_id` (MSC2716) (#11244)Eric Eastwood2021-11-084-3/+4
| | | | | | | | | | | | | | | `get_insertion_event_by_batch_id` -> `get_insertion_event_id_by_batch_id` Split out from https://github.com/matrix-org/synapse/pull/11114
| * | Add some background update admin APIs (#11263)Erik Johnston2021-11-088-18/+468
| | | | | | | | | Fixes #11259
| * | Fix typo in comment from #11255. (#11276)Patrick Cloke2021-11-082-1/+2
| | |
| * | Default value for `public_baseurl` (#11210)Richard van der Hoff2021-11-0816-73/+62
| | | | | | | | | | | | | | | We might as well use a default value for `public_baseurl` based on `server_name` - in many cases, it will be correct.
| * | Address review feedback from #11269 (#11273)Dan Callahan2021-11-082-2/+3
| | | | | | | | | Signed-off-by: Dan Callahan <danc@element.io>
| * | Blacklist new sytest validation test (#11270)Erik Johnston2021-11-082-0/+4
| | |
| * | Handle federation inbound instances being killed more gracefully (#11262)Erik Johnston2021-11-083-10/+27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Make lock better handle process being killed If the process gets killed and restarted (so that it didn't have a chance to drop its locks gracefully) then there may still be locks in the DB that are for the same instance that haven't yet timed out but are safe to delete. We handle this case by a) checking if the current instance already has taken out the lock, and b) if not then ignoring locks that are for the same instance. * Periodically check for old staged events This is to protect against other instances dying and their locks timing out.
| * | Minor cleanup to Debian packaging (#11269)Dan Callahan2021-11-0711-53/+10
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Remove unused Vagrant scripts * Change package Architecture to any * Preinstall the wheel package when building venvs. Addresses the following warnings during Debian builds: Using legacy 'setup.py install' for jaeger-client, since package 'wheel' is not installed. Using legacy 'setup.py install' for matrix-synapse-ldap3, since package 'wheel' is not installed. Using legacy 'setup.py install' for opentracing, since package 'wheel' is not installed. Using legacy 'setup.py install' for psycopg2, since package 'wheel' is not installed. Using legacy 'setup.py install' for systemd-python, since package 'wheel' is not installed. Using legacy 'setup.py install' for pympler, since package 'wheel' is not installed. Using legacy 'setup.py install' for threadloop, since package 'wheel' is not installed. Using legacy 'setup.py install' for thrift, since package 'wheel' is not installed. * Allow /etc/default/matrix-synapse to be missing Per the systemd.exec manpage, prefixing an EnvironmentFile with "-": > indicates that if the file does not exist, it will not be read and no > error or warning message is logged. Signed-off-by: Dan Callahan <danc@element.io>
| * | Add doc to integrate synapse with LemonLDAP OIDC (#11257)Julian2021-11-052-0/+39
| | | | | | | | | | | | Co-authored-by: David Robertson <david.m.robertson1@gmail.com> Co-authored-by: Julian Vanden Broeck <julian.vandenbroeck@dalibo.com>
| * | Fix rolling back when using workers (#11255)Erik Johnston2021-11-053-11/+82
| | | | | | | | | Fixes #11252
| * | Make minor correction to type of auth_checkers callbacks (#11253)reivilibre2021-11-043-2/+5
| | |