summary refs log tree commit diff
path: root/synapse/server.py (unfollow)
Commit message (Collapse)AuthorFilesLines
2023-08-151.90.0 v1.90.0Olivier Wilkinson (reivilibre)3-1/+12
2023-08-08Fixup changelog v1.90.0rc1Erik Johnston1-3/+3
2023-08-08Fixup changelogErik Johnston1-3/+3
2023-08-081.90.0rc1Erik Johnston30-29/+72
2023-08-08Allow modules to schedule delayed background calls. (#15993)reivilibre2-0/+42
* Add a module API function to provide `call_later` * Newsfile Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> * Add comments * Update version number --------- Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
2023-08-08Remove old rows from the `cache_invalidation_stream_by_instance` table ↵reivilibre2-0/+131
automatically. (This table is not used when Synapse is configured to use SQLite.) (#15868) * Add a cache invalidation clean-up task * Run the cache invalidation stream clean-up on the background worker * Tune down * call_later is in millis! * Newsfile Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> * fixup! Add a cache invalidation clean-up task * Update synapse/storage/databases/main/cache.py Co-authored-by: Eric Eastwood <erice@element.io> * Update synapse/storage/databases/main/cache.py Co-authored-by: Eric Eastwood <erice@element.io> * MILLISEC -> MS * Expand on comment * Move and tweak comment about Postgres * Use `wrap_as_background_process` --------- Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> Co-authored-by: Eric Eastwood <erice@element.io>
2023-08-07Fix endpoint improperly declaring support for MSC3814 (#16068)Shay2-10/+9
2023-08-07Drop backwards compat hack for event serialization (#16069)Shay2-11/+2
2023-08-07Add notes describing Synapse's streams (#16015)David Robertson3-0/+159
Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
2023-08-07Bump jsonschema from 4.18.3 to 4.19.0 (#16081)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-07Bump serde from 1.0.179 to 1.0.183 (#16074)dependabot[bot]1-7/+7
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-07Bump regex from 1.9.1 to 1.9.3 (#16073)dependabot[bot]1-6/+6
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-07Bump types-opentracing from 2.4.10.5 to 2.4.10.6 (#16078)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-07Bump furo from 2023.5.20 to 2023.7.26 (#16077)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-07Bump types-setuptools from 68.0.0.0 to 68.0.0.3 (#16079)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-07Bump phonenumbers from 8.13.14 to 8.13.18 (#16076)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-04Fix deletion for Dehydrated Devices (#16046)Shay4-5/+165
2023-08-04Stabilize support for MSC3970: updated transaction semantics (scope to ↵Patrick Cloke9-59/+48
`device_id`) (#15629) For now this maintains compatible with old Synapses by falling back to using transaction semantics on a per-access token. A future version of Synapse will drop support for this.
2023-08-03Move support for application service query parameter authorization behind a ↵Shay6-14/+144
configuration option (#16017)
2023-08-03Allow config of the backoff algorithm for the federation client. (#15754)Mathieu Velten6-26/+64
Adds three new configuration variables: * destination_min_retry_interval is identical to before (10mn). * destination_retry_multiplier is now 2 instead of 5, the maximum value will be reached slower. * destination_max_retry_interval is one day instead of (essentially) infinity. Capping this will cause destinations to continue to be retried sometimes instead of being lost forever. The previous value was 2 ^ 62 milliseconds.
2023-08-03Allow modules to check whether the current worker is configured to run ↵reivilibre2-0/+13
background tasks. (#15991)
2023-08-02Add forward-compatibility for the redacts property (MSC2174). (#16013)Patrick Cloke3-25/+61
The location of the redacts field changes in room version 11. Ensure it is copied to the *new* location for *old* room versions for forwards-compatibility with clients. Note that copying it to the *old* location for the *new* room version was previously handled.
2023-08-02Update MSC3958 support to interact with intentional mentions. (#15992)Patrick Cloke6-42/+64
* Updates the rule ID. * Use `event_property_is` instead of `event_match`. This updates the implementation of MSC3958 to match the latest text from the MSC.
2023-08-02Bump cryptography from 41.0.2 to 41.0.3 (#16048)dependabot[bot]1-24/+24
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-02Update `flake.lock` to fix running the nix developer environment on MacOS ↵Andrew Morgan3-23/+42
(#16019)
2023-08-01Update certifi to 2023.7.22 and pygments to 2.15.1. (#16044)Patrick Cloke2-7/+8
2023-08-01Properly setup the additional sequences in the portdb script. (#16043)Patrick Cloke2-3/+16
The un_partial_stated_event_stream_sequence and application_services_txn_id_seq were never properly configured in the portdb script, resulting in an error on start-up.
2023-08-01Trim whitespace when setting display names (#16031)Mohit Rathee3-1/+14
2023-08-01Add metrics tracking for eviction to ResponseCache (#16028)Jason Little2-2/+9
Track whether the ResponseCache is evicting due to invalidation or due to time.
2023-08-011.89.0 v1.89.0David Robertson3-1/+12
2023-07-31Combine duplicated code for calculating an event ID from a txn ID (#16023)Patrick Cloke3-32/+36
Refactoring related to stabilization of MSC3970, refactor to combine code which has the same logic.
2023-07-31Bump serde from 1.0.175 to 1.0.179 (#16033)dependabot[bot]1-4/+4
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.175 to 1.0.179. - [Release notes](https://github.com/serde-rs/serde/releases) - [Commits](https://github.com/serde-rs/serde/compare/v1.0.175...v1.0.179) --- updated-dependencies: - dependency-name: serde dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31Bump immutabledict from 2.2.4 to 3.0.0 (#16034)dependabot[bot]1-4/+4
Bumps [immutabledict](https://github.com/corenting/immutabledict) from 2.2.4 to 3.0.0. - [Release notes](https://github.com/corenting/immutabledict/releases) - [Changelog](https://github.com/corenting/immutabledict/blob/master/CHANGELOG.md) - [Commits](https://github.com/corenting/immutabledict/compare/v2.2.4...v3.0.0) --- updated-dependencies: - dependency-name: immutabledict dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31Do not expose Admin API in caddy reverse proxy example (#16027)Nils2-1/+2
Signed-off-by: Nils ANDRÉ-CHANG <nils@nilsand.re>
2023-07-31Bump service-identity from 21.1.0 to 23.1.0 (#16038)dependabot[bot]1-7/+7
Bumps [service-identity](https://github.com/pyca/service-identity) from 21.1.0 to 23.1.0. - [Release notes](https://github.com/pyca/service-identity/releases) - [Changelog](https://github.com/pyca/service-identity/blob/main/CHANGELOG.md) - [Commits](https://github.com/pyca/service-identity/compare/21.1.0...23.1.0) --- updated-dependencies: - dependency-name: service-identity dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31Add ability to wait for locks and add locks to purge history / room deletion ↵Erik Johnston16-108/+783
(#15791) c.f. #13476
2023-07-31Bump types-commonmark from 0.9.2.3 to 0.9.2.4 (#16037)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31Bump serde_json from 1.0.103 to 1.0.104 (#16032)dependabot[bot]1-2/+2
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.103 to 1.0.104. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.103...v1.0.104) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31Bump types-jsonschema from 4.17.0.8 to 4.17.0.10 (#16036)dependabot[bot]1-3/+3
Bumps [types-jsonschema](https://github.com/python/typeshed) from 4.17.0.8 to 4.17.0.10. - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-jsonschema dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31Bump types-netaddr from 0.8.0.8 to 0.8.0.9 (#16035)dependabot[bot]1-3/+3
Bumps [types-netaddr](https://github.com/python/typeshed) from 0.8.0.8 to 0.8.0.9. - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-netaddr dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-27Clarify comment on key uploads over replication (#16016)Shay2-2/+4
2023-07-27Fix 404 on /profile when the display name is empty but not the avatar (#16012)Mathieu Velten3-1/+12
2023-07-27Update PyYAML to 6.0.1 (#16011)Mathieu Velten2-41/+42
2023-07-27Attempt to fix labelling in docker workflow (#16009)David Robertson2-1/+8
2023-07-26Remove support for legacy application service paths (#15964)Shay3-124/+12
2023-07-26Inline SQL queries using boolean parameters (#15525)Anshul Madnawat8-25/+24
SQLite now supports TRUE and FALSE constants, simplify some queries by inlining those instead of passing them as arguments.
2023-07-26Add synapse version as Docker container label (#15972)Mo Balaa2-1/+8
Co-authored-by: Mo Balaa <balaa@fractalnetworks.co>
2023-07-26Bump serde from 1.0.171 to 1.0.175 (#15982)dependabot[bot]1-4/+4
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.171 to 1.0.175. - [Release notes](https://github.com/serde-rs/serde/releases) - [Commits](https://github.com/serde-rs/serde/compare/v1.0.171...v1.0.175) --- updated-dependencies: - dependency-name: serde dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-26Edit changelog v1.89.0rc1Mathieu Velten1-7/+7
2023-07-26Remove changelog fileMathieu Velten1-1/+0
2023-07-26Bump DB version to 79 since synapse v1.88 was already there (#15998)Mathieu Velten7-16/+22
2023-07-251.89.0rc1Mathieu Velten33-31/+68
2023-07-25Bump pygithub from 1.58.2 to 1.59.0 (#15834)dependabot[bot]1-3/+3
Bumps [pygithub](https://github.com/pygithub/pygithub) from 1.58.2 to 1.59.0. - [Release notes](https://github.com/pygithub/pygithub/releases) - [Changelog](https://github.com/PyGithub/PyGithub/blob/main/doc/changes.rst) - [Commits](https://github.com/pygithub/pygithub/compare/v1.58.2...v1.59.0) --- updated-dependencies: - dependency-name: pygithub dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-24Support MSC3814: Dehydrated Devices (#15929)Shay7-12/+603
Signed-off-by: Nicolas Werner <n.werner@famedly.com> Co-authored-by: Nicolas Werner <n.werner@famedly.com> Co-authored-by: Nicolas Werner <89468146+nico-famedly@users.noreply.github.com> Co-authored-by: Hubert Chathi <hubert@uhoreg.ca>
2023-07-24Fix broken Arch Linux package link (#15981)SnipeX_2-2/+3
2023-07-24Resync stale devices in background (#15975)Erik Johnston2-1/+9
This is so we don't block responding to federation transaction while we try and fetch the device lists.
2023-07-24Bump click from 8.1.3 to 8.1.6 (#15984)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-24Bump sentry-sdk from 1.26.0 to 1.28.1 (#15985)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-24Bump pillow from 9.4.0 to 10.0.0 (#15986)dependabot[bot]1-83/+62
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-24Bump types-requests from 2.31.0.1 to 2.31.0.2 (#15983)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-23Properly handle redactions of creation events (#15973)Shay3-5/+13
2023-07-23Actually stop reading from column `user_id` of tables `profiles` (#15955)Shay5-12/+12
2023-07-23Build packages for Debian Trixie (#15961)Shay2-0/+2
2023-07-20Speed up updating state in large rooms (#15971)Erik Johnston5-131/+141
This should speed up updating state in rooms with lots of state.
2023-07-20Fixed grafana deploy annotations in the dashboard config, so it shows for ↵Will Lewis2-1/+2
those not managing matrix.org (#15957) Removed the 'matrix.org' hardcorded instance setting Originally introduced in #15674 Co-authored-by: wrjlewis <will.lewis@askattest.com>
2023-07-20Don't log exceptions for every non-200 response (#15969)Erik Johnston2-4/+1
Introduced in #15913
2023-07-20Reduce the amount of state we pull out (#15968)Erik Johnston4-12/+14
2023-07-19Ensure a long state res does not starve CPU (#15960)Erik Johnston2-1/+9
We do this by yielding the reactor in hot loops.
2023-07-19Fix bad merge of #15933 (#15958)Erik Johnston3-0/+1
This was because we reverted the bump of the schema version, so we were not applying the new deltas.
2023-07-19Fix race in triggers for read/write locks. (#15933)Erik Johnston5-98/+135
2023-07-18Fix background schema updates failing over a large upgrade gap (#15887)Shay2-0/+71
2023-07-181.88.0 v1.88.0Olivier Wilkinson (reivilibre)4-3/+16
2023-07-18Support room version 11 (#15912)Patrick Cloke19-290/+190
And fix a bug in the implementation of the updated redaction format (MSC2174) where the top-level redacts field was not properly added for backwards-compatibility.
2023-07-18Revert "Stop writing to column `user_id` of tables `profiles` and ↵Shay10-122/+174
`user_filters`. (#15953) * Revert "Stop writing to column `user_id` of tables `profiles` and `user_filters` (#15787)" This reverts commit f25b0f88081bb436bef914983cff7087b54eba5f. * newsfragement
2023-07-18Add a locality to a few presence metrics (#15952)Jason Little2-13/+25
2023-07-18Re-introduce the outbound federation proxy (#15913)Eric Eastwood32-96/+1128
Allow configuring the set of workers to proxy outbound federation traffic through (`outbound_federation_restricted_to`). This is useful when you have a worker setup with `federation_sender` instances responsible for sending outbound federation requests and want to make sure *all* outbound federation traffic goes through those instances. Before this change, the generic workers would still contact federation themselves for things like profile lookups, backfill, etc. This PR allows you to set more strict access controls/firewall for all workers and only allow the `federation_sender`'s to contact the outside world.
2023-07-17Bump anyhow from 1.0.71 to 1.0.72 (#15949)dependabot[bot]1-2/+2
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Bump pyo3-log from 0.8.2 to 0.8.3 (#15951)dependabot[bot]1-2/+2
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Bump serde_json from 1.0.100 to 1.0.103 (#15950)dependabot[bot]1-2/+2
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Bump jsonschema from 4.17.3 to 4.18.3 (#15948)dependabot[bot]1-42/+144
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Bump typing-extensions from 4.5.0 to 4.7.1 (#15947)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Bump pydantic from 1.10.10 to 1.10.11 (#15946)dependabot[bot]1-37/+37
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Bump prometheus-client from 0.17.0 to 0.17.1 (#15945)dependabot[bot]1-3/+3
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17Pin the rust version in `flake.nix`, and bump to 1.70.0 to fix installing ↵Andrew Morgan3-43/+87
`ruff` (#15940)
2023-07-15Bump cryptography from 41.0.1 to 41.0.2 (#15943)dependabot[bot]1-20/+24
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-14Document that you cannot login as yourself on ↵Will Hunt2-1/+3
/_synapse/admin/v1/users/<user_id>/login (#15938)
2023-07-13Stop accepting 'user' parameter for application service registration. (#15928)Patrick Cloke3-8/+15
This is unspecced, but has existed for a very long time.
2023-07-13Bump types-pillow from 9.5.0.4 to 10.0.0.1 (#15932)dependabot[bot]1-3/+5
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-12Remove unneeded __init__. (#15926)Patrick Cloke2-9/+1
Remove an __init__ which only calls super() without changing the input arguments.
2023-07-12Fix running with an empty experimental features section. (#15925)Patrick Cloke2-1/+2
2023-07-12Fix push for invites received over federation (#15820)Erik Johnston2-1/+37
2023-07-12Mark get_user_in_directory private since only used in tests (#15884)Mathieu Velten4-20/+14
2023-07-11Make it more obvious which Python version runs on a given Linux distribution ↵Eric Eastwood2-7/+12
(#15909) Make it more obvious which Python version runs on a given Linux distribution so when we end up dropping support for a given Python version, we can more easily find the reference to the Python version and remove any references for the distribution. We don't want to be running tests or building packages on a distribution that no longer has a supported Python version. This way, we can avoid another situation like when we dropped support for Python 3.7 but forgot to drop the Debian Buster references everywhere (https://github.com/matrix-org/synapse/pull/15893)
2023-07-11Better clarify how to run a worker instance (pass both configs) (#15921)Eric Eastwood2-2/+3
Previously, if you just followed the instructions per the docs, you just ran into an error: ```sh $ poetry run synapse_worker --config-path homeserver_generic_worker1.yaml Missing mandatory `server_name` config option. ```
2023-07-11Better warning in logs when we fail to fetch an alias (#15922)Eric Eastwood2-1/+4
**Before:** ``` Error retrieving alias ``` **After:** ``` Error retrieving alias #foo:bar -> 401 Unauthorized ``` *Spawning from creating the [manual testing strategy for the outbound federation proxy](https://github.com/matrix-org/synapse/pull/15773).*
2023-07-11Bump Unix sockets intro version (#15924)Eric Eastwood2-1/+2
https://github.com/matrix-org/synapse/pull/15708 didn't quite make the cut for `1.88.0` this morning.
2023-07-11Unix Sockets for HTTP Replication (#15708)Jason Little16-52/+260
Unix socket support for `federation` and `client` Listeners has existed now for a little while(since [1.81.0](https://github.com/matrix-org/synapse/pull/15353)), but there was one last hold out before it could be complete: HTTP Replication communication. This should finish it up. The Listeners would have always worked, but would have had no way to be talked to/at. --------- Co-authored-by: Eric Eastwood <madlittlemods@gmail.com> Co-authored-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> Co-authored-by: Eric Eastwood <erice@element.io>
2023-07-11Add + as an allowed character for Matrix IDs (MSC4009) (#15911)Patrick Cloke7-39/+17
2023-07-11Don't build wheels for Python 3.7 (#15917) v1.88.0rc1David Robertson2-2/+10
* Don't build wheels for CPython or PyPy 3.7 * Update pyproject.toml comments * Manually update the changelog
2023-07-11Call out upgrade notes in READMEDavid Robertson1-2/+6
2023-07-111.88.0rc1David Robertson25-25/+56
2023-07-11Add `Server` to Access-Control-Expose-Headers header (#15908)Michael Telatynski3-2/+3