summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* Change device list streams to have one row per ID (#7010)Erik Johnston2020-03-197-130/+112
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add 'device_lists_outbound_pokes' as extra table. This makes sure we check all the relevant tables to get the current max stream ID. Currently not doing so isn't problematic as the max stream ID in `device_lists_outbound_pokes` is the same as in `device_lists_stream`, however that will change. * Change device lists stream to have one row per id. This will make it possible to process the streams more incrementally, avoiding having to process large chunks at once. * Change device list replication to match new semantics. Instead of sending down batches of user ID/host tuples, send down a row per entity (user ID or host). * Newsfile * Remove handling of multiple rows per ID * Fix worker handling * Comments from review
| * Comments from reviewErik Johnston2020-03-183-8/+25
| |
| * Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2020-03-0213-40/+55
| |\ | | | | | | | | | erikj/fixup_devices_stream
| * | Fix worker handlingErik Johnston2020-03-021-2/+3
| | |
| * | Remove handling of multiple rows per IDErik Johnston2020-02-282-79/+1
| | |
| * | NewsfileErik Johnston2020-02-281-0/+1
| | |
| * | Change device list replication to match new semantics.Erik Johnston2020-02-284-23/+32
| | | | | | | | | | | | | | | Instead of sending down batches of user ID/host tuples, send down a row per entity (user ID or host).
| * | Change device lists stream to have one row per id.Erik Johnston2020-02-281-18/+41
| | | | | | | | | | | | | | | This will make it possible to process the streams more incrementally, avoiding having to process large chunks at once.
| * | Add 'device_lists_outbound_pokes' as extra table.Erik Johnston2020-02-282-2/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | This makes sure we check all the relevant tables to get the current max stream ID. Currently not doing so isn't problematic as the max stream ID in `device_lists_outbound_pokes` is the same as in `device_lists_stream`, however that will change.
* | | more changelog v1.12.0rc1Richard van der Hoff2020-03-191-1/+1
| | |
* | | changelog fixesRichard van der Hoff2020-03-191-3/+3
| | |
* | | fix typoRichard van der Hoff2020-03-191-2/+2
| | |
* | | 1.12.0rc1Richard van der Hoff2020-03-1960-59/+78
| | |
* | | update grafana dashboardRichard van der Hoff2020-03-191-32/+213
| | |
* | | Fix concurrent modification errors in pusher metrics (#7106)Richard van der Hoff2020-03-192-9/+19
| | | | | | | | | add a lock to try to make this metric actually work
* | | Add prometheus metrics for the number of active pushers (#7103)Richard van der Hoff2020-03-195-8/+36
| | |
* | | Move pusherpool startup into _base.setup (#7104)Richard van der Hoff2020-03-193-1/+2
| | | | | | | | | | | | | | | This should be safe to do on all workers/masters because it is guarded by a config option which will ensure it is only actually done on the worker assigned as a pusher.
* | | Improve get auth chain difference algorithm. (#7095)Erik Johnston2020-03-186-71/+310
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It was originally implemented by pulling the full auth chain of all state sets out of the database and doing set comparison. However, that can take a lot work if the state and auth chains are large. Instead, lets try and fetch the auth chains at the same time and calculate the difference on the fly, allowing us to bail early if all the auth chains converge. Assuming that the auth chains do converge more often than not, this should improve performance. Hopefully.
* | | Add an option to the set password API to choose whether to logout other ↵Patrick Cloke2020-03-185-20/+39
| | | | | | | | | | | | devices. (#7085)
* | | Update INSTALL.md updated CentOS8 install instructions (#6925)Richard von Kellner2020-03-172-2/+12
| | |
* | | Share SSL contexts for non-federation requests (#7094)Richard van der Hoff2020-03-177-44/+71
| | | | | | | | | | | | | | | | | | | | | Extends #5794 etc to the SimpleHttpClient so that it also applies to non-federation requests. Fixes #7092.
* | | Set charset to utf-8 when adding headers for certain text content types (#7044)The Stranjer2020-03-172-1/+25
| | | | | | | | | | | | Fixes #7043
* | | Remove unused federation endpoint (`query_auth`) (#7026)Patrick Cloke2020-03-175-146/+80
| | |
* | | Remove special casing of `m.room.aliases` events (#7034)Patrick Cloke2020-03-175-42/+35
| | |
* | | Revert "Add options to disable setting profile info for prevent changes. ↵Richard van der Hoff2020-03-177-398/+1
| | | | | | | | | | | | | | | | | | | | | (#7053)" This reverts commit 54dd28621b070ca67de9f773fe9a89e1f4dc19da, reversing changes made to 6640460d054e8f4444046a34bdf638921b31c01e.
* | | Populate the room version from state events (#7070)Brendan Abolivier2020-03-163-0/+63
| | | | | | | | | | | | | | | Fixes #7065 This is basically the same as https://github.com/matrix-org/synapse/pull/6847 except it tries to populate events from `state_events` rather than `current_state_events`, since the latter might have been cleared from the state of some rooms too early, leaving them with a `NULL` room version.
* | | Fix buggy condition in account validity handler (#7074)Brendan Abolivier2020-03-162-1/+6
| | |
* | | Merge pull request #7067 from matrix-org/babolivier/saml_error_moarBrendan Abolivier2020-03-134-28/+90
|\ \ \ | | | | | | | | Move the default SAML2 error HTML to a dedicated file
| * | | Use innerText instead of innerHTMLBrendan Abolivier2020-03-131-1/+2
| | | |
| * | | LintBrendan Abolivier2020-03-111-2/+1
| | | |
| * | | Put the file in the templates directoryBrendan Abolivier2020-03-112-19/+37
| | | |
| * | | Update wording and configBrendan Abolivier2020-03-113-2/+8
| | | |
| * | | ChangelogBrendan Abolivier2020-03-111-0/+1
| | | |
| * | | Move the default SAML2 error HTML to a dedicated fileBrendan Abolivier2020-03-112-18/+55
| | | | | | | | | | | | | | | | | | | | Also add some JS to it to process any error we might have in the URI (see #6893).
* | | | Add type annotations and comments to auth handler (#7063)Patrick Cloke2020-03-123-89/+106
| | | |
* | | | Merge pull request #7066 from matrix-org/babolivier/dummy_events_stateBrendan Abolivier2020-03-113-31/+37
|\ \ \ \ | |/ / / |/| | | Skip the correct visibility checks when checking the visibility of the state at a given event
| * | | Refactor a bitBrendan Abolivier2020-03-111-28/+30
| | | |
| * | | Also don't fail on aliases events in this caseBrendan Abolivier2020-03-111-1/+1
| | | |
| * | | LintBrendan Abolivier2020-03-111-1/+5
| | | |
| * | | ChangelogBrendan Abolivier2020-03-111-0/+1
| | | |
| * | | Also don't filter out events sent by ignored users when checking state ↵Brendan Abolivier2020-03-111-1/+1
| | | | | | | | | | | | | | | | visibility
| * | | Fix conditionBrendan Abolivier2020-03-111-1/+1
| | | |
| * | | Don't filter out dummy events when we're checking the visibility of stateBrendan Abolivier2020-03-112-9/+8
|/ / /
* | | Add options to disable setting profile info for prevent changes. (#7053)Brendan Abolivier2020-03-107-1/+398
|\ \ \
| * | | Update sample_config.yamlDirk Klimpel2020-03-101-1/+1
| | | |
| * | | Update synapse/config/registration.pyDirk Klimpel2020-03-101-1/+1
| | | | | | | | | | | | Co-Authored-By: Brendan Abolivier <github@brendanabolivier.com>
| * | | lint, fix testsdklimpel2020-03-092-3/+5
| | | |
| * | | updates after reviewdklimpel2020-03-097-37/+40
| | | |
| * | | fix testsdklimpel2020-03-091-2/+2
| | | |
| * | | lintdklimpel2020-03-091-10/+8
| | | |
| * | | add testsdklimpel2020-03-092-3/+311
| | | |
| * | | add disable_3pid_changesdklimpel2020-03-083-0/+21
| | | |
| * | | lint2dklimpel2020-03-082-4/+4
| | | |
| * | | lintdklimpel2020-03-081-4/+2
| | | |
| * | | changelogdklimpel2020-03-084-4/+19
| | | |
| * | | Add options to disable setting profile info for prevent changes.dklimpel2020-03-083-1/+53
| | |/ | |/|
* | | Merge pull request #7058 from matrix-org/babolivier/saml_error_htmlBrendan Abolivier2020-03-107-6/+81
|\ \ \ | | | | | | | | SAML2: render a comprehensible error page if something goes wrong
| * | | Rephrase default messageBrendan Abolivier2020-03-101-2/+2
| | | |
| * | | Hopefully mypy is happy nowBrendan Abolivier2020-03-102-3/+10
| | | |
| * | | Attempt at appeasing the gods of mypyBrendan Abolivier2020-03-101-1/+1
| | | |
| * | | LintBrendan Abolivier2020-03-101-1/+1
| | | |
| * | | ChangelogBrendan Abolivier2020-03-101-0/+1
| | | |
| * | | Update sample configBrendan Abolivier2020-03-101-0/+7
| | | |
| * | | SAML2: render a comprehensible error page if something goes wrongBrendan Abolivier2020-03-103-2/+62
|/ / / | | | | | | | | | | | | | | | If an error happened while processing a SAML AuthN response, or a client ends up doing a `GET` request to `/authn_response`, then render a customisable error page rather than a confusing error.
* | | Merge pull request #7055 from ↵Brendan Abolivier2020-03-093-18/+21
|\ \ \ | | | | | | | | | | | | | | | | matrix-org/babolivier/get_time_of_last_push_action_before Move get_time_of_last_push_action_before to the EventPushActionsWorkerStore
| * | | ChangelogBrendan Abolivier2020-03-091-0/+1
| | | | | | | | | | | | | | | | | | | | It's the same as in #6964 since it's the most likely cause of the bug and that change hasn't been released yet.
| * | | Fix undefined `room_id` in `make_summary_text`Brendan Abolivier2020-03-091-1/+3
| | | | | | | | | | | | | | | | | | | | This would break notifications about un-named rooms when processing notifications in a batch.
| * | | Move `get_time_of_last_push_action_before` to the `EventPushActionsWorkerStore`Brendan Abolivier2020-03-091-17/+17
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes #7054 I also had a look at the rest of the functions in `EventPushActionsStore` and in the push notifications send code and it looks to me like there shouldn't be any other method with this issue in this part of the codebase.
* | | | Remove special auth and redaction rules for aliases events in experimental ↵Patrick Cloke2020-03-098-22/+148
| | | | | | | | | | | | | | | | room ver. (#7037)
* | | | Update routing of fallback auth in the worker docs. (#7048)Patrick Cloke2020-03-092-0/+2
| | | |
* | | | Merge pull request #7045 from matrix-org/babolivier/room_keys_checkBrendan Abolivier2020-03-092-0/+8
|\ \ \ \ | | | | | | | | | | Make sure that is_verified is a boolean when processing room keys
| * | | | LintBrendan Abolivier2020-03-061-2/+1
| | | | |
| * | | | Mention the session ID in the error messageBrendan Abolivier2020-03-061-2/+3
| | | | |
| * | | | LintBrendan Abolivier2020-03-061-1/+2
| | | | |
| * | | | ChangelogBrendan Abolivier2020-03-061-0/+1
| | | | |
| * | | | Make sure that is_verified is a boolean when processing room keysBrendan Abolivier2020-03-061-0/+6
| |/ / /
* | | | Add type hints to logging/context.py (#6309)Neil Pilgrim2020-03-072-47/+75
| | | | | | | | | | | | | | | | | | | | | | | | * Add type hints to logging/context.py Signed-off-by: neiljp (Neil Pilgrim) <github@kepier.clara.net>
* | | | Break down monthly active users by appservice_id (#7030)Neil Johnson2020-03-064-1/+87
|/ / / | | | | | | | | | | | | * Break down monthly active users by appservice_id and emit via prometheus. Co-authored-by: Brendan Abolivier <babolivier@matrix.org>
* | | Convert remote key resource REST layer to async/await. (#7020)Patrick Cloke2020-03-052-7/+5
| | |
* | | Store room_versions in EventBase objects (#6875)Richard van der Hoff2020-03-055-32/+63
| | | | | | | | | | | | | | | | | | | | | This is a bit fiddly because it all has to be done on one fell swoop: * Wherever we create a new event, pass in the room version (and check it matches the format version) * When we prune an event, use the room version of the unpruned event to create the pruned version. * When we pass an event over the replication protocol, pass the room version over alongside it, and use it when deserialising the event again.
* | | Merge pull request #7035 from matrix-org/babolivier/hide_dummy_eventsBrendan Abolivier2020-03-052-0/+4
|\ \ \ | | | | | | | | Hide extremities dummy events from clients
| * | | ChangelogBrendan Abolivier2020-03-041-0/+1
| | | |
| * | | Hide extremities dummy events from clientsBrendan Abolivier2020-03-041-0/+3
|/ / /
* | | Allow deleting an alias if the user has sufficient power level (#6986)Patrick Cloke2020-03-045-64/+182
| | |
* | | Read the room version from database when fetching events (#6874)Richard van der Hoff2020-03-043-16/+79
| | | | | | | | | | | | | | | This is a precursor to giving EventBase objects the knowledge of which room version they belong to.
* | | Merge branch 'master' into developBrendan Abolivier2020-03-0314-35/+401
|\ \ \
| * | | Update debian changelog v1.11.1 github/release-v1.11.1 release-v1.11.1Brendan Abolivier2020-03-031-0/+6
| | | |
| * | | Merge branch 'babolivier/v1.11.1-changelog' into 'release-v1.11.1'Brendan Abolivier2020-03-034-3/+16
| |\ \ \ | | | | | | | | | | | | | | | | | | | | v1.11.1 See merge request new-vector/synapse!6
| | * | | v1.11.1Brendan Abolivier2020-03-034-3/+16
| |/ / /
| * | | Merge branch 'babolivier/complete_sso_login_saml' into 'release-v1.11.1'Brendan Abolivier2020-03-031-3/+2
| |\ \ \ | | | | | | | | | | | | | | | | | | | | Fix wrong handler being used in SAML handler See merge request new-vector/synapse!5
| | * | | Fix wrong handler being used in SAML handlerBrendan Abolivier2020-03-031-3/+2
| |/ / /
| * | | Merge branch 'babolivier/sso_module_api' into 'release-v1.11.1'Brendan Abolivier2020-03-034-57/+96
| |\ \ \ | | | | | | | | | | | | | | | | | | | | Factor out complete_sso_login and expose it to the Module API See merge request new-vector/synapse!4
| | * | | Factor out complete_sso_login and expose it to the Module APIBrendan Abolivier2020-03-034-57/+96
| |/ / /
| * | | Merge branch 'rav/sso-confirm-whitelist' into 'release-v1.11.1'Richard van der Hoff2020-03-024-14/+84
| |\ \ \ | | | | | | | | | | | | | | | | | | | | Add a whitelist for the SSO confirmation step. See merge request new-vector/synapse!3
| | * | | Add a whitelist for the SSO confirmation step.Richard van der Hoff2020-03-024-14/+84
| |/ / /
| * | | Merge remote-tracking branch 'origin/release-v1.11.1' into release-v1.11.1Richard van der Hoff2020-03-024-38/+194
| |\ \ \
| * \ \ \ Merge branch 'anoabolivier/sso-confirm' into 'release-v1.11.1'Brendan Abolivier2020-03-027-6/+245
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Add a confirmation step to the SSO login flow See merge request new-vector/synapse!2
| | * | | | Add a confirmation step to the SSO login flowBrendan Abolivier2020-03-027-6/+245
| |/ / / /
* | | / / Validate the alt_aliases property of canonical alias events (#6971)Patrick Cloke2020-03-038-52/+254
| |_|/ / |/| | |
* | | | Always return a deferred from `get_current_state_deltas`. (#7019)Erik Johnston2020-03-022-1/+4
| | | | | | | | | | | | | | | | | | | | This currently causes presence notify code to log exceptions when there is no state changes to process. This doesn't actually cause any problems as we'd simply do nothing anyway.
* | | | Fix py35-old CI by using native tox. (#7018)Erik Johnston2020-03-022-6/+2
| | | | | | | | | | | | | | | | | | | | I'm not really sure how this was going wrong, but this seems like the right approach anyway.
* | | | remove spurious changelogRichard van der Hoff2020-03-021-1/+0
| | | |
* | | | Merge branch 'release-v1.11.1' into developRichard van der Hoff2020-03-020-0/+0
|\ \ \ \ | | |/ / | |/| |
| * | | Fixed set a user as an admin with the new API (#6928)Dirk Klimpel2020-03-024-38/+194
| |/ / | | | | | | | | | Fix #6910
* | | rst->mdMatthew Hodgson2020-03-011-1/+1
| | |
* | | Fix last date for ACMEv1 install (#7015)Uday Bansal2020-02-292-1/+2
| | | | | | | | | | | | | | | | | | Support for getting TLS certificates through ACMEv1 ended on November 2019. Signed-off-by: Uday Bansal <43824981+udaybansal19@users.noreply.github.com>
* | | Fix mounting of homeserver.yaml when it does not exist on host (#6913)Sandro2020-02-291-2/+1
| | | | | | | | | Signed-off-by: Sandro Jäckel <sandro.jaeckel@gmail.com>
* | | Add some type annotations to the federation base & client classes (#6995)Patrick Cloke2020-02-284-28/+45
| |/ |/|
* | Fixed set a user as an admin with the new API (#6928)Dirk Klimpel2020-02-284-42/+199
| | | | | | Fix #6910
* | Merge remote-tracking branch 'origin/release-v1.11.1' into developPatrick Cloke2020-02-272-6/+9
|\|
| * Cast a coroutine into a Deferred in the federation base (#6996)Patrick Cloke2020-02-262-6/+9
| | | | | | | | Properly convert a coroutine into a Deferred in federation_base to fix an error when joining a room.
* | Don't refuse to start worker if media listener configured. (#7002)Erik Johnston2020-02-272-14/+21
| | | | | | | | | | | | | | | | Instead lets just warn if the worker has a media listener configured but has the media repository disabled. Previously non media repository workers would just ignore the media listener.
* | set worker_app for frontend proxy test (#7003)Richard van der Hoff2020-02-272-0/+6
| | | | | | to stop the federationhandler trying to do master stuff
* | Expose common commands via snap run interface to allow easier invocation (#6315)James2020-02-272-5/+17
| | | | | | | | | | Signed-off-by: James Hebden <james@ec0.io>
* | Add some type annotations in `synapse.storage` (#6987)Richard van der Hoff2020-02-278-84/+270
| | | | | | | | | | I cracked, and added some type definitions in synapse.storage.
* | Store room version on invite (#6983)Richard van der Hoff2020-02-267-2/+78
| | | | | | | | | | When we get an invite over federation, store the room version in the rooms table. The general idea here is that, when we pull the invite out again, we'll want to know what room_version it belongs to (so that we can later redact it if need be). So we need to store it somewhere...
* | Port PresenceHandler to async/await (#6991)Erik Johnston2020-02-267-115/+113
| |
* | Updated warning for incorrect database collation/ctype (#6985)Uday Bansal2020-02-262-3/+8
| | | | | | Signed-off-by: Uday Bansal <43824981+udaybansal19@users.noreply.github.com>
* | Ensure 'deactivated' parameter is a boolean on user admin API, Fix error ↵Andrew Morgan2020-02-264-4/+68
| | | | | | | | handling of call to deactivate user (#6990)
* | Sanity-check database before running upgrades (#6982)Richard van der Hoff2020-02-250-0/+0
| | | | | | | | | | | | Some of the database deltas rely on `config.server_name` being set correctly, so we should check that it is before running the deltas. Fixes #6870.
* | Sanity-check database before running upgrades (#6982)Richard van der Hoff2020-02-253-17/+33
| | | | | | | | | | | | Some of the database deltas rely on `config.server_name` being set correctly, so we should check that it is before running the deltas. Fixes #6870.
* | Merge worker apps into one. (#6964)Erik Johnston2020-02-2516-2327/+1052
| |
* | contrib/docker: remove quotes for POSTGRES_INITDB_ARGS (#6984)Fridtjof Mund2020-02-252-1/+2
| | | | | | | | | | I made a mistake in https://github.com/matrix-org/synapse/pull/6921 - the quotes break the postgres container's startup script (or docker-compose), which makes initdb fail: https://github.com/matrix-org/synapse/pull/6921#issuecomment-590657154 Signed-off-by: Fridtjof Mund <fridtjof@das-labor.org>
* | Remove redundant store_room call (#6979)Richard van der Hoff2020-02-242-23/+1
| | | | | | | | | | `_process_received_pdu` is only called by `on_receive_pdu`, which ignores any events for unknown rooms, so this is redundant.
* | Upsert room version when we join over federation (#6968)Richard van der Hoff2020-02-243-10/+30
| | | | | | | | | | | | | | | | This is intended as a precursor to storing room versions when we receive an invite over federation, but has the happy side-effect of fixing #3374 at last. In short: change the store_room with try/except to a proper upsert which updates the right columns.
* | Fix minor issues with email config (#6962)Richard van der Hoff2020-02-243-40/+36
| | | | | | | | | | | | * Give `notif_template_html`, `notif_template_text` default values (fixes #6960) * Don't complain if `smtp_host` and `smtp_port` are unset, since they have sensible defaults (fixes #6961) * Set the example for `enable_notifs` to `True`, for consistency and because it's more useful * Raise errors as ConfigError rather than RuntimeError for nicer formatting
* | No longer use room alias events to calculate room names for push ↵Patrick Cloke2020-02-212-22/+15
| | | | | | | | notifications. (#6966)
* | Change displayname of user as admin in rooms (#6876)Dirk Klimpel2020-02-212-1/+12
| |
* | Stop returning aliases as part of the room list. (#6970)Patrick Cloke2020-02-212-9/+1
| |
* | Publishing/removing from the directory requires a power level greater than ↵Patrick Cloke2020-02-212-5/+6
| | | | | | | | canonical aliases.
* | Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957)Patrick Cloke2020-02-2173-276/+251
| | | | | | | | Ensure good comprehension hygiene using flake8-comprehensions.
* | Merge pull request #6967 from matrix-org/rav/increase_max_events_behindRichard van der Hoff2020-02-212-1/+2
|\ \ | | | | | | Increase MAX_EVENTS_BEHIND for replication clients
| * | changelogRichard van der Hoff2020-02-211-0/+1
| | |
| * | Increase MAX_EVENTS_BEHIND for replication clientsErik Johnston2020-02-211-1/+1
| | |
* | | Merge branch 'master' into developRichard van der Hoff2020-02-215-11/+25
|\ \ \ | |/ / |/| / | |/
| * 1.11.0 v1.11.0 github/release-v1.11.0 release-v1.11.0Richard van der Hoff2020-02-214-2/+16
| |
| * Small grammar fixes to the ACME v1 deprecation notice (#6944)Andrew Morgan2020-02-213-10/+10
| | | | | | Some small fixes to the copy in #6907.
* | Do not send alias events when creating / upgrading a room (#6941)Patrick Cloke2020-02-203-40/+16
| | | | | | Stop emitting room alias update events during room creation/upgrade.
* | don't insert into the device table for remote cross-signing keys (#6956)Hubert Chathi2020-02-202-15/+19
| |
* | Add some clarifications to README.md in the database schema directory. (#6615)Ruben Barkow-Kuder2020-02-202-8/+17
| | | | | | Signed-off-by: Ruben Barkow-Kuder <github@r.z11.de>
* | Minor perf fixes to `get_auth_chain_ids`.Erik Johnston2020-02-193-7/+6
| |
* | Freeze allocated objects on startup. (#6953)Erik Johnston2020-02-192-0/+10
| | | | | | | | | | This may make gc go a bit faster as the gc will know things like caches/data stores etc. are frozen without having to check.
* | Reduce auth chains fetched during v2 state res. (#6952)Erik Johnston2020-02-195-13/+39
|/ | | | | | The state res v2 algorithm only cares about the difference between auth chains, so we can pass in the known common state to the `get_auth_chain` storage function so that it can ignore those events.
* update changes.md v1.11.0rc1Richard van der Hoff2020-02-191-6/+5
|
* 1.11.0rc1Richard van der Hoff2020-02-1957-56/+74
|
* Revert `get_auth_chain_ids` changes (#6951)Erik Johnston2020-02-192-28/+1
|
* Merge pull request #6949 from matrix-org/rav/list_room_aliases_peekableRichard van der Hoff2020-02-1910-86/+97
|\ | | | | Make room alias lists peekable
| * changelogRichard van der Hoff2020-02-191-0/+1
| |
| * Make room alias lists peekableRichard van der Hoff2020-02-192-1/+20
| | | | | | | | | | | | As per https://github.com/matrix-org/matrix-doc/pull/2432#pullrequestreview-360566830, make room alias lists accessible to users outside world_readable rooms.
| * Add `allow_departed_users` param to `check_in_room_or_world_readable`Richard van der Hoff2020-02-195-15/+33
| | | | | | | | | | | | | | ... and set it everywhere it's called. while we're here, rename it for consistency with `check_user_in_room` (and to help check that I haven't missed any instances)
| * Refactor the membership check methods in AuthRichard van der Hoff2020-02-184-73/+46
| | | | | | | | | | these were getting a bit unwieldy, so let's combine `check_joined_room` and `check_user_was_in_room` into a single `check_user_in_room`.
* | Merge pull request #6940 from matrix-org/babolivier/federate.mdBrendan Abolivier2020-02-194-153/+127
|\ \ | | | | | | Clean up and update federation docs
| * | Incorporate reviewBrendan Abolivier2020-02-192-12/+13
| | |
| * | Incorporate reviewBrendan Abolivier2020-02-182-21/+17
| | |
| * | PhrasingBrendan Abolivier2020-02-181-1/+1
| | |
| * | ChangelogBrendan Abolivier2020-02-181-0/+1
| | |
| * | Add mention of SRV records as an advanced topicBrendan Abolivier2020-02-181-0/+10
| | |
| * | Argh trailing spacesBrendan Abolivier2020-02-181-2/+2
| | |
| * | Fix links in the reverse proxy docBrendan Abolivier2020-02-181-3/+4
| | |
| * | Make federate.md more of a sumary of the steps to follow to set up replicationBrendan Abolivier2020-02-181-17/+28
| | |
| * | Split the delegating documentation out of federate.md and trim it downBrendan Abolivier2020-02-182-133/+87
| | |
* | | Move MSC2432 stuff onto unstable prefix (#6948)Richard van der Hoff2020-02-194-4/+23
| | | | | | | | | it's not in the spec yet, so needs to be unstable. Also add a feature flag for it. Also add a test for admin users.
* | | Tiny optimisation for _get_handler_for_request (#6950)Richard van der Hoff2020-02-192-1/+4
| | | | | | | | | | | | we have hundreds of path_regexes (see #5118), so let's not convert the same bytes to str for each of them.
* | | Increase DB/CPU perf of `_is_server_still_joined` check. (#6936)Erik Johnston2020-02-193-15/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Increase DB/CPU perf of `_is_server_still_joined` check. For rooms with large amount of state a single user leaving could cause us to go and load a lot of membership events and then pull out membership state in a large number of batches. * Newsfile * Update synapse/storage/persist_events.py Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> * Fix adding if too soon * Update docstring * Review comments * Woops typo Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
* | | Merge pull request #6945 from matrix-org/babolivier/fix-retention-debug-logBrendan Abolivier2020-02-192-1/+2
|\ \ \ | | | | | | | | Fix log in message retention purge jobs
| * | | Update changelog.d/6945.bugfixBrendan Abolivier2020-02-191-1/+1
| | | | | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | | ChangelogBrendan Abolivier2020-02-181-0/+1
| | | |
| * | | Fix log in message retention purge jobsBrendan Abolivier2020-02-181-1/+1
| | | |
* | | | Limit size of get_auth_chain_ids query (#6947)Erik Johnston2020-02-192-18/+24
| |_|/ |/| |
* | | Implement GET /_matrix/client/r0/rooms/{roomId}/aliases (#6939)Richard van der Hoff2020-02-185-11/+128
| | | | | | | | | | | | | | | per matrix-org/matrix-doc#2432
* | | Merge pull request #6872 from matrix-org/rav/dictpropertyRichard van der Hoff2020-02-183-82/+120
|\ \ \ | | | | | | | | Rewrite _EventInternalMetadata to back it with a dict
| * | | changelogRichard van der Hoff2020-02-141-0/+1
| | | |
| * | | Rewrite _EventInternalMetadata to back it with a _dictRichard van der Hoff2020-02-141-16/+39
| | | | | | | | | | | | | | | | Mostly, this gives mypy an easier time.
| * | | Replace _event_dict_property with DictPropertyRichard van der Hoff2020-02-142-66/+80
| | | | | | | | | | | | | | | | | | | | this amounts to the same thing, but replaces `_event_dict` with `_dict`, and removes some of the function layers generated by `property`.
* | | | Merge pull request #6907 from matrix-org/babolivier/acme-configBrendan Abolivier2020-02-184-1/+40
|\ \ \ \ | |_|/ / |/| | | Add mention and warning about ACME v1 deprecation to the TLS config
| * | | Make the log more noticeableBrendan Abolivier2020-02-181-1/+2
| | | |
| * | | Print the error as an error log and raise the same exception we gotBrendan Abolivier2020-02-181-9/+10
| | | |
| * | | Linters are hard but in they end they just want what's best for usBrendan Abolivier2020-02-131-1/+1
| | | |
| * | | LintBrendan Abolivier2020-02-131-6/+7
| | | |
| * | | ChangelogBrendan Abolivier2020-02-131-0/+1
| | | |
| * | | LintBrendan Abolivier2020-02-131-7/+6
| | | |
| * | | Add a separator for the config warningBrendan Abolivier2020-02-131-1/+1
| | | |
| * | | Add a comprehensive error when failing to register for an ACME accountBrendan Abolivier2020-02-131-1/+13
| | | |
| * | | Add mention and warning about ACME v1 deprecation to the Synapse configBrendan Abolivier2020-02-132-0/+24
| | | |
* | | | Increase perf of `get_auth_chain_ids` used in state res v2. (#6937)Erik Johnston2020-02-182-0/+24
| | | | | | | | | | | | We do this by moving the recursive query to be fully in the DB.
* | | | Fix worker docs to point `/publicised_groups` API correctly. (#6938)Erik Johnston2020-02-182-3/+5
| | | |
* | | | Merge pull request #6909 from matrix-org/babolivier/acme-installBrendan Abolivier2020-02-182-11/+18
|\ \ \ \ | | | | | | | | | | Update INSTALL.md to recommend reverse proxying and warn about ACMEv1 deprecation
| * | | | Update INSTALL.mdBrendan Abolivier2020-02-131-1/+3
| | | | | | | | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | | | ChangelogBrendan Abolivier2020-02-131-0/+1
| | | | |
| * | | | Update INSTALL.md to recommend reverse proxying and warn about ACMEv1 ↵Brendan Abolivier2020-02-131-11/+15
| | |_|/ | |/| | | | | | | | | | deprecation
* | | | Stop sending events when creating or deleting aliases (#6904)Patrick Cloke2020-02-184-42/+194
| | | | | | | | | | | | Stop sending events when creating or deleting associations (room aliases). Send an updated canonical alias event if one of the alt_aliases is deleted.
* | | | Kill off deprecated "config-on-the-fly" docker mode (#6918)Richard van der Hoff2020-02-183-40/+33
| | | | | | | | | | | | | | | | | | | | Lots of people seem to get confused by this mode, and it's been deprecated since Synapse 1.1.0. It's time for it to go.
* | | | #6924 has been released in 1.10.1Richard van der Hoff2020-02-171-1/+0
| | | |
* | | | Merge branch 'master' into developRichard van der Hoff2020-02-173-1/+16
|\ \ \ \
| * \ \ \ Merge branch 'release-v1.10.1'Richard van der Hoff2020-02-174-3/+21
| |\ \ \ \
| | * | | | 1.10.1 v1.10.1 github/release-v1.10.1 release-v1.10.1Richard van der Hoff2020-02-174-2/+16
| | | | | |
| | * | | | wait for current_state_events_membership before ↵Richard van der Hoff2020-02-172-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | delete_old_current_state_events (#6924)
* | | | | | Raise the default power levels for invites, tombstones and server acls (#6834)Andrew Morgan2020-02-173-2/+13
| | | | | |
* | | | | | wait for current_state_events_membership before ↵Richard van der Hoff2020-02-172-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | delete_old_current_state_events (#6924)
* | | | | | Add type hints to the spam check module (#6915)Patrick Cloke2020-02-144-22/+36
| | | | | | | | | | | | | | | | | | | | | | | | Add typing information to the spam checker modules.
* | | | | | contrib/docker: Ensure correct encoding and locale settings on DB creation ↵Fridtjof Mund2020-02-142-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (#6921) Signed-off-by: Fridtjof Mund <fridtjof@das-labor.org>
* | | | | | Add a warning about indentation to generated config (#6920)Richard van der Hoff2020-02-144-4/+29
| | | | | | | | | | | | | | | | | | Fixes #6916.
* | | | | | Convert the directory handler tests to use HomeserverTestCase (#6919)Patrick Cloke2020-02-142-24/+18
| |_|_|_|/ |/| | | | | | | | | Convert directory handler tests to use HomeserverTestCase.
* | | | | Filter the results of user directory searching via the spam checker (#6888)Patrick Cloke2020-02-145-2/+135
| |_|/ / |/| | | | | | | Add a method to the spam checker to filter the user directory results.
* | | | Update changelog for #6905 to group it with upcoming PRsBrendan Abolivier2020-02-131-1/+1
| | | |
* | | | Add documentation for the spam checker module (#6906)Patrick Cloke2020-02-132-0/+86
| | | | | | | | | | | | Add documentation for the spam checker.
* | | | Merge pull request #6905 from matrix-org/babolivier/acme.mdBrendan Abolivier2020-02-132-12/+44
|\ \ \ \ | | | | | | | | | | Update ACME.md to mention ACME v1 deprecation
| * | | | Update docs/ACME.mdBrendan Abolivier2020-02-131-1/+1
| | | | |
| * | | | Mention that using Synapse to serve certificates requires restartsBrendan Abolivier2020-02-121-1/+3
| | | | |
| * | | | ChangelogBrendan Abolivier2020-02-121-0/+1
| | | | |
| * | | | Remove duplicated info about certbot et alBrendan Abolivier2020-02-121-5/+0
| | | | |
| * | | | Update ACME.md to mention ACME v1 deprecationBrendan Abolivier2020-02-121-7/+41
| | |_|/ | |/| |
* / | | Remove m.lazy_load_members from unstable features since it is in CS r0.5.0 ↵Aaron Raimist2020-02-132-1/+1
|/ / / | | | | | | | | | | | | | | | | | | (#6877) Fixes #5528
* | | Merge pull request #6891 from matrix-org/babolivier/retention-doc-amendBrendan Abolivier2020-02-123-0/+8
|\ \ \ | | | | | | | | Spell out that the last event sent to a room won't be deleted by a purge
| * | | RephraseBrendan Abolivier2020-02-122-5/+5
| | | |
| * | | Update the changelog fileBrendan Abolivier2020-02-111-1/+1
| | | |
| * | | Also spell it out in the purge history API docBrendan Abolivier2020-02-111-0/+3
| | | |
| * | | ChangelogBrendan Abolivier2020-02-111-0/+1
| | | |
| * | | Spell out that Synapse never purges the last event sent in a roomBrendan Abolivier2020-02-111-0/+4
| | | |
* | | | Return a 404 for admin api user lookup if user not found (#6901)Andrew Morgan2020-02-123-1/+21
| | | |
* | | | Merge branch 'master' into developBrendan Abolivier2020-02-125-6/+21
|\ \ \ \ | | |/ / | |/| |
| * | | Merge tag 'v1.10.0'Brendan Abolivier2020-02-1287-520/+1795
| |\ \ \ | | | |/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.10.0 (2020-02-12) =========================== **WARNING to client developers**: As of this release Synapse validates `client_secret` parameters in the Client-Server API as per the spec. See [\#6766](https://github.com/matrix-org/synapse/issues/6766) for details. Updates to the Docker image --------------------------- - Update the docker images to Alpine Linux 3.11. ([\#6897](https://github.com/matrix-org/synapse/issues/6897)) Synapse 1.10.0rc5 (2020-02-11) ============================== Bugfixes -------- - Fix the filtering introduced in 1.10.0rc3 to also apply to the state blocks returned by `/sync`. ([\#6884](https://github.com/matrix-org/synapse/issues/6884)) Synapse 1.10.0rc4 (2020-02-11) ============================== This release candidate was built incorrectly and is superceded by 1.10.0rc5. Synapse 1.10.0rc3 (2020-02-10) ============================== Features -------- - Filter out `m.room.aliases` from the CS API to mitigate abuse while a better solution is specced. ([\#6878](https://github.com/matrix-org/synapse/issues/6878)) Internal Changes ---------------- - Fix continuous integration failures with old versions of `pip`, which were introduced by a release of the `zipp` library. ([\#6880](https://github.com/matrix-org/synapse/issues/6880)) Synapse 1.10.0rc2 (2020-02-06) ============================== Bugfixes -------- - Fix an issue with cross-signing where device signatures were not sent to remote servers. ([\#6844](https://github.com/matrix-org/synapse/issues/6844)) - Fix to the unknown remote device detection which was introduced in 1.10.rc1. ([\#6848](https://github.com/matrix-org/synapse/issues/6848)) Internal Changes ---------------- - Detect unexpected sender keys on remote encrypted events and resync device lists. ([\#6850](https://github.com/matrix-org/synapse/issues/6850)) Synapse 1.10.0rc1 (2020-01-31) ============================== Features -------- - Add experimental support for updated authorization rules for aliases events, from [MSC2260](https://github.com/matrix-org/matrix-doc/pull/2260). ([\#6787](https://github.com/matrix-org/synapse/issues/6787), [\#6790](https://github.com/matrix-org/synapse/issues/6790), [\#6794](https://github.com/matrix-org/synapse/issues/6794)) Bugfixes -------- - Warn if postgres database has a non-C locale, as that can cause issues when upgrading locales (e.g. due to upgrading OS). ([\#6734](https://github.com/matrix-org/synapse/issues/6734)) - Minor fixes to `PUT /_synapse/admin/v2/users` admin api. ([\#6761](https://github.com/matrix-org/synapse/issues/6761)) - Validate `client_secret` parameter using the regex provided by the Client-Server API, temporarily allowing `:` characters for older clients. The `:` character will be removed in a future release. ([\#6767](https://github.com/matrix-org/synapse/issues/6767)) - Fix persisting redaction events that have been redacted (or otherwise don't have a redacts key). ([\#6771](https://github.com/matrix-org/synapse/issues/6771)) - Fix outbound federation request metrics. ([\#6795](https://github.com/matrix-org/synapse/issues/6795)) - Fix bug where querying a remote user's device keys that weren't cached resulted in only returning a single device. ([\#6796](https://github.com/matrix-org/synapse/issues/6796)) - Fix race in federation sender worker that delayed sending of device updates. ([\#6799](https://github.com/matrix-org/synapse/issues/6799), [\#6800](https://github.com/matrix-org/synapse/issues/6800)) - Fix bug where Synapse didn't invalidate cache of remote users' devices when Synapse left a room. ([\#6801](https://github.com/matrix-org/synapse/issues/6801)) - Fix waking up other workers when remote server is detected to have come back online. ([\#6811](https://github.com/matrix-org/synapse/issues/6811)) Improved Documentation ---------------------- - Clarify documentation related to `user_dir` and `federation_reader` workers. ([\#6775](https://github.com/matrix-org/synapse/issues/6775)) Internal Changes ---------------- - Record room versions in the `rooms` table. ([\#6729](https://github.com/matrix-org/synapse/issues/6729), [\#6788](https://github.com/matrix-org/synapse/issues/6788), [\#6810](https://github.com/matrix-org/synapse/issues/6810)) - Propagate cache invalidates from workers to other workers. ([\#6748](https://github.com/matrix-org/synapse/issues/6748)) - Remove some unnecessary admin handler abstraction methods. ([\#6751](https://github.com/matrix-org/synapse/issues/6751)) - Add some debugging for media storage providers. ([\#6757](https://github.com/matrix-org/synapse/issues/6757)) - Detect unknown remote devices and mark cache as stale. ([\#6776](https://github.com/matrix-org/synapse/issues/6776), [\#6819](https://github.com/matrix-org/synapse/issues/6819)) - Attempt to resync remote users' devices when detected as stale. ([\#6786](https://github.com/matrix-org/synapse/issues/6786)) - Delete current state from the database when server leaves a room. ([\#6792](https://github.com/matrix-org/synapse/issues/6792)) - When a client asks for a remote user's device keys check if the local cache for that user has been marked as potentially stale. ([\#6797](https://github.com/matrix-org/synapse/issues/6797)) - Add background update to clean out left rooms from current state. ([\#6802](https://github.com/matrix-org/synapse/issues/6802), [\#6816](https://github.com/matrix-org/synapse/issues/6816)) - Refactoring work in preparation for changing the event redaction algorithm. ([\#6803](https://github.com/matrix-org/synapse/issues/6803), [\#6805](https://github.com/matrix-org/synapse/issues/6805), [\#6806](https://github.com/matrix-org/synapse/issues/6806), [\#6807](https://github.com/matrix-org/synapse/issues/6807), [\#6820](https://github.com/matrix-org/synapse/issues/6820))
| | * | Move the warning at the top of the release changes v1.10.0 github/release-v1.10.0 release-v1.10.0Brendan Abolivier2020-02-121-3/+2
| | | |
| | * | 1.10.0Brendan Abolivier2020-02-124-2/+16
| | | |
| | * | bump the version of Alpine Linux used in the docker images (#6897)Richard van der Hoff2020-02-122-1/+2
| | | |
| * | | Update documentation (#6859)Robin Vleij2020-02-051-1/+2
| | | | | | | | | | | | | | | | Update documentation to reflect the correct format of user_id (fully qualified).
* | | | Use BSD-compatible in-place editing for sed. (#6887)Patrick Cloke2020-02-122-1/+3
| |_|/ |/| |
* | | Merge branch 'release-v1.10.0' into developRichard van der Hoff2020-02-112-5/+9
|\ \ \ | | |/ | |/|
| * | 1.10.0rc5 v1.10.0rc5Richard van der Hoff2020-02-112-2/+6
| | |
| * | changelog wordingRichard van der Hoff2020-02-111-2/+2
| | |
| * | Update CHANGES.mdRichard van der Hoff2020-02-111-1/+1
| | |
| * | changelog formattingRichard van der Hoff2020-02-111-2/+2
| | |
* | | Merge branch 'release-v1.10.0' into developRichard van der Hoff2020-02-113-1/+11
|\| |
| * | 1.10.0rc4Richard van der Hoff2020-02-113-2/+10
| | |
| * | filter out m.room.aliases from /sync state blocks (#6884)Matthew Hodgson2020-02-102-0/+2
| | | | | | | | | We forgot to filter out aliases from /sync state blocks as well as the timeline.
* | | Reject device display names that are too long (#6882)Patrick Cloke2020-02-103-1/+32
| | | | | | | | | | | | | | | | | | | | | | | | * Reject device display names that are too long. Too long is currently defined as 100 characters in length. * Add a regression test for rejecting a too long device display name.
* | | Add an additional test to the SyTest blacklist for worker mode. (#6883)Patrick Cloke2020-02-102-0/+3
| | |
* | | Merge tag 'v1.10.0rc3' into developRichard van der Hoff2020-02-104-2/+23
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.10.0rc3 (2020-02-10) ============================== Features -------- - Filter out m.room.aliases from the CS API to mitigate abuse while a better solution is specced. ([\#6878](https://github.com/matrix-org/synapse/issues/6878)) Internal Changes ---------------- - Fix continuous integration failures with old versions of `pip`, which were introduced by a release of the `zipp` library. ([\#6880](https://github.com/matrix-org/synapse/issues/6880))
| * | 1.10.0rc3 v1.10.0rc3Richard van der Hoff2020-02-104-3/+16
| | |
| * | filter out m.room.aliases from the CS API until a better solution is specced ↵Matthew Hodgson2020-02-102-0/+8
| | | | | | | | | | | | | | | (#6878) We're in the middle of properly mitigating spam caused by malicious aliases being added to a room. However, until this work fully lands, we temporarily filter out all m.room.aliases events from /sync and /messages on the CS API, to remove abusive aliases. This is considered acceptable as m.room.aliases events were never a reliable record of the given alias->id mapping and were purely informational, and in their current state do more harm than good.
* | | Merge remote-tracking branch 'origin/release-v1.10.0' into developRichard van der Hoff2020-02-102-0/+19
|\| |
| * | Update setuptools for python 3.5 tests (#6880)Richard van der Hoff2020-02-102-0/+19
| | | | | | | | | Workaround for jaraco/zipp#40
* | | Add support for putting fed user query API on workers (#6873)Erik Johnston2020-02-075-21/+25
| | |
* | | Remove unused `get_room_stats_state` method. (#6869)Richard van der Hoff2020-02-072-25/+1
| | |
* | | Add a `make_event_from_dict` method (#6858)Richard van der Hoff2020-02-0713-39/+52
| | | | | | | | | | | | | | | | | | | | | ... and use it in places where it's trivial to do so. This will make it easier to pass room versions into the FrozenEvent constructors.
* | | Add typing to synapse.federation.sender (#6871)Erik Johnston2020-02-079-107/+138
| | |
* | | Allow moving group read APIs to workers (#6866)Erik Johnston2020-02-079-687/+722
| | |
* | | Admin api to add an email address (#6789)Dirk Klimpel2020-02-076-2/+78
| | |
* | | remove unused room_version_to_event_format (#6857)Richard van der Hoff2020-02-072-23/+2
| | |
* | | Merge pull request #6856 from matrix-org/rav/redact_changes/6Richard van der Hoff2020-02-075-60/+51
|\ \ \ | | | | | | | | Pass room_version into `event_from_pdu_json`