summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* Merge tag 'v1.43.0' into babolivier/dinsic_1.48.0Brendan Abolivier2021-12-06185-2480/+4208
|\
| * Fix typo again v1.43.0David Robertson2021-09-211-1/+1
| |
| * Specify MSC name; fix typoDavid Robertson2021-09-211-3/+3
| | | | | | one day I'll learn how to spell hierarchy
| * Point to upgrade notesDavid Robertson2021-09-211-0/+2
| |
| * Move deprecation notice from 1.43 rc to releaseDavid Robertson2021-09-211-3/+2
| |
| * 1.43.0David Robertson2021-09-213-1/+13
| |
| * Add hyperlink to #9424 in changelog v1.43.0rc2David Robertson2021-09-171-1/+1
| |
| * 1.43.0rc2David Robertson2021-09-174-2/+16
| |
| * Cleanup opentracing logging for syncs (#10828)Erik Johnston2021-09-152-126/+142
| | | | | | | | | | We added a bunch of spans in #10704, but this ended up adding a lot of redundant spans for rooms where nothing changed, so instead we only start the span if there might be something interesting going on.
| * update changelog wording v1.43.0rc1Andrew Morgan2021-09-141-7/+7
| |
| * changelog improvementsAndrew Morgan2021-09-141-3/+3
| |
| * update changelog wordingAndrew Morgan2021-09-141-1/+1
| |
| * update wordingAndrew Morgan2021-09-141-1/+1
| |
| * 1.43.0rc1Andrew Morgan2021-09-1454-52/+76
| |
| * Use direct references for some configuration variables (#10798)Patrick Cloke2021-09-1366-133/+152
| | | | | | | | Instead of proxying through the magic getter of the RootConfig object. This should be more performant (and is more explicit).
| * Fix copy-paste error in the password section of the sample-config. (#10804)BramvdnHeuvel2021-09-133-2/+3
| |
| * Use the BaseReporter super-class for _WrappedRustReporter. (#10799)Patrick Cloke2021-09-132-1/+12
| | | | | | | | This fixes mypy errors with jaeger-client >= 4.7.0 and should be a no-op for versions before that.
| * Add types to synapse.util. (#10601)reivilibre2021-09-1041-254/+401
| |
| * Fix 2 typos in docs/log_contexts.md (#10795)reivilibre2021-09-102-2/+3
| |
| * Handle room upgrades for spaces (#10774)Patrick Cloke2021-09-103-6/+81
| | | | | | | | | | By copying the `room_type` field of the create event and migrating any non-empty `m.space.child` events to the new room that is created.
| * Easy refactors of the user directory (#10789)David Robertson2021-09-108-37/+90
| | | | | | No functional changes here. This came out as I was working to tackle #5677
| * Remove fixed and flakey tests from the sytest blacklist (#10788)David Robertson2021-09-103-18/+2
| | | | | | We want to blacklist only known, consistent failures. We should deflake tests rather than ignoring them.
| * Ask consent on SSO registration with default mxid (#10733)AndrewFerr2021-09-103-23/+63
| | | | | | | | | | | | Fixes #10732: consent flow skipped during SSO user registration if username is left at default Signed-off-by: Andrew Ferrazzutti fair@miscworks.net
| * Don't needlessly batch in `add_event_to_cache` (#10784)Erik Johnston2021-09-102-27/+25
| | | | | | | | | | We've already batched up the events previously, and assume in other places in the events.py file that we have. Removing this makes it easier to adjust the batch sizes in one place.
| * Remove unstable MSC2858 API, including `experimental.msc2858_enabled` config ↵Sean2021-09-099-127/+19
| | | | | | | | | | option (#10693) Signed-off-by: Sean Quah <seanq@element.io>
| * Prefer room v9 for restricted rooms. (#10772)Patrick Cloke2021-09-092-1/+2
| | | | | | | | | | Hint to clients via the room capabilities API (MSC3244) that room version 9 should be preferred for creating a room with restricted join rules (instead of room version 8).
| * Get rid of `_auth_and_persist_event` (#10781)Richard van der Hoff2021-09-083-63/+43
| | | | | | This is only called in two places, and the code seems much clearer without it.
| * Improve the modules doc (#10758)Brendan Abolivier2021-09-0810-404/+537
| | | | | | | | | | | | * Split up the documentation in several files rather than one huge one * Add examples for each callback category * Other niceties like fixing https://github.com/matrix-org/synapse/issues/10632 * Add titles to callbacks so they're easier to find in the navigation panels and link to
| * Fix frontend_proxy jinja script in docker workers (#10783)kegsay2021-09-082-1/+2
| |
| * Add a script to update the debian changelog for non-Debian systems (#10778)Brendan Abolivier2021-09-082-0/+65
| | | | | | When releasing 1.42.0 with @Azrenbeth and talking with @clokep yesterday I realised doing the dch incantations related to releasing Synapse wasn't trivial on eg a macOS system, so this is a script to run in a Debian container to make things a bit easier.
| * Document that /spaces & /hierarchy can be routed to workers. (#10648)Patrick Cloke2021-09-084-25/+33
| | | | | | Also refactors some of the registration of endpoints on workers.
| * Skip handling of push actions for outlier events (#10780)Erik Johnston2021-09-083-4/+19
| | | | | | | | Outlier events don't ever have push actions associated with them, so we can skip some expensive queries during event persistence.
| * Add a constant for m.federate. (#10775)Patrick Cloke2021-09-088-10/+28
| |
| * Change logging of puppeted requests to better differentiate users (#10779)Erik Johnston2021-09-082-1/+2
| | | | | | This used to be a comma and got accidentally changed to a period in #9654, but a pipe character is more easier to parse visually.
| * Request JSON for oEmbed requests (and ignore XML only providers). (#10759)Patrick Cloke2021-09-084-8/+98
| | | | | | | | | | | | | | | | This adds the format to the request arguments / URL to ensure that JSON data is returned (which is all that Synapse supports). This also adds additional error checking / filtering to the configuration file to ignore XML-only providers.
| * Add some assertions about outliers (#10773)Richard van der Hoff2021-09-082-71/+78
| | | | | | | | I think I have finally teased apart the codepaths which handle outliers, and those that handle non-outliers. Let's add some assertions to demonstrate my newfound knowledge.
| * Persist auth events before the events that rely on them (#10771)Richard van der Hoff2021-09-082-36/+66
| | | | | | | | | | | | | | If we're persisting an event E which has auth_events A1, A2, then we ought to make sure that we correctly auth and persist A1 and A2, before we blindly accept E. This PR does part of that - it persists the auth events first - but it does not fully solve the problem, because we still don't check that the auth events weren't rejected.
| * Merge branch 'master' into developAzrenbeth2021-09-073-6/+15
| |\
| * | Use attrs internally for the URL preview code & add documentation. (#10753)Patrick Cloke2021-09-075-119/+132
| | |
| * | Return stripped m.space.child events via the space summary. (#10760)Patrick Cloke2021-09-072-14/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | The full event content cannot be trusted from this API (as no auth chain, etc.) is processed over federation. Returning the full event content was a bug as MSC2946 specifies that only the stripped state should be returned. This also avoids calculating aggregations / annotations which go unused.
| * | Underscore-prefix private fields in `FederationEventHandler` (#10746)Richard van der Hoff2021-09-072-71/+74
| | |
| * | Merge tag 'v1.42.0rc2' into developBrendan Abolivier2021-09-069-4/+145
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.42.0rc2 (2021-09-06) ============================== This version of Synapse removes deprecated room-management admin APIs, removes out-of-date email pushers, and improves error handling for fallback templates for user-interactive authentication. For more information on these points, server administrators are encouraged to read [the upgrade notes](docs/upgrade.md#upgrading-to-v1420). Features -------- - Support room version 9 from [MSC3375](https://github.com/matrix-org/matrix-doc/pull/3375). ([\#10747](https://github.com/matrix-org/synapse/issues/10747)) Internal Changes ---------------- - Print a warning when using one of the deprecated `template_dir` settings. ([\#10768](https://github.com/matrix-org/synapse/issues/10768))
| * | | Add logging to help debug #9424 (#10704)Azrenbeth2021-09-062-13/+55
| | | |
| * | | Add config option to use non-default manhole password and keys (#10643)Azrenbeth2021-09-069-17/+161
| | | |
| * | | Stop using BaseHandler in `FederationEventHandler` (#10745)Richard van der Hoff2021-09-063-10/+12
| | | | | | | | | | | | | | | | It's now only used in a couple of places, so we can drop it altogether.
| * | | Allow `room_alias_name` parameter to be handled by /createRoom calls on ↵Andrew Morgan2021-09-062-2/+3
| | | | | | | | | | | | | | | | workers (#10757)
| * | | Ease searching for M_TOO_LARGE-related error codes (#10750)Andrew Morgan2021-09-062-9/+7
| | | |
| * | | Doc: Clarifying undoing room shutdowns (#10480)David Teller2021-09-062-15/+28
| | | |
| * | | Move `maybe_kick_guest_users` out of `BaseHandler` (#10744)Richard van der Hoff2021-09-069-85/+125
| | | | | | | | | | | | This is part of my ongoing war against BaseHandler. I've moved kick_guest_users into RoomMemberHandler (since it calls out to that handler anyway), and split maybe_kick_guest_users into the two places it is called.
| * | | Pull out encrypted_by_default tests from user_directory tests (#10752)David Robertson2021-09-064-95/+111
| | | |
| * | | Speed up persisting redacted events (#10756)Erik Johnston2021-09-062-11/+12
| | | |
| * | | Allow room creator to send MSC2716 related events in existing room versions ↵Eric Eastwood2021-09-044-10/+61
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (#10566) * Allow room creator to send MSC2716 related events in existing room versions Discussed at https://github.com/matrix-org/matrix-doc/pull/2716/#discussion_r682474869 Restoring `get_create_event_for_room_txn` from, https://github.com/matrix-org/synapse/pull/10245/commits/44bb3f0cf5cb365ef9281554daceeecfb17cc94d * Add changelog * Stop people from trying to redact MSC2716 events in unsupported room versions * Populate rooms.creator column for easy lookup > From some [out of band discussion](https://matrix.to/#/!UytJQHLQYfvYWsGrGY:jki.re/$p2fKESoFst038x6pOOmsY0C49S2gLKMr0jhNMz_JJz0?via=jki.re&via=matrix.org), my plan is to use `rooms.creator`. But currently, we don't fill in `creator` for remote rooms when a user is invited to a room for example. So we need to add some code to fill in `creator` wherever we add to the `rooms` table. And also add a background update to fill in the rows missing `creator` (we can use the same logic that `get_create_event_for_room_txn` is doing by looking in the state events to get the `creator`). > > https://github.com/matrix-org/synapse/pull/10566#issuecomment-901616642 * Remove and switch away from get_create_event_for_room_txn * Fix no create event being found because no state events persisted yet * Fix and add tests for rooms creator bg update * Populate rooms.creator field for easy lookup Part of https://github.com/matrix-org/synapse/pull/10566 - Fill in creator whenever we insert into the rooms table - Add background update to backfill any missing creator values * Add changelog * Fix usage * Remove extra delta already included in #10697 * Don't worry about setting creator for invite * Only iterate over rows missing the creator See https://github.com/matrix-org/synapse/pull/10697#discussion_r695940898 * Use constant to fetch room creator field See https://github.com/matrix-org/synapse/pull/10697#discussion_r696803029 * More protection from other random types See https://github.com/matrix-org/synapse/pull/10697#discussion_r696806853 * Move new background update to end of list See https://github.com/matrix-org/synapse/pull/10697#discussion_r696814181 * Fix query casing * Fix ambiguity iterating over cursor instead of list Fix `psycopg2.ProgrammingError: no results to fetch` error when tests run with Postgres. ``` SYNAPSE_POSTGRES=1 SYNAPSE_TEST_LOG_LEVEL=INFO python -m twisted.trial tests.storage.databases.main.test_room ``` --- We use `txn.fetchall` because it will return the results as a list or an empty list when there are no results. Docs: > `cursor` objects are iterable, so, instead of calling explicitly fetchone() in a loop, the object itself can be used: > > https://www.psycopg.org/docs/cursor.html#cursor-iterable And I'm guessing iterating over a raw cursor does something weird when there are no results. --- Test CI failure: https://github.com/matrix-org/synapse/pull/10697/checks?check_run_id=3468916530 ``` tests.test_visibility.FilterEventsForServerTestCase.test_large_room =============================================================================== [FAIL] Traceback (most recent call last): File "/home/runner/work/synapse/synapse/tests/storage/databases/main/test_room.py", line 85, in test_background_populate_rooms_creator_column self.get_success( File "/home/runner/work/synapse/synapse/tests/unittest.py", line 500, in get_success return self.successResultOf(d) File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/trial/_synctest.py", line 700, in successResultOf self.fail( twisted.trial.unittest.FailTest: Success result expected on <Deferred at 0x7f4022f3eb50 current result: None>, found failure result instead: Traceback (most recent call last): File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/internet/defer.py", line 701, in errback self._startRunCallbacks(fail) File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/internet/defer.py", line 764, in _startRunCallbacks self._runCallbacks() File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/internet/defer.py", line 858, in _runCallbacks current.result = callback( # type: ignore[misc] File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/internet/defer.py", line 1751, in gotResult current_context.run(_inlineCallbacks, r, gen, status) --- <exception caught here> --- File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/internet/defer.py", line 1657, in _inlineCallbacks result = current_context.run( File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/python/failure.py", line 500, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/home/runner/work/synapse/synapse/synapse/storage/background_updates.py", line 224, in do_next_background_update await self._do_background_update(desired_duration_ms) File "/home/runner/work/synapse/synapse/synapse/storage/background_updates.py", line 261, in _do_background_update items_updated = await update_handler(progress, batch_size) File "/home/runner/work/synapse/synapse/synapse/storage/databases/main/room.py", line 1399, in _background_populate_rooms_creator_column end = await self.db_pool.runInteraction( File "/home/runner/work/synapse/synapse/synapse/storage/database.py", line 686, in runInteraction result = await self.runWithConnection( File "/home/runner/work/synapse/synapse/synapse/storage/database.py", line 791, in runWithConnection return await make_deferred_yieldable( File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/internet/defer.py", line 858, in _runCallbacks current.result = callback( # type: ignore[misc] File "/home/runner/work/synapse/synapse/tests/server.py", line 425, in <lambda> d.addCallback(lambda x: function(*args, **kwargs)) File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/enterprise/adbapi.py", line 293, in _runWithConnection compat.reraise(excValue, excTraceback) File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/python/deprecate.py", line 298, in deprecatedFunction return function(*args, **kwargs) File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/python/compat.py", line 404, in reraise raise exception.with_traceback(traceback) File "/home/runner/work/synapse/synapse/.tox/py/lib/python3.9/site-packages/twisted/enterprise/adbapi.py", line 284, in _runWithConnection result = func(conn, *args, **kw) File "/home/runner/work/synapse/synapse/synapse/storage/database.py", line 786, in inner_func return func(db_conn, *args, **kwargs) File "/home/runner/work/synapse/synapse/synapse/storage/database.py", line 554, in new_transaction r = func(cursor, *args, **kwargs) File "/home/runner/work/synapse/synapse/synapse/storage/databases/main/room.py", line 1375, in _background_populate_rooms_creator_column_txn for room_id, event_json in txn: psycopg2.ProgrammingError: no results to fetch ``` * Move code not under the MSC2716 room version underneath an experimental config option See https://github.com/matrix-org/synapse/pull/10566#issuecomment-906437909 * Add ordering to rooms creator background update See https://github.com/matrix-org/synapse/pull/10697#discussion_r696815277 * Add comment to better document constant See https://github.com/matrix-org/synapse/pull/10697#discussion_r699674458 * Use constant field
| * | | Speed up MultiWriterIdGenerator when lots of IDs are in flight. (#10755)Erik Johnston2021-09-034-2/+124
| | | |
| * | | Add a partial index to `presence_stream` to speed up startups (#10748)Sean2021-09-034-1/+43
| | | | | | | | | | | | Signed-off-by: Sean Quah <seanq@element.io>
| * | | Use `execute_values` more in PostgreSQL (#10754)Erik Johnston2021-09-032-19/+43
| | | | | | | | | | | | `execute_values` is a faster version of `execute_batch`.
| * | | Raise an error if an unknown preset is used to create a room. (#10738)Patrick Cloke2021-09-032-1/+7
| | | | | | | | | | | | | | | | Raises a 400 error instead of a 500 if an unknown preset is passed from a client to create a room.
| * | | Additional type hints for client REST servlets (part 5) (#10736)Patrick Cloke2021-09-038-68/+146
| | | | | | | | | | | | | | | | Additionally this enforce type hints on all function signatures inside of the synapse.rest.client package.
| * | | Fix bug with reusing 'txn' when persisting event. (#10743)Erik Johnston2021-09-032-1/+8
| | | | | | | | | | | | | | | | This will only happen when a server has multiple out of band membership events in a single room.
| * | | Fix documentation of directory name for remote thumbnails (#10556)cuttingedge11092021-09-022-1/+2
| | | |
| * | | Ignore rooms with unknown room versions in the spaces summary. (#10727)Patrick Cloke2021-09-013-2/+40
| | | | | | | | | | | | | | | | This avoids breaking the entire endpoint if a room with an unsupported room version is encountered.
| * | | Consider the `origin_server_ts` of the `m.space.child` event when ordering ↵Patrick Cloke2021-09-013-12/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | rooms. (#10730) This updates the ordering of the returned events from the spaces summary API to that defined in MSC2946 (which updates MSC1772). Previously a step was skipped causing ordering to be inconsistent with clients.
| * | | Additional type hints for client REST servlets (part 4) (#10728)Patrick Cloke2021-09-019-100/+145
| | | |
| * | | Populate `rooms.creator` field for easy lookup (#10697)Eric Eastwood2021-09-016-4/+213
| | | | | | | | | | | | | | | | | | | | | | | | Part of https://github.com/matrix-org/synapse/pull/10566 - Fill in creator whenever we insert into the rooms table - Add background update to backfill any missing creator values
| * | | Merge tag 'v1.42.0rc1' into developOlivier Wilkinson (reivilibre)2021-09-0152-52/+123
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.42.0rc1 (2021-09-01) ============================== Server administrators are reminded to read [the upgrade notes](docs/upgrade.md#upgrading-to-v1420). Features -------- - Add support for [MSC3231](https://github.com/matrix-org/matrix-doc/pull/3231): Token authenticated registration. Users can be required to submit a token during registration to authenticate themselves. Contributed by Callum Brown. ([\#10142](https://github.com/matrix-org/synapse/issues/10142)) - Add support for [MSC3283](https://github.com/matrix-org/matrix-doc/pull/3283): Expose `enable_set_displayname` in capabilities. ([\#10452](https://github.com/matrix-org/synapse/issues/10452)) - Port the `PresenceRouter` module interface to the new generic interface. ([\#10524](https://github.com/matrix-org/synapse/issues/10524)) - Add pagination to the spaces summary based on updates to [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946). ([\#10613](https://github.com/matrix-org/synapse/issues/10613), [\#10725](https://github.com/matrix-org/synapse/issues/10725)) Bugfixes -------- - Validate new `m.room.power_levels` events. Contributed by @aaronraimist. ([\#10232](https://github.com/matrix-org/synapse/issues/10232)) - Display an error on User-Interactive Authentication fallback pages when authentication fails. Contributed by Callum Brown. ([\#10561](https://github.com/matrix-org/synapse/issues/10561)) - Remove pushers when deleting an e-mail address from an account. Pushers for old unlinked emails will also be deleted. ([\#10581](https://github.com/matrix-org/synapse/issues/10581), [\#10734](https://github.com/matrix-org/synapse/issues/10734)) - Reject Client-Server `/keys/query` requests which provide `device_ids` incorrectly. ([\#10593](https://github.com/matrix-org/synapse/issues/10593)) - Rooms with unsupported room versions are no longer returned via `/sync`. ([\#10644](https://github.com/matrix-org/synapse/issues/10644)) - Enforce the maximum length for per-room display names and avatar URLs. ([\#10654](https://github.com/matrix-org/synapse/issues/10654)) - Fix a bug which caused the `synapse_user_logins_total` Prometheus metric not to be correctly initialised on restart. ([\#10677](https://github.com/matrix-org/synapse/issues/10677)) - Improve `ServerNoticeServlet` to avoid duplicate requests and add unit tests. ([\#10679](https://github.com/matrix-org/synapse/issues/10679)) - Fix long-standing issue which caused an error when a thumbnail is requested and there are multiple thumbnails with the same quality rating. ([\#10684](https://github.com/matrix-org/synapse/issues/10684)) - Fix a regression introduced in v1.41.0 which affected the performance of concurrent fetches of large sets of events, in extreme cases causing the process to hang. ([\#10703](https://github.com/matrix-org/synapse/issues/10703)) - Fix a regression introduced in Synapse 1.41 which broke email transmission on Systems using older versions of the Twisted library. ([\#10713](https://github.com/matrix-org/synapse/issues/10713)) Improved Documentation ---------------------- - Add documentation on how to connect Django with Synapse using OpenID Connect and django-oauth-toolkit. Contributed by @HugoDelval. ([\#10192](https://github.com/matrix-org/synapse/issues/10192)) - Advertise https://matrix-org.github.io/synapse documentation in the `README` and `CONTRIBUTING` files. ([\#10595](https://github.com/matrix-org/synapse/issues/10595)) - Fix some of the titles not rendering in the OpenID Connect documentation. ([\#10639](https://github.com/matrix-org/synapse/issues/10639)) - Minor clarifications to the documentation for reverse proxies. ([\#10708](https://github.com/matrix-org/synapse/issues/10708)) - Remove table of contents from the top of installation and contributing documentation pages. ([\#10711](https://github.com/matrix-org/synapse/issues/10711)) Deprecations and Removals ------------------------- - Remove deprecated Shutdown Room and Purge Room Admin API. ([\#8830](https://github.com/matrix-org/synapse/issues/8830)) Internal Changes ---------------- - Improve type hints for the proxy agent and SRV resolver modules. Contributed by @dklimpel. ([\#10608](https://github.com/matrix-org/synapse/issues/10608)) - Clean up some of the federation event authentication code for clarity. ([\#10614](https://github.com/matrix-org/synapse/issues/10614), [\#10615](https://github.com/matrix-org/synapse/issues/10615), [\#10624](https://github.com/matrix-org/synapse/issues/10624), [\#10640](https://github.com/matrix-org/synapse/issues/10640)) - Add a comment asking developers to leave a reason when bumping the database schema version. ([\#10621](https://github.com/matrix-org/synapse/issues/10621)) - Remove not needed database updates in modify user admin API. ([\#10627](https://github.com/matrix-org/synapse/issues/10627)) - Convert room member storage tuples to `attrs` classes. ([\#10629](https://github.com/matrix-org/synapse/issues/10629), [\#10642](https://github.com/matrix-org/synapse/issues/10642)) - Use auto-attribs for the attrs classes used in sync. ([\#10630](https://github.com/matrix-org/synapse/issues/10630)) - Make `backfill` and `get_missing_events` use the same codepath. ([\#10645](https://github.com/matrix-org/synapse/issues/10645)) - Improve the performance of the `/hierarchy` API (from [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946)) by caching responses received over federation. ([\#10647](https://github.com/matrix-org/synapse/issues/10647)) - Run a nightly CI build against Twisted trunk. ([\#10651](https://github.com/matrix-org/synapse/issues/10651), [\#10672](https://github.com/matrix-org/synapse/issues/10672)) - Do not print out stack traces for network errors when fetching data over federation. ([\#10662](https://github.com/matrix-org/synapse/issues/10662)) - Simplify tests for device admin rest API. ([\#10664](https://github.com/matrix-org/synapse/issues/10664)) - Add missing type hints to REST servlets. ([\#10665](https://github.com/matrix-org/synapse/issues/10665), [\#10666](https://github.com/matrix-org/synapse/issues/10666), [\#10674](https://github.com/matrix-org/synapse/issues/10674)) - Flatten the `tests.synapse.rests` package by moving the contents of `v1` and `v2_alpha` into the parent. ([\#10667](https://github.com/matrix-org/synapse/issues/10667)) - Update `complement.sh` to rebuild the base Docker image when run with workers. ([\#10686](https://github.com/matrix-org/synapse/issues/10686)) - Split the event-processing methods in `FederationHandler` into a separate `FederationEventHandler`. ([\#10692](https://github.com/matrix-org/synapse/issues/10692)) - Remove unused `compare_digest` function. ([\#10706](https://github.com/matrix-org/synapse/issues/10706))
| * | | | Correctly include room avatars in email notifications (#10658)David Robertson2021-09-013-6/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Judging by the template, this was intended ages ago, but we never actually passed an avatar URL to the template. So let's provide one. Closes #1546. Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| * | | | Skip the final GC on shutdown to improve restart times (#10712)Sean2021-09-012-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Use `gc.freeze()` on exit to exclude all existing objects from the final GC. In testing, this sped up shutdown by up to a few seconds. `gc.freeze()` runs in constant time, so there is little chance of performance regression. Signed-off-by: Sean Quah <seanq@element.io>
| * | | | Allow configuration of the oEmbed URLs. (#10714)Patrick Cloke2021-08-318-252/+463
| | | | | | | | | | | | | | | | | | | | | | | | | This adds configuration options (under an `oembed` section) to configure which URLs are matched to use oEmbed for URL previews.
| * | | | Additional type hints for the client REST servlets (part 3). (#10707)Patrick Cloke2021-08-317-150/+306
| | | | |
* | | | | Merge tag 'v1.42.0' into babolivier/dinsic_1.48.0Brendan Abolivier2021-12-06162-3671/+7954
|\ \ \ \ \ | | |_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.42.0 (2021-09-07) =========================== This version of Synapse removes deprecated room-management admin APIs, removes out-of-date email pushers, and improves error handling for fallback templates for user-interactive authentication. For more information on these points, server administrators are encouraged to read [the upgrade notes](docs/upgrade.md#upgrading-to-v1420). No significant changes since 1.42.0rc2. Synapse 1.42.0rc2 (2021-09-06) ============================== Features -------- - Support room version 9 from [MSC3375](https://github.com/matrix-org/matrix-doc/pull/3375). ([\#10747](https://github.com/matrix-org/synapse/issues/10747)) Internal Changes ---------------- - Print a warning when using one of the deprecated `template_dir` settings. ([\#10768](https://github.com/matrix-org/synapse/issues/10768)) Synapse 1.42.0rc1 (2021-09-01) ============================== Features -------- - Add support for [MSC3231](https://github.com/matrix-org/matrix-doc/pull/3231): Token authenticated registration. Users can be required to submit a token during registration to authenticate themselves. Contributed by Callum Brown. ([\#10142](https://github.com/matrix-org/synapse/issues/10142)) - Add support for [MSC3283](https://github.com/matrix-org/matrix-doc/pull/3283): Expose `enable_set_displayname` in capabilities. ([\#10452](https://github.com/matrix-org/synapse/issues/10452)) - Port the `PresenceRouter` module interface to the new generic interface. ([\#10524](https://github.com/matrix-org/synapse/issues/10524)) - Add pagination to the spaces summary based on updates to [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946). ([\#10613](https://github.com/matrix-org/synapse/issues/10613), [\#10725](https://github.com/matrix-org/synapse/issues/10725)) Bugfixes -------- - Validate new `m.room.power_levels` events. Contributed by @aaronraimist. ([\#10232](https://github.com/matrix-org/synapse/issues/10232)) - Display an error on User-Interactive Authentication fallback pages when authentication fails. Contributed by Callum Brown. ([\#10561](https://github.com/matrix-org/synapse/issues/10561)) - Remove pushers when deleting an e-mail address from an account. Pushers for old unlinked emails will also be deleted. ([\#10581](https://github.com/matrix-org/synapse/issues/10581), [\#10734](https://github.com/matrix-org/synapse/issues/10734)) - Reject Client-Server `/keys/query` requests which provide `device_ids` incorrectly. ([\#10593](https://github.com/matrix-org/synapse/issues/10593)) - Rooms with unsupported room versions are no longer returned via `/sync`. ([\#10644](https://github.com/matrix-org/synapse/issues/10644)) - Enforce the maximum length for per-room display names and avatar URLs. ([\#10654](https://github.com/matrix-org/synapse/issues/10654)) - Fix a bug which caused the `synapse_user_logins_total` Prometheus metric not to be correctly initialised on restart. ([\#10677](https://github.com/matrix-org/synapse/issues/10677)) - Improve `ServerNoticeServlet` to avoid duplicate requests and add unit tests. ([\#10679](https://github.com/matrix-org/synapse/issues/10679)) - Fix long-standing issue which caused an error when a thumbnail is requested and there are multiple thumbnails with the same quality rating. ([\#10684](https://github.com/matrix-org/synapse/issues/10684)) - Fix a regression introduced in v1.41.0 which affected the performance of concurrent fetches of large sets of events, in extreme cases causing the process to hang. ([\#10703](https://github.com/matrix-org/synapse/issues/10703)) - Fix a regression introduced in Synapse 1.41 which broke email transmission on Systems using older versions of the Twisted library. ([\#10713](https://github.com/matrix-org/synapse/issues/10713)) Improved Documentation ---------------------- - Add documentation on how to connect Django with Synapse using OpenID Connect and django-oauth-toolkit. Contributed by @HugoDelval. ([\#10192](https://github.com/matrix-org/synapse/issues/10192)) - Advertise https://matrix-org.github.io/synapse documentation in the `README` and `CONTRIBUTING` files. ([\#10595](https://github.com/matrix-org/synapse/issues/10595)) - Fix some of the titles not rendering in the OpenID Connect documentation. ([\#10639](https://github.com/matrix-org/synapse/issues/10639)) - Minor clarifications to the documentation for reverse proxies. ([\#10708](https://github.com/matrix-org/synapse/issues/10708)) - Remove table of contents from the top of installation and contributing documentation pages. ([\#10711](https://github.com/matrix-org/synapse/issues/10711)) Deprecations and Removals ------------------------- - Remove deprecated Shutdown Room and Purge Room Admin API. ([\#8830](https://github.com/matrix-org/synapse/issues/8830)) Internal Changes ---------------- - Improve type hints for the proxy agent and SRV resolver modules. Contributed by @dklimpel. ([\#10608](https://github.com/matrix-org/synapse/issues/10608)) - Clean up some of the federation event authentication code for clarity. ([\#10614](https://github.com/matrix-org/synapse/issues/10614), [\#10615](https://github.com/matrix-org/synapse/issues/10615), [\#10624](https://github.com/matrix-org/synapse/issues/10624), [\#10640](https://github.com/matrix-org/synapse/issues/10640)) - Add a comment asking developers to leave a reason when bumping the database schema version. ([\#10621](https://github.com/matrix-org/synapse/issues/10621)) - Remove not needed database updates in modify user admin API. ([\#10627](https://github.com/matrix-org/synapse/issues/10627)) - Convert room member storage tuples to `attrs` classes. ([\#10629](https://github.com/matrix-org/synapse/issues/10629), [\#10642](https://github.com/matrix-org/synapse/issues/10642)) - Use auto-attribs for the attrs classes used in sync. ([\#10630](https://github.com/matrix-org/synapse/issues/10630)) - Make `backfill` and `get_missing_events` use the same codepath. ([\#10645](https://github.com/matrix-org/synapse/issues/10645)) - Improve the performance of the `/hierarchy` API (from [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946)) by caching responses received over federation. ([\#10647](https://github.com/matrix-org/synapse/issues/10647)) - Run a nightly CI build against Twisted trunk. ([\#10651](https://github.com/matrix-org/synapse/issues/10651), [\#10672](https://github.com/matrix-org/synapse/issues/10672)) - Do not print out stack traces for network errors when fetching data over federation. ([\#10662](https://github.com/matrix-org/synapse/issues/10662)) - Simplify tests for device admin rest API. ([\#10664](https://github.com/matrix-org/synapse/issues/10664)) - Add missing type hints to REST servlets. ([\#10665](https://github.com/matrix-org/synapse/issues/10665), [\#10666](https://github.com/matrix-org/synapse/issues/10666), [\#10674](https://github.com/matrix-org/synapse/issues/10674)) - Flatten the `tests.synapse.rests` package by moving the contents of `v1` and `v2_alpha` into the parent. ([\#10667](https://github.com/matrix-org/synapse/issues/10667)) - Update `complement.sh` to rebuild the base Docker image when run with workers. ([\#10686](https://github.com/matrix-org/synapse/issues/10686)) - Split the event-processing methods in `FederationHandler` into a separate `FederationEventHandler`. ([\#10692](https://github.com/matrix-org/synapse/issues/10692)) - Remove unused `compare_digest` function. ([\#10706](https://github.com/matrix-org/synapse/issues/10706))
| * | | | Add "No significant changes" to changelog v1.42.0Azrenbeth2021-09-071-0/+2
| | | | |
| * | | | Move upgrade notice up in changelogAzrenbeth2021-09-071-6/+1
| | | | |
| * | | | 1.42.0Azrenbeth2021-09-073-1/+13
| | |_|/ | |/| |
| * | | Improve changelog wording v1.42.0rc2Brendan Abolivier2021-09-061-1/+1
| | | |
| * | | Expand on why users should read upgrade notesBrendan Abolivier2021-09-061-1/+4
| | | |
| * | | Move the upgrade notes reminder up to rc2Brendan Abolivier2021-09-061-3/+2
| | | |
| * | | 1.42.0rc2Brendan Abolivier2021-09-065-3/+22
| | | |
| * | | Add a warning when using deprecated template_dir settings (#10768)Brendan Abolivier2021-09-064-0/+42
| | | | | | | | | | | | The deprecation itself happened in #10596 which shipped with Synapse v1.41.0. However, it doesn't seem fair to suddenly drop support for these settings in ~4-6w without being more vocal about said deprecation.
| * | | Support MSC3375: room version 9. (#10747)Patrick Cloke2021-09-034-1/+79
| | |/ | |/|
| * | Make minor changes to changelog v1.42.0rc1Olivier Wilkinson (reivilibre)2021-09-011-2/+2
| | |
| * | Improve changelogOlivier Wilkinson (reivilibre)2021-09-011-3/+3
| | | | | | | | | | | | Expand OIDC to OpenID Connect.
| * | Improve changelogOlivier Wilkinson (reivilibre)2021-09-011-7/+6
| | |
| * | 1.42.0rc1Olivier Wilkinson (reivilibre)2021-09-0151-52/+78
| | |
| * | Fix iteration in _remove_deleted_email_pushers background job. (#10734)Andrew Morgan2021-09-013-1/+47
| |/
| * Move the sessions delta to the latest schema version. (#10725)Patrick Cloke2021-08-312-0/+1
| | | | | | This was erroneously put under schema version 62 instead of 63.
| * Merge branch 'master' into developRichard van der Hoff2021-08-318-7/+214
| |\
| * | Advertise matrix-org.github.io/synapse docs (#10595)David Robertson2021-08-314-432/+459
| | | | | | | | | | | | | | | Point to the book where possible, and use hyperlinks to github to refer to files not included in the book. Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| * | Merge remote-tracking branch 'origin/release-v1.41' into developRichard van der Hoff2021-08-275-21/+173
| |\ \
| * | | Removed page summaries from the top of installation and contributing doc ↵Azrenbeth2021-08-274-75/+21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | pages (#10711) - Removed page summaries from CONTRIBUTING and installation pages as this information was already in the table of contents on the right hand side - Fixed some broken links in CONTRIBUTING - Added margin-right tag for when table of contents is being shown (otherwise the text in the page sometimes overlaps with it)
| * | | Clarifications to reverse_proxy.md (#10708)Richard van der Hoff2021-08-272-5/+6
| | | | | | | | | | | | | | | | | | | | * Update reverse_proxy.md * Create 10708.doc
| * | | Remove unused `compare_digest` function. (#10706)Patrick Cloke2021-08-272-13/+1
| | | |
| * | | Improve ServerNoticeServlet to avoid duplicate requests (#10679)Dirk Klimpel2021-08-275-17/+475
| | | | | | | | | | | | Fixes: #9544
| * | | Fix perf of fetching the same events many times. (#10703)Erik Johnston2021-08-272-6/+24
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The code to deduplicate repeated fetches of the same set of events was N^2 (over the number of events requested), which could lead to a process being completely wedged. The main fix is to deduplicate the returned deferreds so we only await on a deferred once rather than many times. Seperately, when handling the returned events from the defrered we only add the events we care about to the event map to be returned (so that we don't pay the price of inserting extraneous events into the dict).
| * | | Split `FederationHandler` in half (#10692)Richard van der Hoff2021-08-2611-1780/+1883
| | | | | | | | | | | | The idea here is to take anything to do with incoming events and move it out to a separate handler, as a way of making FederationHandler smaller.
| * | | Make `backfill` and `get_missing_events` use the same codepath (#10645)Richard van der Hoff2021-08-263-233/+42
| | | | | | | | | | | | Given that backfill and get_missing_events are basically the same thing, it's somewhat crazy that we have entirely separate code paths for them. This makes backfill use the existing get_missing_events code, and then clears up all the unused code.
| * | | Validate new m.room.power_levels events (#10232)Aaron Raimist2021-08-265-4/+160
| | | | | | | | | | | | | | | | Signed-off-by: Aaron Raimist <aaron@raim.ist>
| * | | Remove pushers when deleting 3pid from account (#10581)Azrenbeth2021-08-267-1/+143
| | | | | | | | | | | | | | | | | | | | When a user deletes an email from their account it will now also remove all pushers for that email and that user (even if these pushers were created by a different client)
| * | | Additional type hints for REST servlets (part 2). (#10674)Patrick Cloke2021-08-2617-138/+216
| | | | | | | | | | | | Applies the changes from #10665 to additional modules.
| * | | Cache the result of fetching the room hierarchy over federation. (#10647)Patrick Cloke2021-08-262-40/+67
| | | |
| * | | Make a note to leave a summary when one is bumping the schema version (#10621)Andrew Morgan2021-08-252-0/+3
| | | | | | | | | | | | I found this easy to miss (and evidently, it looks like it was missed for schema version 62).
| * | | Ensure the base Docker image is rebuilt when running complement with ↵Patrick Cloke2021-08-252-7/+8
| | | | | | | | | | | | | | | | | | | | | | | | workers. (#10686) We now always rebuild the matrixdotorg/synapse image, then build the matrixdotorg/synapse-workers image on top of it.
| * | | Fix error when selecting between thumbnails with the same quality (#10684)Sean2021-08-253-10/+56
| | | | | | | | | | | | Fixes #10318
| * | | Merge branch 'master' into developErik Johnston2021-08-246-9/+29
| |\ \ \
| * | | | Persist room hierarchy pagination sessions to the database. (#10613)Patrick Cloke2021-08-247-38/+212
| | | | |
| * | | | Correctly initialise the `synapse_user_logins` metric. (#10677)Richard van der Hoff2021-08-244-6/+44
| | | | | | | | | | | | | | | | | | | | | | | | | Fix a bug where the prometheus metrics for SSO logins wouldn't be initialised until the first user logged in with a given auth provider.
| * | | | doc: add django-oauth-toolkit to oidc doc (#10192)Hugo DELVAL2021-08-232-0/+49
| | | | | | | | | | | | | | | | | | | | Signed-off-by: Hugo Delval <hugo.delval@gmail.com>
| * | | | Enforce the max length for per-room display names / avatar URLs. (#10654)Azrenbeth2021-08-232-1/+17
| | | | | | | | | | | | | | | To match the maximum lengths allowed for profile data.
| * | | | Fix the titles in the OIDC documentation (#10639)Andrew Morgan2021-08-232-6/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Fix the titles in the OIDC documentation Having them as links broke the table-of-contents rendering in mdbook. Plus there's no reason for only some of the provider titles to be links. * Changelog * Add link to google idp docs
| * | | | Avoid duplicate issues from Twisted trunk failures (#10672)Dan Callahan2021-08-232-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Setting `update_existing: true` in the `create-an-issue` GitHub Action will avoid opening duplicate issues if an open issue already exists with an identical title. If no open issues match the title, then a new issue will be created. This helps avoid spamming our issue tracker should there be a failure when testing against Twisted's trunk. This PR also pins the SHA of the `create-an-issue` action to mitigate the risk of a malicious actor gaining access to JasonEtco's account. See GitHub's page on security hardening third party actions for more: https://docs.github.com/en/actions/learn-github-actions/security-hardening-for-github-actions#using-third-party-actions Signed-off-by: Dan Callahan <danc@element.io>
| * | | | Additional type hints for the sync REST servlet. (#10666)Patrick Cloke2021-08-233-61/+93
| | | | |
| * | | | Addtional type hints for the REST servlets. (#10665)Patrick Cloke2021-08-2314-107/+204
| | | | |
| * | | | Do not include stack traces for known exceptions when trying multiple ↵Patrick Cloke2021-08-232-1/+7
| | | | | | | | | | | | | | | | | | | | federation destinations. (#10662)
| * | | | Run a nightly CI build against Twisted trunk. (#10651)Richard van der Hoff2021-08-234-0/+102
| | | | | | | | | | | | | | | This creates a GHA workflow which runs at 8am every day, and runs mypy, trial and sytest against Twisted's current trunk. If any of the jobs fail, it opens an issue.
| * | | | Implement MSC3231: Token authenticated registration (#10142)Callum Brown2021-08-2121-1/+2389
| | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Callum Brown <callum@calcuode.com> This is part of my GSoC project implementing [MSC3231](https://github.com/matrix-org/matrix-doc/pull/3231).
| * | | | Flatten tests/rest/client/{v1,v2_alpha} too (#10667)David Robertson2021-08-2027-18/+6
| | | | |
| * | | | Simplify tests for the device admin rest API. (#10664)Dirk Klimpel2021-08-202-81/+19
| | | | | | | | | | | | | | | | | | | | By replacing duplicated code with parameterized tests and avoiding unnecessary dumping of JSON data.
| * | | | Follow-up: format changelog, add licence (#10593)David Robertson2021-08-202-1/+15
| | | | | | | | | | | | | | | | | | | | Merged before approval; these comments from @clokep on that PR.
| * | | | Validate device_keys for C-S /keys/query requests (#10593)David Robertson2021-08-204-1/+101
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Validate device_keys for C-S /keys/query requests Closes #10354 A small, not particularly critical fix. I'm interested in seeing if we can find a more systematic approach though. #8445 is the place for any discussion.
| * | | | Split `on_receive_pdu` in half (#10640)Richard van der Hoff2021-08-194-109/+142
| | | | | | | | | | | | | | | Here we split on_receive_pdu into two functions (on_receive_pdu and process_pulled_event), rather than having both cases in the same method. There's a tiny bit of overlap, but not that much.
| * | | | Extract `_resolve_state_at_missing_prevs` (#10624)Richard van der Hoff2021-08-192-105/+125
| | | | | | | | | | | | | | | This is a follow-up to #10615: it takes the code that constructs the state at a backwards extremity, and extracts it to a separate method.
| * | | | Do not include rooms with an unknown room version in a sync response. (#10644)Patrick Cloke2021-08-197-11/+145
| | | | | | | | | | | | | | | | | | | | A user will still see this room if it is in a local cache, but it will not reappear if clearing the cache and reloading.
| * | | | Support MSC3283: Expose `enable_set_displayname` in capabilities (#10452)Dirk Klimpel2021-08-194-23/+101
| | | | |
| * | | | Remove not needed database updates in modify user admin API (#10627)Dirk Klimpel2021-08-195-33/+118
| | | | |
| * | | | Additional type hints for the proxy agent and SRV resolver modules. (#10608)Dirk Klimpel2021-08-185-25/+41
| | | | |
| * | | | Merge branch 'release-v1.41' into developErik Johnston2021-08-1884-950/+806
| |\ \ \ \
| * | | | | Fix weakref_slot parameter for room member storage attrs. (#10642)Patrick Cloke2021-08-182-4/+5
| | | | | | | | | | | | | | | | | | Follow-up to #10629 which set it to true, not false.
| * | | | | Convert room member storage tuples to attrs. (#10629)Patrick Cloke2021-08-187-29/+54
| | | | | | | | | | | | | | | | | | | | | | | | Instead of using namedtuples. This helps with asserting type hints and code completion.
| * | | | | Display an error page during failure of fallback UIA. (#10561)Callum Brown2021-08-188-28/+65
| | | | | |
| * | | | | Refactor `on_receive_pdu` code (#10615)Richard van der Hoff2021-08-182-134/+138
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * drop room pdu linearizer sooner No point holding onto it while we recheck the db * move out `missing_prevs` calculation we're going to need `missing_prevs` whatever we do, so we may as well calculate it eagerly and just update it if it gets outdated. * Add another `if missing_prevs` condition this should be a no-op, since all the code inside the block already checks `if missing_prevs` * reorder if conditions This shouldn't change the logic at all. * Push down `min_depth` read No point reading it from the database unless we're going to use it. * Collect the sent_to_us_directly code together Move the remaining `sent_to_us_directly` code inside the `if sent_to_us_directly` block. * Properly separate the `not sent_to_us_directly` branch Since the only way this second block is now reachable is if we *didn't* go into the `sent_to_us_directly` branch, we can replace it with a simple `else`. * changelog
| * | | | | Use auto-attribs for attrs classes for sync. (#10630)Patrick Cloke2021-08-182-78/+79
| | | | | |
| * | | | | Remove deprecated Shutdown Room and Purge Room Admin API (#8830)Dirk Klimpel2021-08-179-384/+14
| | | | | |
| * | | | | Port the PresenceRouter module interface to the new generic interface (#10524)Azrenbeth2021-08-179-69/+326
| | | | | | | | | | | | | | | | | | Port the PresenceRouter module interface to the new generic interface introduced in v1.37.0
| * | | | | Stop setting the outlier flag for things that aren't (#10614)Richard van der Hoff2021-08-172-7/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Marking things as outliers to inhibit pushes is a sledgehammer to crack a nut. Move the test further down the stack so that we just inhibit the thing we want.
* | | | | | Remove DomainRuleChecker module (#113)Brendan Abolivier2021-12-064-658/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The module has now moved to https://github.com/matrix-org/synapse-domain-rule-checker __Note to ops__: To deploy this change, the module needs to be installed in addition to Synapse (from the aforementioned repo, or the PyPI project mentioned its readme). The configuration doesn't change besides a) `default` is renamed into `can_invite_if_not_in_domain_mapping` and b) the module's configuration has moved to the `modules` section of the configuration file (though that was already the case as of https://github.com/matrix-org/synapse-dinsic/pull/108).
* | | | | | Delete local RoomAccessRules module (#112)Brendan Abolivier2021-11-123-2211/+0
| | | | | |
* | | | | | Merge pull request #108 from matrix-org/babolivier/update_spam_checkerBrendan Abolivier2021-11-1115-290/+1045
|\ \ \ \ \ \ | | | | | | | | | | | | | | Bring spamchecker to parity with mainline
| * \ \ \ \ \ Merge branch 'dinsic' into babolivier/update_spam_checkerBrendan Abolivier2021-11-042-2/+4
| |\ \ \ \ \ \ | |/ / / / / / |/| | | | | |
* | | | | | | Fix debian package builds. (#10931) (#109)Brendan Abolivier2021-11-032-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This was due to dh-virtualenv builds being broken due to Shpinx removing deprecated APIs. Co-authored-by: Erik Johnston <erik@matrix.org>
| * | | | | | Remove now useless config optionBrendan Abolivier2021-11-041-3/+0
| | | | | | |
| * | | | | | LintBrendan Abolivier2021-11-042-12/+58
| | | | | | |
| * | | | | | Delete custom user_may_create_roomBrendan Abolivier2021-11-042-57/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Because we already do these checks with RoomAccessRules
| * | | | | | Update testsBrendan Abolivier2021-11-041-47/+123
| | | | | | |
| * | | | | | Update DomainRuleChecker to use the new interfaceBrendan Abolivier2021-11-041-32/+108
| | | | | | |
| * | | | | | Add a module API method to retrieve state from a room (#11204)Brendan Abolivier2021-11-013-2/+81
| | | | | | |
| * | | | | | Converge with mainlineBrendan Abolivier2021-10-265-129/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bring other callbacks to party with mainline, and fixup code calling to the various callbacks.
| * | | | | | Add a spamchecker method to allow or deny 3pid invites (#10894)Brendan Abolivier2021-10-265-4/+153
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is in the context of creating new module callbacks that modules in https://github.com/matrix-org/synapse-dinsic can use, in an effort to reconcile the spam checker API in synapse-dinsic with the one in mainline. Note that a module callback already exists for 3pid invites (https://matrix-org.github.io/synapse/develop/modules/third_party_rules_callbacks.html#check_threepid_can_be_invited) but it doesn't check whether the sender of the invite is allowed to send it.
| * | | | | | Add a spamchecker callback to allow or deny room joins (#10910)Brendan Abolivier2021-10-265-6/+156
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Co-authored-by: Erik Johnston <erik@matrix.org>
| * | | | | | Add a spamchecker callback to allow or deny room creation based on invites ↵Brendan Abolivier2021-10-265-17/+358
|/ / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (#10898) This is in the context of creating new module callbacks that modules in https://github.com/matrix-org/synapse-dinsic can use, in an effort to reconcile the spam checker API in synapse-dinsic with the one in mainline. This adds a callback that's fairly similar to user_may_create_room except it also allows processing based on the invites sent at room creation.
* | | | | | Revert shadow HS support (#104)Brendan Abolivier2021-09-279-272/+70
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Revert shadow HS support added in matrix-org/synapse#4145 Fixes matrix-org/matrix-dinsic#803 Part of that PR isn't reverted because it relates to matrix-org/matrix-dinsic#793
* | | | | | Remove duplicate jobBrendan Abolivier2021-09-271-3/+0
| | | | | | | | | | | | | | | | | | | | | | | | Forgot to include this commit in #106
* | | | | | Use correct tag for sytest (#106)Brendan Abolivier2021-09-272-9/+6
| | | | | |
* | | | | | Use the BaseReporter super-class for _WrappedRustReporter (#105)Brendan Abolivier2021-09-222-1/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Use the BaseReporter super-class for _WrappedRustReporter. (#10799) This fixes mypy errors with jaeger-client >= 4.7.0 and should be a no-op for versions before that. Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
* | | | | | Merge branch 'babolivier/dinsic_1.41.0' into dinsicBrendan Abolivier2021-09-071174-19522/+45429
|\ \ \ \ \ \
| * | | | | | Incorporate reviewBrendan Abolivier2021-09-033-13/+9
| | | | | | |
| * | | | | | Merge tag 'v1.41.1' into babolivier/dinsic_1.41.0Brendan Abolivier2021-09-0213-28/+388
| |\ \ \ \ \ \ | | | |_|_|_|/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.41.1 (2021-08-31) =========================== Due to the two security issues highlighted below, server administrators are encouraged to update Synapse. We are not aware of these vulnerabilities being exploited in the wild. Security advisory ----------------- The following issues are fixed in v1.41.1. - **[GHSA-3x4c-pq33-4w3q](https://github.com/matrix-org/synapse/security/advisories/GHSA-3x4c-pq33-4w3q) / [CVE-2021-39164](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-39164): Enumerating a private room's list of members and their display names.** If an unauthorized user both knows the Room ID of a private room *and* that room's history visibility is set to `shared`, then they may be able to enumerate the room's members, including their display names. The unauthorized user must be on the same homeserver as a user who is a member of the target room. Fixed by [52c7a51cf](https://github.com/matrix-org/synapse/commit/52c7a51cf). - **[GHSA-jj53-8fmw-f2w2](https://github.com/matrix-org/synapse/security/advisories/GHSA-jj53-8fmw-f2w2) / [CVE-2021-39163](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-39163): Disclosing a private room's name, avatar, topic, and number of members.** If an unauthorized user knows the Room ID of a private room, then its name, avatar, topic, and number of members may be disclosed through Group / Community features. The unauthorized user must be on the same homeserver as a user who is a member of the target room, and their homeserver must allow non-administrators to create groups (`enable_group_creation` in the Synapse configuration; off by default). Fixed by [cb35df940a](https://github.com/matrix-org/synapse/commit/cb35df940a), [\#10723](https://github.com/matrix-org/synapse/issues/10723). Bugfixes -------- - Fix a regression introduced in Synapse 1.41 which broke email transmission on systems using older versions of the Twisted library. ([\#10713](https://github.com/matrix-org/synapse/issues/10713))
| | * | | | | 1.41.1 v1.41.1Richard van der Hoff2021-08-313-1/+39
| | | | | | |
| | * | | | | Fix up unit tests (#10723)Richard van der Hoff2021-08-312-2/+16
| | | | | | | | | | | | | | | | | | | | | These were broken in an incorrect merge of GHSA-jj53-8fmw-f2w2 (cb35df9)
| | * | | | | Merge pull request from GHSA-jj53-8fmw-f2w2reivilibre2021-08-312-2/+59
| | | | | | |
| | * | | | | Merge pull request from GHSA-3x4c-pq33-4w3qreivilibre2021-08-312-4/+103
| | | |_|_|/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add some tests to characterise the problem Some failing. Current states: RoomsMemberListTestCase test_get_member_list ... [OK] test_get_member_list_mixed_memberships ... [OK] test_get_member_list_no_permission ... [OK] test_get_member_list_no_permission_former_member ... [OK] test_get_member_list_no_permission_former_member_with_at_token ... [FAIL] test_get_member_list_no_room ... [OK] test_get_member_list_no_permission_with_at_token ... [FAIL] * Correct the tests * Check user is/was member before divulging room membership * Pull out only the 1 membership event we want. * Update tests/rest/client/v1/test_rooms.py Co-authored-by: Erik Johnston <erik@matrix.org> * Fixup tests (following apply review suggestion) Co-authored-by: Erik Johnston <erik@matrix.org>
| | * | | | Fix incompatibility with Twisted < 21. (#10713)Richard van der Hoff2021-08-275-21/+173
| | | |_|/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | Turns out that the functionality added in #10546 to skip TLS was incompatible with older Twisted versions, so we need to be a bit more inventive. Also, add a test to (hopefully) not break this in future. Sadly, testing TLS is really hard.
| * | | | Use correct federation path for knockingBrendan Abolivier2021-09-021-12/+1
| | | | |
| * | | | LintBrendan Abolivier2021-09-022-2/+1
| | | | |
| * | | | Import mock from unittestBrendan Abolivier2021-09-024-4/+4
| | | | |
| * | | | Fix test_rewritten_id_serverBrendan Abolivier2021-09-021-0/+5
| | | | |
| * | | | LintBrendan Abolivier2021-09-022-4/+6
| | | | |
| * | | | Appease mypyBrendan Abolivier2021-09-024-6/+12
| | | | |
| * | | | Load legacy modules in testsBrendan Abolivier2021-09-022-0/+5
| | | | |
| * | | | LintBrendan Abolivier2021-09-022-5/+7
| | | | |
| * | | | Sample configBrendan Abolivier2021-09-021-66/+0
| | | | |
| * | | | LintBrendan Abolivier2021-09-013-5/+13
| | | | |
| * | | | Don't ratelimit when admin updates profileBrendan Abolivier2021-09-012-3/+8
| | | | |
| * | | | Fix one more testBrendan Abolivier2021-09-011-4/+0
| | | | |
| * | | | Fix more testsBrendan Abolivier2021-09-015-11/+21
| | | | |
| * | | | Fix testsBrendan Abolivier2021-09-014-11/+7
| | | | |
| * | | | Fix cyclic dependency with the legacy account validity workBrendan Abolivier2021-09-011-3/+7
| | | | |
| * | | | Remove account validity related schema updateBrendan Abolivier2021-09-011-18/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Because DINUM had it before mainline, so the file names don't match. Will need some fiddling with the database before updating to a mainlined version.
| * | | | Remove knock-related schema updateBrendan Abolivier2021-09-011-20/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Because DINUM had it before mainline, so the file names don't match. Will need some fiddling with the database before updating to a mainlined version.
| * | | | LintBrendan Abolivier2021-09-014-23/+18
| | | | |
| * | | | Remove buildkite pipelineBrendan Abolivier2021-09-0111-717/+0
| | | | |
| * | | | Add buildkite pipeline backBrendan Abolivier2021-09-0110-0/+682
| | | | |
| * | | | Merge tag 'v1.41.0' into babolivier/dinsic_1.41.0Brendan Abolivier2021-09-01239-6014/+9667
| |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.41.0 (2021-08-24) =========================== This release adds support for Debian 12 (Bookworm), but **removes support for Ubuntu 20.10 (Groovy Gorilla)**, which reached End of Life last month. Note that when using workers the `/_synapse/admin/v1/users/{userId}/media` must now be handled by media workers. See the [upgrade notes](https://matrix-org.github.io/synapse/latest/upgrade.html) for more information. Features -------- - Enable room capabilities ([MSC3244](https://github.com/matrix-org/matrix-doc/pull/3244)) by default and set room version 8 as the preferred room version when creating restricted rooms. ([\#10571](https://github.com/matrix-org/synapse/issues/10571)) Synapse 1.41.0rc1 (2021-08-18) ============================== Features -------- - Add `get_userinfo_by_id` method to ModuleApi. ([\#9581](https://github.com/matrix-org/synapse/issues/9581)) - Initial local support for [MSC3266](https://github.com/matrix-org/synapse/pull/10394), Room Summary over the unstable `/rooms/{roomIdOrAlias}/summary` API. ([\#10394](https://github.com/matrix-org/synapse/issues/10394)) - Experimental support for [MSC3288](https://github.com/matrix-org/matrix-doc/pull/3288), sending `room_type` to the identity server for 3pid invites over the `/store-invite` API. ([\#10435](https://github.com/matrix-org/synapse/issues/10435)) - Add support for sending federation requests through a proxy. Contributed by @Bubu and @dklimpel. See the [upgrade notes](https://matrix-org.github.io/synapse/latest/upgrade.html) for more information. ([\#10596](https://github.com/matrix-org/synapse/issues/10596)). ([\#10475](https://github.com/matrix-org/synapse/issues/10475)) - Add support for "marker" events which makes historical events discoverable for servers that already have all of the scrollback history (part of [MSC2716](https://github.com/matrix-org/matrix-doc/pull/2716)). ([\#10498](https://github.com/matrix-org/synapse/issues/10498)) - Add a configuration setting for the time a `/sync` response is cached for. ([\#10513](https://github.com/matrix-org/synapse/issues/10513)) - The default logging handler for new installations is now `PeriodicallyFlushingMemoryHandler`, a buffered logging handler which periodically flushes itself. ([\#10518](https://github.com/matrix-org/synapse/issues/10518)) - Add support for new redaction rules for historical events specified in [MSC2716](https://github.com/matrix-org/matrix-doc/pull/2716). ([\#10538](https://github.com/matrix-org/synapse/issues/10538)) - Add a setting to disable TLS when sending email. ([\#10546](https://github.com/matrix-org/synapse/issues/10546)) - Add pagination to the spaces summary based on updates to [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946). ([\#10549](https://github.com/matrix-org/synapse/issues/10549), [\#10560](https://github.com/matrix-org/synapse/issues/10560), [\#10569](https://github.com/matrix-org/synapse/issues/10569), [\#10574](https://github.com/matrix-org/synapse/issues/10574), [\#10575](https://github.com/matrix-org/synapse/issues/10575), [\#10579](https://github.com/matrix-org/synapse/issues/10579), [\#10583](https://github.com/matrix-org/synapse/issues/10583)) - Admin API to delete several media for a specific user. Contributed by @dklimpel. ([\#10558](https://github.com/matrix-org/synapse/issues/10558), [\#10628](https://github.com/matrix-org/synapse/issues/10628)) - Add support for routing `/createRoom` to workers. ([\#10564](https://github.com/matrix-org/synapse/issues/10564)) - Update the Synapse Grafana dashboard. ([\#10570](https://github.com/matrix-org/synapse/issues/10570)) - Add an admin API (`GET /_synapse/admin/username_available`) to check if a username is available (regardless of registration settings). ([\#10578](https://github.com/matrix-org/synapse/issues/10578)) - Allow editing a user's `external_ids` via the "Edit User" admin API. Contributed by @dklimpel. ([\#10598](https://github.com/matrix-org/synapse/issues/10598)) - The Synapse manhole no longer needs coroutines to be wrapped in `defer.ensureDeferred`. ([\#10602](https://github.com/matrix-org/synapse/issues/10602)) - Add option to allow modules to run periodic tasks on all instances, rather than just the one configured to run background tasks. ([\#10638](https://github.com/matrix-org/synapse/issues/10638)) Bugfixes -------- - Add some clarification to the sample config file. Contributed by @Kentokamoto. ([\#10129](https://github.com/matrix-org/synapse/issues/10129)) - Fix a long-standing bug where protocols which are not implemented by any appservices were incorrectly returned via `GET /_matrix/client/r0/thirdparty/protocols`. ([\#10532](https://github.com/matrix-org/synapse/issues/10532)) - Fix exceptions in logs when failing to get remote room list. ([\#10541](https://github.com/matrix-org/synapse/issues/10541)) - Fix longstanding bug which caused the user's presence "status message" to be reset when the user went offline. Contributed by @dklimpel. ([\#10550](https://github.com/matrix-org/synapse/issues/10550)) - Allow public rooms to be previewed in the spaces summary APIs from [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946). ([\#10580](https://github.com/matrix-org/synapse/issues/10580)) - Fix a bug introduced in v1.37.1 where an error could occur in the asynchronous processing of PDUs when the queue was empty. ([\#10592](https://github.com/matrix-org/synapse/issues/10592)) - Fix errors on /sync when read receipt data is a string. Only affects homeservers with the experimental flag for [MSC2285](https://github.com/matrix-org/matrix-doc/pull/2285) enabled. Contributed by @SimonBrandner. ([\#10606](https://github.com/matrix-org/synapse/issues/10606)) - Additional validation for the spaces summary API to avoid errors like `ValueError: Stop argument for islice() must be None or an integer`. The missing validation has existed since v1.31.0. ([\#10611](https://github.com/matrix-org/synapse/issues/10611)) - Revert behaviour introduced in v1.38.0 that strips `org.matrix.msc2732.device_unused_fallback_key_types` from `/sync` when its value is empty. This field should instead always be present according to [MSC2732](https://github.com/matrix-org/matrix-doc/blob/master/proposals/2732-olm-fallback-keys.md). ([\#10623](https://github.com/matrix-org/synapse/issues/10623)) Improved Documentation ---------------------- - Add documentation for configuring a forward proxy. ([\#10443](https://github.com/matrix-org/synapse/issues/10443)) - Updated the reverse proxy documentation to highlight the homserver configuration that is needed to make Synapse aware that is is intentionally reverse proxied. ([\#10551](https://github.com/matrix-org/synapse/issues/10551)) - Update CONTRIBUTING.md to fix index links and the instructions for SyTest in docker. ([\#10599](https://github.com/matrix-org/synapse/issues/10599)) Deprecations and Removals ------------------------- - No longer build `.deb` packages for Ubuntu 20.10 Groovy Gorilla, which has now EOLed. ([\#10588](https://github.com/matrix-org/synapse/issues/10588)) - The `template_dir` configuration settings in the `sso`, `account_validity` and `email` sections of the configuration file are now deprecated in favour of the global `templates.custom_template_directory` setting. See the [upgrade notes](https://matrix-org.github.io/synapse/latest/upgrade.html) for more information. ([\#10596](https://github.com/matrix-org/synapse/issues/10596)) Internal Changes ---------------- - Improve event caching mechanism to avoid having multiple copies of an event in memory at a time. ([\#10119](https://github.com/matrix-org/synapse/issues/10119)) - Reduce errors in PostgreSQL logs due to concurrent serialization errors. ([\#10504](https://github.com/matrix-org/synapse/issues/10504)) - Include room ID in ignored EDU log messages. Contributed by @ilmari. ([\#10507](https://github.com/matrix-org/synapse/issues/10507)) - Add pagination to the spaces summary based on updates to [MSC2946](https://github.com/matrix-org/matrix-doc/pull/2946). ([\#10527](https://github.com/matrix-org/synapse/issues/10527), [\#10530](https://github.com/matrix-org/synapse/issues/10530)) - Fix CI to not break when run against branches rather than pull requests. ([\#10529](https://github.com/matrix-org/synapse/issues/10529)) - Mark all events stemming from the [MSC2716](https://github.com/matrix-org/matrix-doc/pull/2716) `/batch_send` endpoint as historical. ([\#10537](https://github.com/matrix-org/synapse/issues/10537)) - Clean up some of the federation event authentication code for clarity. ([\#10539](https://github.com/matrix-org/synapse/issues/10539), [\#10591](https://github.com/matrix-org/synapse/issues/10591)) - Convert `Transaction` and `Edu` objects to attrs. ([\#10542](https://github.com/matrix-org/synapse/issues/10542)) - Update `/batch_send` endpoint to only return `state_events` created by the `state_events_from_before` passed in. ([\#10552](https://github.com/matrix-org/synapse/issues/10552)) - Update contributing.md to warn against rebasing an open PR. ([\#10563](https://github.com/matrix-org/synapse/issues/10563)) - Remove the unused public rooms replication stream. ([\#10565](https://github.com/matrix-org/synapse/issues/10565)) - Clarify error message when failing to join a restricted room. ([\#10572](https://github.com/matrix-org/synapse/issues/10572)) - Remove references to BuildKite in favour of GitHub Actions. ([\#10573](https://github.com/matrix-org/synapse/issues/10573)) - Move `/batch_send` endpoint defined by [MSC2716](https://github.com/matrix-org/matrix-doc/pull/2716) to the `/v2_alpha` directory. ([\#10576](https://github.com/matrix-org/synapse/issues/10576)) - Allow multiple custom directories in `read_templates`. ([\#10587](https://github.com/matrix-org/synapse/issues/10587)) - Re-organize the `synapse.federation.transport.server` module to create smaller files. ([\#10590](https://github.com/matrix-org/synapse/issues/10590)) - Flatten the `synapse.rest.client` package by moving the contents of `v1` and `v2_alpha` into the parent. ([\#10600](https://github.com/matrix-org/synapse/issues/10600)) - Build Debian packages for Debian 12 (Bookworm). ([\#10612](https://github.com/matrix-org/synapse/issues/10612)) - Fix up a couple of links to the database schema documentation. ([\#10620](https://github.com/matrix-org/synapse/issues/10620)) - Fix a broken link to the upgrade notes. ([\#10631](https://github.com/matrix-org/synapse/issues/10631))
| | * | | Update changelog v1.41.0Erik Johnston2021-08-241-4/+9
| | | | |
| | * | | 1.41.0Erik Johnston2021-08-244-2/+16
| | | | |
| | * | | Set room version 8 as preferred for restricted rooms. (#10571)Patrick Cloke2021-08-204-4/+5
| | | | |
| | * | | Fix typo in release notes (#10646)John-Scott Atlakson2021-08-191-1/+1
| | | |/ | | |/| | | | | | | | | | | | | Ubuntu 20.10 was not an LTS release Signed-off-by: John-Scott Atlakson 24574+jsma@users.noreply.github.com
| | * | Update docs/upgrade.md with new versionErik Johnston2021-08-181-1/+1
| | | |
| | * | Update changelog v1.41.0rc1Erik Johnston2021-08-181-4/+4
| | | |
| | * | 1.41.0rc1Erik Johnston2021-08-1863-61/+86
| | | |
| | * | Mount /_synapse/admin/v1/users/{userId}/media admin API on media workers ↵Andrew Morgan2021-08-186-165/+173
| | | | | | | | | | | | | | | | | | | | only (#10628) Co-authored-by: Patrick Cloke <patrickc@matrix.org>
| | * | fix broken link to upgrade notes (#10631)Richard van der Hoff2021-08-182-1/+2
| | | |
| | * | Allow modules to run looping call on all instances (#10638)Erik Johnston2021-08-182-1/+9
| | | | | | | | | | | | | | | | By default the calls only ran on the worker configured to run background tasks.
| | * | Allow /createRoom to be run on workers (#10564)Andrew Morgan2021-08-174-35/+37
| | | | | | | | | | | | Fixes https://github.com/matrix-org/synapse/issues/7867
| | * | Remove the unused public_room_list_stream (#10565)Andrew Morgan2021-08-179-250/+48
| | | | | | | | | | | | Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
| | * | Build debs for bookworm (#10612)Richard van der Hoff2021-08-172-1/+3
| | | |
| | * | Centralise the custom template directory (#10596)Brendan Abolivier2021-08-1712-418/+342
| | | | | | | | | | | | Several configuration sections are using separate settings for custom template directories, which can be confusing. This PR adds a new top-level configuration for a custom template directory which is then used for every module. The only exception is the consent templates, since the consent template directory require a specific hierarchy, so it's probably better that it stays separate from everything else.
| | * | Attempt to pull from the legacy spaces summary API over federation. (#10583)Patrick Cloke2021-08-172-9/+56
| | | | | | | | | | | | | | | | | | | | | | | | | | | | If the new /hierarchy API does not exist on all destinations, fallback to querying the /spaces API and translating the results. This is a backwards compatibility hack since not all of the federated homeservers will update at the same time.
| | * | Make `PeriodicallyFlushingMemoryHandler` the default logging handler. (#10518)reivilibre2021-08-174-21/+61
| | |/
| | * Flatten the synapse.rest.client package (#10600)reivilibre2021-08-17123-188/+137
| | |
| | * Always list fallback key types in /sync (#10623)Andrew Morgan2021-08-172-4/+6
| | |
| | * Allow to edit `external_ids` by Edit User admin API (#10598)Dirk Klimpel2021-08-175-89/+340
| | | | | | | | | Signed-off-by: Dirk Klimpel dirk@klimpel.org
| | * update links to schema doc (#10620)Richard van der Hoff2021-08-173-3/+4
| | |
| | * Allow using several custom template directories (#10587)Brendan Abolivier2021-08-177-27/+98
| | | | | | | | | Allow using several directories in read_templates.
| | * Add an admin API to check if a username is available (#10578)Will Hunt2021-08-175-0/+136
| | | | | | | | | This adds a new API GET /_synapse/admin/v1/username_available?username=foo to check if a username is available. It is the counterpart to https://matrix.org/docs/spec/client_server/r0.6.0#get-matrix-client-r0-register-available, except that it works even if registration is disabled.
| | * Manhole: wrap coroutines in `defer.ensureDeferred` automatically (#10602)reivilibre2021-08-163-1/+16
| | |
| | * Update CONTRIBUTING.md to fix index links and SyTest instructions (#10599)reivilibre2021-08-162-3/+5
| | | | | | | | | | | | Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net>
| | * Validate the max_rooms_per_space parameter to ensure it is non-negative. ↵Patrick Cloke2021-08-163-9/+39
| | | | | | | | | | | | (#10611)
| | * Experimental support for MSC3266 Room Summary API. (#10394)Michael Telatynski2021-08-1610-115/+289
| | |
| | * Split `synapse.federation.transport.server` into multiple files. (#10590)Patrick Cloke2021-08-167-2158/+2219
| | |
| | * Clean up some logging in the federation event handler (#10591)Richard van der Hoff2021-08-164-29/+28
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Include outlier status in `str(event)` In places where we log event objects, knowing whether or not you're dealing with an outlier is super useful. * Remove duplicated logging in get_missing_events When we process events received from get_missing_events, we log them twice (once in `_get_missing_events_for_pdu`, and once in `on_receive_pdu`). Reduce the duplication by removing the logging in `on_receive_pdu`, and ensuring the call sites do sensible logging. * log in `on_receive_pdu` when we already have the event * Log which prev_events we are missing * changelog
| | * Support federation in the new spaces summary API (MSC2946). (#10569)Patrick Cloke2021-08-166-165/+518
| | |
| | * Handle string read receipt data (#10606)Šimon Brandner2021-08-163-1/+32
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Handle string read receipt data Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Test that we handle string read receipt data Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Add changelog for #10606 Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Add docs Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Ignore malformed RRs Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Only surround hidden = ... Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Remove unnecessary argument Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Update changelog.d/10606.bugfix Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| | * Update the Synapse Grafana dashboard (#10570)Brendan Abolivier2021-08-162-66/+485
| | |
| | * Move /batch_send to /v2_alpha directory (MSC2716) (#10576)Eric Eastwood2021-08-134-409/+445
| | | | | | | | | | | | | | | | | | | | | * Move /batch_send to /v2_alpha directory As pointed out by @erikjohnston, https://github.com/matrix-org/synapse/pull/10552#discussion_r685836624
| | * Fix a harmless exception when the staged events queue is empty. (#10592)Patrick Cloke2021-08-132-5/+11
| | |
| | * Stop building a debian package for Groovy Gorilla (#10588)David Robertson2021-08-122-1/+1
| | |
| | * Merge pull request #10573 from DMRobertson/dmr/goodbye-buildkiteDavid Robertson2021-08-1215-84/+28
| | |\ | | | | | | | | Remove references to BuildKite in favour of GitHub Actions
| | | * Remove buildkite-era commentDavid Robertson2021-08-121-3/+0
| | | |
| | | * portdb also uses coverage, so provide $TOP thereDavid Robertson2021-08-121-0/+2
| | | |
| | | * Also rename in lint.shDavid Robertson2021-08-121-1/+1
| | | |
| | | * Missed another ci->.ciDavid Robertson2021-08-111-9/+9
| | | | | | | | | | | | | | | | Should have been more systematic with my grepping.
| | | * set TOP in sytest containersDavid Robertson2021-08-112-2/+3
| | | |
| | | * Teach MANIFEST and tox about ci->.ciDavid Robertson2021-08-112-2/+2
| | | |
| | | * Rename ci to .ciDavid Robertson2021-08-118-6/+6
| | | |
| | | * Add changelog entry and signoffDavid Robertson2021-08-101-0/+1
| | | | | | | | | | | | | | | | Signed-off-by: David Robertson <david.m.robertson1@gmail.com>
| | | * Kill off the .buildkite dir completelyDavid Robertson2021-08-105-14/+2
| | | |
| | | * Remove buildkite from portdb CI testsDavid Robertson2021-08-106-23/+17
| | | |
| | | * Remove unused BUILDKITE_BRANCH env varDavid Robertson2021-08-102-2/+0
| | | |
| | | * Move sytest worker-blacklist to ci directoryDavid Robertson2021-08-102-1/+1
| | | |
| | | * check-newsfragment: pass pr number explicitlyDavid Robertson2021-08-104-41/+3
| | | | | | | | | | | | | | | | | | | | use PULL_REQUEST_NUMBER instead of BUILDKITE_PULL_REQUEST remove the other user of BUILDKITE_PULL_REQUEST, namely merge_base_branch.sh
| | | * Move test_old_deps.sh to new ci dirDavid Robertson2021-08-103-2/+3
| | | |
| | * | Update the pagination parameter name based on MSC2946 review. (#10579)Patrick Cloke2021-08-113-10/+11
| | | |
| | * | Admin API to delete media for a specific user (#10558)Dirk Klimpel2021-08-117-128/+347
| | | |
| | * | Allow requesting the summary of a space which is joinable. (#10580)Patrick Cloke2021-08-113-15/+45
| | | | | | | | | | | | | | | | | | | | | | | | | | | | As opposed to only allowing the summary of spaces which the user is already in or has world-readable visibility. This makes the logic consistent with whether a space/room is returned as part of a space and whether a space summary can start at a space.
| | * | Expire old spaces summary pagination sessions. (#10574)Patrick Cloke2021-08-112-1/+24
| | | |
| | * | Clarify error message when joining a restricted room. (#10572)Patrick Cloke2021-08-112-1/+2
| | | |
| | * | Fix type hints in space summary tests. (#10575)Patrick Cloke2021-08-114-9/+10
| | | | | | | | | | | | And ensure that the file is checked via mypy.
| | * | support federation queries through http connect proxy (#10475)Dirk Klimpel2021-08-119-191/+555
| | | | | | | | | | | | | | | | | | | | Signed-off-by: Marcus Hoffmann <bubu@bubu1.eu> Signed-off-by: Dirk Klimpel dirk@klimpel.org
| | * | Only return state events that the AS passed in via `state_events_at_start` ↵Eric Eastwood2021-08-102-1/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (MSC2716) (#10552) * Only return state events that the AS passed in via state_events_at_start As discovered by @Half-Shot in https://github.com/matrix-org/matrix-doc/pull/2716#discussion_r684158448 Part of MSC2716 * Add changelog * Fix changelog extension
| | * | Add local support for the new spaces summary endpoint (MSC2946) (#10549)Patrick Cloke2021-08-106-112/+521
| | | | | | | | | | | | | | | | | | | | This adds support for the /hierarchy endpoint, which is an update to MSC2946. Currently this only supports rooms known locally to the homeserver.
| | * | Fix an edge-case with invited rooms over federation in the spaces summary. ↵Patrick Cloke2021-08-103-62/+138
| | | | | | | | | | | | | | | | | | | | | | | | | | | | (#10560) If a room which the requesting user was invited to was queried over federation it will now properly appear in the spaces summary (instead of being stripped out by the requesting server).
| | * | Update contributing.md to warn against rebasing an open PR. (#10563)Hillery Shay2021-08-102-0/+2
| | | | | | | | | | | | | | | | Signed-off-by: H.Shay <shaysquared@gmail.com>
| | * | Merge branch 'master' into developBrendan Abolivier2021-08-103-1/+13
| | |\ \
| | * | | When redacting, keep event fields around that maintain the historical event ↵Eric Eastwood2021-08-093-6/+40
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | structure intact (MSC2716) (#10538) * Keep event fields that maintain the historical event structure intact Fix https://github.com/matrix-org/synapse/issues/10521 * Add changelog * Bump room version * Better changelog text * Fix up room version after develop merge
| | * | | Do not remove `status_msg` when user going offline (#10550)Dirk Klimpel2021-08-093-9/+166
| | | | | | | | | | | | | | | Signed-off-by: Dirk Klimpel dirk@klimpel.org
| | * | | Moved homeserver documentation above reverse proxy examples (#10551)Drew Short2021-08-092-10/+14
| | | | | | | | | | | | | | | | | | | | Signed-off-by: Drew Short <warrick@sothr.com>
| | * | | Merge branch 'release-v1.40' into developBrendan Abolivier2021-08-0911-38/+61
| | |\ \ \ | | | |_|/ | | |/| |
| | * | | Convert Transaction and Edu object to attrs (#10542)Patrick Cloke2021-08-068-194/+75
| | | | | | | | | | | | | | | | | | | | | | | | | Instead of wrapping the JSON into an object, this creates concrete instances for Transaction and Edu. This allows for improved type hints and simplified code.
| | * | | Fix exceptions in logs when failing to get remote room list (#10541)Erik Johnston2021-08-065-38/+134
| | | | |
| | * | | Clean up federation event auth code (#10539)Richard van der Hoff2021-08-063-56/+69
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * drop old-room hack pretty sure we don't need this any more. * Remove incorrect comment about modifying `context` It doesn't look like the supplied context is ever modified. * Stop `_auth_and_persist_event` modifying its parameters This is only called in three places. Two of them don't pass `auth_events`, and the third doesn't use the dict after passing it in, so this should be non-functional. * Stop `_check_event_auth` modifying its parameters `_check_event_auth` is only called in three places. `on_send_membership_event` doesn't pass an `auth_events`, and `prep` and `_auth_and_persist_event` do not use the map after passing it in. * Stop `_update_auth_events_and_context_for_auth` modifying its parameters Return the updated auth event dict, rather than modifying the parameter. This is only called from `_check_event_auth`. * Improve documentation on `_auth_and_persist_event` Rename `auth_events` parameter to better reflect what it contains. * Improve documentation on `_NewEventInfo` * Improve documentation on `_check_event_auth` rename `auth_events` parameter to better describe what it contains * changelog
| | * | | Update the API response for spaces summary over federation. (#10530)Patrick Cloke2021-08-062-19/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds 'allowed_room_ids' (in addition to 'allowed_spaces', for backwards compatibility) to the federation response of the spaces summary. A future PR will remove the 'allowed_spaces' flag.
| | * | | Add a setting to disable TLS for sending email (#10546)Richard van der Hoff2021-08-068-50/+138
| | | | | | | | | | | | | | | This is mostly useful in case the server offers TLS, but doesn't present a valid certificate.
generated by cgit-magenta 1.5.1 (git 2.48.1) at 2025-09-02 01:16:39 +0000