summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* Merge tag 'v1.10.0'Brendan Abolivier2020-02-1287-520/+1795
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.10.0 (2020-02-12) =========================== **WARNING to client developers**: As of this release Synapse validates `client_secret` parameters in the Client-Server API as per the spec. See [\#6766](https://github.com/matrix-org/synapse/issues/6766) for details. Updates to the Docker image --------------------------- - Update the docker images to Alpine Linux 3.11. ([\#6897](https://github.com/matrix-org/synapse/issues/6897)) Synapse 1.10.0rc5 (2020-02-11) ============================== Bugfixes -------- - Fix the filtering introduced in 1.10.0rc3 to also apply to the state blocks returned by `/sync`. ([\#6884](https://github.com/matrix-org/synapse/issues/6884)) Synapse 1.10.0rc4 (2020-02-11) ============================== This release candidate was built incorrectly and is superceded by 1.10.0rc5. Synapse 1.10.0rc3 (2020-02-10) ============================== Features -------- - Filter out `m.room.aliases` from the CS API to mitigate abuse while a better solution is specced. ([\#6878](https://github.com/matrix-org/synapse/issues/6878)) Internal Changes ---------------- - Fix continuous integration failures with old versions of `pip`, which were introduced by a release of the `zipp` library. ([\#6880](https://github.com/matrix-org/synapse/issues/6880)) Synapse 1.10.0rc2 (2020-02-06) ============================== Bugfixes -------- - Fix an issue with cross-signing where device signatures were not sent to remote servers. ([\#6844](https://github.com/matrix-org/synapse/issues/6844)) - Fix to the unknown remote device detection which was introduced in 1.10.rc1. ([\#6848](https://github.com/matrix-org/synapse/issues/6848)) Internal Changes ---------------- - Detect unexpected sender keys on remote encrypted events and resync device lists. ([\#6850](https://github.com/matrix-org/synapse/issues/6850)) Synapse 1.10.0rc1 (2020-01-31) ============================== Features -------- - Add experimental support for updated authorization rules for aliases events, from [MSC2260](https://github.com/matrix-org/matrix-doc/pull/2260). ([\#6787](https://github.com/matrix-org/synapse/issues/6787), [\#6790](https://github.com/matrix-org/synapse/issues/6790), [\#6794](https://github.com/matrix-org/synapse/issues/6794)) Bugfixes -------- - Warn if postgres database has a non-C locale, as that can cause issues when upgrading locales (e.g. due to upgrading OS). ([\#6734](https://github.com/matrix-org/synapse/issues/6734)) - Minor fixes to `PUT /_synapse/admin/v2/users` admin api. ([\#6761](https://github.com/matrix-org/synapse/issues/6761)) - Validate `client_secret` parameter using the regex provided by the Client-Server API, temporarily allowing `:` characters for older clients. The `:` character will be removed in a future release. ([\#6767](https://github.com/matrix-org/synapse/issues/6767)) - Fix persisting redaction events that have been redacted (or otherwise don't have a redacts key). ([\#6771](https://github.com/matrix-org/synapse/issues/6771)) - Fix outbound federation request metrics. ([\#6795](https://github.com/matrix-org/synapse/issues/6795)) - Fix bug where querying a remote user's device keys that weren't cached resulted in only returning a single device. ([\#6796](https://github.com/matrix-org/synapse/issues/6796)) - Fix race in federation sender worker that delayed sending of device updates. ([\#6799](https://github.com/matrix-org/synapse/issues/6799), [\#6800](https://github.com/matrix-org/synapse/issues/6800)) - Fix bug where Synapse didn't invalidate cache of remote users' devices when Synapse left a room. ([\#6801](https://github.com/matrix-org/synapse/issues/6801)) - Fix waking up other workers when remote server is detected to have come back online. ([\#6811](https://github.com/matrix-org/synapse/issues/6811)) Improved Documentation ---------------------- - Clarify documentation related to `user_dir` and `federation_reader` workers. ([\#6775](https://github.com/matrix-org/synapse/issues/6775)) Internal Changes ---------------- - Record room versions in the `rooms` table. ([\#6729](https://github.com/matrix-org/synapse/issues/6729), [\#6788](https://github.com/matrix-org/synapse/issues/6788), [\#6810](https://github.com/matrix-org/synapse/issues/6810)) - Propagate cache invalidates from workers to other workers. ([\#6748](https://github.com/matrix-org/synapse/issues/6748)) - Remove some unnecessary admin handler abstraction methods. ([\#6751](https://github.com/matrix-org/synapse/issues/6751)) - Add some debugging for media storage providers. ([\#6757](https://github.com/matrix-org/synapse/issues/6757)) - Detect unknown remote devices and mark cache as stale. ([\#6776](https://github.com/matrix-org/synapse/issues/6776), [\#6819](https://github.com/matrix-org/synapse/issues/6819)) - Attempt to resync remote users' devices when detected as stale. ([\#6786](https://github.com/matrix-org/synapse/issues/6786)) - Delete current state from the database when server leaves a room. ([\#6792](https://github.com/matrix-org/synapse/issues/6792)) - When a client asks for a remote user's device keys check if the local cache for that user has been marked as potentially stale. ([\#6797](https://github.com/matrix-org/synapse/issues/6797)) - Add background update to clean out left rooms from current state. ([\#6802](https://github.com/matrix-org/synapse/issues/6802), [\#6816](https://github.com/matrix-org/synapse/issues/6816)) - Refactoring work in preparation for changing the event redaction algorithm. ([\#6803](https://github.com/matrix-org/synapse/issues/6803), [\#6805](https://github.com/matrix-org/synapse/issues/6805), [\#6806](https://github.com/matrix-org/synapse/issues/6806), [\#6807](https://github.com/matrix-org/synapse/issues/6807), [\#6820](https://github.com/matrix-org/synapse/issues/6820))
| * Move the warning at the top of the release changes v1.10.0 github/release-v1.10.0 release-v1.10.0Brendan Abolivier2020-02-121-3/+2
| |
| * 1.10.0Brendan Abolivier2020-02-124-2/+16
| |
| * bump the version of Alpine Linux used in the docker images (#6897)Richard van der Hoff2020-02-122-1/+2
| |
| * 1.10.0rc5 v1.10.0rc5Richard van der Hoff2020-02-112-2/+6
| |
| * changelog wordingRichard van der Hoff2020-02-111-2/+2
| |
| * Update CHANGES.mdRichard van der Hoff2020-02-111-1/+1
| |
| * changelog formattingRichard van der Hoff2020-02-111-2/+2
| |
| * 1.10.0rc4Richard van der Hoff2020-02-113-2/+10
| |
| * filter out m.room.aliases from /sync state blocks (#6884)Matthew Hodgson2020-02-102-0/+2
| | | | | | We forgot to filter out aliases from /sync state blocks as well as the timeline.
| * 1.10.0rc3 v1.10.0rc3Richard van der Hoff2020-02-104-3/+16
| |
| * filter out m.room.aliases from the CS API until a better solution is specced ↵Matthew Hodgson2020-02-102-0/+8
| | | | | | | | | | (#6878) We're in the middle of properly mitigating spam caused by malicious aliases being added to a room. However, until this work fully lands, we temporarily filter out all m.room.aliases events from /sync and /messages on the CS API, to remove abusive aliases. This is considered acceptable as m.room.aliases events were never a reliable record of the given alias->id mapping and were purely informational, and in their current state do more harm than good.
| * Update setuptools for python 3.5 tests (#6880)Richard van der Hoff2020-02-102-0/+19
| | | | | | Workaround for jaraco/zipp#40
| * Update changelog v1.10.0rc2Erik Johnston2020-02-061-1/+1
| |
| * Update changelogErik Johnston2020-02-061-2/+2
| |
| * Update changelogErik Johnston2020-02-061-1/+1
| |
| * 1.10.0rc2Erik Johnston2020-02-065-4/+17
| |
| * Check sender_key matches on inbound encrypted events. (#6850)Erik Johnston2020-02-053-14/+67
| | | | | | If they don't then the device lists are probably out of sync.
| * Merge pull request #6844 from matrix-org/uhoreg/cross_signing_fix_device_fedHubert Chathi2020-02-052-0/+11
| | | | | | add device signatures to device key query results
| * Fix detecting unknown devices from remote encrypted events. (#6848)Erik Johnston2020-02-046-7/+7
| | | | | | | | | | | | | | | | We were looking at the wrong event type (`m.room.encryption` vs `m.room.encrypted`). Also fixup the duplicate `EvenTypes` entries. Introduced in #6776.
| * Update changelog v1.10.0rc1Erik Johnston2020-01-311-1/+4
| |
| * Fix link in upgrade.rstErik Johnston2020-01-311-1/+1
| |
| * 1.10.0rc1Erik Johnston2020-01-3135-35/+47
| |
| * Fix deleting of stale marker for device lists (#6819)Erik Johnston2020-01-312-7/+8
| | | | | | | | We were in fact only deleting stale marker when we got an incremental update, rather than when we did a full resync.
| * pass room_version into compute_event_signature (#6807)Richard van der Hoff2020-01-313-9/+25
| |
| * Merge pull request #6806 from matrix-org/rav/redact_changes/3Richard van der Hoff2020-01-316-41/+49
| |\ | | | | | | Pass room_version into add_hashes_and_signatures
| | * changelogRichard van der Hoff2020-01-301-0/+1
| | |
| | * Pass room_version into add_hashes_and_signaturesRichard van der Hoff2020-01-303-10/+21
| | |
| | * Pass room_version into create_local_event_from_event_dictRichard van der Hoff2020-01-302-25/+19
| | |
| | * Store the room version in EventBuilderRichard van der Hoff2020-01-302-7/+9
| | |
| * | Merge pull request #6820 from matrix-org/rav/get_room_version_idRichard van der Hoff2020-01-3114-38/+64
| |\ \ | | | | | | | | Make `get_room_version` return a RoomVersion object
| | * | newsfileRichard van der Hoff2020-01-311-0/+1
| | | |
| | * | Add `get_room_version` methodRichard van der Hoff2020-01-312-5/+26
| | | | | | | | | | | | | | | | So that we can start factoring out some of this boilerplatey boilerplate.
| | * | s/get_room_version/get_room_version_id/Richard van der Hoff2020-01-3112-33/+37
| | | | | | | | | | | | | | | | | | | | ... to make way for a forthcoming get_room_version which returns a RoomVersion object.
| * | | Fix bug with getting missing auth event during join 500'ed (#6810)Erik Johnston2020-01-312-1/+6
| |/ /
| * | pass room version into FederationHandler.on_invite_request (#6805)Richard van der Hoff2020-01-303-4/+5
| | |
| * | Log when we delete room in bg update (#6816)Erik Johnston2020-01-302-0/+3
| |/
| * MSC2260: Block direct sends of m.room.aliases events (#6794)Richard van der Hoff2020-01-304-33/+28
| | | | | | | | | | as per MSC2260
| * Backgroud update to clean out rooms from current state (#6802)Erik Johnston2020-01-303-2/+126
| |
| * Resync remote device list when detected as stale. (#6786)Erik Johnston2020-01-304-7/+28
| |
| * Fix sending server up commands from workers (#6811)Erik Johnston2020-01-306-13/+36
| | | | | | | | Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| * When server leaves room check for stale device lists. (#6801)Erik Johnston2020-01-303-6/+83
| | | | | | | | | | | | | | | | | | When a server leaves a room it may stop sharing a room with remote users, and thus not get any updates to their device lists. So we need to check for this case and delete those device lists from the cache. We don't need to do this if we stop sharing a room because the remote user leaves the room, because we track that case via looking at membership changes.
| * When a client asks for remote keys check if should resync. (#6797)Erik Johnston2020-01-302-3/+30
| | | | | | | | | | | | If we detect that the remote users' keys may have changed then we should attempt to resync against the remote server rather than using the (potentially) stale local cache.
| * Type defintions for use in refactoring for redaction changes (#6803)Richard van der Hoff2020-01-305-8/+24
| | | | | | | | | | | | | | | | | | | | * Bump signedjson to 1.1 ... so that we can use the type definitions * Fix breakage caused by upgrade to signedjson 1.1 Thanks, @illicitonion...
| * Remove unused DeviceRow class (#6800)Erik Johnston2020-01-292-20/+2
| |
| * Merge pull request #6790 from matrix-org/rav/msc2260.1Richard van der Hoff2020-01-295-18/+112
| |\ | | | | | | MSC2260: change the default power level for m.room.aliases events
| | * changelogRichard van der Hoff2020-01-291-0/+1
| | |
| | * Make /directory/room/<alias> handle restrictive power levelsRichard van der Hoff2020-01-291-1/+6
| | | | | | | | | | | | | | | Fixes a bug where the alias would be added, but `PUT /directory/room/<alias>` would return a 403.
| | * Set the PL for aliases events to 0.Richard van der Hoff2020-01-292-3/+16
| | |
| | * Factor out a `copy_power_levels_contents` methodRichard van der Hoff2020-01-293-15/+90
| |/ | | | | | | I'm going to need another copy (hah!) of this.
| * Fix race in federation sender that delayed device updates. (#6799)Erik Johnston2020-01-293-30/+23
| | | | | | | | | | | | | | | | | | | | | | | | We were sending device updates down both the federation stream and device streams. This mean there was a race if the federation sender worker processed the federation stream first, as when the sender checked if there were new device updates the slaved ID generator hadn't been updated with the new stream IDs and so returned nothing. This situation is correctly handled by events/receipts/etc by not sending updates down the federation stream and instead having the federation sender worker listen on the other streams and poke the transaction queues as appropriate.
| * Delete current state when server leaves a room (#6792)Erik Johnston2020-01-293-75/+198
| | | | | | | | | | | | Otherwise its just stale data, which may get deleted later anyway so can't be relied on. It's also a bit of a shotgun if we're trying to get the current state of a room we're not in.
| * Fix bug when querying remote user keys that require a resync. (#6796)Erik Johnston2020-01-292-1/+3
| | | | | | | | We ended up only returning a single device, rather than all of them.
| * Fix outbound federation request metrics (#6795)Erik Johnston2020-01-282-0/+5
| |
| * Merge pull request #6787 from matrix-org/rav/msc2260Richard van der Hoff2020-01-283-5/+36
| |\ | | | | | | Implement updated auth rules from MSC2260
| | * fix bad variable refRichard van der Hoff2020-01-281-1/+1
| | |
| | * update changelogRichard van der Hoff2020-01-282-1/+1
| | |
| | * changelogRichard van der Hoff2020-01-281-0/+1
| | |
| | * Implement updated auth rules from MSC2260Richard van der Hoff2020-01-282-5/+35
| | |
| * | Detect unknown remote devices and mark cache as stale (#6776)Erik Johnston2020-01-286-8/+126
| |/ | | | | | | We just mark the fact that the cache may be stale in the database for now.
| * Pass room version object into event_auth.check and check_redaction (#6788)Richard van der Hoff2020-01-288-34/+53
| | | | | | | | | | | | | | These are easier to work with than the strings and we normally have one around. This fixes `FederationHander._persist_auth_tree` which was passing a RoomVersion object into event_auth.check instead of a string.
| * Warn if postgres database has non-C locale. (#6734)Erik Johnston2020-01-286-1/+81
| | | | | | As using non-C locale can cause issues on upgrading OS.
| * Merge branch 'master' into developErik Johnston2020-01-284-2/+23
| |\
| * | Add `rooms.room_version` column (#6729)Erik Johnston2020-01-2711-73/+270
| | | | | | | | | This is so that we don't have to rely on pulling it out from `current_state_events` table.
| * | Propagate cache invalidates from workers to other workers. (#6748)Erik Johnston2020-01-274-5/+29
| | | | | | | | | Currently if a worker invalidates a cache it will be streamed to master, which then didn't forward those to other workers.
| * | Merge pull request #6775 from matrix-org/jaywink/worker-docs-tweaksBrendan Abolivier2020-01-272-0/+18
| |\ \ | | | | | | | | Clarifications to the workers documentation
| | * | Formatting of changelogJason Robinson2020-01-271-1/+1
| | | | | | | | | | | | Co-Authored-By: Brendan Abolivier <babolivier@matrix.org>
| | * | Fix federation_reader listeners doc as per PR reviewJason Robinson2020-01-271-2/+12
| | | | | | | | | | | | | | | | Signed-off-by: Jason Robinson <jasonr@matrix.org>
| | * | Clarifications to the workers documentationJason Robinson2020-01-242-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add note that user_dir requires disabling user dir updates from the main synapse process. * Add note that federation_reader should have the federation listener resource. Signed-off-by: Jason Robinson <jasonr@matrix.org>
| * | | Validate client_secret parameter (#6767)Andrew Morgan2020-01-246-6/+93
| |/ /
| * | Make 'event.redacts' never raise. (#6771)Erik Johnston2020-01-235-6/+62
| | | | | | | | | | | | | | | | | | There are quite a few places that we assume that a redaction event has a corresponding `redacts` key, which is not always the case. So lets cheekily make it so that event.redacts just returns None instead.
| * | Merge branch 'master' into developBrendan Abolivier2020-01-234-5/+20
| |\ \
| * | | a bit of debugging for media storage providers (#6757)Richard van der Hoff2020-01-233-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | * a bit of debugging for media storage providers * changelog
| * | | Minor fixes to user admin api (#6761)Richard van der Hoff2020-01-232-9/+6
| | | | | | | | | | | | | | | | * don't insist on a password (this is valid if you have an SSO login) * fix reference to undefined `requester`
| * | | Merge branch 'release-v1.9.0' into developAndrew Morgan2020-01-232-4/+5
| |\ \ \
| * | | | Remove unnecessary abstractions in admin handler (#6751)Andrew Morgan2020-01-224-73/+11
| | | | |
* | | | | Update documentation (#6859)Robin Vleij2020-02-051-1/+2
| |_|_|/ |/| | | | | | | | | | | Update documentation to reflect the correct format of user_id (fully qualified).
* | | | 1.9.1 v1.9.1 github/release-v1.9.1 release-v1.9.1Erik Johnston2020-01-284-2/+16
| | | |
* | | | Fix setting `mau_limit_reserved_threepids` config (#6793)Erik Johnston2020-01-282-1/+8
| |_|/ |/| | | | | | | | | | | Calling the invalidation function during initialisation of the data stores introduces a circular dependency, causing Synapse to fail to start.
* | | Fixup changelog v1.9.0 github/release-v1.9.0 release-v1.9.0Brendan Abolivier2020-01-231-1/+1
| | |
* | | Fixup changelogBrendan Abolivier2020-01-231-4/+5
| | |
* | | Fixup changelogBrendan Abolivier2020-01-232-2/+4
| | |
* | | Merge branch 'release-v1.9.0' of github.com:matrix-org/synapse into ↵Brendan Abolivier2020-01-232-4/+5
|\ \ \ | | |/ | |/| | | | release-v1.9.0
| * | Update admin room docs with correct endpoints (#6770)Andrew Morgan2020-01-232-4/+5
| |/
* / 1.9.0Brendan Abolivier2020-01-233-1/+13
|/
* Fixup warning about workers changes v1.9.0rc1Brendan Abolivier2020-01-221-1/+1
|
* Add deprecation headersBrendan Abolivier2020-01-221-0/+4
|
* Fixup changelogBrendan Abolivier2020-01-221-10/+10
|
* 1.9.0rc1Brendan Abolivier2020-01-2249-49/+71
|
* Admin API to list, filter and sort rooms (#6720)Andrew Morgan2020-01-228-7/+787
|
* Merge pull request #6764 from matrix-org/babolivier/fix-thumbnailBrendan Abolivier2020-01-223-5/+46
|\ | | | | Fix typo in _select_thumbnail
| * Lint + changelogBrendan Abolivier2020-01-222-3/+2
| |
| * Remove unused importBrendan Abolivier2020-01-221-1/+1
| |
| * Add tests for thumbnailingBrendan Abolivier2020-01-221-3/+45
| |
| * Fix typo in _select_thumbnailBrendan Abolivier2020-01-221-1/+1
|/
* Fix and add test to deprecated quarantine media admin api (#6756)Andrew Morgan2020-01-223-5/+13
|
* Allow monthly active user limiting support for worker mode, fixes #4639. (#6742)Neil Johnson2020-01-226-82/+100
|
* Allow streaming cache invalidate all to workers. (#6749)Erik Johnston2020-01-226-15/+69
|
* Remove unused CI docker compose files (#6754)Erik Johnston2020-01-224-66/+1
| | | These now exist in the pipelines repo.
* Avoid attribute error when `password_config` present but empty (#6753)Ivan Vilata-i-Balaguer2020-01-222-1/+2
| | | | | | | | | | The old statement returned `None` for such a `password_config` (like the one created on first run), thus retrieval of the `pepper` key failed with `AttributeError`. Fixes #5315 Signed-off-by: Ivan Vilata i Balaguer <ivan@selidor.net>
* Port synapse_port_db to async/await (#6718)Brendan Abolivier2020-01-213-89/+126
| | | | | | | | | | | | | | | | | | | | | | | | | | * Raise an exception if there are pending background updates So we return with a non-0 code * Changelog * Port synapse_port_db to async/await * Port update_database to async/await * Add version string to mocked homeservers * Remove unused imports * Convert overseen bits to async/await * Fixup logging contexts * Fix imports * Add a way to print an error without raising an exception * Incorporate review
* Add a DeltaState to track changes to be made to current state (#6716)Erik Johnston2020-01-203-99/+112
|
* Fixup synapse.rest to pass mypy (#6732)Erik Johnston2020-01-2012-35/+56
|
* Fix `/events/:event_id` deprecated API. (#6731)Erik Johnston2020-01-204-2/+30
|
* Fixup synapse.api to pass mypy (#6733)Erik Johnston2020-01-206-4/+14
|
* Fix changing password via user admin API. (#6730)Erik Johnston2020-01-203-2/+16
|
* Fix empty account_validity config block (#6747)Andrew Morgan2020-01-202-1/+3
|\
| * Update changelog.d/6747.bugfixAndrew Morgan2020-01-201-1/+1
| | | | | | Co-Authored-By: Erik Johnston <erik@matrix.org>
| * Add changelogAndrew Morgan2020-01-201-0/+1
| |
| * Fix empty account_validity config blockAndrew Morgan2020-01-201-1/+2
| |
* | Revert "Newsfile"Erik Johnston2020-01-201-1/+0
| | | | | | | | This reverts commit 11c23af465633b8dd641db60793a19e5b7524e2b.
* | NewsfileErik Johnston2020-01-201-0/+1
|/
* Add more logging around message retention policies support (#6717)Brendan Abolivier2020-01-173-0/+22
| | | So we can debug issues like #6683 more easily
* Fix up changelogErik Johnston2020-01-172-1/+1
|
* bump version to v1.9.0.dev2 v1.9.0.dev2Richard van der Hoff2020-01-171-1/+1
|
* Fix syntax error in run_upgrade for schema 57 (#6728)Satsuki Yanagi2020-01-172-3/+5
| | | | | | | Fix #6727 Related #6655 Co-authored-by: Erik Johnston <erikj@jki.re>
* Merge pull request #6714 from matrix-org/babolivier/retention_select_eventBrendan Abolivier2020-01-174-7/+8
|\ | | | | Fix instantiation of message retention purge jobs
| * Precise changelogBrendan Abolivier2020-01-161-1/+1
| |
| * Fixup diffBrendan Abolivier2020-01-161-6/+7
| |
| * Remove get_room_event_after_stream_ordering entirelyBrendan Abolivier2020-01-162-58/+13
| |
| * LintBrendan Abolivier2020-01-161-6/+12
| |
| * Rename changelogBrendan Abolivier2020-01-151-0/+0
| |
| * ChangelogBrendan Abolivier2020-01-151-0/+1
| |
| * Correctly order when selecting before stream orderingBrendan Abolivier2020-01-151-2/+5
| |
| * Fix typoBrendan Abolivier2020-01-151-1/+1
| |
| * Fix instantiation of message retention purge jobsBrendan Abolivier2020-01-152-13/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When figuring out which topological token to start a purge job at, we need to do the following: 1. Figure out a timestamp before which events will be purged 2. Select the first stream ordering after that timestamp 3. Select info about the first event after that stream ordering 4. Build a topological token from that info In some situations (e.g. quiet rooms with a short max_lifetime), there might not be an event after the stream ordering at step 3, therefore we abort the purge with the error `No event found`. To mitigate that, this patch fetches the first event _before_ the stream ordering, instead of after.
* | bump version to v1.9.0.dev1 v1.9.0.dev1Richard van der Hoff2020-01-171-1/+1
| |
* | Merge pull request #6724 from matrix-org/rav/log_saml_attributesRichard van der Hoff2020-01-1711-24/+114
|\ \ | | | | | | Log saml assertions rather than the whole response
| * | changelogRichard van der Hoff2020-01-161-0/+1
| | |
| * | Log saml assertions rather than the whole responseRichard van der Hoff2020-01-163-1/+72
| | | | | | | | | | | | | | | | | | ... since the whole response is huge. We even need to break up the assertions, since kibana otherwise truncates them.
| * | move batch_iter to a separate moduleRichard van der Hoff2020-01-168-23/+41
| | |
* | | Delegate remote_user_id mapping to the saml mapping provider (#6723)Richard van der Hoff2020-01-173-6/+23
| | | | | | | | | Turns out that figuring out a remote user id for the SAML user isn't quite as obvious as it seems. Factor it out to the SamlMappingProvider so that it's easy to control.
* | | Wake up transaction queue when remote server comes back online (#6706)Erik Johnston2020-01-1711-8/+135
| | | | | | | | | | | | | | | This will be used to retry outbound transactions to a remote server if we think it might have come back up.
* | | Clarify the `account_validity` and `email` sections of the sample ↵Richard van der Hoff2020-01-175-272/+320
|/ / | | | | | | | | | | | | | | | | | | | | configuration. (#6685) Generally try to make this more comprehensible, and make it match the conventions. I've removed the documentation for all the settings which allow you to change the names of the template files, because I can't really see why they are useful.
* | Add StateMap type alias (#6715)Erik Johnston2020-01-1614-93/+115
| |
* | Add tips for the changelog to the pull request template (#6663)Andrew Morgan2020-01-163-3/+8
| |
* | Add org.matrix.e2e_cross_signing to unstable_features in /versions as per ↵Neil Johnson2020-01-162-0/+3
| | | | | | | | MSC1756 (#6712)
* | Port synapse.replication.tcp to async/await (#6666)Erik Johnston2020-01-1615-105/+80
| | | | | | | | | | | | | | | | | | | | * Port synapse.replication.tcp to async/await * Newsfile * Correctly document type of on_<FOO> functions as async * Don't be overenthusiastic with the asyncing....
* | Fix purge_room admin API (#6711)Erik Johnston2020-01-153-4/+3
| |
* | Remove duplicate session check in web fallback servlet (#6702)Andrew Morgan2020-01-152-4/+1
| |
* | Merge pull request #6688 from matrix-org/rav/module_api_extensionsRichard van der Hoff2020-01-154-7/+61
|\ \ | | | | | | Cleanups and additions to the module API
| * \ Merge branch 'develop' into rav/module_api_extensionsRichard van der Hoff2020-01-1564-290/+1276
| |\ \ | |/ / |/| |
* | | Implement RedirectException (#6687)Richard van der Hoff2020-01-154-7/+113
| | | | | | | | | | | | | | | Allow REST endpoint implemnentations to raise a RedirectException, which will redirect the user's browser to a given location.
* | | Add `local_current_membership` table (#6655)Erik Johnston2020-01-1520-107/+263
| |/ |/| | | | | | | | | | | Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.
* | Process EDUs in parallel with PDUs. (#6697)Erik Johnston2020-01-142-12/+59
| | | | | | | | This means that things like to device messages don't get blocked behind processing PDUs, which can potentially take *ages*.
* | Fixup synapse.replication to pass mypy checks (#6667)Erik Johnston2020-01-1412-86/+105
| |
* | Quarantine media by ID or user ID (#6681)Andrew Morgan2020-01-137-11/+632
| |
* | Document more supported endpoints for workers (#6698)Richard van der Hoff2020-01-132-0/+5
| |
* | Kill off RegistrationError (#6691)Richard van der Hoff2020-01-134-17/+4
| | | | | | This is pretty pointless. Let's just use SynapseError.
* | Don't assign numeric IDs for empty usernames (#6690)Richard van der Hoff2020-01-132-1/+2
| | | | | | | | Fix a bug where we would assign a numeric userid if somebody tried registering with an empty username
* | Merge pull request #6689 from matrix-org/rav/saml_mapping_provider_updatesRichard van der Hoff2020-01-132-6/+17
|\ \ | | | | | | Updates to the SAML mapping provider API
| * | changelogRichard van der Hoff2020-01-121-0/+1
| | |
| * | Pass client redirect URL into SAML mapping providersRichard van der Hoff2020-01-121-4/+11
| | |
| * | Pass the module_api into the SamlMappingProviderRichard van der Hoff2020-01-121-2/+5
| | | | | | | | | | | | | | | ... for consistency with other modules, and because we'll need it sooner or later and it will be a pain to introduce later.
* | | Allow additional_resources to implement Resource directly (#6686)Richard van der Hoff2020-01-132-2/+12
| | | | | | | | | | | | | | | | | | AdditionalResource really doesn't add any value, and it gets in the way for resources which want to support child resources or the like. So, if the resource object already implements the IResource interface, don't bother wrapping it.
* | | Fix exceptions on requests for non-ascii urls (#6682)Richard van der Hoff2020-01-132-1/+3
| | | | | | | | | Fixes #6402
* | | comment for run_in_backgroundRichard van der Hoff2020-01-121-0/+3
| | |
* | | Merge pull request #6675 from matrix-org/rav/die_sqlite37_die_die_dieRichard van der Hoff2020-01-106-41/+47
|\ \ \ | | | | | | | | Refuse to start if sqlite is older than 3.11.0
| * | | update install notes for CentOSRichard van der Hoff2020-01-091-0/+5
| | | |
| * | | changelogRichard van der Hoff2020-01-091-0/+1
| | | |
| * | | Refuse to start if sqlite is older than 3.11.0Richard van der Hoff2020-01-093-8/+19
| | | |
| * | | Check postgres version in check_databaseRichard van der Hoff2020-01-091-13/+12
| | | | | | | | | | | | | | | | | | | | this saves doing it on each connection, and will allow us to pass extra options in.
| * | | Modify check_database to take a connection rather than a cursorRichard van der Hoff2020-01-094-28/+18
| |/ / | | | | | | | | | We might not need the cursor at all.
* | | Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2020-01-092-0/+12
|\ \ \ | |/ / |/| |
| * | Add note about log_file no longer be accepted (#6674) github/release-v1.8.0 release-v1.8.0Erik Johnston2020-01-092-0/+12
| | |
| | * changelogRichard van der Hoff2020-01-121-0/+1
| | |
| | * Handle `config` not being set for synapse plugin modulesRichard van der Hoff2020-01-121-1/+1
| | | | | | | | | | | | | | | Some modules don't need any config, so having to define a `config` property just to keep the loader happy is a bit annoying.
| | * Cleanups and additions to the module APIRichard van der Hoff2020-01-122-6/+59
| |/ |/| | | | | | | | | | | | | | | | | | | Add some useful things, such as error types and logcontext handling, to the API. Make `hs` a private member to dissuade people from using it (hopefully they aren't already). Add a couple of new methods (`record_user_external_id` and `generate_short_term_login_token`).
* | Allow admin users to create or modify users without a shared secret (#6495)Manuel Stahl2020-01-099-339/+655
| | | | | | Signed-off-by: Manuel Stahl <manuel.stahl@awesome-technologies.de>
* | Merge branch 'master' into developErik Johnston2020-01-095-5/+17
|\|
| * Fixup changelog v1.8.0Erik Johnston2020-01-091-1/+1
| |
| * 1.8.0Erik Johnston2020-01-095-5/+17
| |
* | Merge pull request #6664 from matrix-org/erikj/media_admin_apisErik Johnston2020-01-083-120/+131
|\ \ | | | | | | Fix media repo admin APIs when using a media worker.
| * | Shuffle the codeErik Johnston2020-01-081-25/+16
| | |
| * | CommentsErik Johnston2020-01-081-0/+3
| | |
| * | Do not rely on streaming events, as media repo doesn'tErik Johnston2020-01-081-12/+26
| | |
| * | NewsfileErik Johnston2020-01-081-0/+1
| | |
| * | Import RoomStore in media worker to fix admin APIsErik Johnston2020-01-081-0/+2
| | |
| * | Move media admin store functions to worker storeErik Johnston2020-01-081-120/+120
| | |
* | | Merge pull request #6665 from matrix-org/babolivier/retention_doc_typoBrendan Abolivier2020-01-082-1/+2
|\ \ \ | | | | | | | | Fix typo in message retention policies doc
| * | | ChangelogBrendan Abolivier2020-01-081-0/+1
| | | |
| * | | Fix typo in message retention policies docBrendan Abolivier2020-01-081-1/+1
| | | |
* | | | Merge remote-tracking branch 'origin/release-v1.8.0' into developRichard van der Hoff2020-01-088-28/+184
|\ \ \ \ | |/ / / |/| | / | | |/ | |/|
| * | Fix GET request on /_synapse/admin/v2/users endpoint (#6563)Manuel Stahl2020-01-083-2/+44
| | | | | | | | | | | | Fixes #6552
| * | Back out ill-advised notary server hackery (#6657)Richard van der Hoff2020-01-085-26/+140
| |/ | | | | | | | | | | | | | | | | | | | | This was ill-advised. We can't modify verify_keys here, because the response object has already been signed by the requested key. Furthermore, it's somewhat unnecessary because existing versions of Synapse (which get upset that the notary key isn't present in verify_keys) will fall back to a direct fetch via `/key/v2/server`. Also: more tests for fetching keys via perspectives: it would be nice if we actually tested when our fetcher can't talk to our notary impl.
* | Merge pull request #6624 from matrix-org/babolivier/retention_docBrendan Abolivier2020-01-082-0/+192
|\ \ | | | | | | Add complete documentation of the message retention policies support
| * | Fix referenceBrendan Abolivier2020-01-071-1/+1
| | |
| * | Incorporate reviewBrendan Abolivier2020-01-071-27/+28
| | |
| * | Merge branch 'develop' into babolivier/retention_docBrendan Abolivier2020-01-0783-491/+788
| |\|
| * | Apply suggestions from code reviewBrendan Abolivier2020-01-071-5/+4
| | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | Update changelog.d/6624.docBrendan Abolivier2020-01-071-1/+1
| | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | Fix vacuum instructions for sqliteBrendan Abolivier2020-01-031-2/+2
| | |
| * | Rename changelogBrendan Abolivier2020-01-031-0/+0
| | |
| * | Add a complete documentation of the message retention policies supportBrendan Abolivier2020-01-032-0/+192
| | |
* | | contrib/docker-compose: fixing mount that overrides containers' /etc (#6656)Fabian Meyer2020-01-082-1/+2
| | | | | | | | | | | | The mount in the form of ./matrix-config:/etc overwrites the contents of the container /etc folder. Since all valid ca certificates are stored in /etc, the synapse.push.httppusher, for example, cannot validate the certificate from matrix.org.
* | | typoMatthew Hodgson2020-01-071-1/+1
| | |
* | | Correctly proxy remote group HTTP errors. (#6654)Erik Johnston2020-01-072-0/+17
| | | | | | | | | | | | | | | e.g. if remote returns a 404 then that shouldn't be treated as an error but should be proxied through.
* | | Merge pull request #6621 from matrix-org/babolivier/purge_job_config_typoBrendan Abolivier2020-01-073-10/+11
|\ \ \ | |_|/ |/| | Fix a typo in the purge jobs configuration example
| * | RewordBrendan Abolivier2020-01-072-6/+6
| | |
| * | Change the example from 5min to 12hBrendan Abolivier2020-01-072-8/+8
| | | | | | | | | | | | Have a purge job running every 5min is probably not something we want to advise admins to do as a sort-of default.
| * | ChangelogBrendan Abolivier2020-01-031-0/+1
| | |
| * | Update sample configBrendan Abolivier2020-01-031-1/+1
| | |
| * | Fix a typo in the purge jobs configuration exampleBrendan Abolivier2020-01-031-1/+1
| |/
* | Fixup changelog v1.8.0rc1Erik Johnston2020-01-071-3/+3
| |
* | Fixup changelogErik Johnston2020-01-071-1/+1
| |
* | Fixup changelogErik Johnston2020-01-071-21/+11
| |
* | 1.8.0rc1Erik Johnston2020-01-0756-55/+81
| |
* | Merge pull request #6652 from matrix-org/babolivier/depth_missing_eventsBrendan Abolivier2020-01-073-3/+4
|\ \ | | | | | | Fix conditions failing if min_depth = 0
| * | ChangelogBrendan Abolivier2020-01-071-0/+1
| | |
| * | Fix conditions failing if min_depth = 0Brendan Abolivier2020-01-072-3/+3
| |/ | | | | | | This could result in Synapse not fetching prev_events for new events in the room if it has missed some events.
* | Add a background update to clear tombstoned rooms from the directory (#6648)Richard van der Hoff2020-01-076-1/+106
| | | | | | | | | | | | * Add a background update to clear tombstoned rooms from the directory * use the ABC metaclass
* | Async/await for background updates (#6647)Richard van der Hoff2020-01-072-16/+21
| | | | | | | | so that bg update routines can be async
* | port BackgroundUpdateTestCase to HomeserverTestCase (#6653)Richard van der Hoff2020-01-072-35/+38
| |
* | Merge pull request #6645 from matrix-org/rav/fix_synchrotron_errorRichard van der Hoff2020-01-073-15/+48
|\ \ | | | | | | Fix exceptions in the synchrotron worker log when events are rejected.
| * | changelogRichard van der Hoff2020-01-061-0/+1
| | |
| * | Fix exceptions in log when rejected event is replicatedRichard van der Hoff2020-01-061-2/+9
| | |
| * | async/await for SyncReplicationHandler.process_and_notifyRichard van der Hoff2020-01-061-5/+4
| | |
| * | Clarify documentation on get_event* methodsRichard van der Hoff2020-01-061-9/+35
| | | | | | | | | | | | Make it clearer how they behave in the face of rejected and/or missing events.
* | | Merge pull request #6629 from matrix-org/rav/kill_event_reference_hashesRichard van der Hoff2020-01-067-103/+55
|\ \ \ | |/ / |/| | Remove a bunch of unused code from event creation
| * | changelogRichard van der Hoff2020-01-061-0/+1
| | |
| * | Remove unused get_latest_event_ids_and_hashes_in_roomRichard van der Hoff2020-01-061-42/+0
| | |
| * | Remove unused get_prev_events_and_hashes_for_roomRichard van der Hoff2020-01-062-43/+6
| | |
| * | Remove unused hashes and depths from _update_membership paramsRichard van der Hoff2020-01-061-13/+4
| | |
| * | Remove unused hashes and depths from create_event paramsRichard van der Hoff2020-01-063-22/+13
| | |
| * | Remove unused hashes and depths from create_new_client_event paramsRichard van der Hoff2020-01-062-12/+26
| | |
| * | replace get_prev_events_and_hashes_for_room with get_prev_events_for_room in ↵Richard van der Hoff2020-01-062-9/+38
| | | | | | | | | | | | create_new_client_event
| * | rename get_prev_events_for_room to get_prev_events_and_hashes_for_roomRichard van der Hoff2020-01-064-7/+12
| | | | | | | | | | | | ... to make way for a new method which just returns the event ids
* | | Fix some test failures when frozen_dicts are enabled (#6642)Richard van der Hoff2020-01-065-11/+20
| | | | | | | | | | | | Fixes #4026
* | | Add experimental 'databases' config (#6580)Erik Johnston2020-01-063-13/+64
| | |
* | | Fix an error which was thrown by the PresenceHandler _on_shutdown handler. ↵Richard van der Hoff2020-01-062-7/+3
| | | | | | | | | | | | (#6640)
* | | Fix exception when fetching notary server's old keys (#6625)Richard van der Hoff2020-01-063-50/+103
| | | | | | | | | | | | | | | | | | Lift the restriction that *all* the keys used for signing v2 key responses be present in verify_keys. Fixes #6596.
* | | Workaround for error when fetching notary's own key (#6620)Richard van der Hoff2020-01-064-9/+163
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | * Kill off redundant SynapseRequestFactory We already get the Site via the Channel, so there's no need for a dedicated RequestFactory: we can just use the right constructor. * Workaround for error when fetching notary's own key As a notary server, when we return our own keys, include all of our signing keys in verify_keys. This is a workaround for #6596.
* | Fix power levels being incorrectly set in old and new rooms after a room ↵Andrew Morgan2020-01-062-7/+11
| | | | | | | | | | | | upgrade (#6633) Modify a copy of an upgraded room's PL before sending to the new room
* | Automate generation of the sample and debian log configs (#6627)Richard van der Hoff2020-01-039-40/+73
| |
* | Raise an error if someone tries to use the log_file config option (#6626)Richard van der Hoff2020-01-033-3/+17
| | | | | | | | This has caused some confusion for people who didn't notice it going away.
* | Remove unused, undocumented "content repo" resource (#6628)Richard van der Hoff2020-01-039-128/+3
| | | | | | | | | | | | This looks like it got half-killed back in #888. Fixes #6567.
* | Kill off redundant SynapseRequestFactory (#6619)Richard van der Hoff2020-01-033-17/+8
| | | | | | | | We already get the Site via the Channel, so there's no need for a dedicated RequestFactory: we can just use the right constructor.
* | Reduce the reconnect time when replication fails. (#6617)Richard van der Hoff2020-01-032-1/+3
|/
* Added the section 'Configuration' in /docs/turn-howto.md (#6614)ewaf12020-01-022-0/+3
| | | | put the 2nd part of the "source installation"-section into a new section, because it also applies to Debian packages
* Reword sections of federate.md that explained delegation at time of Synapse ↵Aaron Raimist2020-01-022-21/+4
| | | | | | | | | | | | 1.0 transition (#6601) * Remove sections of federate.md explaining delegation at time of Synapse 1.0 transition Signed-off-by: Aaron Raimist <aaron@raim.ist> * Add changelog Signed-off-by: Aaron Raimist <aaron@raim.ist>
* Merge branch 'master' into developRichard van der Hoff2019-12-315-16/+98
|\
| * 1.7.3 v1.7.3 github/release-v1.7.3 release-v1.7.3Richard van der Hoff2019-12-314-2/+18
| |
| * Hacks to work around #6605 (#6608)Richard van der Hoff2019-12-312-15/+38
| | | | | | | | | | When we have an event which refers to non-existent auth_events, ignore said events rather than exploding in a ball of fire. Fixes #6605.
| * sample log config 1.7.2Richard van der Hoff2019-12-241-0/+43
| | | | | | | | TODO: automate generation of this
| * Update reverse proxy file name (#6590)dopple2019-12-221-1/+1
| | | | | | s/reverse_proxy.rst/reverse_proxy.md/
* | Update reverse proxy file name (#6590)dopple2019-12-221-1/+1
| | | | | | s/reverse_proxy.rst/reverse_proxy.md/
* | Merge branch 'master' into developRichard van der Hoff2019-12-204-2/+23
|\|
| * Merge tag 'v1.7.2'Richard van der Hoff2019-12-205-3/+32
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.7.2 (2019-12-20) ========================== This release fixes some regressions introduced in Synapse 1.7.0 and 1.7.1. Bugfixes -------- - Fix a regression introduced in Synapse 1.7.1 which caused errors when attempting to backfill rooms over federation. ([\#6576](https://github.com/matrix-org/synapse/issues/6576)) - Fix a bug introduced in Synapse 1.7.0 which caused an error on startup when upgrading from versions before 1.3.0. ([\#6578](https://github.com/matrix-org/synapse/issues/6578))
| | * 1.7.2 v1.7.2 github/release-v1.7.2 release-v1.7.2Richard van der Hoff2019-12-205-3/+19
| | |
| | * Backport fixes to sqlite upgrade from develop (#6578)Richard van der Hoff2019-12-202-1/+10
| | | | | | | | | | | | | | | Only run prepare_database on connection for in-memory databases. Fixes #6569.