summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* When server leaves room check for stale device lists. (#6801)Erik Johnston2020-01-303-6/+83
| | | | | | | | | When a server leaves a room it may stop sharing a room with remote users, and thus not get any updates to their device lists. So we need to check for this case and delete those device lists from the cache. We don't need to do this if we stop sharing a room because the remote user leaves the room, because we track that case via looking at membership changes.
* When a client asks for remote keys check if should resync. (#6797)Erik Johnston2020-01-302-3/+30
| | | | | | If we detect that the remote users' keys may have changed then we should attempt to resync against the remote server rather than using the (potentially) stale local cache.
* Type defintions for use in refactoring for redaction changes (#6803)Richard van der Hoff2020-01-305-8/+24
| | | | | | | | | | * Bump signedjson to 1.1 ... so that we can use the type definitions * Fix breakage caused by upgrade to signedjson 1.1 Thanks, @illicitonion...
* Remove unused DeviceRow class (#6800)Erik Johnston2020-01-292-20/+2
|
* Merge pull request #6790 from matrix-org/rav/msc2260.1Richard van der Hoff2020-01-295-18/+112
|\ | | | | MSC2260: change the default power level for m.room.aliases events
| * changelogRichard van der Hoff2020-01-291-0/+1
| |
| * Make /directory/room/<alias> handle restrictive power levelsRichard van der Hoff2020-01-291-1/+6
| | | | | | | | | | Fixes a bug where the alias would be added, but `PUT /directory/room/<alias>` would return a 403.
| * Set the PL for aliases events to 0.Richard van der Hoff2020-01-292-3/+16
| |
| * Factor out a `copy_power_levels_contents` methodRichard van der Hoff2020-01-293-15/+90
|/ | | | I'm going to need another copy (hah!) of this.
* Fix race in federation sender that delayed device updates. (#6799)Erik Johnston2020-01-293-30/+23
| | | | | | | | | | | | We were sending device updates down both the federation stream and device streams. This mean there was a race if the federation sender worker processed the federation stream first, as when the sender checked if there were new device updates the slaved ID generator hadn't been updated with the new stream IDs and so returned nothing. This situation is correctly handled by events/receipts/etc by not sending updates down the federation stream and instead having the federation sender worker listen on the other streams and poke the transaction queues as appropriate.
* Delete current state when server leaves a room (#6792)Erik Johnston2020-01-293-75/+198
| | | | | | Otherwise its just stale data, which may get deleted later anyway so can't be relied on. It's also a bit of a shotgun if we're trying to get the current state of a room we're not in.
* Fix bug when querying remote user keys that require a resync. (#6796)Erik Johnston2020-01-292-1/+3
| | | | We ended up only returning a single device, rather than all of them.
* Fix outbound federation request metrics (#6795)Erik Johnston2020-01-282-0/+5
|
* Merge pull request #6787 from matrix-org/rav/msc2260Richard van der Hoff2020-01-283-5/+36
|\ | | | | Implement updated auth rules from MSC2260
| * fix bad variable refRichard van der Hoff2020-01-281-1/+1
| |
| * update changelogRichard van der Hoff2020-01-282-1/+1
| |
| * changelogRichard van der Hoff2020-01-281-0/+1
| |
| * Implement updated auth rules from MSC2260Richard van der Hoff2020-01-282-5/+35
| |
* | Detect unknown remote devices and mark cache as stale (#6776)Erik Johnston2020-01-286-8/+126
|/ | | | We just mark the fact that the cache may be stale in the database for now.
* Pass room version object into event_auth.check and check_redaction (#6788)Richard van der Hoff2020-01-288-34/+53
| | | | | | | These are easier to work with than the strings and we normally have one around. This fixes `FederationHander._persist_auth_tree` which was passing a RoomVersion object into event_auth.check instead of a string.
* Warn if postgres database has non-C locale. (#6734)Erik Johnston2020-01-286-1/+81
| | | As using non-C locale can cause issues on upgrading OS.
* Merge branch 'master' into developErik Johnston2020-01-284-2/+23
|\
| * 1.9.1 v1.9.1 github/release-v1.9.1 release-v1.9.1Erik Johnston2020-01-284-2/+16
| |
| * Fix setting `mau_limit_reserved_threepids` config (#6793)Erik Johnston2020-01-282-1/+8
| | | | | | | | | | Calling the invalidation function during initialisation of the data stores introduces a circular dependency, causing Synapse to fail to start.
* | Add `rooms.room_version` column (#6729)Erik Johnston2020-01-2711-73/+270
| | | | | | This is so that we don't have to rely on pulling it out from `current_state_events` table.
* | Propagate cache invalidates from workers to other workers. (#6748)Erik Johnston2020-01-274-5/+29
| | | | | | Currently if a worker invalidates a cache it will be streamed to master, which then didn't forward those to other workers.
* | Merge pull request #6775 from matrix-org/jaywink/worker-docs-tweaksBrendan Abolivier2020-01-272-0/+18
|\ \ | | | | | | Clarifications to the workers documentation
| * | Formatting of changelogJason Robinson2020-01-271-1/+1
| | | | | | | | | Co-Authored-By: Brendan Abolivier <babolivier@matrix.org>
| * | Fix federation_reader listeners doc as per PR reviewJason Robinson2020-01-271-2/+12
| | | | | | | | | | | | Signed-off-by: Jason Robinson <jasonr@matrix.org>
| * | Clarifications to the workers documentationJason Robinson2020-01-242-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | * Add note that user_dir requires disabling user dir updates from the main synapse process. * Add note that federation_reader should have the federation listener resource. Signed-off-by: Jason Robinson <jasonr@matrix.org>
* | | Validate client_secret parameter (#6767)Andrew Morgan2020-01-246-6/+93
|/ /
* | Make 'event.redacts' never raise. (#6771)Erik Johnston2020-01-235-6/+62
| | | | | | | | | | | | There are quite a few places that we assume that a redaction event has a corresponding `redacts` key, which is not always the case. So lets cheekily make it so that event.redacts just returns None instead.
* | Merge branch 'master' into developBrendan Abolivier2020-01-234-5/+20
|\|
| * Fixup changelog v1.9.0 github/release-v1.9.0 release-v1.9.0Brendan Abolivier2020-01-231-1/+1
| |
| * Fixup changelogBrendan Abolivier2020-01-231-4/+5
| |
| * Fixup changelogBrendan Abolivier2020-01-232-2/+4
| |
| * Merge branch 'release-v1.9.0' of github.com:matrix-org/synapse into ↵Brendan Abolivier2020-01-232-4/+5
| |\ | | | | | | | | | release-v1.9.0
| * | 1.9.0Brendan Abolivier2020-01-233-1/+13
| | |
* | | a bit of debugging for media storage providers (#6757)Richard van der Hoff2020-01-233-0/+8
| | | | | | | | | | | | | | | | | | * a bit of debugging for media storage providers * changelog
* | | Minor fixes to user admin api (#6761)Richard van der Hoff2020-01-232-9/+6
| | | | | | | | | | | | * don't insist on a password (this is valid if you have an SSO login) * fix reference to undefined `requester`
* | | Merge branch 'release-v1.9.0' into developAndrew Morgan2020-01-232-4/+5
|\ \ \ | | |/ | |/|
| * | Update admin room docs with correct endpoints (#6770)Andrew Morgan2020-01-232-4/+5
| |/
* / Remove unnecessary abstractions in admin handler (#6751)Andrew Morgan2020-01-224-73/+11
|/
* Fixup warning about workers changes v1.9.0rc1Brendan Abolivier2020-01-221-1/+1
|
* Add deprecation headersBrendan Abolivier2020-01-221-0/+4
|
* Fixup changelogBrendan Abolivier2020-01-221-10/+10
|
* 1.9.0rc1Brendan Abolivier2020-01-2249-49/+71
|
* Admin API to list, filter and sort rooms (#6720)Andrew Morgan2020-01-228-7/+787
|
* Merge pull request #6764 from matrix-org/babolivier/fix-thumbnailBrendan Abolivier2020-01-223-5/+46
|\ | | | | Fix typo in _select_thumbnail
| * Lint + changelogBrendan Abolivier2020-01-222-3/+2
| |
| * Remove unused importBrendan Abolivier2020-01-221-1/+1
| |
| * Add tests for thumbnailingBrendan Abolivier2020-01-221-3/+45
| |
| * Fix typo in _select_thumbnailBrendan Abolivier2020-01-221-1/+1
|/
* Fix and add test to deprecated quarantine media admin api (#6756)Andrew Morgan2020-01-223-5/+13
|
* Allow monthly active user limiting support for worker mode, fixes #4639. (#6742)Neil Johnson2020-01-226-82/+100
|
* Allow streaming cache invalidate all to workers. (#6749)Erik Johnston2020-01-226-15/+69
|
* Remove unused CI docker compose files (#6754)Erik Johnston2020-01-224-66/+1
| | | These now exist in the pipelines repo.
* Avoid attribute error when `password_config` present but empty (#6753)Ivan Vilata-i-Balaguer2020-01-222-1/+2
| | | | | | | | | | The old statement returned `None` for such a `password_config` (like the one created on first run), thus retrieval of the `pepper` key failed with `AttributeError`. Fixes #5315 Signed-off-by: Ivan Vilata i Balaguer <ivan@selidor.net>
* Port synapse_port_db to async/await (#6718)Brendan Abolivier2020-01-213-89/+126
| | | | | | | | | | | | | | | | | | | | | | | | | | * Raise an exception if there are pending background updates So we return with a non-0 code * Changelog * Port synapse_port_db to async/await * Port update_database to async/await * Add version string to mocked homeservers * Remove unused imports * Convert overseen bits to async/await * Fixup logging contexts * Fix imports * Add a way to print an error without raising an exception * Incorporate review
* Add a DeltaState to track changes to be made to current state (#6716)Erik Johnston2020-01-203-99/+112
|
* Fixup synapse.rest to pass mypy (#6732)Erik Johnston2020-01-2012-35/+56
|
* Fix `/events/:event_id` deprecated API. (#6731)Erik Johnston2020-01-204-2/+30
|
* Fixup synapse.api to pass mypy (#6733)Erik Johnston2020-01-206-4/+14
|
* Fix changing password via user admin API. (#6730)Erik Johnston2020-01-203-2/+16
|
* Fix empty account_validity config block (#6747)Andrew Morgan2020-01-202-1/+3
|\
| * Update changelog.d/6747.bugfixAndrew Morgan2020-01-201-1/+1
| | | | | | Co-Authored-By: Erik Johnston <erik@matrix.org>
| * Add changelogAndrew Morgan2020-01-201-0/+1
| |
| * Fix empty account_validity config blockAndrew Morgan2020-01-201-1/+2
| |
* | Revert "Newsfile"Erik Johnston2020-01-201-1/+0
| | | | | | | | This reverts commit 11c23af465633b8dd641db60793a19e5b7524e2b.
* | NewsfileErik Johnston2020-01-201-0/+1
|/
* Add more logging around message retention policies support (#6717)Brendan Abolivier2020-01-173-0/+22
| | | So we can debug issues like #6683 more easily
* Fix up changelogErik Johnston2020-01-172-1/+1
|
* bump version to v1.9.0.dev2 v1.9.0.dev2Richard van der Hoff2020-01-171-1/+1
|
* Fix syntax error in run_upgrade for schema 57 (#6728)Satsuki Yanagi2020-01-172-3/+5
| | | | | | | Fix #6727 Related #6655 Co-authored-by: Erik Johnston <erikj@jki.re>
* Merge pull request #6714 from matrix-org/babolivier/retention_select_eventBrendan Abolivier2020-01-174-7/+8
|\ | | | | Fix instantiation of message retention purge jobs
| * Precise changelogBrendan Abolivier2020-01-161-1/+1
| |
| * Fixup diffBrendan Abolivier2020-01-161-6/+7
| |
| * Remove get_room_event_after_stream_ordering entirelyBrendan Abolivier2020-01-162-58/+13
| |
| * LintBrendan Abolivier2020-01-161-6/+12
| |
| * Rename changelogBrendan Abolivier2020-01-151-0/+0
| |
| * ChangelogBrendan Abolivier2020-01-151-0/+1
| |
| * Correctly order when selecting before stream orderingBrendan Abolivier2020-01-151-2/+5
| |
| * Fix typoBrendan Abolivier2020-01-151-1/+1
| |
| * Fix instantiation of message retention purge jobsBrendan Abolivier2020-01-152-13/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When figuring out which topological token to start a purge job at, we need to do the following: 1. Figure out a timestamp before which events will be purged 2. Select the first stream ordering after that timestamp 3. Select info about the first event after that stream ordering 4. Build a topological token from that info In some situations (e.g. quiet rooms with a short max_lifetime), there might not be an event after the stream ordering at step 3, therefore we abort the purge with the error `No event found`. To mitigate that, this patch fetches the first event _before_ the stream ordering, instead of after.
* | bump version to v1.9.0.dev1 v1.9.0.dev1Richard van der Hoff2020-01-171-1/+1
| |
* | Merge pull request #6724 from matrix-org/rav/log_saml_attributesRichard van der Hoff2020-01-1711-24/+114
|\ \ | | | | | | Log saml assertions rather than the whole response
| * | changelogRichard van der Hoff2020-01-161-0/+1
| | |
| * | Log saml assertions rather than the whole responseRichard van der Hoff2020-01-163-1/+72
| | | | | | | | | | | | | | | | | | ... since the whole response is huge. We even need to break up the assertions, since kibana otherwise truncates them.
| * | move batch_iter to a separate moduleRichard van der Hoff2020-01-168-23/+41
| | |
* | | Delegate remote_user_id mapping to the saml mapping provider (#6723)Richard van der Hoff2020-01-173-6/+23
| | | | | | | | | Turns out that figuring out a remote user id for the SAML user isn't quite as obvious as it seems. Factor it out to the SamlMappingProvider so that it's easy to control.
* | | Wake up transaction queue when remote server comes back online (#6706)Erik Johnston2020-01-1711-8/+135
| | | | | | | | | | | | | | | This will be used to retry outbound transactions to a remote server if we think it might have come back up.
* | | Clarify the `account_validity` and `email` sections of the sample ↵Richard van der Hoff2020-01-175-272/+320
|/ / | | | | | | | | | | | | | | | | | | | | configuration. (#6685) Generally try to make this more comprehensible, and make it match the conventions. I've removed the documentation for all the settings which allow you to change the names of the template files, because I can't really see why they are useful.
* | Add StateMap type alias (#6715)Erik Johnston2020-01-1614-93/+115
| |
* | Add tips for the changelog to the pull request template (#6663)Andrew Morgan2020-01-163-3/+8
| |
* | Add org.matrix.e2e_cross_signing to unstable_features in /versions as per ↵Neil Johnson2020-01-162-0/+3
| | | | | | | | MSC1756 (#6712)
* | Port synapse.replication.tcp to async/await (#6666)Erik Johnston2020-01-1615-105/+80
| | | | | | | | | | | | | | | | | | | | * Port synapse.replication.tcp to async/await * Newsfile * Correctly document type of on_<FOO> functions as async * Don't be overenthusiastic with the asyncing....
* | Fix purge_room admin API (#6711)Erik Johnston2020-01-153-4/+3
| |
* | Remove duplicate session check in web fallback servlet (#6702)Andrew Morgan2020-01-152-4/+1
| |
* | Merge pull request #6688 from matrix-org/rav/module_api_extensionsRichard van der Hoff2020-01-154-7/+61
|\ \ | | | | | | Cleanups and additions to the module API
| * \ Merge branch 'develop' into rav/module_api_extensionsRichard van der Hoff2020-01-1564-290/+1276
| |\ \ | |/ / |/| |
* | | Implement RedirectException (#6687)Richard van der Hoff2020-01-154-7/+113
| | | | | | | | | | | | | | | Allow REST endpoint implemnentations to raise a RedirectException, which will redirect the user's browser to a given location.
* | | Add `local_current_membership` table (#6655)Erik Johnston2020-01-1520-107/+263
| |/ |/| | | | | | | | | | | Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.
* | Process EDUs in parallel with PDUs. (#6697)Erik Johnston2020-01-142-12/+59
| | | | | | | | This means that things like to device messages don't get blocked behind processing PDUs, which can potentially take *ages*.
* | Fixup synapse.replication to pass mypy checks (#6667)Erik Johnston2020-01-1412-86/+105
| |
* | Quarantine media by ID or user ID (#6681)Andrew Morgan2020-01-137-11/+632
| |
* | Document more supported endpoints for workers (#6698)Richard van der Hoff2020-01-132-0/+5
| |
* | Kill off RegistrationError (#6691)Richard van der Hoff2020-01-134-17/+4
| | | | | | This is pretty pointless. Let's just use SynapseError.
* | Don't assign numeric IDs for empty usernames (#6690)Richard van der Hoff2020-01-132-1/+2
| | | | | | | | Fix a bug where we would assign a numeric userid if somebody tried registering with an empty username
* | Merge pull request #6689 from matrix-org/rav/saml_mapping_provider_updatesRichard van der Hoff2020-01-132-6/+17
|\ \ | | | | | | Updates to the SAML mapping provider API
| * | changelogRichard van der Hoff2020-01-121-0/+1
| | |
| * | Pass client redirect URL into SAML mapping providersRichard van der Hoff2020-01-121-4/+11
| | |
| * | Pass the module_api into the SamlMappingProviderRichard van der Hoff2020-01-121-2/+5
| | | | | | | | | | | | | | | ... for consistency with other modules, and because we'll need it sooner or later and it will be a pain to introduce later.
* | | Allow additional_resources to implement Resource directly (#6686)Richard van der Hoff2020-01-132-2/+12
| | | | | | | | | | | | | | | | | | AdditionalResource really doesn't add any value, and it gets in the way for resources which want to support child resources or the like. So, if the resource object already implements the IResource interface, don't bother wrapping it.
* | | Fix exceptions on requests for non-ascii urls (#6682)Richard van der Hoff2020-01-132-1/+3
| | | | | | | | | Fixes #6402
* | | comment for run_in_backgroundRichard van der Hoff2020-01-121-0/+3
| | |
* | | Merge pull request #6675 from matrix-org/rav/die_sqlite37_die_die_dieRichard van der Hoff2020-01-106-41/+47
|\ \ \ | | | | | | | | Refuse to start if sqlite is older than 3.11.0
| * | | update install notes for CentOSRichard van der Hoff2020-01-091-0/+5
| | | |
| * | | changelogRichard van der Hoff2020-01-091-0/+1
| | | |
| * | | Refuse to start if sqlite is older than 3.11.0Richard van der Hoff2020-01-093-8/+19
| | | |
| * | | Check postgres version in check_databaseRichard van der Hoff2020-01-091-13/+12
| | | | | | | | | | | | | | | | | | | | this saves doing it on each connection, and will allow us to pass extra options in.
| * | | Modify check_database to take a connection rather than a cursorRichard van der Hoff2020-01-094-28/+18
| |/ / | | | | | | | | | We might not need the cursor at all.
* | | Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2020-01-092-0/+12
|\ \ \ | |/ / |/| |
| * | Add note about log_file no longer be accepted (#6674) github/release-v1.8.0 release-v1.8.0Erik Johnston2020-01-092-0/+12
| | |
| | * changelogRichard van der Hoff2020-01-121-0/+1
| | |
| | * Handle `config` not being set for synapse plugin modulesRichard van der Hoff2020-01-121-1/+1
| | | | | | | | | | | | | | | Some modules don't need any config, so having to define a `config` property just to keep the loader happy is a bit annoying.
| | * Cleanups and additions to the module APIRichard van der Hoff2020-01-122-6/+59
| |/ |/| | | | | | | | | | | | | | | | | | | Add some useful things, such as error types and logcontext handling, to the API. Make `hs` a private member to dissuade people from using it (hopefully they aren't already). Add a couple of new methods (`record_user_external_id` and `generate_short_term_login_token`).
* | Allow admin users to create or modify users without a shared secret (#6495)Manuel Stahl2020-01-099-339/+655
| | | | | | Signed-off-by: Manuel Stahl <manuel.stahl@awesome-technologies.de>
* | Merge branch 'master' into developErik Johnston2020-01-095-5/+17
|\|
| * Fixup changelog v1.8.0Erik Johnston2020-01-091-1/+1
| |
| * 1.8.0Erik Johnston2020-01-095-5/+17
| |
* | Merge pull request #6664 from matrix-org/erikj/media_admin_apisErik Johnston2020-01-083-120/+131
|\ \ | | | | | | Fix media repo admin APIs when using a media worker.
| * | Shuffle the codeErik Johnston2020-01-081-25/+16
| | |
| * | CommentsErik Johnston2020-01-081-0/+3
| | |
| * | Do not rely on streaming events, as media repo doesn'tErik Johnston2020-01-081-12/+26
| | |
| * | NewsfileErik Johnston2020-01-081-0/+1
| | |
| * | Import RoomStore in media worker to fix admin APIsErik Johnston2020-01-081-0/+2
| | |
| * | Move media admin store functions to worker storeErik Johnston2020-01-081-120/+120
| | |
* | | Merge pull request #6665 from matrix-org/babolivier/retention_doc_typoBrendan Abolivier2020-01-082-1/+2
|\ \ \ | | | | | | | | Fix typo in message retention policies doc
| * | | ChangelogBrendan Abolivier2020-01-081-0/+1
| | | |
| * | | Fix typo in message retention policies docBrendan Abolivier2020-01-081-1/+1
| | | |
* | | | Merge remote-tracking branch 'origin/release-v1.8.0' into developRichard van der Hoff2020-01-088-28/+184
|\ \ \ \ | |/ / / |/| | / | | |/ | |/|
| * | Fix GET request on /_synapse/admin/v2/users endpoint (#6563)Manuel Stahl2020-01-083-2/+44
| | | | | | | | | | | | Fixes #6552
| * | Back out ill-advised notary server hackery (#6657)Richard van der Hoff2020-01-085-26/+140
| |/ | | | | | | | | | | | | | | | | | | | | This was ill-advised. We can't modify verify_keys here, because the response object has already been signed by the requested key. Furthermore, it's somewhat unnecessary because existing versions of Synapse (which get upset that the notary key isn't present in verify_keys) will fall back to a direct fetch via `/key/v2/server`. Also: more tests for fetching keys via perspectives: it would be nice if we actually tested when our fetcher can't talk to our notary impl.
* | Merge pull request #6624 from matrix-org/babolivier/retention_docBrendan Abolivier2020-01-082-0/+192
|\ \ | | | | | | Add complete documentation of the message retention policies support
| * | Fix referenceBrendan Abolivier2020-01-071-1/+1
| | |
| * | Incorporate reviewBrendan Abolivier2020-01-071-27/+28
| | |
| * | Merge branch 'develop' into babolivier/retention_docBrendan Abolivier2020-01-0783-491/+788
| |\|
| * | Apply suggestions from code reviewBrendan Abolivier2020-01-071-5/+4
| | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | Update changelog.d/6624.docBrendan Abolivier2020-01-071-1/+1
| | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | Fix vacuum instructions for sqliteBrendan Abolivier2020-01-031-2/+2
| | |
| * | Rename changelogBrendan Abolivier2020-01-031-0/+0
| | |
| * | Add a complete documentation of the message retention policies supportBrendan Abolivier2020-01-032-0/+192
| | |
* | | contrib/docker-compose: fixing mount that overrides containers' /etc (#6656)Fabian Meyer2020-01-082-1/+2
| | | | | | | | | | | | The mount in the form of ./matrix-config:/etc overwrites the contents of the container /etc folder. Since all valid ca certificates are stored in /etc, the synapse.push.httppusher, for example, cannot validate the certificate from matrix.org.
* | | typoMatthew Hodgson2020-01-071-1/+1
| | |
* | | Correctly proxy remote group HTTP errors. (#6654)Erik Johnston2020-01-072-0/+17
| | | | | | | | | | | | | | | e.g. if remote returns a 404 then that shouldn't be treated as an error but should be proxied through.
* | | Merge pull request #6621 from matrix-org/babolivier/purge_job_config_typoBrendan Abolivier2020-01-073-10/+11
|\ \ \ | |_|/ |/| | Fix a typo in the purge jobs configuration example
| * | RewordBrendan Abolivier2020-01-072-6/+6
| | |
| * | Change the example from 5min to 12hBrendan Abolivier2020-01-072-8/+8
| | | | | | | | | | | | Have a purge job running every 5min is probably not something we want to advise admins to do as a sort-of default.
| * | ChangelogBrendan Abolivier2020-01-031-0/+1
| | |
| * | Update sample configBrendan Abolivier2020-01-031-1/+1
| | |
| * | Fix a typo in the purge jobs configuration exampleBrendan Abolivier2020-01-031-1/+1
| |/
* | Fixup changelog v1.8.0rc1Erik Johnston2020-01-071-3/+3
| |
* | Fixup changelogErik Johnston2020-01-071-1/+1
| |
* | Fixup changelogErik Johnston2020-01-071-21/+11
| |
* | 1.8.0rc1Erik Johnston2020-01-0756-55/+81
| |
* | Merge pull request #6652 from matrix-org/babolivier/depth_missing_eventsBrendan Abolivier2020-01-073-3/+4
|\ \ | | | | | | Fix conditions failing if min_depth = 0
| * | ChangelogBrendan Abolivier2020-01-071-0/+1
| | |
| * | Fix conditions failing if min_depth = 0Brendan Abolivier2020-01-072-3/+3
| |/ | | | | | | This could result in Synapse not fetching prev_events for new events in the room if it has missed some events.
* | Add a background update to clear tombstoned rooms from the directory (#6648)Richard van der Hoff2020-01-076-1/+106
| | | | | | | | | | | | * Add a background update to clear tombstoned rooms from the directory * use the ABC metaclass
* | Async/await for background updates (#6647)Richard van der Hoff2020-01-072-16/+21
| | | | | | | | so that bg update routines can be async
* | port BackgroundUpdateTestCase to HomeserverTestCase (#6653)Richard van der Hoff2020-01-072-35/+38
| |
* | Merge pull request #6645 from matrix-org/rav/fix_synchrotron_errorRichard van der Hoff2020-01-073-15/+48
|\ \ | | | | | | Fix exceptions in the synchrotron worker log when events are rejected.
| * | changelogRichard van der Hoff2020-01-061-0/+1
| | |
| * | Fix exceptions in log when rejected event is replicatedRichard van der Hoff2020-01-061-2/+9
| | |
| * | async/await for SyncReplicationHandler.process_and_notifyRichard van der Hoff2020-01-061-5/+4
| | |
| * | Clarify documentation on get_event* methodsRichard van der Hoff2020-01-061-9/+35
| | | | | | | | | | | | Make it clearer how they behave in the face of rejected and/or missing events.
* | | Merge pull request #6629 from matrix-org/rav/kill_event_reference_hashesRichard van der Hoff2020-01-067-103/+55
|\ \ \ | |/ / |/| | Remove a bunch of unused code from event creation
| * | changelogRichard van der Hoff2020-01-061-0/+1
| | |
| * | Remove unused get_latest_event_ids_and_hashes_in_roomRichard van der Hoff2020-01-061-42/+0
| | |
| * | Remove unused get_prev_events_and_hashes_for_roomRichard van der Hoff2020-01-062-43/+6
| | |
| * | Remove unused hashes and depths from _update_membership paramsRichard van der Hoff2020-01-061-13/+4
| | |
| * | Remove unused hashes and depths from create_event paramsRichard van der Hoff2020-01-063-22/+13
| | |
| * | Remove unused hashes and depths from create_new_client_event paramsRichard van der Hoff2020-01-062-12/+26
| | |
| * | replace get_prev_events_and_hashes_for_room with get_prev_events_for_room in ↵Richard van der Hoff2020-01-062-9/+38
| | | | | | | | | | | | create_new_client_event
| * | rename get_prev_events_for_room to get_prev_events_and_hashes_for_roomRichard van der Hoff2020-01-064-7/+12
| | | | | | | | | | | | ... to make way for a new method which just returns the event ids
* | | Fix some test failures when frozen_dicts are enabled (#6642)Richard van der Hoff2020-01-065-11/+20
| | | | | | | | | | | | Fixes #4026
* | | Add experimental 'databases' config (#6580)Erik Johnston2020-01-063-13/+64
| | |
* | | Fix an error which was thrown by the PresenceHandler _on_shutdown handler. ↵Richard van der Hoff2020-01-062-7/+3
| | | | | | | | | | | | (#6640)
* | | Fix exception when fetching notary server's old keys (#6625)Richard van der Hoff2020-01-063-50/+103
| | | | | | | | | | | | | | | | | | Lift the restriction that *all* the keys used for signing v2 key responses be present in verify_keys. Fixes #6596.
* | | Workaround for error when fetching notary's own key (#6620)Richard van der Hoff2020-01-064-9/+163
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | * Kill off redundant SynapseRequestFactory We already get the Site via the Channel, so there's no need for a dedicated RequestFactory: we can just use the right constructor. * Workaround for error when fetching notary's own key As a notary server, when we return our own keys, include all of our signing keys in verify_keys. This is a workaround for #6596.
* | Fix power levels being incorrectly set in old and new rooms after a room ↵Andrew Morgan2020-01-062-7/+11
| | | | | | | | | | | | upgrade (#6633) Modify a copy of an upgraded room's PL before sending to the new room
* | Automate generation of the sample and debian log configs (#6627)Richard van der Hoff2020-01-039-40/+73
| |
* | Raise an error if someone tries to use the log_file config option (#6626)Richard van der Hoff2020-01-033-3/+17
| | | | | | | | This has caused some confusion for people who didn't notice it going away.
* | Remove unused, undocumented "content repo" resource (#6628)Richard van der Hoff2020-01-039-128/+3
| | | | | | | | | | | | This looks like it got half-killed back in #888. Fixes #6567.
* | Kill off redundant SynapseRequestFactory (#6619)Richard van der Hoff2020-01-033-17/+8
| | | | | | | | We already get the Site via the Channel, so there's no need for a dedicated RequestFactory: we can just use the right constructor.
* | Reduce the reconnect time when replication fails. (#6617)Richard van der Hoff2020-01-032-1/+3
|/
* Added the section 'Configuration' in /docs/turn-howto.md (#6614)ewaf12020-01-022-0/+3
| | | | put the 2nd part of the "source installation"-section into a new section, because it also applies to Debian packages
* Reword sections of federate.md that explained delegation at time of Synapse ↵Aaron Raimist2020-01-022-21/+4
| | | | | | | | | | | | 1.0 transition (#6601) * Remove sections of federate.md explaining delegation at time of Synapse 1.0 transition Signed-off-by: Aaron Raimist <aaron@raim.ist> * Add changelog Signed-off-by: Aaron Raimist <aaron@raim.ist>
* Merge branch 'master' into developRichard van der Hoff2019-12-315-16/+98
|\
| * 1.7.3 v1.7.3 github/release-v1.7.3 release-v1.7.3Richard van der Hoff2019-12-314-2/+18
| |
| * Hacks to work around #6605 (#6608)Richard van der Hoff2019-12-312-15/+38
| | | | | | | | | | When we have an event which refers to non-existent auth_events, ignore said events rather than exploding in a ball of fire. Fixes #6605.
| * sample log config 1.7.2Richard van der Hoff2019-12-241-0/+43
| | | | | | | | TODO: automate generation of this
| * Update reverse proxy file name (#6590)dopple2019-12-221-1/+1
| | | | | | s/reverse_proxy.rst/reverse_proxy.md/
* | Update reverse proxy file name (#6590)dopple2019-12-221-1/+1
| | | | | | s/reverse_proxy.rst/reverse_proxy.md/
* | Merge branch 'master' into developRichard van der Hoff2019-12-204-2/+23
|\|
| * Merge tag 'v1.7.2'Richard van der Hoff2019-12-205-3/+32
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.7.2 (2019-12-20) ========================== This release fixes some regressions introduced in Synapse 1.7.0 and 1.7.1. Bugfixes -------- - Fix a regression introduced in Synapse 1.7.1 which caused errors when attempting to backfill rooms over federation. ([\#6576](https://github.com/matrix-org/synapse/issues/6576)) - Fix a bug introduced in Synapse 1.7.0 which caused an error on startup when upgrading from versions before 1.3.0. ([\#6578](https://github.com/matrix-org/synapse/issues/6578))
| | * 1.7.2 v1.7.2 github/release-v1.7.2 release-v1.7.2Richard van der Hoff2019-12-205-3/+19
| | |
| | * Backport fixes to sqlite upgrade from develop (#6578)Richard van der Hoff2019-12-202-1/+10
| | | | | | | | | | | | | | | Only run prepare_database on connection for in-memory databases. Fixes #6569.
| | * Fix exceptions when attempting to backfill (#6576)Richard van der Hoff2019-12-202-1/+5
| | | | | | | | | Fixes #6575
* | | Split state groups into a separate data store (#6296)Erik Johnston2019-12-2028-1168/+1159
| | |
* | | Change EventContext to use the Storage class (#6564)Erik Johnston2019-12-2015-53/+64
| | |
* | | Explode on duplicate delta file names. (#6565)Erik Johnston2019-12-192-0/+19
| | |
* | | Port some admin handlers to async/await (#6559)Erik Johnston2019-12-194-56/+46
| | |
* | | Improve diagnostics on database upgrade failure (#6570)Richard van der Hoff2019-12-193-8/+7
| | | | | | | | | | | | `Failed to upgrade database` is not helpful, and it's unlikely that UPGRADE.rst has anything useful.
* | | Fix sdnotify with acme enabled (#6571)Richard van der Hoff2019-12-192-3/+8
| | | | | | | | | | | | | | | | | | | | | If acme was enabled, the sdnotify startup hook would never be run because we would try to add it to a hook which had already fired. There's no need to delay it: we can sdnotify as soon as we've started the listeners.
* | | Add an export_signing_key script (#6546)Richard van der Hoff2019-12-195-22/+130
| | | | | | | | | | | | | | | I want to do some key rotation, and it is silly that we don't have a way to do this.
* | | Clean up startup for the pusher (#6558)Richard van der Hoff2019-12-187-43/+45
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Remove redundant python2 support code `str.decode()` doesn't exist on python3, so presumably this code was doing nothing * Filter out pushers with corrupt data When we get a row with unparsable json, drop the row, rather than returning a row with null `data`, which will then cause an explosion later on. * Improve logging when we can't start a pusher Log the ID to help us understand the problem * Make email pusher setup more robust We know we'll have a `data` member, since that comes from the database. What we *don't* know is if that is a dict, and if that has a `brand` member, and if that member is a string.
* | | Add delta file to fix missing default table data (#6555)Andrew Morgan2019-12-184-15/+24
| | |
* | | Add database config class (#6513)Erik Johnston2019-12-1819-209/+287
| | | | | | | | | | | | | | | This encapsulates config for a given database and is the way to get new connections.
* | | Merge branch 'master' into developRichard van der Hoff2019-12-1814-15/+25
|\| |
| * | Merge tag 'v1.7.1'Richard van der Hoff2019-12-1815-373/+547
| |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.7.1 (2019-12-18) ========================== This release includes several security fixes as well as a fix to a bug exposed by the security fixes. Administrators are encouraged to upgrade as soon as possible. Security updates ---------------- - Fix a bug which could cause room events to be incorrectly authorized using events from a different room. ([\#6501](https://github.com/matrix-org/synapse/issues/6501), [\#6503](https://github.com/matrix-org/synapse/issues/6503), [\#6521](https://github.com/matrix-org/synapse/issues/6521), [\#6524](https://github.com/matrix-org/synapse/issues/6524), [\#6530](https://github.com/matrix-org/synapse/issues/6530), [\#6531](https://github.com/matrix-org/synapse/issues/6531)) - Fix a bug causing responses to the `/context` client endpoint to not use the pruned version of the event. ([\#6553](https://github.com/matrix-org/synapse/issues/6553)) - Fix a cause of state resets in room versions 2 onwards. ([\#6556](https://github.com/matrix-org/synapse/issues/6556), [\#6560](https://github.com/matrix-org/synapse/issues/6560)) Bugfixes -------- - Fix a bug which could cause the federation server to incorrectly return errors when handling certain obscure event graphs. ([\#6526](https://github.com/matrix-org/synapse/issues/6526), [\#6527](https://github.com/matrix-org/synapse/issues/6527))
| | * too many parens v1.7.1 github/release-v1.7.1 release-v1.7.1Richard van der Hoff2019-12-181-1/+1
| | |
| | * 1.7.1Richard van der Hoff2019-12-1814-15/+25
| | |
* | | Merge release-v1.7.1 into developRichard van der Hoff2019-12-187-10/+145
|\ \ \ | | |/ | |/|
| * | Fix bug where we added duplicate event IDs as auth_events (#6560)Erik Johnston2019-12-172-7/+9
| | |
| * | Add auth events as per spec. (#6556)Erik Johnston2019-12-162-67/+35
| | | | | | | | | | | | | | | Previously we tried to be clever and filter out some unnecessary event IDs to keep the auth chain small, but that had some annoying interactions with state res v2 so we stop doing that for now.
| * | Merge pull request #6553 from matrix-org/babolivier/fix-context-filterBrendan Abolivier2019-12-164-3/+135
| |\ \ | | | | | | | | Use the filtered version of an event when responding to /context requests for that event
| | * \ Merge branch 'babolivier/fix-context-filter' of ↵Brendan Abolivier2019-12-161-1/+1
| | |\ \ | | | | | | | | | | | | | | | github.com:matrix-org/synapse into babolivier/fix-context-filter
| | | * | Update changelog.d/6553.bugfixBrendan Abolivier2019-12-161-1/+1
| | | | | | | | | | | | | | | Co-Authored-By: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| | * | | Incorporate reviewBrendan Abolivier2019-12-162-6/+1
| | |/ /
| | * | LintBrendan Abolivier2019-12-161-2/+1
| | | |
| | * | Add test caseBrendan Abolivier2019-12-161-0/+133
| | | |
| | * | ChangelogBrendan Abolivier2019-12-161-0/+1
| | | |
| | * | Update the documentation of the filtering functionBrendan Abolivier2019-12-161-1/+2
| | | |
| | * | Use the filtered version of an event when responding to /context requests ↵Brendan Abolivier2019-12-161-1/+4
| | | | | | | | | | | | | | | | | | | | | | | | for that event Sometimes the filtering function can return a pruned version of an event (on top of either the event itself or an empty list), if it thinks the user should be able to see that there's an event there but not the content of that event. Therefore, the previous logic of 'if filtered is empty then we can use the event we retrieved from the database' is flawed, and we should use the event returned by the filtering function.
| * | | Exclude rejected state events when calculating state at backwards extrems ↵Richard van der Hoff2019-12-162-1/+2
| | | | | | | | | | | | | | | | | | | | (#6527) This fixes a weird bug where, if you were determined enough, you could end up with a rejected event forming part of the state at a backwards-extremity. Authing that backwards extrem would then lead to us trying to pull the rejected event from the db (with allow_rejected=False), which would fail with a 404.
| * | | Persist auth/state events at backwards extremities when we fetch them (#6526)Richard van der Hoff2019-12-163-165/+83
| | | | | | | | | | | | | | | | The main point here is to make sure that the state returned by _get_state_in_room has been authed before we try to use it as state in the room.
| * | | sanity-checking for events used in state res (#6531)Richard van der Hoff2019-12-166-43/+128
| | | | | | | | | | | | | | | | | | | | When we perform state resolution, check that all of the events involved are in the right room.
| * | | Sanity-check room ids in event auth (#6530)Richard van der Hoff2019-12-162-0/+14
| | | | | | | | | | | | | | | | When we do an event auth operation, check that all of the events involved are in the right room.
| * | | Check the room_id of events when fetching room state/auth (#6524)Richard van der Hoff2019-12-162-24/+56
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When we request the state/auth_events to populate a backwards extremity (on backfill or in the case of missing events in a transaction push), we should check that the returned events are in the right room rather than blindly using them in the room state or auth chain. Given that _get_events_from_store_or_dest takes a room_id, it seems clear that it should be sanity-checking the room_id of the requested events, so let's do it there.
| * | | Add `include_event_in_state` to _get_state_for_room (#6521)Richard van der Hoff2019-12-162-18/+22
| | | | | | | | | | | | | | | | | | | | | | | | Make it return the state *after* the requested event, rather than the one before it. This is a bit easier and requires fewer calls to get_events_from_store_or_dest.
| * | | Move get_state methods into FederationHandler (#6503)Richard van der Hoff2019-12-163-86/+107
| | | | | | | | | | | | | | | | | | | | This is a non-functional refactor as a precursor to some other work.
| * | | Refactor get_events_from_store_or_dest to return a dict (#6501)Richard van der Hoff2019-12-162-29/+16
| |/ / | | | | | | | | | | | | There was a bunch of unnecessary conversion back and forth between dict and list going on here. We can simplify a bunch of the code.
* | | Remove unused `get_pagination_rows` methods. (#6557)Erik Johnston2019-12-174-18/+1
| | | | | | | | | Remove unused get_pagination_rows methods
* | | Add auth events as per spec. (#6556)Erik Johnston2019-12-162-67/+35
| | | | | | | | | | | | | | | Previously we tried to be clever and filter out some unnecessary event IDs to keep the auth chain small, but that had some annoying interactions with state res v2 so we stop doing that for now.
* | | Add option to allow profile queries without sharing a room (#6523)Will Hunt2019-12-165-1/+28
| | |
* | | Exclude rejected state events when calculating state at backwards extrems ↵Richard van der Hoff2019-12-162-1/+2
| | | | | | | | | | | | | | | (#6527) This fixes a weird bug where, if you were determined enough, you could end up with a rejected event forming part of the state at a backwards-extremity. Authing that backwards extrem would then lead to us trying to pull the rejected event from the db (with allow_rejected=False), which would fail with a 404.
* | | Persist auth/state events at backwards extremities when we fetch them (#6526)Richard van der Hoff2019-12-163-169/+83
| | | | | | | | | The main point here is to make sure that the state returned by _get_state_in_room has been authed before we try to use it as state in the room.
* | | Automatically delete empty groups/communities (#6453)Werner Sembach2019-12-164-0/+38
| | | | | | | | | Signed-off-by: Werner Sembach <werner.sembach@fau.de>
* | | Document Shutdown Room admin API (#6541)Andrew Morgan2019-12-132-0/+73
| | |