summary refs log tree commit diff
path: root/changelog.d (follow)
Commit message (Collapse)AuthorAgeFilesLines
* 1.11.0rc1Richard van der Hoff2020-02-1955-55/+0
|
* Revert `get_auth_chain_ids` changes (#6951)Erik Johnston2020-02-191-0/+1
|
* Merge pull request #6949 from matrix-org/rav/list_room_aliases_peekableRichard van der Hoff2020-02-191-0/+1
|\ | | | | Make room alias lists peekable
| * changelogRichard van der Hoff2020-02-191-0/+1
| |
* | Merge pull request #6940 from matrix-org/babolivier/federate.mdBrendan Abolivier2020-02-191-0/+1
|\ \ | | | | | | Clean up and update federation docs
| * | ChangelogBrendan Abolivier2020-02-181-0/+1
| | |
* | | Move MSC2432 stuff onto unstable prefix (#6948)Richard van der Hoff2020-02-191-0/+1
| | | | | | | | | it's not in the spec yet, so needs to be unstable. Also add a feature flag for it. Also add a test for admin users.
* | | Tiny optimisation for _get_handler_for_request (#6950)Richard van der Hoff2020-02-191-0/+1
| | | | | | | | | | | | we have hundreds of path_regexes (see #5118), so let's not convert the same bytes to str for each of them.
* | | Increase DB/CPU perf of `_is_server_still_joined` check. (#6936)Erik Johnston2020-02-191-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Increase DB/CPU perf of `_is_server_still_joined` check. For rooms with large amount of state a single user leaving could cause us to go and load a lot of membership events and then pull out membership state in a large number of batches. * Newsfile * Update synapse/storage/persist_events.py Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> * Fix adding if too soon * Update docstring * Review comments * Woops typo Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
* | | Merge pull request #6945 from matrix-org/babolivier/fix-retention-debug-logBrendan Abolivier2020-02-191-0/+1
|\ \ \ | | | | | | | | Fix log in message retention purge jobs
| * | | Update changelog.d/6945.bugfixBrendan Abolivier2020-02-191-1/+1
| | | | | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | | ChangelogBrendan Abolivier2020-02-181-0/+1
| | | |
* | | | Limit size of get_auth_chain_ids query (#6947)Erik Johnston2020-02-191-0/+1
| |_|/ |/| |
* | | Implement GET /_matrix/client/r0/rooms/{roomId}/aliases (#6939)Richard van der Hoff2020-02-181-0/+1
| | | | | | | | | | | | | | | per matrix-org/matrix-doc#2432
* | | Merge pull request #6872 from matrix-org/rav/dictpropertyRichard van der Hoff2020-02-181-0/+1
|\ \ \ | | | | | | | | Rewrite _EventInternalMetadata to back it with a dict
| * | | changelogRichard van der Hoff2020-02-141-0/+1
| | | |
* | | | Merge pull request #6907 from matrix-org/babolivier/acme-configBrendan Abolivier2020-02-181-0/+1
|\ \ \ \ | |_|/ / |/| | | Add mention and warning about ACME v1 deprecation to the TLS config
| * | | ChangelogBrendan Abolivier2020-02-131-0/+1
| | | |
* | | | Increase perf of `get_auth_chain_ids` used in state res v2. (#6937)Erik Johnston2020-02-181-0/+1
| | | | | | | | | | | | We do this by moving the recursive query to be fully in the DB.
* | | | Fix worker docs to point `/publicised_groups` API correctly. (#6938)Erik Johnston2020-02-181-0/+1
| | | |
* | | | Merge pull request #6909 from matrix-org/babolivier/acme-installBrendan Abolivier2020-02-181-0/+1
|\ \ \ \ | | | | | | | | | | Update INSTALL.md to recommend reverse proxying and warn about ACMEv1 deprecation
| * | | | ChangelogBrendan Abolivier2020-02-131-0/+1
| | |_|/ | |/| |
* | | | Stop sending events when creating or deleting aliases (#6904)Patrick Cloke2020-02-181-0/+1
| | | | | | | | | | | | Stop sending events when creating or deleting associations (room aliases). Send an updated canonical alias event if one of the alt_aliases is deleted.
* | | | Kill off deprecated "config-on-the-fly" docker mode (#6918)Richard van der Hoff2020-02-181-0/+1
| | | | | | | | | | | | | | | | | | | | Lots of people seem to get confused by this mode, and it's been deprecated since Synapse 1.1.0. It's time for it to go.
* | | | #6924 has been released in 1.10.1Richard van der Hoff2020-02-171-1/+0
| | | |
* | | | Raise the default power levels for invites, tombstones and server acls (#6834)Andrew Morgan2020-02-171-0/+1
| | | |
* | | | wait for current_state_events_membership before ↵Richard van der Hoff2020-02-171-0/+1
| | | | | | | | | | | | | | | | delete_old_current_state_events (#6924)
* | | | Add type hints to the spam check module (#6915)Patrick Cloke2020-02-141-0/+1
| | | | | | | | | | | | | | | | Add typing information to the spam checker modules.
* | | | contrib/docker: Ensure correct encoding and locale settings on DB creation ↵Fridtjof Mund2020-02-141-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | (#6921) Signed-off-by: Fridtjof Mund <fridtjof@das-labor.org>
* | | | Add a warning about indentation to generated config (#6920)Richard van der Hoff2020-02-141-0/+1
| | | | | | | | | | | | Fixes #6916.
* | | | Convert the directory handler tests to use HomeserverTestCase (#6919)Patrick Cloke2020-02-141-0/+1
| |_|/ |/| | | | | Convert directory handler tests to use HomeserverTestCase.
* | | Filter the results of user directory searching via the spam checker (#6888)Patrick Cloke2020-02-141-0/+1
|/ / | | | | Add a method to the spam checker to filter the user directory results.
* | Update changelog for #6905 to group it with upcoming PRsBrendan Abolivier2020-02-131-1/+1
| |
* | Add documentation for the spam checker module (#6906)Patrick Cloke2020-02-131-0/+1
| | | | | | Add documentation for the spam checker.
* | Merge pull request #6905 from matrix-org/babolivier/acme.mdBrendan Abolivier2020-02-131-0/+1
|\ \ | | | | | | Update ACME.md to mention ACME v1 deprecation
| * | ChangelogBrendan Abolivier2020-02-121-0/+1
| |/
* / Remove m.lazy_load_members from unstable features since it is in CS r0.5.0 ↵Aaron Raimist2020-02-131-0/+1
|/ | | | | | | (#6877) Fixes #5528
* Merge pull request #6891 from matrix-org/babolivier/retention-doc-amendBrendan Abolivier2020-02-121-0/+1
|\ | | | | Spell out that the last event sent to a room won't be deleted by a purge
| * Update the changelog fileBrendan Abolivier2020-02-111-1/+1
| |
| * ChangelogBrendan Abolivier2020-02-111-0/+1
| |
* | Return a 404 for admin api user lookup if user not found (#6901)Andrew Morgan2020-02-121-0/+1
| |
* | Use BSD-compatible in-place editing for sed. (#6887)Patrick Cloke2020-02-121-0/+1
|/
* Reject device display names that are too long (#6882)Patrick Cloke2020-02-101-0/+1
| | | | | | | | * Reject device display names that are too long. Too long is currently defined as 100 characters in length. * Add a regression test for rejecting a too long device display name.
* Add an additional test to the SyTest blacklist for worker mode. (#6883)Patrick Cloke2020-02-101-0/+1
|
* Merge tag 'v1.10.0rc3' into developRichard van der Hoff2020-02-101-1/+0
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.10.0rc3 (2020-02-10) ============================== Features -------- - Filter out m.room.aliases from the CS API to mitigate abuse while a better solution is specced. ([\#6878](https://github.com/matrix-org/synapse/issues/6878)) Internal Changes ---------------- - Fix continuous integration failures with old versions of `pip`, which were introduced by a release of the `zipp` library. ([\#6880](https://github.com/matrix-org/synapse/issues/6880))
| * 1.10.0rc3 v1.10.0rc3Richard van der Hoff2020-02-102-2/+0
| |
| * filter out m.room.aliases from the CS API until a better solution is specced ↵Matthew Hodgson2020-02-101-0/+1
| | | | | | | | | | (#6878) We're in the middle of properly mitigating spam caused by malicious aliases being added to a room. However, until this work fully lands, we temporarily filter out all m.room.aliases events from /sync and /messages on the CS API, to remove abusive aliases. This is considered acceptable as m.room.aliases events were never a reliable record of the given alias->id mapping and were purely informational, and in their current state do more harm than good.
* | Merge remote-tracking branch 'origin/release-v1.10.0' into developRichard van der Hoff2020-02-101-0/+1
|\|
| * Update setuptools for python 3.5 tests (#6880)Richard van der Hoff2020-02-101-0/+1
| | | | | | Workaround for jaraco/zipp#40
| * 1.10.0rc2Erik Johnston2020-02-063-3/+0
| |
| * Check sender_key matches on inbound encrypted events. (#6850)Erik Johnston2020-02-051-0/+1
| | | | | | If they don't then the device lists are probably out of sync.
| * Merge pull request #6844 from matrix-org/uhoreg/cross_signing_fix_device_fedHubert Chathi2020-02-051-0/+1
| | | | | | add device signatures to device key query results
| * Fix detecting unknown devices from remote encrypted events. (#6848)Erik Johnston2020-02-041-0/+1
| | | | | | | | | | | | | | | | We were looking at the wrong event type (`m.room.encryption` vs `m.room.encrypted`). Also fixup the duplicate `EvenTypes` entries. Introduced in #6776.
* | Add support for putting fed user query API on workers (#6873)Erik Johnston2020-02-071-0/+1
| |
* | Remove unused `get_room_stats_state` method. (#6869)Richard van der Hoff2020-02-071-0/+1
| |
* | Add a `make_event_from_dict` method (#6858)Richard van der Hoff2020-02-071-0/+1
| | | | | | | | | | | | | | ... and use it in places where it's trivial to do so. This will make it easier to pass room versions into the FrozenEvent constructors.
* | Add typing to synapse.federation.sender (#6871)Erik Johnston2020-02-071-0/+1
| |
* | Allow moving group read APIs to workers (#6866)Erik Johnston2020-02-071-0/+1
| |
* | Admin api to add an email address (#6789)Dirk Klimpel2020-02-071-0/+1
| |
* | remove unused room_version_to_event_format (#6857)Richard van der Hoff2020-02-071-0/+1
| |
* | Merge pull request #6856 from matrix-org/rav/redact_changes/6Richard van der Hoff2020-02-071-0/+1
|\ \ | | | | | | Pass room_version into `event_from_pdu_json`
| * | Pass room_version into `event_from_pdu_json`Richard van der Hoff2020-02-061-0/+1
| | | | | | | | | | | | It's called from all over the shop, so this one's a bit messy.
* | | Limit the number of events that can be requested when backfilling events (#6864)Patrick Cloke2020-02-061-0/+1
|/ / | | | | Limit the maximum number of events requested when backfilling events.
* | pass room version into FederationClient.send_join (#6854)Richard van der Hoff2020-02-061-0/+1
| | | | | | | | ... which allows us to sanity-check the create event.
* | Allow empty federation_certificate_verification_whitelist (#6849)timfi2020-02-061-0/+1
| |
* | Third party event rules Update (#6781)PeerD2020-02-061-0/+1
| |
* | Reduce amount of logging at INFO level. (#6862)Erik Johnston2020-02-061-0/+1
| | | | | | | | | | | | | | | | A lot of the things we log at INFO are now a bit superfluous, so lets make them DEBUG logs to reduce the amount we log by default. Co-Authored-By: Brendan Abolivier <babolivier@matrix.org> Co-authored-by: Brendan Abolivier <github@brendanabolivier.com>
* | Merge pull request #6823 from matrix-org/rav/redact_changes/5Richard van der Hoff2020-02-061-0/+1
|\ \ | | | | | | pass room versions around
| * | NewsfileRichard van der Hoff2020-02-051-0/+1
| | |
* | | Merge pull request #6855 from matrix-org/clokep/readme-pip-installPatrick Cloke2020-02-051-0/+1
|\ \ \ | |/ / |/| | Add quotes around the pip install target to avoid my shell complaining
| * | Add quotes around pip install target (my shell complained without them).Patrick Cloke2020-02-051-0/+1
| | |
* | | Merge pull request #6840 from matrix-org/rav/federation_client_asyncRichard van der Hoff2020-02-051-0/+1
|\ \ \ | |/ / |/| | Port much of `synapse.federation.federation_client` to async/await
| * | Merge remote-tracking branch 'origin/develop' into rav/federation_client_asyncRichard van der Hoff2020-02-042-0/+2
| |\ \
| * | | newsfileRichard van der Hoff2020-02-031-0/+1
| | | |
* | | | Reduce performance logging to DEBUG (#6833)Michael Kaye2020-02-051-0/+1
| | | | | | | | | | | | | | | | | | | | * Reduce tnx performance logging to DEBUG * Changelog.d
* | | | Database updates to populate rooms.room_version (#6847)Richard van der Hoff2020-02-041-0/+1
| | | | | | | | | | | | We're going to need this so that we can figure out how to handle redactions when fetching events from the database.
* | | | Merge pull request #6844 from matrix-org/uhoreg/cross_signing_fix_device_fedHubert Chathi2020-02-041-0/+1
|\ \ \ \ | | | | | | | | | | add device signatures to device key query results
| * | | | add changelogHubert Chathi2020-02-041-0/+1
| | | | |
* | | | | Update CONTRIBUTING.md about merging PRs. (#6846)Michael Kaye2020-02-041-0/+1
| |_|/ / |/| | |
* | | | Merge pull request #6837 from matrix-org/rav/federation_asyncRichard van der Hoff2020-02-041-0/+1
|\ \ \ \ | |/ / / |/| / / | |/ / Port much of `synapse.handlers.federation` to async/await.
| * | changelogRichard van der Hoff2020-02-031-0/+1
| | |
* | | Add typing to SyncHandler (#6821)Erik Johnston2020-02-031-0/+1
| | | | | | | | | | | | Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
* | | Fix stacktraces when using ObservableDeferred and async/await (#6836)Erik Johnston2020-02-031-0/+1
|/ /
* | Allow URL-encoded user IDs on user admin api paths (#6825)Andrew Morgan2020-02-031-0/+1
| |
* | Fix `room_version` in `on_invite_request` flow (#6827)Richard van der Hoff2020-02-031-0/+1
|/ | | | I messed this up a bit in #6805, but fortunately we weren't actually doing anything with the room_version so it didn't matter that it was a str not a RoomVersion.
* 1.10.0rc1Erik Johnston2020-01-3132-32/+0
|
* Fix deleting of stale marker for device lists (#6819)Erik Johnston2020-01-311-0/+1
| | | | We were in fact only deleting stale marker when we got an incremental update, rather than when we did a full resync.
* pass room_version into compute_event_signature (#6807)Richard van der Hoff2020-01-311-0/+1
|
* Merge pull request #6806 from matrix-org/rav/redact_changes/3Richard van der Hoff2020-01-311-0/+1
|\ | | | | Pass room_version into add_hashes_and_signatures
| * changelogRichard van der Hoff2020-01-301-0/+1
| |
* | Merge pull request #6820 from matrix-org/rav/get_room_version_idRichard van der Hoff2020-01-311-0/+1
|\ \ | | | | | | Make `get_room_version` return a RoomVersion object
| * | newsfileRichard van der Hoff2020-01-311-0/+1
| | |
* | | Fix bug with getting missing auth event during join 500'ed (#6810)Erik Johnston2020-01-311-0/+1
|/ /
* | pass room version into FederationHandler.on_invite_request (#6805)Richard van der Hoff2020-01-301-0/+1
| |
* | Log when we delete room in bg update (#6816)Erik Johnston2020-01-301-0/+1
|/
* MSC2260: Block direct sends of m.room.aliases events (#6794)Richard van der Hoff2020-01-301-0/+1
| | | | | as per MSC2260
* Backgroud update to clean out rooms from current state (#6802)Erik Johnston2020-01-301-0/+1
|
* Resync remote device list when detected as stale. (#6786)Erik Johnston2020-01-301-0/+1
|
* Fix sending server up commands from workers (#6811)Erik Johnston2020-01-301-0/+1
| | | | Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
* When server leaves room check for stale device lists. (#6801)Erik Johnston2020-01-301-0/+1
| | | | | | | | | When a server leaves a room it may stop sharing a room with remote users, and thus not get any updates to their device lists. So we need to check for this case and delete those device lists from the cache. We don't need to do this if we stop sharing a room because the remote user leaves the room, because we track that case via looking at membership changes.
* When a client asks for remote keys check if should resync. (#6797)Erik Johnston2020-01-301-0/+1
| | | | | | If we detect that the remote users' keys may have changed then we should attempt to resync against the remote server rather than using the (potentially) stale local cache.
* Type defintions for use in refactoring for redaction changes (#6803)Richard van der Hoff2020-01-301-0/+1
| | | | | | | | | | * Bump signedjson to 1.1 ... so that we can use the type definitions * Fix breakage caused by upgrade to signedjson 1.1 Thanks, @illicitonion...
* Remove unused DeviceRow class (#6800)Erik Johnston2020-01-291-0/+1
|
* changelogRichard van der Hoff2020-01-291-0/+1
|
* Fix race in federation sender that delayed device updates. (#6799)Erik Johnston2020-01-291-0/+1
| | | | | | | | | | | | We were sending device updates down both the federation stream and device streams. This mean there was a race if the federation sender worker processed the federation stream first, as when the sender checked if there were new device updates the slaved ID generator hadn't been updated with the new stream IDs and so returned nothing. This situation is correctly handled by events/receipts/etc by not sending updates down the federation stream and instead having the federation sender worker listen on the other streams and poke the transaction queues as appropriate.
* Delete current state when server leaves a room (#6792)Erik Johnston2020-01-291-0/+1
| | | | | | Otherwise its just stale data, which may get deleted later anyway so can't be relied on. It's also a bit of a shotgun if we're trying to get the current state of a room we're not in.
* Fix bug when querying remote user keys that require a resync. (#6796)Erik Johnston2020-01-291-0/+1
| | | | We ended up only returning a single device, rather than all of them.
* Fix outbound federation request metrics (#6795)Erik Johnston2020-01-281-0/+1
|
* Merge pull request #6787 from matrix-org/rav/msc2260Richard van der Hoff2020-01-281-0/+1
|\ | | | | Implement updated auth rules from MSC2260
| * update changelogRichard van der Hoff2020-01-282-1/+1
| |
| * changelogRichard van der Hoff2020-01-281-0/+1
| |
* | Detect unknown remote devices and mark cache as stale (#6776)Erik Johnston2020-01-281-0/+1
|/ | | | We just mark the fact that the cache may be stale in the database for now.
* Pass room version object into event_auth.check and check_redaction (#6788)Richard van der Hoff2020-01-281-0/+1
| | | | | | | These are easier to work with than the strings and we normally have one around. This fixes `FederationHander._persist_auth_tree` which was passing a RoomVersion object into event_auth.check instead of a string.
* Warn if postgres database has non-C locale. (#6734)Erik Johnston2020-01-281-0/+1
| | | As using non-C locale can cause issues on upgrading OS.
* Add `rooms.room_version` column (#6729)Erik Johnston2020-01-271-0/+1
| | | This is so that we don't have to rely on pulling it out from `current_state_events` table.
* Propagate cache invalidates from workers to other workers. (#6748)Erik Johnston2020-01-271-0/+1
| | | Currently if a worker invalidates a cache it will be streamed to master, which then didn't forward those to other workers.
* Merge pull request #6775 from matrix-org/jaywink/worker-docs-tweaksBrendan Abolivier2020-01-271-0/+1
|\ | | | | Clarifications to the workers documentation
| * Formatting of changelogJason Robinson2020-01-271-1/+1
| | | | | | Co-Authored-By: Brendan Abolivier <babolivier@matrix.org>
| * Clarifications to the workers documentationJason Robinson2020-01-241-0/+1
| | | | | | | | | | | | | | | | | | * Add note that user_dir requires disabling user dir updates from the main synapse process. * Add note that federation_reader should have the federation listener resource. Signed-off-by: Jason Robinson <jasonr@matrix.org>
* | Validate client_secret parameter (#6767)Andrew Morgan2020-01-241-0/+1
|/
* Make 'event.redacts' never raise. (#6771)Erik Johnston2020-01-231-0/+1
| | | | | | There are quite a few places that we assume that a redaction event has a corresponding `redacts` key, which is not always the case. So lets cheekily make it so that event.redacts just returns None instead.
* Merge branch 'master' into developBrendan Abolivier2020-01-231-1/+0
|\
| * Fixup changelogBrendan Abolivier2020-01-231-1/+0
| |
* | a bit of debugging for media storage providers (#6757)Richard van der Hoff2020-01-231-0/+1
| | | | | | | | | | | | * a bit of debugging for media storage providers * changelog
* | Minor fixes to user admin api (#6761)Richard van der Hoff2020-01-231-0/+1
| | | | | | | | * don't insist on a password (this is valid if you have an SSO login) * fix reference to undefined `requester`
* | Merge branch 'release-v1.9.0' into developAndrew Morgan2020-01-231-0/+1
|\|
| * Update admin room docs with correct endpoints (#6770)Andrew Morgan2020-01-231-0/+1
| |
* | Remove unnecessary abstractions in admin handler (#6751)Andrew Morgan2020-01-221-0/+1
|/
* 1.9.0rc1Brendan Abolivier2020-01-2247-48/+0
|
* Admin API to list, filter and sort rooms (#6720)Andrew Morgan2020-01-221-0/+1
|
* Lint + changelogBrendan Abolivier2020-01-221-0/+1
|
* Fix and add test to deprecated quarantine media admin api (#6756)Andrew Morgan2020-01-221-0/+1
|
* Allow monthly active user limiting support for worker mode, fixes #4639. (#6742)Neil Johnson2020-01-221-0/+1
|
* Allow streaming cache invalidate all to workers. (#6749)Erik Johnston2020-01-221-0/+1
|
* Remove unused CI docker compose files (#6754)Erik Johnston2020-01-221-0/+1
| | | These now exist in the pipelines repo.
* Avoid attribute error when `password_config` present but empty (#6753)Ivan Vilata-i-Balaguer2020-01-221-0/+1
| | | | | | | | | | The old statement returned `None` for such a `password_config` (like the one created on first run), thus retrieval of the `pepper` key failed with `AttributeError`. Fixes #5315 Signed-off-by: Ivan Vilata i Balaguer <ivan@selidor.net>
* Port synapse_port_db to async/await (#6718)Brendan Abolivier2020-01-211-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | * Raise an exception if there are pending background updates So we return with a non-0 code * Changelog * Port synapse_port_db to async/await * Port update_database to async/await * Add version string to mocked homeservers * Remove unused imports * Convert overseen bits to async/await * Fixup logging contexts * Fix imports * Add a way to print an error without raising an exception * Incorporate review
* Add a DeltaState to track changes to be made to current state (#6716)Erik Johnston2020-01-201-0/+1
|
* Fixup synapse.rest to pass mypy (#6732)Erik Johnston2020-01-201-0/+1
|
* Fix `/events/:event_id` deprecated API. (#6731)Erik Johnston2020-01-201-0/+1
|
* Fixup synapse.api to pass mypy (#6733)Erik Johnston2020-01-201-0/+1
|
* Fix changing password via user admin API. (#6730)Erik Johnston2020-01-201-0/+1
|
* Update changelog.d/6747.bugfixAndrew Morgan2020-01-201-1/+1
| | | Co-Authored-By: Erik Johnston <erik@matrix.org>
* Add changelogAndrew Morgan2020-01-201-0/+1
|
* Add more logging around message retention policies support (#6717)Brendan Abolivier2020-01-171-0/+1
| | | So we can debug issues like #6683 more easily
* Fix up changelogErik Johnston2020-01-172-1/+1
|
* Fix syntax error in run_upgrade for schema 57 (#6728)Satsuki Yanagi2020-01-171-0/+1
| | | | | | | Fix #6727 Related #6655 Co-authored-by: Erik Johnston <erikj@jki.re>
* Merge pull request #6714 from matrix-org/babolivier/retention_select_eventBrendan Abolivier2020-01-171-0/+1
|\ | | | | Fix instantiation of message retention purge jobs
| * Precise changelogBrendan Abolivier2020-01-161-1/+1
| |
| * Rename changelogBrendan Abolivier2020-01-151-0/+0
| |
| * ChangelogBrendan Abolivier2020-01-151-0/+1
| |
* | Merge pull request #6724 from matrix-org/rav/log_saml_attributesRichard van der Hoff2020-01-171-0/+1
|\ \ | | | | | | Log saml assertions rather than the whole response
| * | changelogRichard van der Hoff2020-01-161-0/+1
| | |
* | | Delegate remote_user_id mapping to the saml mapping provider (#6723)Richard van der Hoff2020-01-171-0/+1
| | | | | | | | | Turns out that figuring out a remote user id for the SAML user isn't quite as obvious as it seems. Factor it out to the SamlMappingProvider so that it's easy to control.
* | | Wake up transaction queue when remote server comes back online (#6706)Erik Johnston2020-01-171-0/+1
| | | | | | | | | | | | | | | This will be used to retry outbound transactions to a remote server if we think it might have come back up.
* | | Clarify the `account_validity` and `email` sections of the sample ↵Richard van der Hoff2020-01-171-0/+1
|/ / | | | | | | | | | | | | | | | | | | | | configuration. (#6685) Generally try to make this more comprehensible, and make it match the conventions. I've removed the documentation for all the settings which allow you to change the names of the template files, because I can't really see why they are useful.
* | Add StateMap type alias (#6715)Erik Johnston2020-01-161-0/+1
| |
* | Add tips for the changelog to the pull request template (#6663)Andrew Morgan2020-01-161-0/+1
| |
* | Add org.matrix.e2e_cross_signing to unstable_features in /versions as per ↵Neil Johnson2020-01-161-0/+1
| | | | | | | | MSC1756 (#6712)
* | Port synapse.replication.tcp to async/await (#6666)Erik Johnston2020-01-161-0/+1
| | | | | | | | | | | | | | | | | | | | * Port synapse.replication.tcp to async/await * Newsfile * Correctly document type of on_<FOO> functions as async * Don't be overenthusiastic with the asyncing....
* | Fix purge_room admin API (#6711)Erik Johnston2020-01-151-0/+1
| |
* | Remove duplicate session check in web fallback servlet (#6702)Andrew Morgan2020-01-151-0/+1
| |
* | Merge branch 'develop' into rav/module_api_extensionsRichard van der Hoff2020-01-1512-0/+13
|\ \
| * | Implement RedirectException (#6687)Richard van der Hoff2020-01-151-0/+1
| | | | | | | | | | | | | | | Allow REST endpoint implemnentations to raise a RedirectException, which will redirect the user's browser to a given location.
| * | Add `local_current_membership` table (#6655)Erik Johnston2020-01-151-0/+1
| |/ | | | | | | | | | | | | Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.
| * Process EDUs in parallel with PDUs. (#6697)Erik Johnston2020-01-141-0/+1
| | | | | | | | This means that things like to device messages don't get blocked behind processing PDUs, which can potentially take *ages*.
| * Fixup synapse.replication to pass mypy checks (#6667)Erik Johnston2020-01-141-0/+1
| |
| * Quarantine media by ID or user ID (#6681)Andrew Morgan2020-01-131-0/+1
| |
| * Document more supported endpoints for workers (#6698)Richard van der Hoff2020-01-131-0/+1
| |
| * Kill off RegistrationError (#6691)Richard van der Hoff2020-01-131-0/+1
| | | | | | This is pretty pointless. Let's just use SynapseError.
| * Don't assign numeric IDs for empty usernames (#6690)Richard van der Hoff2020-01-131-0/+1
| | | | | | | | Fix a bug where we would assign a numeric userid if somebody tried registering with an empty username
| * Merge pull request #6689 from matrix-org/rav/saml_mapping_provider_updatesRichard van der Hoff2020-01-131-0/+1
| |\ | | | | | | Updates to the SAML mapping provider API
| | * changelogRichard van der Hoff2020-01-121-0/+1
| | |
| * | Allow additional_resources to implement Resource directly (#6686)Richard van der Hoff2020-01-131-0/+1
| | | | | | | | | | | | | | | | | | AdditionalResource really doesn't add any value, and it gets in the way for resources which want to support child resources or the like. So, if the resource object already implements the IResource interface, don't bother wrapping it.
| * | Fix exceptions on requests for non-ascii urls (#6682)Richard van der Hoff2020-01-131-0/+2
| | | | | | | | | Fixes #6402
| * | changelogRichard van der Hoff2020-01-091-0/+1
| |/
* / changelogRichard van der Hoff2020-01-121-0/+1
|/
* Allow admin users to create or modify users without a shared secret (#6495)Manuel Stahl2020-01-091-0/+1
| | | Signed-off-by: Manuel Stahl <manuel.stahl@awesome-technologies.de>
* Merge branch 'master' into developErik Johnston2020-01-092-2/+0
|\
| * 1.8.0Erik Johnston2020-01-092-2/+0
| |
* | Merge pull request #6664 from matrix-org/erikj/media_admin_apisErik Johnston2020-01-081-0/+1
|\ \ | | | | | | Fix media repo admin APIs when using a media worker.
| * | NewsfileErik Johnston2020-01-081-0/+1
| | |
* | | Merge pull request #6665 from matrix-org/babolivier/retention_doc_typoBrendan Abolivier2020-01-081-0/+1
|\ \ \ | | | | | | | | Fix typo in message retention policies doc
| * | | ChangelogBrendan Abolivier2020-01-081-0/+1
| | | |
* | | | Merge remote-tracking branch 'origin/release-v1.8.0' into developRichard van der Hoff2020-01-082-0/+2
|\ \ \ \ | |/ / / |/| | / | | |/ | |/|
| * | Fix GET request on /_synapse/admin/v2/users endpoint (#6563)Manuel Stahl2020-01-081-0/+1
| | | | | | | | | | | | Fixes #6552
| * | Back out ill-advised notary server hackery (#6657)Richard van der Hoff2020-01-081-0/+1
| |/ | | | | | | | | | | | | | | | | | | | | This was ill-advised. We can't modify verify_keys here, because the response object has already been signed by the requested key. Furthermore, it's somewhat unnecessary because existing versions of Synapse (which get upset that the notary key isn't present in verify_keys) will fall back to a direct fetch via `/key/v2/server`. Also: more tests for fetching keys via perspectives: it would be nice if we actually tested when our fetcher can't talk to our notary impl.
* | Merge pull request #6624 from matrix-org/babolivier/retention_docBrendan Abolivier2020-01-081-0/+1
|\ \ | | | | | | Add complete documentation of the message retention policies support
| * | Merge branch 'develop' into babolivier/retention_docBrendan Abolivier2020-01-0737-37/+0
| |\|
| * | Update changelog.d/6624.docBrendan Abolivier2020-01-071-1/+1
| | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | Rename changelogBrendan Abolivier2020-01-031-0/+0
| | |
| * | Add a complete documentation of the message retention policies supportBrendan Abolivier2020-01-031-0/+1
| | |
* | | contrib/docker-compose: fixing mount that overrides containers' /etc (#6656)Fabian Meyer2020-01-081-0/+1
| | | | | | | | | | | | The mount in the form of ./matrix-config:/etc overwrites the contents of the container /etc folder. Since all valid ca certificates are stored in /etc, the synapse.push.httppusher, for example, cannot validate the certificate from matrix.org.
* | | Correctly proxy remote group HTTP errors. (#6654)Erik Johnston2020-01-071-0/+1
| | | | | | | | | | | | | | | e.g. if remote returns a 404 then that shouldn't be treated as an error but should be proxied through.
* | | Merge pull request #6621 from matrix-org/babolivier/purge_job_config_typoBrendan Abolivier2020-01-071-0/+1
|\ \ \ | |_|/ |/| | Fix a typo in the purge jobs configuration example
| * | ChangelogBrendan Abolivier2020-01-031-0/+1
| |/
* | 1.8.0rc1Erik Johnston2020-01-0754-54/+0
| |
* | Merge pull request #6652 from matrix-org/babolivier/depth_missing_eventsBrendan Abolivier2020-01-071-0/+1
|\ \ | | | | | | Fix conditions failing if min_depth = 0
| * | ChangelogBrendan Abolivier2020-01-071-0/+1
| |/
* | Add a background update to clear tombstoned rooms from the directory (#6648)Richard van der Hoff2020-01-071-0/+1
| | | | | | | | | | | | * Add a background update to clear tombstoned rooms from the directory * use the ABC metaclass
* | Async/await for background updates (#6647)Richard van der Hoff2020-01-071-0/+1
| | | | | | | | so that bg update routines can be async
* | port BackgroundUpdateTestCase to HomeserverTestCase (#6653)Richard van der Hoff2020-01-071-0/+1
| |
* | Merge pull request #6645 from matrix-org/rav/fix_synchrotron_errorRichard van der Hoff2020-01-071-0/+1
|\ \ | | | | | | Fix exceptions in the synchrotron worker log when events are rejected.
| * | changelogRichard van der Hoff2020-01-061-0/+1
| | |
* | | Merge pull request #6629 from matrix-org/rav/kill_event_reference_hashesRichard van der Hoff2020-01-061-0/+1
|\ \ \ | |/ / |/| | Remove a bunch of unused code from event creation
| * | changelogRichard van der Hoff2020-01-061-0/+1
| | |
* | | Fix some test failures when frozen_dicts are enabled (#6642)Richard van der Hoff2020-01-061-0/+1
| | | | | | | | | | | | Fixes #4026
* | | Add experimental 'databases' config (#6580)Erik Johnston2020-01-061-0/+1
| | |
* | | Fix an error which was thrown by the PresenceHandler _on_shutdown handler. ↵Richard van der Hoff2020-01-061-0/+1
| | | | | | | | | | | | (#6640)
* | | Fix exception when fetching notary server's old keys (#6625)Richard van der Hoff2020-01-061-0/+1
| | | | | | | | | | | | | | | | | | Lift the restriction that *all* the keys used for signing v2 key responses be present in verify_keys. Fixes #6596.
* | | Workaround for error when fetching notary's own key (#6620)Richard van der Hoff2020-01-061-0/+1
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | * Kill off redundant SynapseRequestFactory We already get the Site via the Channel, so there's no need for a dedicated RequestFactory: we can just use the right constructor. * Workaround for error when fetching notary's own key As a notary server, when we return our own keys, include all of our signing keys in verify_keys. This is a workaround for #6596.
* | Fix power levels being incorrectly set in old and new rooms after a room ↵Andrew Morgan2020-01-061-0/+1
| | | | | | | | | | | | upgrade (#6633) Modify a copy of an upgraded room's PL before sending to the new room
* | Automate generation of the sample and debian log configs (#6627)Richard van der Hoff2020-01-031-0/+1
| |
* | Raise an error if someone tries to use the log_file config option (#6626)Richard van der Hoff2020-01-031-0/+1
| | | | | | | | This has caused some confusion for people who didn't notice it going away.
* | Remove unused, undocumented "content repo" resource (#6628)Richard van der Hoff2020-01-031-0/+1
| | | | | | | | | | | | This looks like it got half-killed back in #888. Fixes #6567.
* | Kill off redundant SynapseRequestFactory (#6619)Richard van der Hoff2020-01-031-0/+1
| | | | | | | | We already get the Site via the Channel, so there's no need for a dedicated RequestFactory: we can just use the right constructor.
* | Reduce the reconnect time when replication fails. (#6617)Richard van der Hoff2020-01-031-0/+1
|/
* Added the section 'Configuration' in /docs/turn-howto.md (#6614)ewaf12020-01-021-0/+1
| | | | put the 2nd part of the "source installation"-section into a new section, because it also applies to Debian packages
* Reword sections of federate.md that explained delegation at time of Synapse ↵Aaron Raimist2020-01-021-0/+1
| | | | | | | | | | | | 1.0 transition (#6601) * Remove sections of federate.md explaining delegation at time of Synapse 1.0 transition Signed-off-by: Aaron Raimist <aaron@raim.ist> * Add changelog Signed-off-by: Aaron Raimist <aaron@raim.ist>
* Split state groups into a separate data store (#6296)Erik Johnston2019-12-201-0/+1
|
* Change EventContext to use the Storage class (#6564)Erik Johnston2019-12-201-0/+1
|
* Explode on duplicate delta file names. (#6565)Erik Johnston2019-12-191-0/+1
|
* Port some admin handlers to async/await (#6559)Erik Johnston2019-12-191-0/+1
|
* Improve diagnostics on database upgrade failure (#6570)Richard van der Hoff2019-12-191-0/+1
| | | | `Failed to upgrade database` is not helpful, and it's unlikely that UPGRADE.rst has anything useful.
* Fix sdnotify with acme enabled (#6571)Richard van der Hoff2019-12-191-0/+1
| | | | | | | If acme was enabled, the sdnotify startup hook would never be run because we would try to add it to a hook which had already fired. There's no need to delay it: we can sdnotify as soon as we've started the listeners.
* Add an export_signing_key script (#6546)Richard van der Hoff2019-12-191-0/+1
| | | | | I want to do some key rotation, and it is silly that we don't have a way to do this.
* Clean up startup for the pusher (#6558)Richard van der Hoff2019-12-181-0/+1
| | | | | | | | | | | | | | | | | | | | | | | * Remove redundant python2 support code `str.decode()` doesn't exist on python3, so presumably this code was doing nothing * Filter out pushers with corrupt data When we get a row with unparsable json, drop the row, rather than returning a row with null `data`, which will then cause an explosion later on. * Improve logging when we can't start a pusher Log the ID to help us understand the problem * Make email pusher setup more robust We know we'll have a `data` member, since that comes from the database. What we *don't* know is if that is a dict, and if that has a `brand` member, and if that member is a string.
* Add delta file to fix missing default table data (#6555)Andrew Morgan2019-12-181-0/+1
|
* Add database config class (#6513)Erik Johnston2019-12-181-0/+1
| | | | | This encapsulates config for a given database and is the way to get new connections.
* Merge branch 'master' into developRichard van der Hoff2019-12-1811-13/+0
|\
| * Remove #6369 changelogAndrew Morgan2019-12-051-1/+0
| |
* | Merge release-v1.7.1 into developRichard van der Hoff2019-12-182-0/+2
|\ \
| * | Fix bug where we added duplicate event IDs as auth_events (#6560)Erik Johnston2019-12-171-0/+1
| | |
| * | Add auth events as per spec. (#6556)Erik Johnston2019-12-161-0/+1
| | | | | | | | | | | | | | | Previously we tried to be clever and filter out some unnecessary event IDs to keep the auth chain small, but that had some annoying interactions with state res v2 so we stop doing that for now.
| * | Merge pull request #6553 from matrix-org/babolivier/fix-context-filterBrendan Abolivier2019-12-161-0/+1
| |\ \ | | | | | | | | Use the filtered version of an event when responding to /context requests for that event
| | * | Update changelog.d/6553.bugfixBrendan Abolivier2019-12-161-1/+1
| | | | | | | | | | | | Co-Authored-By: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
| | * | ChangelogBrendan Abolivier2019-12-161-0/+1
| | | |
| * | | Exclude rejected state events when calculating state at backwards extrems ↵Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | | | | | | | | | | | | (#6527) This fixes a weird bug where, if you were determined enough, you could end up with a rejected event forming part of the state at a backwards-extremity. Authing that backwards extrem would then lead to us trying to pull the rejected event from the db (with allow_rejected=False), which would fail with a 404.
| * | | Persist auth/state events at backwards extremities when we fetch them (#6526)Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | | | | | | | | The main point here is to make sure that the state returned by _get_state_in_room has been authed before we try to use it as state in the room.
| * | | sanity-checking for events used in state res (#6531)Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | | | | | | | | | | | | When we perform state resolution, check that all of the events involved are in the right room.
| * | | Sanity-check room ids in event auth (#6530)Richard van der Hoff2019-12-161-0/+2
| | | | | | | | | | | | | | | | When we do an event auth operation, check that all of the events involved are in the right room.
| * | | Check the room_id of events when fetching room state/auth (#6524)Richard van der Hoff2019-12-161-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When we request the state/auth_events to populate a backwards extremity (on backfill or in the case of missing events in a transaction push), we should check that the returned events are in the right room rather than blindly using them in the room state or auth chain. Given that _get_events_from_store_or_dest takes a room_id, it seems clear that it should be sanity-checking the room_id of the requested events, so let's do it there.
| * | | Add `include_event_in_state` to _get_state_for_room (#6521)Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | Make it return the state *after* the requested event, rather than the one before it. This is a bit easier and requires fewer calls to get_events_from_store_or_dest.
| * | | Move get_state methods into FederationHandler (#6503)Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | | | | | | | | | | | | This is a non-functional refactor as a precursor to some other work.
| * | | Refactor get_events_from_store_or_dest to return a dict (#6501)Richard van der Hoff2019-12-161-0/+1
| |/ / | | | | | | | | | | | | There was a bunch of unnecessary conversion back and forth between dict and list going on here. We can simplify a bunch of the code.
* | | Remove unused `get_pagination_rows` methods. (#6557)Erik Johnston2019-12-171-0/+1
| | | | | | | | | Remove unused get_pagination_rows methods
* | | Add auth events as per spec. (#6556)Erik Johnston2019-12-161-0/+1
| | | | | | | | | | | | | | | Previously we tried to be clever and filter out some unnecessary event IDs to keep the auth chain small, but that had some annoying interactions with state res v2 so we stop doing that for now.
* | | Add option to allow profile queries without sharing a room (#6523)Will Hunt2019-12-161-0/+1
| | |
* | | Exclude rejected state events when calculating state at backwards extrems ↵Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | | | | | | | (#6527) This fixes a weird bug where, if you were determined enough, you could end up with a rejected event forming part of the state at a backwards-extremity. Authing that backwards extrem would then lead to us trying to pull the rejected event from the db (with allow_rejected=False), which would fail with a 404.
* | | Persist auth/state events at backwards extremities when we fetch them (#6526)Richard van der Hoff2019-12-161-0/+1
| | | | | | | | | The main point here is to make sure that the state returned by _get_state_in_room has been authed before we try to use it as state in the room.