summary refs log tree commit diff
path: root/docs/sphinx/synapse.util.dbutils.rst (unfollow)
Commit message (Collapse)AuthorFilesLines
2021-09-07Add "No significant changes" to changelog v1.42.0Azrenbeth1-0/+2
2021-09-07Move upgrade notice up in changelogAzrenbeth1-6/+1
2021-09-071.42.0Azrenbeth3-1/+13
2021-09-06Improve changelog wording v1.42.0rc2Brendan Abolivier1-1/+1
2021-09-06Expand on why users should read upgrade notesBrendan Abolivier1-1/+4
2021-09-06Move the upgrade notes reminder up to rc2Brendan Abolivier1-3/+2
2021-09-06 1.42.0rc2Brendan Abolivier5-3/+22
2021-09-06Add a warning when using deprecated template_dir settings (#10768)Brendan Abolivier4-0/+42
The deprecation itself happened in #10596 which shipped with Synapse v1.41.0. However, it doesn't seem fair to suddenly drop support for these settings in ~4-6w without being more vocal about said deprecation.
2021-09-03Support MSC3375: room version 9. (#10747)Patrick Cloke4-1/+79
2021-09-01Make minor changes to changelog v1.42.0rc1Olivier Wilkinson (reivilibre)1-2/+2
2021-09-01Improve changelogOlivier Wilkinson (reivilibre)1-3/+3
Expand OIDC to OpenID Connect.
2021-09-01Improve changelogOlivier Wilkinson (reivilibre)1-7/+6
2021-09-011.42.0rc1Olivier Wilkinson (reivilibre)51-52/+78
2021-09-01Fix iteration in _remove_deleted_email_pushers background job. (#10734)Andrew Morgan3-1/+47
2021-08-31Move the sessions delta to the latest schema version. (#10725)Patrick Cloke2-0/+1
This was erroneously put under schema version 62 instead of 63.
2021-08-31 1.41.1 v1.41.1Richard van der Hoff3-1/+39
2021-08-31Fix up unit tests (#10723)Richard van der Hoff2-2/+16
These were broken in an incorrect merge of GHSA-jj53-8fmw-f2w2 (cb35df9)
2021-08-31Advertise matrix-org.github.io/synapse docs (#10595)David Robertson4-432/+459
Point to the book where possible, and use hyperlinks to github to refer to files not included in the book. Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
2021-08-31Merge pull request from GHSA-jj53-8fmw-f2w2reivilibre2-2/+59
2021-08-31Merge pull request from GHSA-3x4c-pq33-4w3qreivilibre2-4/+103
* Add some tests to characterise the problem Some failing. Current states: RoomsMemberListTestCase test_get_member_list ... [OK] test_get_member_list_mixed_memberships ... [OK] test_get_member_list_no_permission ... [OK] test_get_member_list_no_permission_former_member ... [OK] test_get_member_list_no_permission_former_member_with_at_token ... [FAIL] test_get_member_list_no_room ... [OK] test_get_member_list_no_permission_with_at_token ... [FAIL] * Correct the tests * Check user is/was member before divulging room membership * Pull out only the 1 membership event we want. * Update tests/rest/client/v1/test_rooms.py Co-authored-by: Erik Johnston <erik@matrix.org> * Fixup tests (following apply review suggestion) Co-authored-by: Erik Johnston <erik@matrix.org>
2021-08-27Fix incompatibility with Twisted < 21. (#10713)Richard van der Hoff5-21/+173
Turns out that the functionality added in #10546 to skip TLS was incompatible with older Twisted versions, so we need to be a bit more inventive. Also, add a test to (hopefully) not break this in future. Sadly, testing TLS is really hard.
2021-08-27 Removed page summaries from the top of installation and contributing doc ↵Azrenbeth4-75/+21
pages (#10711) - Removed page summaries from CONTRIBUTING and installation pages as this information was already in the table of contents on the right hand side - Fixed some broken links in CONTRIBUTING - Added margin-right tag for when table of contents is being shown (otherwise the text in the page sometimes overlaps with it)
2021-08-27Clarifications to reverse_proxy.md (#10708)Richard van der Hoff2-5/+6
* Update reverse_proxy.md * Create 10708.doc
2021-08-27Remove unused `compare_digest` function. (#10706)Patrick Cloke2-13/+1
2021-08-27Improve ServerNoticeServlet to avoid duplicate requests (#10679)Dirk Klimpel5-17/+475
Fixes: #9544
2021-08-27Fix perf of fetching the same events many times. (#10703)Erik Johnston2-6/+24
The code to deduplicate repeated fetches of the same set of events was N^2 (over the number of events requested), which could lead to a process being completely wedged. The main fix is to deduplicate the returned deferreds so we only await on a deferred once rather than many times. Seperately, when handling the returned events from the defrered we only add the events we care about to the event map to be returned (so that we don't pay the price of inserting extraneous events into the dict).
2021-08-26Split `FederationHandler` in half (#10692)Richard van der Hoff11-1780/+1883
The idea here is to take anything to do with incoming events and move it out to a separate handler, as a way of making FederationHandler smaller.
2021-08-26Make `backfill` and `get_missing_events` use the same codepath (#10645)Richard van der Hoff3-233/+42
Given that backfill and get_missing_events are basically the same thing, it's somewhat crazy that we have entirely separate code paths for them. This makes backfill use the existing get_missing_events code, and then clears up all the unused code.
2021-08-26Validate new m.room.power_levels events (#10232)Aaron Raimist5-4/+160
Signed-off-by: Aaron Raimist <aaron@raim.ist>
2021-08-26Remove pushers when deleting 3pid from account (#10581)Azrenbeth7-1/+143
When a user deletes an email from their account it will now also remove all pushers for that email and that user (even if these pushers were created by a different client)
2021-08-26Additional type hints for REST servlets (part 2). (#10674)Patrick Cloke17-138/+216
Applies the changes from #10665 to additional modules.
2021-08-26Cache the result of fetching the room hierarchy over federation. (#10647)Patrick Cloke2-40/+67
2021-08-25Make a note to leave a summary when one is bumping the schema version (#10621)Andrew Morgan2-0/+3
I found this easy to miss (and evidently, it looks like it was missed for schema version 62).
2021-08-25Ensure the base Docker image is rebuilt when running complement with ↵Patrick Cloke2-7/+8
workers. (#10686) We now always rebuild the matrixdotorg/synapse image, then build the matrixdotorg/synapse-workers image on top of it.
2021-08-25Fix error when selecting between thumbnails with the same quality (#10684)Sean3-10/+56
Fixes #10318
2021-08-24Update changelog v1.41.0Erik Johnston1-4/+9
2021-08-24 1.41.0Erik Johnston4-2/+16
2021-08-24Persist room hierarchy pagination sessions to the database. (#10613)Patrick Cloke7-38/+212
2021-08-24Correctly initialise the `synapse_user_logins` metric. (#10677)Richard van der Hoff4-6/+44
Fix a bug where the prometheus metrics for SSO logins wouldn't be initialised until the first user logged in with a given auth provider.
2021-08-23doc: add django-oauth-toolkit to oidc doc (#10192)Hugo DELVAL2-0/+49
Signed-off-by: Hugo Delval <hugo.delval@gmail.com>
2021-08-23Enforce the max length for per-room display names / avatar URLs. (#10654)Azrenbeth2-1/+17
To match the maximum lengths allowed for profile data.
2021-08-23Fix the titles in the OIDC documentation (#10639)Andrew Morgan2-6/+11
* Fix the titles in the OIDC documentation Having them as links broke the table-of-contents rendering in mdbook. Plus there's no reason for only some of the provider titles to be links. * Changelog * Add link to google idp docs
2021-08-23Avoid duplicate issues from Twisted trunk failures (#10672)Dan Callahan2-1/+3
Setting `update_existing: true` in the `create-an-issue` GitHub Action will avoid opening duplicate issues if an open issue already exists with an identical title. If no open issues match the title, then a new issue will be created. This helps avoid spamming our issue tracker should there be a failure when testing against Twisted's trunk. This PR also pins the SHA of the `create-an-issue` action to mitigate the risk of a malicious actor gaining access to JasonEtco's account. See GitHub's page on security hardening third party actions for more: https://docs.github.com/en/actions/learn-github-actions/security-hardening-for-github-actions#using-third-party-actions Signed-off-by: Dan Callahan <danc@element.io>
2021-08-23Additional type hints for the sync REST servlet. (#10666)Patrick Cloke3-61/+93
2021-08-23Addtional type hints for the REST servlets. (#10665)Patrick Cloke14-107/+204
2021-08-23Do not include stack traces for known exceptions when trying multiple ↵Patrick Cloke2-1/+7
federation destinations. (#10662)
2021-08-23Run a nightly CI build against Twisted trunk. (#10651)Richard van der Hoff4-0/+102
This creates a GHA workflow which runs at 8am every day, and runs mypy, trial and sytest against Twisted's current trunk. If any of the jobs fail, it opens an issue.
2021-08-21Implement MSC3231: Token authenticated registration (#10142)Callum Brown21-1/+2389
Signed-off-by: Callum Brown <callum@calcuode.com> This is part of my GSoC project implementing [MSC3231](https://github.com/matrix-org/matrix-doc/pull/3231).
2021-08-20Flatten tests/rest/client/{v1,v2_alpha} too (#10667)David Robertson27-18/+6
2021-08-20Simplify tests for the device admin rest API. (#10664)Dirk Klimpel2-81/+19
By replacing duplicated code with parameterized tests and avoiding unnecessary dumping of JSON data.
2021-08-20Follow-up: format changelog, add licence (#10593)David Robertson2-1/+15
Merged before approval; these comments from @clokep on that PR.
2021-08-20Validate device_keys for C-S /keys/query requests (#10593)David Robertson4-1/+101
* Validate device_keys for C-S /keys/query requests Closes #10354 A small, not particularly critical fix. I'm interested in seeing if we can find a more systematic approach though. #8445 is the place for any discussion.
2021-08-20Set room version 8 as preferred for restricted rooms. (#10571)Patrick Cloke4-4/+5
2021-08-19Split `on_receive_pdu` in half (#10640)Richard van der Hoff4-109/+142
Here we split on_receive_pdu into two functions (on_receive_pdu and process_pulled_event), rather than having both cases in the same method. There's a tiny bit of overlap, but not that much.
2021-08-19Extract `_resolve_state_at_missing_prevs` (#10624)Richard van der Hoff2-105/+125
This is a follow-up to #10615: it takes the code that constructs the state at a backwards extremity, and extracts it to a separate method.
2021-08-19Do not include rooms with an unknown room version in a sync response. (#10644)Patrick Cloke7-11/+145
A user will still see this room if it is in a local cache, but it will not reappear if clearing the cache and reloading.
2021-08-19Fix typo in release notes (#10646)John-Scott Atlakson1-1/+1
Ubuntu 20.10 was not an LTS release Signed-off-by: John-Scott Atlakson 24574+jsma@users.noreply.github.com
2021-08-19Support MSC3283: Expose `enable_set_displayname` in capabilities (#10452)Dirk Klimpel4-23/+101
2021-08-19Remove not needed database updates in modify user admin API (#10627)Dirk Klimpel5-33/+118
2021-08-18Additional type hints for the proxy agent and SRV resolver modules. (#10608)Dirk Klimpel5-25/+41
2021-08-18Update docs/upgrade.md with new versionErik Johnston1-1/+1
2021-08-18Fix weakref_slot parameter for room member storage attrs. (#10642)Patrick Cloke2-4/+5
Follow-up to #10629 which set it to true, not false.
2021-08-18Update changelog v1.41.0rc1Erik Johnston1-4/+4
2021-08-18 1.41.0rc1Erik Johnston63-61/+86
2021-08-18Convert room member storage tuples to attrs. (#10629)Patrick Cloke7-29/+54
Instead of using namedtuples. This helps with asserting type hints and code completion.
2021-08-18Mount /_synapse/admin/v1/users/{userId}/media admin API on media workers ↵Andrew Morgan6-165/+173
only (#10628) Co-authored-by: Patrick Cloke <patrickc@matrix.org>
2021-08-18Display an error page during failure of fallback UIA. (#10561)Callum Brown8-28/+65
2021-08-18fix broken link to upgrade notes (#10631)Richard van der Hoff2-1/+2
2021-08-18Refactor `on_receive_pdu` code (#10615)Richard van der Hoff2-134/+138
* drop room pdu linearizer sooner No point holding onto it while we recheck the db * move out `missing_prevs` calculation we're going to need `missing_prevs` whatever we do, so we may as well calculate it eagerly and just update it if it gets outdated. * Add another `if missing_prevs` condition this should be a no-op, since all the code inside the block already checks `if missing_prevs` * reorder if conditions This shouldn't change the logic at all. * Push down `min_depth` read No point reading it from the database unless we're going to use it. * Collect the sent_to_us_directly code together Move the remaining `sent_to_us_directly` code inside the `if sent_to_us_directly` block. * Properly separate the `not sent_to_us_directly` branch Since the only way this second block is now reachable is if we *didn't* go into the `sent_to_us_directly` branch, we can replace it with a simple `else`. * changelog
2021-08-18Use auto-attribs for attrs classes for sync. (#10630)Patrick Cloke2-78/+79
2021-08-18Allow modules to run looping call on all instances (#10638)Erik Johnston2-1/+9
By default the calls only ran on the worker configured to run background tasks.
2021-08-17Remove deprecated Shutdown Room and Purge Room Admin API (#8830)Dirk Klimpel9-384/+14
2021-08-17Allow /createRoom to be run on workers (#10564)Andrew Morgan4-35/+37
Fixes https://github.com/matrix-org/synapse/issues/7867
2021-08-17Port the PresenceRouter module interface to the new generic interface (#10524)Azrenbeth9-69/+326
Port the PresenceRouter module interface to the new generic interface introduced in v1.37.0
2021-08-17Remove the unused public_room_list_stream (#10565)Andrew Morgan9-250/+48
Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
2021-08-17Build debs for bookworm (#10612)Richard van der Hoff2-1/+3
2021-08-17Centralise the custom template directory (#10596)Brendan Abolivier12-418/+342
Several configuration sections are using separate settings for custom template directories, which can be confusing. This PR adds a new top-level configuration for a custom template directory which is then used for every module. The only exception is the consent templates, since the consent template directory require a specific hierarchy, so it's probably better that it stays separate from everything else.
2021-08-17Attempt to pull from the legacy spaces summary API over federation. (#10583)Patrick Cloke2-9/+56
If the new /hierarchy API does not exist on all destinations, fallback to querying the /spaces API and translating the results. This is a backwards compatibility hack since not all of the federated homeservers will update at the same time.
2021-08-17Stop setting the outlier flag for things that aren't (#10614)Richard van der Hoff2-7/+3
Marking things as outliers to inhibit pushes is a sledgehammer to crack a nut. Move the test further down the stack so that we just inhibit the thing we want.
2021-08-17Make `PeriodicallyFlushingMemoryHandler` the default logging handler. (#10518)reivilibre4-21/+61
2021-08-17Flatten the synapse.rest.client package (#10600)reivilibre123-188/+137
2021-08-17Always list fallback key types in /sync (#10623)Andrew Morgan2-4/+6
2021-08-17Allow to edit `external_ids` by Edit User admin API (#10598)Dirk Klimpel5-89/+340
Signed-off-by: Dirk Klimpel dirk@klimpel.org
2021-08-17update links to schema doc (#10620)Richard van der Hoff3-3/+4
2021-08-17Allow using several custom template directories (#10587)Brendan Abolivier7-27/+98
Allow using several directories in read_templates.
2021-08-17Add an admin API to check if a username is available (#10578)Will Hunt5-0/+136
This adds a new API GET /_synapse/admin/v1/username_available?username=foo to check if a username is available. It is the counterpart to https://matrix.org/docs/spec/client_server/r0.6.0#get-matrix-client-r0-register-available, except that it works even if registration is disabled.
2021-08-16Manhole: wrap coroutines in `defer.ensureDeferred` automatically (#10602)reivilibre3-1/+16
2021-08-16Update CONTRIBUTING.md to fix index links and SyTest instructions (#10599)reivilibre2-3/+5
Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net>
2021-08-16Validate the max_rooms_per_space parameter to ensure it is non-negative. ↵Patrick Cloke3-9/+39
(#10611)
2021-08-16Experimental support for MSC3266 Room Summary API. (#10394)Michael Telatynski10-115/+289
2021-08-16Split `synapse.federation.transport.server` into multiple files. (#10590)Patrick Cloke7-2158/+2219
2021-08-16Clean up some logging in the federation event handler (#10591)Richard van der Hoff4-29/+28
* Include outlier status in `str(event)` In places where we log event objects, knowing whether or not you're dealing with an outlier is super useful. * Remove duplicated logging in get_missing_events When we process events received from get_missing_events, we log them twice (once in `_get_missing_events_for_pdu`, and once in `on_receive_pdu`). Reduce the duplication by removing the logging in `on_receive_pdu`, and ensuring the call sites do sensible logging. * log in `on_receive_pdu` when we already have the event * Log which prev_events we are missing * changelog
2021-08-16Support federation in the new spaces summary API (MSC2946). (#10569)Patrick Cloke6-165/+518
2021-08-16Handle string read receipt data (#10606)Šimon Brandner3-1/+32
* Handle string read receipt data Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Test that we handle string read receipt data Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Add changelog for #10606 Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Add docs Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Ignore malformed RRs Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Only surround hidden = ... Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Remove unnecessary argument Signed-off-by: Šimon Brandner <simon.bra.ag@gmail.com> * Update changelog.d/10606.bugfix Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
2021-08-16Update the Synapse Grafana dashboard (#10570)Brendan Abolivier2-66/+485
2021-08-13Move /batch_send to /v2_alpha directory (MSC2716) (#10576)Eric Eastwood4-409/+445
* Move /batch_send to /v2_alpha directory As pointed out by @erikjohnston, https://github.com/matrix-org/synapse/pull/10552#discussion_r685836624
2021-08-13Fix a harmless exception when the staged events queue is empty. (#10592)Patrick Cloke2-5/+11
2021-08-12Stop building a debian package for Groovy Gorilla (#10588)David Robertson2-1/+1
2021-08-12Remove buildkite-era commentDavid Robertson1-3/+0
2021-08-12portdb also uses coverage, so provide $TOP thereDavid Robertson1-0/+2
2021-08-12Also rename in lint.shDavid Robertson1-1/+1
2021-08-11Update the pagination parameter name based on MSC2946 review. (#10579)Patrick Cloke3-10/+11
2021-08-11Admin API to delete media for a specific user (#10558)Dirk Klimpel7-128/+347
2021-08-11Missed another ci->.ciDavid Robertson1-9/+9
Should have been more systematic with my grepping.
2021-08-11set TOP in sytest containersDavid Robertson2-2/+3
2021-08-11Teach MANIFEST and tox about ci->.ciDavid Robertson2-2/+2
2021-08-11Allow requesting the summary of a space which is joinable. (#10580)Patrick Cloke3-15/+45