summary refs log tree commit diff
path: root/tests/storage (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'release-v1.15.0' of github.com:matrix-org/synapse into ↵Andrew Morgan2020-06-241-118/+149
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dinsic-release-v1.15.x * 'release-v1.15.0' of github.com:matrix-org/synapse: (55 commits) 1.15.0 Fix some attributions Update CHANGES.md 1.15.0rc1 Revert "1.15.0rc1" 1.15.0rc1 Fix bug in account data replication stream. (#7656) Convert the registration handler to async/await. (#7649) Accept device information at the login fallback endpoint. (#7629) Convert user directory handler and related classes to async/await. (#7640) Add an option to disable autojoin for guest accounts (#6637) Clarifications to the admin api documentation (#7647) Update to the stable SSO prefix for UI Auth. (#7630) Fix type information on `assert_*_is_admin` methods (#7645) Remove some unused constants. (#7644) Typo fixes. Allow new users to be registered via the admin API even if the monthly active user limit has been reached (#7263) Add device management to admin API (#7481) Attempt to fix PhoneHomeStatsTestCase.test_performance_100 being flaky. (#7634) Support CS API v0.6.0 (#6585) ...
| * Replace instances of reactor pumping with get_success. (#7619)Andrew Morgan2020-06-031-118/+149
| | | | | | | | | | Calls `self.get_success` on all deferred methods instead of abusing `self.pump()`. This has the benefit of working with coroutines, as well as checking that method execution completed successfully. There are also a few small cleanups that I made in the process.
* | Merge branch 'release-v1.14.0' of github.com:matrix-org/synapse into ↵Andrew Morgan2020-06-1011-73/+279
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dinsic-release-v1.14.x * 'release-v1.14.0' of github.com:matrix-org/synapse: (108 commits) Fix typo in PR link Update debian changelog 1.14.0 Improve changelog wording 1.14.0rc2 Fix sample config docs error (#7581) Fix up comments Fix specifying cache factors via env vars with * in name. (#7580) Don't apply cache factor to event cache. (#7578) Ensure ReplicationStreamer is always started when replication enabled. (#7579) Remove the changes to the debian changelog Not full release yet, this is rc1 Merge event persistence move changelog entries More changelog fix Changelog fixes 1.14.0 Replace device_27_unique_idx bg update with a fg one (#7562) Fix incorrect exception handling in KeyUploadServlet.on_POST (#7563) Fix recording of federation stream token (#7564) Simplify reap_monthly_active_users (#7558) ...
| * Optimise some references to hs.config (#7546)Richard van der Hoff2020-05-222-58/+65
| | | | | | These are surprisingly expensive, and we only really need to do them at startup.
| * Add ability to wait for replication streams (#7542)Erik Johnston2020-05-222-3/+3
| | | | | | | | | | | | | | The idea here is that if an instance persists an event via the replication HTTP API it can return before we receive that event over replication, which can lead to races where code assumes that persisting an event immediately updates various caches (e.g. current state of the room). Most of Synapse doesn't hit such races, so we don't do the waiting automagically, instead we do so where necessary to avoid unnecessary delays. We may decide to change our minds here if it turns out there are a lot of subtle races going on. People probably want to look at this commit by commit.
| * Merge tag 'v1.13.0rc2' into developRichard van der Hoff2020-05-141-1/+49
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.13.0rc2 (2020-05-14) ============================== Bugfixes -------- - Fix a long-standing bug which could cause messages not to be sent over federation, when state events with state keys matching user IDs (such as custom user statuses) were received. ([\#7376](https://github.com/matrix-org/synapse/issues/7376)) - Restore compatibility with non-compliant clients during the user interactive authentication process, fixing a problem introduced in v1.13.0rc1. ([\#7483](https://github.com/matrix-org/synapse/issues/7483)) Internal Changes ---------------- - Fix linting errors in new version of Flake8. ([\#7470](https://github.com/matrix-org/synapse/issues/7470))
| * | Shuffle persist event data store functions. (#7440)Erik Johnston2020-05-131-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The aim here is to get to a stage where we have a `PersistEventStore` that holds all the write methods used during event persistence, so that we can take that class out of the `DataStore` mixin and instansiate it separately. This will allow us to instansiate it on processes other than master, while also ensuring it is only available on processes that are configured to write to events stream. This is a bit of an architectural change, where we end up with multiple classes per data store (rather than one per data store we have now). We end up having: 1. Storage classes that provide high level APIs that can talk to multiple data stores. 2. Data store modules that consist of classes that must point at the same database instance. 3. Classes in a data store that can be instantiated on processes depending on config.
| * | Allow configuration of Synapse's cache without using synctl or environment ↵Amber Brown2020-05-113-10/+11
| | | | | | | | | | | | variables (#6391)
| * | Add room details admin endpoint (#7317)Manuel Stahl2020-05-071-0/+11
| | |
| * | Add MultiWriterIdGenerator. (#7281)Erik Johnston2020-05-041-0/+184
| | | | | | | | | | | | | | | | | | This will be used to coordinate stream IDs across multiple writers. Functions as the equivalent of both `StreamIdGenerator` and `SlavedIdTracker`.
* | | Merge branch 'release-v1.13.0' of github.com:matrix-org/synapse into ↵Andrew Morgan2020-06-105-55/+162
|\ \ \ | | |/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dinsic-release-v1.14.x * 'release-v1.13.0' of github.com:matrix-org/synapse: (257 commits) Update changelog based on feedback. Move warnings in the changelog and re-iterate changes to branches. 1.13.0 update dh-virtualenv (#7526) 1.13.0rc3 Hash passwords earlier in the registration process (#7523) 1.13.0rc2 1.13.0rc2 Stop `get_joined_users` corruption from custom statuses (#7376) Do not validate that the client dict is stable during UI Auth. (#7483) Fix new flake8 errors (#7489) Don't UPGRADE database rows RST indenting Put rollback instructions in upgrade notes Fix changelog typo Oh yeah, RST Absolute URL it is then Fix upgrade notes link Provide summary of upgrade issues in changelog. Fix ) Move next version notes from changelog to upgrade notes ...
| * | Stop `get_joined_users` corruption from custom statuses (#7376)Richard van der Hoff2020-05-141-1/+49
| |/ | | | | | | | | | | | | | | Fix a bug where the `get_joined_users` cache could be corrupted by custom status events (or other state events with a state_key matching the user ID). The bug was introduced by #2229, but has largely gone unnoticed since then. Fixes #7099, #7373.
| * Return total number of users and profile attributes in admin users endpoint ↵Manuel Stahl2020-04-281-0/+46
| | | | | | | | | | (#6881) Signed-off-by: Manuel Stahl <manuel.stahl@awesome-technologies.de>
| * bg update to clear out duplicate outbound_device_list_pokes (#7193)Richard van der Hoff2020-04-071-0/+52
| | | | | | | | We seem to have some duplicates, which could do with being cleared out.
| * Make do_next_background_update return a boolRichard van der Hoff2020-03-311-3/+3
| | | | | | | | returning a None or an int that we don't use is confusing.
| * Make `has_completed_background_updates` asyncRichard van der Hoff2020-03-311-1/+3
| | | | | | | | (Almost) everywhere that uses it is happy with an awaitable.
| * Remove unused `start_background_update`Richard van der Hoff2020-03-311-5/+9
| | | | | | | | This was only used in a unit test, so let's just inline it in the test.
| * Change device list streams to have one row per ID (#7010)Erik Johnston2020-03-191-45/+0
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Add 'device_lists_outbound_pokes' as extra table. This makes sure we check all the relevant tables to get the current max stream ID. Currently not doing so isn't problematic as the max stream ID in `device_lists_outbound_pokes` is the same as in `device_lists_stream`, however that will change. * Change device lists stream to have one row per id. This will make it possible to process the streams more incrementally, avoiding having to process large chunks at once. * Change device list replication to match new semantics. Instead of sending down batches of user ID/host tuples, send down a row per entity (user ID or host). * Newsfile * Remove handling of multiple rows per ID * Fix worker handling * Comments from review
| | * Remove handling of multiple rows per IDErik Johnston2020-02-281-45/+0
| | |
* | | Improve get auth chain difference algorithm. (#7095)Andrew Morgan2020-03-241-17/+140
|\| | | | | | | | | | | | | | * commit '4a17a647a': Improve get auth chain difference algorithm. (#7095)
| * | Improve get auth chain difference algorithm. (#7095)Erik Johnston2020-03-181-17/+140
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It was originally implemented by pulling the full auth chain of all state sets out of the database and doing set comparison. However, that can take a lot work if the state and auth chains are large. Instead, lets try and fetch the auth chains at the same time and calculate the difference on the fly, allowing us to bail early if all the auth chains converge. Assuming that the auth chains do converge more often than not, this should improve performance. Hopefully.
* | | Break down monthly active users by appservice_id (#7030)Andrew Morgan2020-03-241-0/+42
|\| | | | | | | | | | | | | | * commit '1d66dce83': Break down monthly active users by appservice_id (#7030)
| * | Break down monthly active users by appservice_id (#7030)Neil Johnson2020-03-061-0/+42
| |/ | | | | | | | | * Break down monthly active users by appservice_id and emit via prometheus. Co-authored-by: Brendan Abolivier <babolivier@matrix.org>
* | Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957)Andrew Morgan2020-03-245-46/+42
|\| | | | | | | | | | | | | * commit '509e381af': Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957) changelog Increase MAX_EVENTS_BEHIND for replication clients
| * Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957)Patrick Cloke2020-02-215-46/+42
| | | | | | | | Ensure good comprehension hygiene using flake8-comprehensions.
* | Merge pull request #6872 from matrix-org/rav/dictpropertyAndrew Morgan2020-03-241-1/+1
|\| | | | | | | | | | | | | * commit '3f1cd1479': changelog Rewrite _EventInternalMetadata to back it with a _dict Replace _event_dict_property with DictProperty
| * Replace _event_dict_property with DictPropertyRichard van der Hoff2020-02-141-1/+1
| | | | | | | | | | this amounts to the same thing, but replaces `_event_dict` with `_dict`, and removes some of the function layers generated by `property`.
* | Add typing to SyncHandler (#6821)Andrew Morgan2020-03-231-1/+4
|\| | | | | | | | | * commit 'b9391c957': Add typing to SyncHandler (#6821)
| * Add typing to SyncHandler (#6821)Erik Johnston2020-02-031-1/+4
| | | | | | | | Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * Type defintions for use in refactoring for redaction changes (#6803)Richard van der Hoff2020-01-301-4/+11
| | | | | | | | | | | | | | | | | | | | * Bump signedjson to 1.1 ... so that we can use the type definitions * Fix breakage caused by upgrade to signedjson 1.1 Thanks, @illicitonion...
* | Add `rooms.room_version` column (#6729)Andrew Morgan2020-03-232-2/+10
|\| | | | | | | | | * commit '8df862e45': Add `rooms.room_version` column (#6729)
| * Add `rooms.room_version` column (#6729)Erik Johnston2020-01-272-2/+10
| | | | | | This is so that we don't have to rely on pulling it out from `current_state_events` table.
* | Make 'event.redacts' never raise. (#6771)Andrew Morgan2020-03-231-0/+35
|\| | | | | | | | | | | | | | | * commit 'fa4d609e2': Make 'event.redacts' never raise. (#6771) Fixup changelog Fixup changelog Fixup changelog
| * Make 'event.redacts' never raise. (#6771)Erik Johnston2020-01-231-0/+35
| | | | | | | | | | | | There are quite a few places that we assume that a redaction event has a corresponding `redacts` key, which is not always the case. So lets cheekily make it so that event.redacts just returns None instead.
* | Add `local_current_membership` table (#6655)Andrew Morgan2020-03-231-1/+1
|\| | | | | | | | | * commit '28c98e51f': Add `local_current_membership` table (#6655)
| * Add `local_current_membership` table (#6655)Erik Johnston2020-01-151-1/+1
| | | | | | | | | | | | | | Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.
* | Allow admin users to create or modify users without a shared secret (#6495)Andrew Morgan2020-03-231-0/+2
|\| | | | | | | | | | | * commit 'd2906fe66': Allow admin users to create or modify users without a shared secret (#6495) Fixup changelog
| * Allow admin users to create or modify users without a shared secret (#6495)Manuel Stahl2020-01-091-0/+2
| | | | | | Signed-off-by: Manuel Stahl <manuel.stahl@awesome-technologies.de>
* | port BackgroundUpdateTestCase to HomeserverTestCase (#6653)Andrew Morgan2020-03-201-35/+37
|\| | | | | | | | | | | | | | | | | * commit 'd20c34654': port BackgroundUpdateTestCase to HomeserverTestCase (#6653) changelog Fix exceptions in log when rejected event is replicated async/await for SyncReplicationHandler.process_and_notify Clarify documentation on get_event* methods
| * port BackgroundUpdateTestCase to HomeserverTestCase (#6653)Richard van der Hoff2020-01-071-35/+37
| |
* | Merge pull request #6629 from matrix-org/rav/kill_event_reference_hashesAndrew Morgan2020-03-201-11/+4
|\| | | | | | | | | | | | | | | | | | | | | | | * commit '1807db5e7': changelog Remove unused get_latest_event_ids_and_hashes_in_room Remove unused get_prev_events_and_hashes_for_room Remove unused hashes and depths from _update_membership params Remove unused hashes and depths from create_event params Remove unused hashes and depths from create_new_client_event params replace get_prev_events_and_hashes_for_room with get_prev_events_for_room in create_new_client_event rename get_prev_events_for_room to get_prev_events_and_hashes_for_room
| * Remove unused get_prev_events_and_hashes_for_roomRichard van der Hoff2020-01-061-13/+6
| |
| * rename get_prev_events_for_room to get_prev_events_and_hashes_for_roomRichard van der Hoff2020-01-061-2/+2
| | | | | | | | ... to make way for a new method which just returns the event ids
* | Split state groups into a separate data store (#6296)Andrew Morgan2020-03-201-1/+1
|\| | | | | | | | | * commit '75d8f26ac': Split state groups into a separate data store (#6296)
| * Split state groups into a separate data store (#6296)Erik Johnston2019-12-201-1/+1
| |
* | Add database config class (#6513)Andrew Morgan2020-03-203-18/+34
|\| | | | | | | | | | | * commit '2284eb3a5': Add database config class (#6513) too many parens
| * Add database config class (#6513)Erik Johnston2019-12-183-18/+34
| | | | | | | | | | This encapsulates config for a given database and is the way to get new connections.
* | Fix race which caused deleted devices to reappear (#6514)Andrew Morgan2020-03-191-20/+29
|\| | | | | | | | | * commit '40eda8493': Fix race which caused deleted devices to reappear (#6514)
| * Fix race which caused deleted devices to reappear (#6514)Richard van der Hoff2019-12-101-20/+29
| | | | | | | | Stop the `update_client_ips` background job from recreating deleted devices.
* | Back out perf regression from get_cross_signing_keys_from_cache. (#6494)Andrew Morgan2020-03-194-13/+14
|\| | | | | | | | | | | | | | | | | | | | | | | | | * commit 'adfdd82b2': Back out perf regression from get_cross_signing_keys_from_cache. (#6494) Fix comment Fix port db script Newsfile Fixup tests Move start up DB checks to main data store. Pass Database into the data store Move are_all_users_on_domain checks to main data store. Change DataStores to accept 'database' param.
| * Fixup testsErik Johnston2019-12-064-11/+11
| |
| * Change DataStores to accept 'database' param.Erik Johnston2019-12-061-2/+3
| |
* | Merge pull request #6469 from matrix-org/erikj/make_database_classAndrew Morgan2020-03-1910-66/+102
|\| | | | | | | | | | | | | | | | | | | * commit 'f3ea2f5a0': Remove unused var Fix DB scripts Newsfile Move background update handling out of store Comments Move DB pool and helper functions into dedicated Database class
| * Move background update handling out of storeErik Johnston2019-12-054-25/+59
| |
| * Move DB pool and helper functions into dedicated Database classErik Johnston2019-12-0510-41/+43
| |
* | Merge pull request #6464 from matrix-org/erikj/make_public_sql_baseAndrew Morgan2020-03-196-24/+24
|\| | | | | | | | | | | | | * commit 'ddbbfc951': Newsfile Remove underscore from SQLBaseStore functions Don't call SQLBaseStore methods from outside stores
| * Remove underscore from SQLBaseStore functionsErik Johnston2019-12-046-24/+24
| |
* | Implementation of MSC2314 (#6176)Andrew Morgan2020-03-181-25/+1
|\| | | | | | | | | * commit '0f87b912a': Implementation of MSC2314 (#6176)
| * Implementation of MSC2314 (#6176)Amber Brown2019-11-281-25/+1
| |
* | add etag and count to key backup endpoints (#5858)Andrew Morgan2020-03-181-4/+4
|\| | | | | | | | | * commit '0d27aba90': add etag and count to key backup endpoints (#5858)
| * add etag and count to key backup endpoints (#5858)Hubert Chathi2019-11-271-4/+4
| |
* | Merge pull request #6295 from matrix-org/erikj/split_purge_historyAndrew Morgan2020-03-181-7/+8
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit 'f713c01e2': Move type annotation into docstring Fix deleting state groups during room purge. Use correct type annotation Change to not require a state_groups.room_id index. Fix up comment Update log line to lie a little less Add state_groups.room_id index Docstrings Fix purge room API Newsfile Split purge API into events vs state
| * Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-11-041-7/+9
| |\ | | | | | | | | | erikj/split_purge_history
| * \ Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-311-48/+102
| |\ \ | | | | | | | | | | | | erikj/split_purge_history
| * | | Split purge API into events vs stateErik Johnston2019-10-301-7/+8
| | | |
* | | | Merge pull request #5727 from matrix-org/uhoreg/e2e_cross-signing2-part3Andrew Morgan2020-03-161-7/+9
|\ \ \ \ | | |_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit '53d7680e3': Update synapse/storage/data_stores/main/devices.py rename get_devices_by_remote to get_device_updates_by_remote black apply changes as a result of PR review don't error if federation query doesn't have cross-signing keys move get_e2e_cross_signing_key to EndToEndKeyWorkerStore so it works with workers black vendor-prefix the EDU name until MSC1756 is merged into the spec fix unit test add news file update to work with newer code, and fix formatting add missing param make black happy don't crash if the user doesn't have cross-signing keys implement federation parts of cross-signing
| * | | Merge branch 'develop' into cross-signing_federationHubert Chathi2019-10-311-48/+102
| |\ \ \ | | | |/ | | |/|
| * | | rename get_devices_by_remote to get_device_updates_by_remoteHubert Chathi2019-10-301-6/+6
| | | |
| * | | Merge branch 'develop' into cross-signing_federationHubert Chathi2019-10-306-9/+88
| |\ \ \ | | | |/ | | |/|
| * | | Merge branch 'develop' into cross-signing_federationHubert Chathi2019-10-244-3/+5
| |\ \ \
| * | | | fix unit testHubert Chathi2019-10-221-1/+3
| | | | |
* | | | | Merge pull request #6294 from matrix-org/erikj/add_state_storageAndrew Morgan2020-03-161-48/+102
|\ \ \ \ \ | | |_|_|/ | |/| | |
| * | | | Port to use state storageErik Johnston2019-10-301-48/+102
| | |_|/ | |/| |
* | | | Merge pull request #6240 from matrix-org/erikj/split_out_persistence_storeAndrew Morgan2020-03-164-8/+12
|\| | |
| * | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-302-1/+76
| |\ \ \ | | | | | | | | | | | | | | | erikj/split_out_persistence_store
| * | | | Use new EventPersistenceStoreErik Johnston2019-10-234-8/+12
| | |_|/ | |/| |
* | | | Merge pull request #6291 from matrix-org/erikj/fix_cache_descriptorAndrew Morgan2020-03-161-1/+1
|\ \ \ \ | | |/ / | |/| |
| * | | Make ObservableDeferred.observe() always return deferred.Erik Johnston2019-10-301-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This makes it easier to use in an async/await world. Also fixes a bug where cache descriptors would occaisonally return a raw value rather than a deferred.
* | | | Merge pull request #6253 from matrix-org/uhoreg/e2e_backup_delete_keysAndrew Morgan2020-03-161-0/+75
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit 'da78f6177': remove unneeded imports switch to using HomeserverTestCase remove some unnecessary lines add changelog delete keys when deleting backups
| * | | remove unneeded importsHubert Chathi2019-10-251-3/+1
| | | |
| * | | switch to using HomeserverTestCaseHubert Chathi2019-10-251-19/+25
| | | |
| * | | remove some unnecessary linesHubert Chathi2019-10-241-5/+0
| | | |
| * | | delete keys when deleting backupsHubert Chathi2019-10-241-0/+76
| |/ /
* | | Merge pull request #6231 from matrix-org/erikj/refactor_storesAndrew Morgan2020-03-164-3/+5
|\| |
| * | Move storage classes into a main "data store".Erik Johnston2019-10-214-3/+5
| |/ | | | | | | | | This is in preparation for having multiple data stores that offer different functionality, e.g. splitting out state or event storage.
* | Merge pull request #6193 from matrix-org/uhoreg/interpret_device_key_in_storageAndrew Morgan2020-02-261-6/+6
|\|
| * Merge pull request #6193 from matrix-org/uhoreg/interpret_device_key_in_storageHubert Chathi2019-10-111-6/+6
| |\ | | | | | | make storage layer in charge of interpreting the device key data
| | * make storage layer in charge of interpreting the device key dataHubert Chathi2019-10-101-6/+6
| | |
* | | Fix MAU reaping where reserved users are specified. (#6168)Andrew Morgan2020-02-261-9/+49
|\| |
| * | Fix MAU reaping where reserved users are specified. (#6168)Neil Johnson2019-10-111-9/+49
| | |
* | | Merge pull request #6186 from matrix-org/erikj/disable_sql_bytesAndrew Morgan2020-02-261-1/+1
|\| |
| * | Fix postgres unit testsErik Johnston2019-10-101-1/+1
| |/
* | Merge pull request #6146 from matrix-org/erikj/fix_destination_retry_timingsAndrew Morgan2020-02-261-0/+11
|\|
| * Merge pull request #6146 from matrix-org/erikj/fix_destination_retry_timingsErik Johnston2019-10-021-0/+11
| |\ | | | | | | Fix errors storing large retry intervals.
| | * Fix errors storing large retry intervals.Erik Johnston2019-10-021-0/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | We have set the max retry interval to a value larger than a postgres or sqlite int can hold, which caused exceptions when updating the destinations table. To fix postgres we need to change the column to a bigint, and for sqlite we lower the max interval to 2**62 (which is still incredibly long).
* | | Merge pull request #6145 from matrix-org/erikj/fix_censored_redactionsAndrew Morgan2020-02-261-0/+36
|\| |
| * | Fix fetching censored redactions from DBErik Johnston2019-10-021-0/+36
| |/ | | | | | | | | | | Fetching a censored redactions caused an exception due to the code expecting redactions to have a `redact` key, which redacted redactions don't have.
* | Fix dummy event insertion consent bug (#6053)Andrew Morgan2020-02-252-9/+178
|\|
| * Fix dummy event insertion consent bug (#6053)Neil Johnson2019-09-262-9/+178
| | | | | | Fixes #5905
* | Merge pull request #6098 from matrix-org/erikj/cleanup_user_ips_2Andrew Morgan2020-02-251-0/+71
|\|
| * Test that pruning of old user IPs worksErik Johnston2019-09-241-0/+71
| |
* | Merge pull request #6089 from matrix-org/erikj/cleanup_user_ipsAndrew Morgan2020-02-251-1/+79
|\|
| * Test background updateErik Johnston2019-09-231-0/+79
| |
| * Query devices table for last seen info.Erik Johnston2019-09-231-1/+0
| | | | | | | | | | | | | | | | This is a) simpler than querying user_ips directly and b) means we can purge older entries from user_ips without losing the required info. The storage functions now no longer return the access_token, since it was unused.
* | Add 'failure_ts' column to 'destinations' table (#6016)Andrew Morgan2020-02-251-3/+5
|\|
| * Add 'failure_ts' column to 'destinations' table (#6016)Richard van der Hoff2019-09-171-3/+5
| | | | | | | | Track the time that a server started failing at, for general analysis purposes.
* | Merge pull request #5934 from matrix-org/erikj/censor_redactionsAndrew Morgan2020-02-251-1/+76
|\|
| * Merge pull request #5934 from matrix-org/erikj/censor_redactionsErik Johnston2019-09-091-1/+76
| |\ | | | | | | Censor redactions in DB after a month
| | * Fix testErik Johnston2019-09-051-1/+3
| | |
| | * Make redaction retention period configurableErik Johnston2019-09-051-1/+3
| | |
| | * Censor redactions in DB after a monthErik Johnston2019-08-301-0/+71
| | |
* | | Servers-known-about statistic (#5981)Andrew Morgan2020-02-251-37/+89
|\| |
| * | Servers-known-about statistic (#5981)Amber Brown2019-09-071-37/+89
| |/
* | Merge pull request #5902 from matrix-org/hs/exempt-support-users-from-consentAndrew Morgan2020-02-241-0/+1
|\|
| * Fix registration testHalf-Shot2019-08-231-0/+1
| |
* | Merge pull request #5788 from matrix-org/rav/metaredactionsAndrew Morgan2020-02-201-0/+70
|\|
| * Merge pull request #5788 from matrix-org/rav/metaredactionsRichard van der Hoff2019-08-121-0/+70
| |\ | | | | | | Fix handling of redactions of redactions
| | * Handle loops in redaction eventsRichard van der Hoff2019-07-301-0/+70
| | |
* | | Merge pull request #5746 from matrix-org/erikj/test_bg_update_currnet_stateAndrew Morgan2020-02-201-1/+36
|\| |
| * | Merge pull request #5746 from matrix-org/erikj/test_bg_update_currnet_stateErik Johnston2019-07-301-1/+36
| |\ \ | | |/ | |/| Add unit test for current state membership bg update
| | * Add unit test for current state membership bg updateErik Johnston2019-07-231-1/+36
| | |
* | | Convert RedactionTestCase to modern test style (#5768)Andrew Morgan2020-02-191-36/+38
|\| |
| * | Convert RedactionTestCase to modern test style (#5768)Richard van der Hoff2019-07-261-36/+38
| | |
* | | Replace returnValue with return (#5736)Andrew Morgan2020-02-194-6/+6
|\| |
| * | Replace returnValue with return (#5736)Amber Brown2019-07-234-6/+6
| |/
* | Support Prometheus_client 0.4.0+ (#5636)Andrew Morgan2020-02-191-3/+1
|\|
| * Support Prometheus_client 0.4.0+ (#5636)Amber Brown2019-07-181-3/+1
| |
* | Implement access token expiry (#5660)Andrew Morgan2020-02-171-3/+5
|\|
| * Implement access token expiry (#5660)Richard van der Hoff2019-07-121-3/+5
| | | | | | | | Record how long an access token is valid for, and raise a soft-logout once it expires.
* | Remove access-token support from RegistrationStore.register (#5642)Andrew Morgan2020-02-173-41/+17
|\|
| * Remove access-token support from RegistrationStore.register (#5642)Richard van der Hoff2019-07-103-41/+17
| | | | | | | | | | The 'token' param is no longer used anywhere except the tests, so let's kill that off too.
* | Fix with isort==4.3.21 and black==19.3b0Andrew Morgan2020-02-141-1/+0
| |
* | Fix signedjson deleted methodAndrew Morgan2020-02-141-4/+12
| |
* | Run Black. (#5482)Andrew Morgan2020-02-133-5/+5
|\|
| * Run Black. (#5482)Amber Brown2019-06-2011-72/+74
| |
* | Dinsic Blacking with black==18.6b2Andrew Morgan2020-02-119-73/+72
| |
* | Merge pull request #5480 from matrix-org/erikj/extremities_dummy_eventsAndrew Morgan2020-02-101-1/+1
|\|
| * Run as background process and fix commentsErik Johnston2019-06-191-1/+1
| |
* | Add experimental option to reduce extremities.Andrew Morgan2020-02-101-0/+41
|\|
| * Add experimental option to reduce extremities.Erik Johnston2019-06-181-0/+41
| | | | | | | | | | | | | | Adds new config option `cleanup_extremities_with_dummy_events` which periodically sends dummy events to rooms with more than 10 extremities. THIS IS REALLY EXPERIMENTAL.
* | Merge pull request #5461 from matrix-org/erikj/histograms_are_cumalitiveAndrew Morgan2020-02-101-10/+10
|\|
| * Prometheus histograms are cumalativeErik Johnston2019-06-141-10/+10
| |
* | Merge pull request #5458 from matrix-org/hawkowl/fix-prometheusAndrew Morgan2020-02-101-38/+23
|\|
| * fix prometheus rendering errorAmber H. Brown2019-06-141-38/+23
| |
* | Expose statistics on extrems to prometheus (#5384)Andrew Morgan2020-02-102-79/+146
|\|
| * Expose statistics on extrems to prometheus (#5384)Amber Brown2019-06-132-79/+146
| |
* | Merge branch 'master' into dinsicBrendan Abolivier2019-06-123-19/+126
|\|
| * Prevent multiple device list updates from breaking a batch send (#5156)Andrew Morgan2019-06-061-0/+69
| | | | | | fixes #5153
| * Set default room version to v4. (#5379)Neil Johnson2019-06-061-0/+6
| | | | | | | | Set default room version to v4.
| * Add testErik Johnston2019-05-291-0/+248
| |
| * Store key validity time in the storage layerRichard van der Hoff2019-05-231-14/+30
| | | | | | | | | | | | | | | | This is a first step to checking that the key is valid at the required moment. The idea here is that, rather than passing VerifyKey objects in and out of the storage layer, we instead pass FetchKeyResult objects, which simply wrap the VerifyKey and add a valid_until_ts field.
| * Rewrite store_server_verify_key to store several keys at once (#5234)Richard van der Hoff2019-05-231-14/+30
| | | | | | | | | | Storing server keys hammered the database a bit. This replaces the implementation which stored a single key, with one which can do many updates at once.
* | Merge branch 'master' into dinsicBrendan Abolivier2019-06-111-0/+248
|\ \
| * | Add testErik Johnston2019-05-301-0/+248
| |/
* | Merge branch 'babolivier/per_room_profiles' into dinsic dinsic_2019-05-17Brendan Abolivier2019-05-171-1/+1
|\|
| * Expose DataStore._get_events as get_events_as_listErik Johnston2019-05-141-1/+1
| | | | | | | | This is in preparation for reaction work which requires it.
* | Merge branch 'release-v0.99.4' into dinsic dinsic_2019-05-14Brendan Abolivier2019-05-1410-82/+50
|\|
| * Run Black on the tests again (#5170)Amber Brown2019-05-109-80/+44
| |
| * Add admin api for sending server_notices (#5121)Richard van der Hoff2019-05-021-1/+4
| |
| * Move admin api impl to its own packageRichard van der Hoff2019-05-011-2/+3
| | | | | | | | It doesn't really belong under rest/client/v1 any more.
* | Merge branch 'develop' into dinsicAndrew Morgan2019-04-155-146/+74
|\|
| * Rewrite Datastore.get_server_verify_keysRichard van der Hoff2019-04-091-3/+50
| | | | | | | | Rewrite this so that it doesn't hammer the database.
| * Rewrite test_keys as a HomeserverTestCaseRichard van der Hoff2019-04-081-19/+15
| |
| * Remove presence lists (#4989)Neil Johnson2019-04-031-118/+0
| | | | | | Remove presence list support as per MSC 1819
| * Collect room-version variations into one place (#4969)Richard van der Hoff2019-04-013-8/+11
| | | | | | | | Collect all the things that make room-versions different to one another into one place, so that it's easier to define new room versions.
* | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/dinsic-mergedErik Johnston2019-03-211-12/+5
|\|
| * Migrate the user directory initial population to a background task (#4864)Amber Brown2019-03-191-8/+3
| |
| * fixupAmber Brown2019-03-121-2/+2
| |
| * Rewrite userdir to be faster (#4537)Amber Brown2019-03-071-2/+0
| |
* | Merge branch 'master' of github.com:matrix-org/synapse into ↵Erik Johnston2019-03-1511-19/+270
|\| | | | | | | erikj/dinsic-merged-master
| * UPSERT many functionality (#4644)Amber Brown2019-02-201-0/+88
| |
| * Fix flake8 (#4519)Amber Brown2019-01-304-10/+1
| |
| * Fix UPSERTs on SQLite 3.24+ (#4477)Amber Brown2019-01-282-4/+7
| |
| * Fix testsErik Johnston2019-01-253-3/+8
| |
| * Revert "Require event format version to parse or create events"Erik Johnston2019-01-253-8/+3
| |
| * Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-01-241-0/+1
| |\ | | | | | | | | | erikj/require_format_version
| | * Use native UPSERTs where possible (#4306)Amber Brown2019-01-241-0/+1
| | |
| * | Fix testsErik Johnston2019-01-243-3/+8
| |/
| * Fix adding new rows instead of updating them if one of the key values is a ↵Amber Brown2019-01-091-0/+71
| | | | | | | | NULL in upserts. (#4369)
| * create support user (#4141)Neil Johnson2018-12-142-2/+54
| | | | | | | | | | | | Allow for the creation of a support user. A support user can access the server, join rooms, interact with other users, but does not appear in the user directory nor does it contribute to monthly active user limits.
| * Initialise user displayname from SAML2 data (#4272)Richard van der Hoff2018-12-071-1/+1
| | | | | | | | | | When we register a new user from SAML2 data, initialise their displayname correctly.
| * Add option to track MAU stats (but not limit people) (#3830)Travis Ralston2018-11-151-0/+25
| |
| * Add test to assert set_e2e_device_keys correctly returns False on no-opErik Johnston2018-11-081-0/+15
| |
* | merge master into dinsic, again...Matthew Hodgson2018-11-0315-253/+730
|\|
| * Refactor state group lookup to reduce DB hits (#4011)Erik Johnston2018-10-251-65/+110
| | | | | | | | | | | | | | | | Currently when fetching state groups from the data store we make two hits two the database: once for members and once for non-members (unless request is filtered to one or the other). This adds needless load to the datbase, so this PR refactors the lookup to make only a single database hit.
| * fix style inconsistenciesNeil Johnson2018-10-241-2/+2
| |
| * fix race condiftion in calling initialise_reserved_usersNeil Johnson2018-10-231-2/+8
| |
| * Add testsErik Johnston2018-10-021-0/+45
| |
| * Fix userconsent on Python 3 (#3938)Amber Brown2018-10-021-46/+2
| |
| * docstrings and unittests for storage.state (#3958)Richard van der Hoff2018-09-271-0/+39
| | | | | | | | I spent ages trying to figure out how I was going mad...
| * Fix client IPs being broken on Python 3 (#3908)Amber Brown2018-09-201-35/+167
| |
| * improve namingNeil Johnson2018-09-121-3/+3
| |
| * expose number of real reserved usersNeil Johnson2018-09-121-0/+31
| |
| * Port tests/ to Python 3 (#3808)Amber Brown2018-09-071-64/+38
| |
| * ensure guests never enter mau listNeil Johnson2018-09-062-4/+6
| |
| * guest users should not be part of mau totalNeil Johnson2018-09-051-2/+42
| |
| * Fix tests on postgresql (#3740)Amber Brown2018-09-047-138/+151
| |
| * Port storage/ to Python 3 (#3725)Amber Brown2018-08-311-0/+106
| |
| * Fix up testsRichard van der Hoff2018-08-281-2/+2
| |
| * Implement trail usersErik Johnston2018-08-231-0/+1
| |
| * Merge pull request #3673 from matrix-org/erikj/refactor_state_handlerErik Johnston2018-08-222-2/+6
| |\ | | | | | | Refactor state module to support multiple room versions
| | * Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2018-08-2020-648/+543
| | |\ | | | | | | | | | | | | erikj/refactor_state_handler
| | * | Fix testsErik Johnston2018-08-092-2/+6
| | | |
| * | | Split the state_group_cache in two (#3726)Matthew Hodgson2018-08-221-11/+94
| | |/ | |/| | | | | | | | | | | | | | | | | | | | | | Splits the state_group_cache in two. One half contains normal state events; the other contains member events. The idea is that the lazyloading common case of: "I want a subset of member events plus all of the other state" can be accomplished efficiently by splitting the cache into two, and asking for "all events" from the non-members cache, and "just these keys" from the members cache. This means we can avoid having to make DictionaryCache aware of these sort of complicated queries, whilst letting LL requests benefit from the caching. Previously we were unable to sensibly use the caching and had to pull all state from the DB irrespective of the filtering, which made things slow. Hopefully fixes https://github.com/matrix-org/synapse/issues/3720.
* | | fix conflict and reinstate 6372dff771413c2b9cd5648cbb6de01a679ef801Matthew Hodgson2018-10-221-4/+0
| | |
* | | merge in masterMatthew Hodgson2018-10-2220-501/+909
|\| |
| * | call reap on start up and fix under reaping bugNeil Johnson2018-08-161-0/+13
| | |
| * | speed up /members and add at= and membership params (#3568)Matthew Hodgson2018-08-151-1/+1
| | |
| * | in case max_mau is less than I thinkNeil Johnson2018-08-141-1/+1
| | |
| * | Merge pull request #3670 from matrix-org/neilj/mau_sync_blockNeil Johnson2018-08-142-12/+13
| |\ \ | | | | | | | | Block ability to read via sync if mau limit exceeded
| | * | rename _user_last_seen_monthly_activeNeil Johnson2018-08-092-12/+13
| | |/
| * | Run tests under PostgreSQL (#3423)Amber Brown2018-08-1318-21/+31
| | |
| * | Run black.black2018-08-1020-622/+493
| | |
| * | Rename async to async_helpers because `async` is a keyword on Python 3.7 (#3678)Amber Brown2018-08-101-1/+1
| |/
| * Test fixes for Python 3 (#3647)Amber Brown2018-08-092-2/+2
| |
| * implement reserved users for mau limitsNeil Johnson2018-08-071-1/+58
| |
| * wip commit - tests failingNeil Johnson2018-08-032-13/+13
| |
| * fix (lots of) py3 test failuresNeil Johnson2018-08-031-1/+0
| |
| * fix py3 test failureNeil Johnson2018-08-031-0/+1
| |
| * fix caching and testsNeil Johnson2018-08-031-13/+37
| |
| * remove unused count_monthly_usersNeil Johnson2018-08-021-65/+0
| |
| * fix test, update constructor callNeil Johnson2018-08-021-1/+1
| |
| * insertion into monthly_active_usersNeil Johnson2018-08-021-3/+63
| |
| * Revert "change monthly_active_users table to be a single column"Neil Johnson2018-08-021-3/+3
| | | | | | | | This reverts commit ec716a35b219d147dee51733b55573952799a549.
| * change monthly_active_users table to be a single columnNeil Johnson2018-08-011-3/+3
| |
| * Merge branch 'develop' of github.com:matrix-org/synapse into neilj/mau_trackerNeil Johnson2018-08-011-0/+65
| |\
| | * fix isortNeil Johnson2018-08-011-1/+0
| | |
| | * fix known broken testNeil Johnson2018-08-011-25/+20
| | |
| | * coding styleNeil Johnson2018-07-311-1/+0
| | |
| | * fix user_ips countingNeil Johnson2018-07-311-9/+33
| | |
| | * monthly_active_testsNeil Johnson2018-07-301-0/+48
| | |
| * | api into monthly_active_users tableNeil Johnson2018-07-311-0/+42
| |/
| * flake8Matthew Hodgson2018-07-251-12/+12
| |
| * add tests for _get_some_state_from_cacheMatthew Hodgson2018-07-251-0/+150
| |
| * incorporate more reviewMatthew Hodgson2018-07-241-0/+9
| |
| * make test workMatthew Hodgson2018-07-191-37/+46
| |
| * first cut of a UT for testing state store (untested)Matthew Hodgson2018-07-191-0/+151
| |
* | Merge remote-tracking branch 'origin/master' into dinsicDavid Baker2018-07-1915-36/+44
|\|
| * run isortAmber Brown2018-07-0915-36/+44
| |
* | Merge tag 'v0.31.2' into dinsicMichael Kaye2018-06-222-6/+11
|\|
| * fix testsRichard van der Hoff2018-05-291-0/+1
| |
| * Send users a server notice about consentRichard van der Hoff2018-05-221-3/+8
| | | | | | | | | | When a user first syncs, we will send them a server notice asking them to consent to the privacy policy if they have not already done so.
| * Use stream rather depth ordering for push actionsErik Johnston2018-05-111-2/+2
| | | | | | | | | | | | This simplifies things as it is, but will also allow us to change the way we traverse topologically without having to update the way push actions work.
| * Fix a couple of logcontext leaks in unit testsRichard van der Hoff2018-05-021-1/+0
| | | | | | | | | | | | ... which were making other, innocent, tests, fail. Plus remove a spurious unittest.DEBUG which was making the output noisy.
* | remove create_profile from testsMatthew Hodgson2018-05-041-8/+0
| |
* | Merge branch 'master' into dinsicMatthew Hodgson2018-05-032-6/+74
|\|
| * Merge pull request #3103 from NotAFile/py3-baseexcepton-messageRichard van der Hoff2018-04-201-6/+6
| |\ | | | | | | Use str(e) instead of e.message
| | * Use str(e) instead of e.messageAdrian Tschira2018-04-151-6/+6
| | | | | | | | | | | | | | | | | | | | | Doing this I learned e.message was pretty shortlived, added in 2.6, they realized it was a bad idea and deprecated it in 2.7 Signed-off-by: Adrian Tschira <nota@notafile.com>
| * | Avoid creating events with huge numbers of prev_eventsRichard van der Hoff2018-04-161-0/+68
| |/ | | | | | | | | | | In most cases, we limit the number of prev_events for a given event to 10 events. This fixes a particular code path which created events with huge numbers of prev_events.
* | PR feedbackDavid Baker2018-04-251-2/+2
| | | | | | | | | | Unnecessary inlineCallbacks, missing yield, SQL comments & trailing commas.
generated by cgit-magenta 1.5.1 (git 2.48.1) at 2025-09-06 01:08:40 +0000