summary refs log tree commit diff
path: root/synapse/storage/schema (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Move schema delta files to the correct data store.Erik Johnston2019-10-242-73/+0
| | | | They were put in the global schema delta directory due to a bad merge.
* Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-222-0/+73
|\ | | | | | | erikj/refactor_stores
| * Merge branch 'develop' into uhoreg/e2e_cross-signing_mergedHubert Chathi2019-10-189-0/+221
| |\
| * \ Merge branch 'develop' into cross-signing_keysHubert Chathi2019-09-041-0/+152
| |\ \
| * \ \ Merge branch 'uhoreg/e2e_cross-signing_merged' into cross-signing_keysHubert Chathi2019-08-284-0/+75
| |\ \ \
| | * \ \ Merge branch 'develop' into uhoreg/e2e_cross-signing_mergedHubert Chathi2019-08-284-0/+75
| | |\ \ \
| | * | | | Cross-signing [1/4] -- hidden devices (#5759)Hubert Chathi2019-08-121-0/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * allow devices to be marked as "hidden" This is a prerequisite for cross-signing, as it allows us to create other things that live within the device namespace, so they can be used for signatures.
| * | | | | use stream ID generator instead of timestampHubert Chathi2019-08-281-3/+3
| | | | | |
| * | | | | make changes from PR reviewHubert Chathi2019-08-012-41/+55
| | | | | |
| * | | | | Merge branch 'cross-signing_hidden' into cross-signing_keysHubert Chathi2019-08-013-3/+42
| |\ \ \ \ \
| | * | | | | Merge branch 'develop' into cross-signing_hiddenHubert Chathi2019-07-303-3/+42
| | |\| | | |
| * | | | | | Merge branch 'cross-signing_hidden' into cross-signing_keysHubert Chathi2019-07-301-1/+1
| |\| | | | |
| | * | | | | apply changes from PR reviewHubert Chathi2019-07-301-1/+1
| | | | | | |
| * | | | | | allow uploading keys for cross-signingHubert Chathi2019-07-251-0/+41
| |/ / / / /
| * | | | | allow devices to be marked as "hidden"Hubert Chathi2019-07-241-0/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a prerequisite for cross-signing, as it allows us to create other things that live within the device namespace, so they can be used for signatures.
* | | | | | Move storage classes into a main "data store".Erik Johnston2019-10-21189-8109/+10
| |_|_|_|/ |/| | | | | | | | | | | | | | | | | | | This is in preparation for having multiple data stores that offer different functionality, e.g. splitting out state or event storage.
* | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-103-0/+88
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | erikj/disable_sql_bytes
| * | | | | Rewrite the user_filter migration again (#6184)Richard van der Hoff2019-10-101-26/+32
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | you can't plausibly ALTER TABLE in sqlite, so we create the new table with the right schema to start with.
| * | | | | Merge pull request #6185 from matrix-org/erikj/fix_censored_evnetsErik Johnston2019-10-091-0/+26
| |\ \ \ \ \ | | | | | | | | | | | | | | Fix inserting bytes as text in `censor_redactions`
| * | | | | | Fix unique_user_filter_index schema updateBrendan Abolivier2019-10-071-2/+2
| | | | | | |
| * | | | | | Update `user_filters` table to have a unique index, and non-null columns (#1172)Alexander Maznev2019-10-041-0/+46
| | | | | | |
| * | | | | | Land improved room list based on room stats (#6019)Erik Johnston2019-10-021-0/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Use room_stats and room_state for room directory search
| * | | | | | Merge branch 'release-v1.4.0' of github.com:matrix-org/synapse into developErik Johnston2019-10-022-0/+38
| |\ \ \ \ \ \
| * | | | | | | Drop unused tables (#6115)Richard van der Hoff2019-09-301-0/+20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | These tables are unused since #5893 (as amended by #6047), so we can now drop them. Fixes #6048.
* | | | | | | | Do the update as a background indexErik Johnston2019-10-091-9/+8
| |_|/ / / / / |/| | | | | |
* | | | | | | Fix existing hex encoded json values in DBErik Johnston2019-10-081-0/+26
| |/ / / / / |/| | | | |
* | | | | | Fix errors storing large retry intervals.Erik Johnston2019-10-021-0/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We have set the max retry interval to a value larger than a postgres or sqlite int can hold, which caused exceptions when updating the destinations table. To fix postgres we need to change the column to a bigint, and for sqlite we lower the max interval to 2**62 (which is still incredibly long).
* | | | | | Add received_ts column to redactions.Erik Johnston2019-10-011-0/+20
|/ / / / / | | | | | | | | | | | | | | | | | | | | This will allow us to efficiently search for uncensored redactions in the DB before a given time.
* | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-09-251-0/+24
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | erikj/cleanup_user_ips
| * \ \ \ \ Merge remote-tracking branch 'origin/develop' into rav/saml_mapping_workRichard van der Hoff2019-09-241-20/+0
| |\ \ \ \ \
| * \ \ \ \ \ Merge branch 'develop' into rav/saml_mapping_workRichard van der Hoff2019-09-197-0/+269
| |\ \ \ \ \ \
| * | | | | | | Record mappings from saml users in an external tableRichard van der Hoff2019-09-131-0/+24
| | |_|_|/ / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We want to assign unique mxids to saml users based on an incrementing suffix. For that to work, we need to record the allocated mxid in a separate table.
* | | | | | | Add BG update to populate devices last seen infoErik Johnston2019-09-231-0/+3
| | | | | | |
* | | | | | | Add last seen info to devices table.Erik Johnston2019-09-231-0/+21
| |_|/ / / / |/| | | | | | | | | | | | | | | | | | | | | | | This allows us to purge old user_ips entries without having to preserve the latest last seen info for active devices.
* | | | | | Undo the deletion of some tables (#6047)Richard van der Hoff2019-09-191-20/+0
| |/ / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a partial revert of #5893. The problem is that if we drop these tables in the same release as removing the code that writes to them, it prevents users users from being able to roll back to a previous release. So let's leave the tables in place for now, and remember to drop them in a subsequent release. (Note that these tables haven't been *read* for *years*, so any missing rows resulting from a temporary upgrade to vNext won't cause a problem.)
* | | | | Add 'failure_ts' column to 'destinations' table (#6016)Richard van der Hoff2019-09-171-0/+25
| | | | | | | | | | | | | | | | | | | | Track the time that a server started failing at, for general analysis purposes.
* | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-09-051-0/+152
|\ \ \ \ \ | | |_|_|/ | |/| | | | | | | | erikj/censor_redactions
| * | | | Fix and refactor room and user stats (#5971)Erik Johnston2019-09-041-0/+152
| | |_|/ | |/| | | | | | Previously the stats were not being correctly populated.
* / | | Censor redactions in DB after a monthErik Johnston2019-08-301-0/+17
|/ / /
* | | Propagate opentracing contexts through EDUs (#5852)Jorik Schellekens2019-08-221-0/+20
| | | | | | | | | | | | | | | Propagate opentracing contexts through EDUs Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
* | | Add missing index on users_in_public_rooms. (#5894)Richard van der Hoff2019-08-221-0/+17
| | |
* | | Drop some unused tables. (#5893)Richard van der Hoff2019-08-211-0/+20
| | | | | | | | | These tables are never used, so we may as well drop them.
* | | add the version field to the index for e2e_room_keysHubert Chathi2019-08-141-0/+18
|/ /
* | Don't recreate columnErik Johnston2019-07-302-1/+22
| |
* | Fix current_state_events membership background update.Erik Johnston2019-07-301-0/+0
| | | | | | | | | | | | Turns out not all rooms are in `rooms`, so lets fetch the room list from `current_state_events`. We move the delta file to force it to be run again.
* | Remove lost commentErik Johnston2019-07-291-7/+0
| |
* | Add function to get all forgotten rooms for userErik Johnston2019-07-241-0/+25
|/ | | | | | This will allow us to efficiently filter out rooms that have been forgotten in other queries without having to join against the `room_memberships` table.
* Update comment for new columnErik Johnston2019-07-191-0/+3
|
* Add background update for current_state_events.membership columnErik Johnston2019-07-181-0/+3
|
* Add membership column to current_state_events table.Erik Johnston2019-07-181-0/+19
| | | | | It turns out that doing a join is surprisingly expensive for the DB to do when room_membership table is larger than the disk cache.
* Implement access token expiry (#5660)Richard van der Hoff2019-07-121-0/+18
| | | | Record how long an access token is valid for, and raise a soft-logout once it expires.
* Run Black. (#5482)Amber Brown2019-06-207-38/+58
|
* Track deactivated accounts in the database (#5378)Brendan Abolivier2019-06-141-0/+19
|
* Merge pull request #5320 from matrix-org/hawkowl/full-schema-v1Erik Johnston2019-06-064-0/+2338
|\ | | | | Make a full SQL schema
| * fix maybeAmber H. Brown2019-06-071-20/+2
| |
| * just user dir?Amber H. Brown2019-06-071-1/+19
| |
| * remove background updates that arent neededAmber H. Brown2019-06-071-33/+1
| |
| * add more commentsAmber Brown2019-06-061-0/+5
| |
| * add stuff in bg updatesAmber Brown2019-06-041-10/+62
| |
| * WHY IS THIS CALLED A SLIGHTLY DIFFERENT THINGAmber Brown2019-06-031-0/+1
| |
| * more fixAmber Brown2019-06-031-0/+38
| |
| * fix schemasAmber Brown2019-06-033-59/+18
| |
| * full schemaAmber Brown2019-06-033-0/+2315
| |
* | Add ability to perform password reset via email without trusting the ↵Andrew Morgan2019-06-061-0/+31
|/ | | | | | | | | | | | identity server (#5377) Sends password reset emails from the homeserver instead of proxying to the identity server. This is now the default behaviour for security reasons. If you wish to continue proxying password reset requests to the identity server you must now enable the email.trust_identity_server_for_password_resets option. This PR is a culmination of 3 smaller PRs which have each been separately reviewed: * #5308 * #5345 * #5368
* Merge pull request #5294 from matrix-org/erikj/speed_up_room_statsErik Johnston2019-05-311-0/+28
|\ | | | | Speed up room stats background update
| * Add indices. Remove room_ids accidentally addedErik Johnston2019-05-311-0/+28
| | | | | | | | | | | | | | | | | | | | We have to do this by re-inserting a background update and recreating tables, as the tables only get created during a background update and will later be deleted. We also make sure that we remove any entries that should have been removed but weren't due to a race that has been fixed in a previous commit.
* | Add index to temp tableErik Johnston2019-05-301-0/+1
|/
* Fixup comments and loggingErik Johnston2019-05-301-0/+3
|
* Add DB bg update to cleanup extremities.Erik Johnston2019-05-291-0/+19
| | | | | Due to #5269 we may have extremities in our DB that we shouldn't have, so lets add a cleanup task such to remove those.
* Merge pull request #5268 from matrix-org/babolivier/account_validity_fix_schemaBrendan Abolivier2019-05-281-0/+3
|\ | | | | Fix schema update for account validity
| * Fix schema update for account validityBrendan Abolivier2019-05-281-0/+3
| |
* | Store key validity time in the storage layerRichard van der Hoff2019-05-231-0/+23
| | | | | | | | | | | | | | | | This is a first step to checking that the key is valid at the required moment. The idea here is that, rather than passing VerifyKey objects in and out of the storage layer, we instead pass FetchKeyResult objects, which simply wrap the VerifyKey and add a valid_until_ts field.
* | Room Statistics (#4338)Amber Brown2019-05-211-0/+80
| |
* | Add simple send_relation API and track in DBErik Johnston2019-05-151-0/+27
|/
* Merge pull request #5047 from matrix-org/babolivier/account_expirationBrendan Abolivier2019-04-171-1/+8
|\ | | | | Send out emails with links to extend an account's validity period
| * Send out emails with links to extend an account's validity periodBrendan Abolivier2019-04-171-1/+8
| |
* | Merge pull request #5033 from matrix-org/erikj/fix_schema_deltaErik Johnston2019-04-101-1/+3
|\ \ | | | | | | Fix schema upgrade when dropping tables
| * | Fix schema upgrade when dropping tablesErik Johnston2019-04-091-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | We need to drop tables in the correct order due to foreign table constraints (on `application_services`), otherwise the DROP TABLE command will fail. Introduced in #4992.
* | | Merge pull request #5027 from matrix-org/babolivier/account_expirationBrendan Abolivier2019-04-091-0/+20
|\ \ \ | |/ / |/| / | |/ Add time-based account expiration
| * Add account expiration featureBrendan Abolivier2019-04-091-0/+20
| |
* | Remove unused server_tls_certificates functions (#5028)Richard van der Hoff2019-04-082-11/+4
| | | | | | | | These have been unused since #4120, and with the demise of perspectives, it is unlikely that they will ever be used again.
* | drop tables listed in #1830 (#4992)Neil Johnson2019-04-0823-740/+42
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Tables dropped: * application_services, * application_services_regex, * transaction_id_to_pdu, * stats_reporting * current_state_resets * event_content_hashes * event_destinations * event_edge_hashes * event_signatures * feedback * room_hosts * state_forward_extremities
* | Remove presence lists (#4989)Neil Johnson2019-04-032-10/+18
| | | | | | Remove presence list support as per MSC 1819
* | Fixup docstringsErik Johnston2019-04-021-2/+2
| |
* | Grandfather in existing user threepidsErik Johnston2019-04-011-0/+2
| | | | | | | | | | | | We assume, as we did before, that users bound their threepid to one of the trusted identity servers. So we simply fill the new table with all threepids in `user_threepids` joined with the trusted identity servers.
* | Track IS used to bind 3PIDsErik Johnston2019-04-011-0/+27
|/ | | | | This will then be used to know which IS to default to when unbinding the threepid.
* Fix user directory background update (#4887)Erik Johnston2019-03-191-1/+1
|
* Migrate the user directory initial population to a background task (#4864)Amber Brown2019-03-191-0/+30
|
* fixupAmber Brown2019-03-131-7/+0
|
* fixupAmber Brown2019-03-121-5/+12
|
* Merge remote-tracking branch 'origin/develop' into hawkowl/userdir-searchAmber Brown2019-03-111-0/+2
|\
| * Add comment to schemaErik Johnston2019-03-081-0/+2
| |
* | initialAmber Brown2019-03-112-3/+28
|/
* Rewrite userdir to be faster (#4537)Amber Brown2019-03-071-0/+47
|
* Analyze user_ips before running deduplicationErik Johnston2019-02-121-3/+7
| | | | | | | Due to the table locks taken out by the naive upsert, the table statistics may be out of date. During deduplication it is important that the correct index is used as otherwise a full table scan may be incorrectly used, which can end up thrashing the database badly.
* Add support for persisting event format versionsErik Johnston2019-01-231-0/+16
| | | | | | | | | | | | | | Currently we only have the one event format version defined, but this adds the necessary infrastructure to persist and fetch the format versions alongside the events. We specify the format version rather than the room version as: 1. We don't necessarily know the room version, existing events may be either v1 or v2. 2. We'd need to be careful to prevent/handle correctly if different events in the same room reported to be of different versions, which sounds annoying.
* Remove duplicates in the user_ips table and add an index (#4370)Amber Brown2019-01-121-0/+26
|
* create support user (#4141)Neil Johnson2018-12-141-0/+19
| | | | | | Allow for the creation of a support user. A support user can access the server, join rooms, interact with other users, but does not appear in the user directory nor does it contribute to monthly active user limits.
* Drop sent_transactionsAaron Raimist2018-12-014-72/+2
| | | | Signed-off-by: Aaron Raimist <aaron@raim.ist>
* Merge remote-tracking branch 'origin/develop' into ↵David Baker2018-11-093-4/+60
|\ | | | | | | dbkr/e2e_backup_versions_are_numbers
| * Add unique indexes to a couple of tablesRichard van der Hoff2018-11-022-4/+41
| | | | | | | | | | The indexes on device_lists_remote_extremeties can be unique, and they therefore should, to ensure that the db remains consistent.
| * Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2018-10-191-0/+39
| |\ | | | | | | | | | erikj/purge_state_groups
| * | Add state_group index to event_to_state_groupsErik Johnston2018-10-041-0/+19
| | | | | | | | | | | | | | | This is needed to efficiently check for unreferenced state groups during purge.
* | | Try & make it work on postgresDavid Baker2018-10-301-2/+2
| | |
* | | Make e2e backup versions numeric in the DBDavid Baker2018-10-291-0/+53
| |/ |/| | | | | | | We were doing max(version) which does not do what we wanted on a column of type TEXT.
* | Don't reuse backup versionsDavid Baker2018-10-051-1/+2
| | | | | | | | | | | | | | | | Since we don't actually delete the keys, just mark the versions as deleted in the db rather than actually deleting them, then we won't reuse versions. Fixes https://github.com/vector-im/riot-web/issues/7448
* | WIP e2e key backupsDavid Baker2018-09-131-0/+0
| | | | | | | | | | | | | | Continues from uhoreg's branch This just fixed the errcode on /room_keys/version if no backup and updates the schema delta to be on the latest so it gets run
* | Merge branch 'develop' into e2e_backupsHubert Chathi2018-08-241-0/+27
|\|
| * typosNeil Johnson2018-08-081-1/+1
| |
| * make use of _simple_select_one_onecol, improved commentsNeil Johnson2018-08-061-0/+4
| |
| * Revert "change monthly_active_users table to be a single column"Neil Johnson2018-08-021-1/+3
| | | | | | | | This reverts commit ec716a35b219d147dee51733b55573952799a549.
| * change monthly_active_users table to be a single columnNeil Johnson2018-08-011-3/+1
| |
| * fix commentNeil Johnson2018-08-011-1/+1
| |
| * api into monthly_active_users tableNeil Johnson2018-07-312-1/+24
| |
* | fix idiocies and so make tests passMatthew Hodgson2018-08-121-1/+1
| |
* | blindly incorporate PR review - needs testing & fixingMatthew Hodgson2018-08-121-5/+3
| |
* | make /room_keys/version workMatthew Hodgson2018-08-121-2/+2
| |
* | implement /room_keys/version too (untested)Matthew Hodgson2018-08-121-1/+1
| |
* | make it work and fix pep8Matthew Hodgson2018-08-121-1/+1
| |
* | total WIP skeleton for /room_keys APIMatthew Hodgson2018-08-121-0/+40
| |
* | coding styleNeil Johnson2018-07-311-1/+1
|/
* Create the column nullableRichard van der Hoff2018-07-262-9/+13
| | | | | There's no real point in ever making the column non-nullable, and doing so breaks the sytests.
* Stop populating events.contentRichard van der Hoff2018-07-261-0/+93
| | | | | | This field is no longer read from, so we should stop populating it. Once we're happy that this doesn't break everything, and a rollback is unlikely, we can think about dropping the column.
* comment on event_edgesRichard van der Hoff2018-07-261-1/+2
|
* run isortAmber Brown2018-07-0911-23/+24
|
* Revert "Revert "Merge pull request #3431 from ↵Erik Johnston2018-06-251-0/+21
| | | | | | matrix-org/rav/erasure_visibility"" This reverts commit 1d009013b3c3e814177afc59f066e02a202b21cd.
* Revert "Merge pull request #3431 from matrix-org/rav/erasure_visibility"Richard van der Hoff2018-06-221-21/+0
| | | | | This reverts commit ce0d911156b355c5bf452120bfb08653dad96497, reversing changes made to b4a5d767a94f1680d07edfd583aae54ce422573e.
* UserErasureStoreRichard van der Hoff2018-06-121-0/+21
| | | | to store which users have been erased
* remove unnecessary INSERTNeil Johnson2018-06-011-1/+0
|
* create users index on creation_tsNeil Johnson2018-05-291-0/+20
|
* Send users a server notice about consentRichard van der Hoff2018-05-221-0/+20
| | | | | When a user first syncs, we will send them a server notice asking them to consent to the privacy policy if they have not already done so.
* Merge pull request #3163 from matrix-org/cohort_analyticsNeil Johnson2018-05-162-0/+38
|\ | | | | user visit data
| * Merge branch 'develop' of https://github.com/matrix-org/synapse into ↵Neil Johnson2018-05-142-1/+60
| |\ | | | | | | | | | cohort_analytics
| * | add inidexes based on usageNeil Johnson2018-05-011-6/+2
| | |
| * | Generate user daily statsNeil Johnson2018-04-252-0/+42
| | |
* | | Merge pull request #3213 from matrix-org/rav/consent_handlerRichard van der Hoff2018-05-161-0/+18
|\ \ \ | | | | | | | | ConsentResource to gather policy consent from users
| * | | ConsentResource to gather policy consent from usersRichard van der Hoff2018-05-151-0/+18
| | |/ | |/| | | | | | | | | | Hopefully there are enough comments and docs in this that it makes sense on its own.
* / | Add the schema fileDavid Baker2018-05-091-0/+25
|/ /
* | Merge pull request #3129 from matrix-org/matthew/fix_group_dupsMatthew Hodgson2018-04-301-0/+57
|\ \ | | | | | | remove duplicates from groups tables
| * | fix missing importMatthew Hodgson2018-04-281-0/+1
| | |
| * | pep8Matthew Hodgson2018-04-281-3/+5
| | |
| * | make it work with sqliteMatthew Hodgson2018-04-282-34/+54
| | |
| * | remove duplicates from groups tablesMatthew Hodgson2018-04-251-0/+34
| |/ | | | | | | | | and rename inconsistently named indexes. Based on https://github.com/matrix-org/synapse/pull/3128 - thanks @vurpo\!
* / Move more xrange to sixAdrian Tschira2018-04-281-1/+3
|/ | | | | | plus a bonus next() Signed-off-by: Adrian Tschira <nota@notafile.com>
* Merge pull request #3045 from matrix-org/dbkr/group_joinableLuke Barnard2018-04-051-0/+22
|\ | | | | Add joinability for groups
| * NON NULL -> NOT NULLLuke Barnard2018-04-051-1/+1
| |
| * Use DEFAULT join_policy of "invite" in dbLuke Barnard2018-04-051-1/+1
| |
| * Use join_policy API instead of joinableLuke Barnard2018-04-031-1/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The API is now under /groups/$group_id/setting/m.join_policy and expects a JSON blob of the shape ```json { "m.join_policy": { "type": "invite" } } ``` where "invite" could alternatively be "open".
| * OK, smallint it is thenDavid Baker2018-03-281-1/+1
| |
| * Grr. Copy the definition from is_adminDavid Baker2018-03-281-1/+1
| |
| * Make column definition that works on both dbsDavid Baker2018-03-281-1/+1
| |
| * Add schema delta fileDavid Baker2018-03-281-0/+16
| |
* | Merge pull request #3041 from matrix-org/r30_statsNeil Johnson2018-04-051-0/+17
|\ \ | | | | | | R30 stats
| * | Add user_ips last seen indexNeil Johnson2018-03-281-0/+17
| |/
* / Use simplejson throughoutRichard van der Hoff2018-03-291-1/+2
|/ | | | Let's use simplejson rather than json, for consistency.
* Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2018-03-194-8/+8
|\
| * Replace ujson with simplejsonErik Johnston2018-03-154-7/+7
| |
* | CommentsErik Johnston2018-02-161-0/+4
| |
* | Store push actions in staging areaErik Johnston2018-02-151-0/+24
| |
* | Merge branch 'matthew/gin_work_mem' into matthew/hit_the_ginRichard van der Hoff2018-02-132-0/+53
|\ \
| * | Store state groups separately from events (#2784)Erik Johnston2018-02-061-0/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Split state group persist into seperate storage func * Add per database engine code for state group id gen * Move store_state_group to StateReadStore This allows other workers to use it, and so resolve state. * Hook up store_state_group * Fix tests * Rename _store_mult_state_groups_txn * Rename StateGroupReadStore * Remove redundant _have_persisted_state_group_txn * Update comments * Comment compute_event_context * Set start val for state_group_id_seq ... otherwise we try to recreate old state groups * Update comments * Don't store state for outliers * Update comment * Update docstring as state groups are ints
| * | Remove lost commentErik Johnston2018-01-171-3/+0
| | |
| * | Keep track of last access time for local mediaErik Johnston2018-01-171-0/+19
| |/
* | move search reindex to schema 47Richard van der Hoff2018-02-132-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | We're up to schema v47 on develop now, so this will have to go in there to have an effect. This might cause an error if somebody has already run it in the v46 guise, and runs it again in the v47 guise, because it will cause a duplicate entry in the bbackground_updates table. On the other hand, the entry is removed once it is complete, and it is unlikely that anyone other than matrix.org has run it on v46. The update itself is harmless to re-run because it deliberately copes with the index already existing.
* | fix GIST->GIN switchMatthew Hodgson2018-01-092-2/+21
|/
* Merge branch 'develop' into matthew/search-all-local-usersMatthew Hodgson2017-11-302-1/+28
|\
| * Fix error on sqlite 3.7Richard van der Hoff2017-11-212-1/+28
| | | | | | | | | | | | | | | | | | | | | | Create the url_cache index on local_media_repository as a background update, so that we can detect whether we are on sqlite or not and create a partial or complete index accordingly. To avoid running the cleanup job before we have built the index, add a bailout which will defer the cleanup if the bg updates are still running. Fixes https://github.com/matrix-org/synapse/issues/2572.
* | remove null constraint on user_dir.room_idMatthew Hodgson2017-11-301-0/+35
|/
* Avoid locking for upsert on pushers tablesRichard van der Hoff2017-11-161-0/+35
| | | | | * replace the upsert into deleted_pushers with an insert * no need to lock for upsert on pusher_throttle
* create new indexes before dropping old ones to keep safetynet in placeMatthew Hodgson2017-11-071-2/+4
|
* s/users_in_pubic_room/users_in_public_rooms/gMatthew Hodgson2017-11-041-2/+2
|
* s/users_in_pubic_room/users_in_public_rooms/gMatthew Hodgson2017-11-041-0/+22
|
* fix copyright....Matthew Hodgson2017-11-041-1/+1
|
* s/popualte/populate/Matthew Hodgson2017-11-041-1/+1
|
* Remove the last vestiges of refresh_tokensRichard van der Hoff2017-10-313-40/+3
|
* DB schema interface for password auth providersRichard van der Hoff2017-10-311-0/+7
| | | | | Provide an interface by which password auth providers can register db schema files to be run at startup
* Recreate groups table instead of adding columnLuke Barnard2017-10-261-2/+16
| | | | Adding a column with non-constant default not possible in sqlite3
* Awful hack to get default trueLuke Barnard2017-10-261-1/+2
|
* Add is_public to groups table to allow for private groupsLuke Barnard2017-10-261-0/+17
| | | | | | Prevent group API access to non-members for private groups Also make all the group code paths consistent with `requester_user_id` always being the User ID of the requesting user.
* replace 'except:' with 'except Exception:'Richard van der Hoff2017-10-231-1/+1
| | | | what could possibly go wrong
* Fix schema delta versionsErik Johnston2017-10-112-0/+0
|
* Merge branch 'develop' into erikj/groups_mergedDavid Baker2017-10-021-0/+38
|\
| * Add old indicesErik Johnston2017-09-281-0/+2
| |
| * Change expires column to expires_tsErik Johnston2017-09-281-1/+20
| |
| * More bracketsErik Johnston2017-09-281-1/+1
| |
| * Delete expired url cache dataErik Johnston2017-09-281-0/+17
| |
* | Add unique index to group_rooms tableErik Johnston2017-09-261-1/+1
| |
* | Add remote profile cacheErik Johnston2017-08-251-0/+28
| |
* | Use BOOLEAN rather than TEXT typeErik Johnston2017-08-211-1/+1
| |
* | Store whether the user wants to publicise their membership of a groupErik Johnston2017-08-081-0/+1
| |
* | Add groups to sync streamErik Johnston2017-07-201-0/+9
| |
* | Remove sync stuffErik Johnston2017-07-181-9/+1
| |
* | Remove unused tablesErik Johnston2017-07-181-7/+0
| |
* | Add local group server supportErik Johnston2017-07-171-0/+28
| |
* | CommentsErik Johnston2017-07-121-5/+12
| |
* | Add group summary APIsErik Johnston2017-07-121-0/+56
| |
* | CommentErik Johnston2017-07-121-1/+1
| |
* | Move commentErik Johnston2017-07-111-2/+2
| |
* | Rename column to attestation_jsonErik Johnston2017-07-111-1/+1
| |
* | CommentsErik Johnston2017-07-111-2/+2
| |
* | CommentsErik Johnston2017-07-111-1/+5
| |
* | Initial group server implementationErik Johnston2017-07-101-0/+77
|/
* Fix up indices for users_who_share_roomsErik Johnston2017-06-261-1/+2
|
* Store URL cache preview downloads seperatelyErik Johnston2017-06-231-0/+16
| | | | This makes it easier to clear old media out at a later date
* Add API to quarantine mediaErik Johnston2017-06-191-0/+17
|
* Add shutdown room APIErik Johnston2017-06-191-0/+21
|
* Add DB schema for tracking users who share roomsErik Johnston2017-06-151-0/+32
|
* Split up device_lists_outbound_pokes table for faster updates.Erik Johnston2017-06-071-0/+33
|
* Split the table in twoErik Johnston2017-06-011-1/+9
|
* Use unique indicesErik Johnston2017-05-311-2/+2
|
* Split out directory and search tablesErik Johnston2017-05-311-11/+14
|
* Handle the server leaving a public roomErik Johnston2017-05-311-0/+4
|
* Add commentsErik Johnston2017-05-311-1/+1
|
* Add user_directory to databaseErik Johnston2017-05-311-0/+69
|
* Add commentErik Johnston2017-05-301-1/+1
|
* Add clobbered event_idErik Johnston2017-05-301-1/+2
|
* Add current_state_delta_stream tableErik Johnston2017-05-301-0/+25
|
* Add background task to clear out old event_authErik Johnston2017-05-241-0/+17
|
* Add a comment to old deltaRichard van der Hoff2017-05-111-0/+4
|
* Add an index to event_searchRichard van der Hoff2017-05-111-0/+17
| | | | - to make the purge API quicker
* Add per user ratelimiting overridesErik Johnston2017-05-101-0/+22
|
* Add index to device_lists_streamErik Johnston2017-03-011-0/+17
|
* Add stream_id index to device_lists_outbound_pokesErik Johnston2017-02-281-0/+16
| | | | As this is used for replication streaming
* Use TEXT rather than VARCHARDavid Baker2017-02-171-6/+6
| | | | While we're changing anyway
* Make the pushers lang field column longerDavid Baker2017-02-171-0/+39
| | | | | | To accommodate things like zh-Hans-CN Fixes https://github.com/vector-im/riot-ios/issues/1031
* Aggregate event push actionsErik Johnston2017-02-141-0/+37
|
* Add an index to make membership queries fasterErik Johnston2017-01-311-0/+17
|
* Add ts column to device_lists_outbound_pokesErik Johnston2017-01-271-1/+2
|
* Add commentsErik Johnston2017-01-261-1/+7
|
* Implement device key caching over federationErik Johnston2017-01-261-12/+8
|
* Add basic implementation of local device list changesErik Johnston2017-01-251-0/+56
|
* Add commentErik Johnston2017-01-131-0/+1
|
* Change device_inbox stream index to include userErik Johnston2017-01-101-0/+20
| | | | | This makes fetching the nost recently changed users much tricker, and brings it in line with e.g. presence_stream indices.
* Merge pull request #1676 from matrix-org/erikj/room_listErik Johnston2016-12-121-0/+29
|\ | | | | Add new API appservice specific public room list
| * CommentsErik Johnston2016-12-071-0/+2
| |
| * Add new API appservice specific public room listErik Johnston2016-12-061-0/+27
| |
* | Add profile data to the room_membership table for joinsErik Johnston2016-12-081-0/+20
|/
* Don't send old events as federationErik Johnston2016-11-241-1/+1
|
* More efficient notif count queriesErik Johnston2016-11-231-0/+17
|
* Store federation stream positions in the databaseErik Johnston2016-11-211-0/+22
|
* Handle sending events and device messages over federationErik Johnston2016-11-171-0/+16
|
* Replace postgres GIN with GISTErik Johnston2016-11-031-0/+17
| | | | | This is because GIN can be slow to write too, especially when the table gets large.
* Use most recently added binding, not most recently seen user.Erik Johnston2016-10-271-19/+11
|
* Fix user_threepids schema deltaErik Johnston2016-10-271-1/+38
| | | | | | | | | | | The delta `37/user_threepids.sql` aimed to update all the email addresses to be lower case, however duplicate emails may exist in the table already. This commit adds a step where the delta moves the duplicate emails to a new `medium` `email_old`. Only the most recently used account keeps the binding intact. We move rather than delete so that we retain some record of which emails were associated with which account.
* Latest delta is now 37David Baker2016-10-191-0/+0
|
* Merge remote-tracking branch 'origin/develop' into ↵David Baker2016-10-191-0/+81
|\ | | | | | | dbkr/password_reset_case_insensitive
| * Bump schema versionErik Johnston2016-10-171-0/+0
| |
| * Remove TODOErik Johnston2016-10-171-2/+0
| |
| * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/remove_authErik Johnston2016-10-174-1/+97
| |\
| * | Drop some unused indicesErik Johnston2016-10-172-16/+83
| | |