Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Add logging on startup/shutdown (#8448) | Erik Johnston | 2020-10-02 | 1 | -23/+10 |
| | | | | | This is so we can tell what is going on when things are taking a while to start up. The main change here is to ensure that transactions that are created during startup get correctly logged like normal transactions. | ||||
* | Use slots in attrs classes where possible (#8296) | Patrick Cloke | 2020-09-14 | 1 | -1/+1 |
| | | | | | slots use less memory (and attribute access is faster) while slightly limiting the flexibility of the class attributes. This focuses on objects which are instantiated "often" and for short periods of time. | ||||
* | Merge remote-tracking branch 'origin/release-v1.20.0' into develop | Richard van der Hoff | 2020-09-08 | 1 | -17/+70 |
|\ | |||||
| * | Add more logging to debug slow startup (#8264) | Richard van der Hoff | 2020-09-07 | 1 | -0/+10 |
| | | | | | | | | I'm hoping this will provide some pointers for debugging https://github.com/matrix-org/synapse/issues/7968. | ||||
| * | Refuse to upgrade database on worker processes (#8266) | Richard van der Hoff | 2020-09-07 | 1 | -17/+61 |
| | | |||||
* | | Run database updates in a transaction (#8265) | Richard van der Hoff | 2020-09-07 | 1 | -5/+22 |
|/ | | | Fixes: #6467 | ||||
* | Stop sub-classing object (#8249) | Patrick Cloke | 2020-09-04 | 1 | -1/+1 |
| | |||||
* | Rename database classes to make some sense (#8033) | Erik Johnston | 2020-08-05 | 1 | -25/+23 |
| | |||||
* | Fix bug in account data replication stream. (#7656) | Erik Johnston | 2020-06-09 | 1 | -0/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | * Ensure account data stream IDs are unique. The account data stream is shared between three tables, and the maximum allocated ID was tracked in a dedicated table. Updating the max ID happened outside the transaction that allocated the ID, leading to a race where if the server was restarted then the same ID could be allocated but the max ID failed to be updated, leading it to be reused. The ID generators have support for tracking across multiple tables, so we may as well use that instead of a dedicated table. * Fix bug in account data replication stream. If the same stream ID was used in both global and room account data then the getting updates for the replication stream would fail due to `heapq.merge(..)` trying to compare a `str` with a `None`. (This is because you'd have two rows like `(534, '!room')` and `(534, None)` from the room and global account data tables). Fix is just to order by stream ID, since we don't rely on the ordering beyond that. The bug where stream IDs can be reused should be fixed now, so this case shouldn't happen going forward. Fixes #7617 | ||||
* | Fix incorrect placeholder syntax in database prepartion code (#7575) | Andrew Morgan | 2020-05-27 | 1 | -3/+2 |
| | | | We were using `logger` syntax which isn't supported by `Exception`s. | ||||
* | Replace device_27_unique_idx bg update with a fg one (#7562) | Richard van der Hoff | 2020-05-26 | 1 | -4/+9 |
| | | | | | | The bg update never managed to complete, because it kept being interrupted by transactions which want to take a lock. Just doing it in the foreground isn't that bad, and is a good deal simpler. | ||||
* | Support any process writing to cache invalidation stream. (#7436) | Erik Johnston | 2020-05-07 | 1 | -0/+2 |
| | |||||
* | Only run one background update at a time | Richard van der Hoff | 2020-03-31 | 1 | -1/+1 |
| | |||||
* | Sanity-check database before running upgrades (#6982) | Richard van der Hoff | 2020-02-25 | 1 | -2/+13 |
| | | | | | | Some of the database deltas rely on `config.server_name` being set correctly, so we should check that it is before running the deltas. Fixes #6870. | ||||
* | Clarify list/set/dict/tuple comprehensions and enforce via flake8 (#6957) | Patrick Cloke | 2020-02-21 | 1 | -3/+3 |
| | | | | Ensure good comprehension hygiene using flake8-comprehensions. | ||||
* | Warn if postgres database has non-C locale. (#6734) | Erik Johnston | 2020-01-28 | 1 | -0/+5 |
| | | | As using non-C locale can cause issues on upgrading OS. | ||||
* | Add `local_current_membership` table (#6655) | Erik Johnston | 2020-01-15 | 1 | -1/+1 |
| | | | | | | | Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information. | ||||
* | Split state groups into a separate data store (#6296) | Erik Johnston | 2019-12-20 | 1 | -1/+1 |
| | |||||
* | Explode on duplicate delta file names. (#6565) | Erik Johnston | 2019-12-19 | 1 | -0/+18 |
| | |||||
* | Improve diagnostics on database upgrade failure (#6570) | Richard van der Hoff | 2019-12-19 | 1 | -1/+4 |
| | | | | `Failed to upgrade database` is not helpful, and it's unlikely that UPGRADE.rst has anything useful. | ||||
* | Add database config class (#6513) | Erik Johnston | 2019-12-18 | 1 | -4/+3 |
| | | | | | This encapsulates config for a given database and is the way to get new connections. | ||||
* | Clean up newline quote marks around the codebase (#6362) | Andrew Morgan | 2019-11-21 | 1 | -1/+1 |
| | |||||
* | Clean up prepare_database.py a bit and add comments | Erik Johnston | 2019-10-22 | 1 | -7/+30 |
| | |||||
* | Fix schema management to work with multiple data stores. | Erik Johnston | 2019-10-21 | 1 | -41/+108 |
| | |||||
* | Code style (Black) | Olivier Wilkinson (reivilibre) | 2019-08-27 | 1 | -3/+1 |
| | | | | Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> | ||||
* | Allow schema deltas to be engine-specific | Olivier Wilkinson (reivilibre) | 2019-08-27 | 1 | -5/+21 |
| | | | | Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> | ||||
* | Add membership column to current_state_events table. | Erik Johnston | 2019-07-18 | 1 | -1/+1 |
| | | | | | It turns out that doing a join is surprisingly expensive for the DB to do when room_membership table is larger than the disk cache. | ||||
* | Fix "Unexpected entry in 'full_schemas'" log warning (#5509) | Richard van der Hoff | 2019-06-21 | 1 | -1/+1 |
| | | | | | There is a README.txt which always sets off this warning, which is a bit alarming when you first start synapse. I don't think we need to warn about this. | ||||
* | Run Black. (#5482) | Amber Brown | 2019-06-20 | 1 | -6/+7 |
| | |||||
* | Merge pull request #5320 from matrix-org/hawkowl/full-schema-v1 | Erik Johnston | 2019-06-06 | 1 | -2/+14 |
|\ | | | | | Make a full SQL schema | ||||
| * | fix schemas | Amber Brown | 2019-06-03 | 1 | -2/+2 |
| | | |||||
| * | prepare | Amber Brown | 2019-06-03 | 1 | -2/+14 |
| | | |||||
* | | Add ability to perform password reset via email without trusting the ↵ | Andrew Morgan | 2019-06-06 | 1 | -1/+1 |
|/ | | | | | | | | | | | | identity server (#5377) Sends password reset emails from the homeserver instead of proxying to the identity server. This is now the default behaviour for security reasons. If you wish to continue proxying password reset requests to the identity server you must now enable the email.trust_identity_server_for_password_resets option. This PR is a culmination of 3 smaller PRs which have each been separately reviewed: * #5308 * #5345 * #5368 | ||||
* | Remove presence lists (#4989) | Neil Johnson | 2019-04-03 | 1 | -1/+1 |
| | | | Remove presence list support as per MSC 1819 | ||||
* | Run black on the rest of the storage module (#4996) | Amber Brown | 2019-04-03 | 1 | -38/+29 |
| | |||||
* | Drop sent_transactions | Aaron Raimist | 2018-12-01 | 1 | -1/+1 |
| | | | | Signed-off-by: Aaron Raimist <aaron@raim.ist> | ||||
* | Ignore __pycache__ directories in schema delta dir | Richard van der Hoff | 2018-11-20 | 1 | -1/+1 |
| | | | | Now that we use py3, compiled python ends up in __pycache__ rather than *.pyc. | ||||
* | Add state_group index to event_to_state_groups | Erik Johnston | 2018-10-04 | 1 | -1/+1 |
| | | | | | This is needed to efficiently check for unreferenced state groups during purge. | ||||
* | api into monthly_active_users table | Neil Johnson | 2018-07-31 | 1 | -1/+1 |
| | |||||
* | run isort | Amber Brown | 2018-07-09 | 1 | -1/+0 |
| | |||||
* | bump version | Neil Johnson | 2018-05-29 | 1 | -1/+1 |
| | |||||
* | Generate user daily stats | Neil Johnson | 2018-04-25 | 1 | -1/+1 |
| | |||||
* | Add joinability for groups | David Baker | 2018-03-28 | 1 | -1/+2 |
| | | | | | Adds API to set the 'joinable' flag, and corresponding flag in the table. | ||||
* | Keep track of last access time for local media | Erik Johnston | 2018-01-17 | 1 | -1/+1 |
| | |||||
* | DB schema interface for password auth providers | Richard van der Hoff | 2017-10-31 | 1 | -0/+70 |
| | | | | | Provide an interface by which password auth providers can register db schema files to be run at startup | ||||
* | Bump schema version to 46 | Luke Barnard | 2017-10-26 | 1 | -1/+1 |
| | |||||
* | replace 'except:' with 'except Exception:' | Richard van der Hoff | 2017-10-23 | 1 | -1/+1 |
| | | | | what could possibly go wrong | ||||
* | Fix schema delta versions | Erik Johnston | 2017-10-11 | 1 | -1/+1 |
| | |||||
* | Delete expired url cache data | Erik Johnston | 2017-09-28 | 1 | -1/+1 |
| | |||||
* | Add DB schema for tracking users who share rooms | Erik Johnston | 2017-06-15 | 1 | -1/+1 |
| | |||||
* | Add background task to clear out old event_auth | Erik Johnston | 2017-05-24 | 1 | -1/+1 |
| | |||||
* | User Cursor.__iter__ instead of fetchall | Erik Johnston | 2017-03-23 | 1 | -1/+1 |
| | | | | This prevents unnecessary construction of lists | ||||
* | Add stream_id index to device_lists_outbound_pokes | Erik Johnston | 2017-02-28 | 1 | -1/+1 |
| | | | | As this is used for replication streaming | ||||
* | Change device_inbox stream index to include user | Erik Johnston | 2017-01-10 | 1 | -1/+1 |
| | | | | | This makes fetching the nost recently changed users much tricker, and brings it in line with e.g. presence_stream indices. | ||||
* | Handle sending events and device messages over federation | Erik Johnston | 2016-11-17 | 1 | -1/+1 |
| | |||||
* | Replace postgres GIN with GIST | Erik Johnston | 2016-11-03 | 1 | -1/+1 |
| | | | | | This is because GIN can be slow to write too, especially when the table gets large. | ||||
* | Bump schema version | Erik Johnston | 2016-10-17 | 1 | -1/+1 |
| | |||||
* | Readd entries to public_room_list_stream that were deleted | Erik Johnston | 2016-09-21 | 1 | -1/+1 |
| | |||||
* | Log delta files we're applying | Erik Johnston | 2016-09-08 | 1 | -2/+2 |
| | |||||
* | Move to storing state_groups_state as deltas | Erik Johnston | 2016-09-01 | 1 | -1/+1 |
| | |||||
* | Add some invalidations to a cache_stream | Erik Johnston | 2016-08-15 | 1 | -1/+1 |
| | |||||
* | Track approximate last access time for remote media | Erik Johnston | 2016-06-29 | 1 | -1/+1 |
| | |||||
* | Add /report endpoint | Erik Johnston | 2016-05-04 | 1 | -1/+1 |
| | |||||
* | Remove some unused functions (#711) | Mark Haines | 2016-04-08 | 1 | -12/+0 |
| | | | | | | | | * Remove some unused functions * get_room_events_stream is only used in tests * is_exclusive_room might actually be something we want | ||||
* | Don't require config to create database | Erik Johnston | 2016-04-06 | 1 | -43/+21 |
| | |||||
* | Store invites in a separate table. | Erik Johnston | 2016-04-04 | 1 | -1/+1 |
| | |||||
* | Mark AS users with their AS's ID | Daniel Wagner-Hall | 2016-02-11 | 1 | -7/+8 |
| | |||||
* | Change a log from debug to info | Erik Johnston | 2016-02-09 | 1 | -1/+1 |
| | |||||
* | Change event_push_actions_rm_tokens schema | Erik Johnston | 2016-02-03 | 1 | -1/+1 |
| | |||||
* | Allow guests to upgrade their accounts | Daniel Wagner-Hall | 2016-01-05 | 1 | -2/+2 |
| | |||||
* | Bump schema version. | Mark Haines | 2015-12-04 | 1 | -1/+1 |
| | | | | As we released version 26 in v0.11.1 | ||||
* | s/private_user_data/account_data/ | Mark Haines | 2015-11-18 | 1 | -1/+1 |
| | |||||
* | Move FTS to delta 25 | Erik Johnston | 2015-10-22 | 1 | -1/+1 |
| | |||||
* | rename schema_prepare to prepare_database | Erik Johnston | 2015-10-13 | 1 | -0/+395 |