Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge pull request #6263 from matrix-org/erikj/caches_return_deferreds | Erik Johnston | 2019-10-29 | 1 | -1/+1 |
|\ | | | | | Quick fix to ensure cache descriptors always return deferreds | ||||
| * | Quick fix to ensure cache descriptors always return deferreds | Erik Johnston | 2019-10-28 | 1 | -1/+1 |
| | | |||||
* | | Merge branch 'release-v1.5.0' of github.com:matrix-org/synapse into develop | Erik Johnston | 2019-10-29 | 1 | -4/+8 |
|\ \ | |||||
| * | | Make room directory search case insensitive | Erik Johnston | 2019-10-29 | 1 | -4/+8 |
| | | | |||||
* | | | Add CI for synapse_port_db (#6140) | Brendan Abolivier | 2019-10-28 | 1 | -3/+6 |
| |/ |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds: * a test sqlite database * a configuration file for the sqlite database * a configuration file for a postgresql database (using the credentials in `.buildkite/docker-compose.pyXX.pgXX.yaml`) as well as a new script named `.buildkite/scripts/test_synapse_port_db.sh` that: 1. installs Synapse 2. updates the test sqlite database to the latest schema and runs background updates on it 3. creates an empty postgresql database 4. run the `synapse_port_db` script to migrate the test sqlite database to the empty postgresql database (with coverage) Step `2` is done via a new script located at `scripts-dev/update_database`. The test sqlite database is extracted from a SyTest run, so that it can be considered as an actual homeserver's database with actual data in it. | ||||
* | | Convert EventContext to attrs (#6218) | Richard van der Hoff | 2019-10-28 | 1 | -1/+6 |
| | | | | | | | | * make EventContext use an attr | ||||
* | | Merge pull request #6253 from matrix-org/uhoreg/e2e_backup_delete_keys | Hubert Chathi | 2019-10-25 | 2 | -0/+33 |
|\ \ | | | | | | | delete keys when deleting backup versions | ||||
| * | | delete keys when deleting backups | Hubert Chathi | 2019-10-24 | 2 | -0/+33 |
| | | | |||||
* | | | Merge branch 'release-v1.5.0' of github.com:matrix-org/synapse into develop | Erik Johnston | 2019-10-25 | 1 | -67/+67 |
|\ \ \ | | |/ | |/| | |||||
| * | | Fix /keys/query API on workers. | Erik Johnston | 2019-10-25 | 1 | -67/+67 |
| |/ | | | | | | | | | The necessary getters were added only to the master store and not the worker stores. | ||||
* | | Merge pull request #6251 from matrix-org/michaelkaye/debug_guard_logging | Erik Johnston | 2019-10-25 | 1 | -3/+1 |
|\ \ | | | | | | | Reduce debug logging overhead | ||||
| * | | Address codestyle concerns | Michael Kaye | 2019-10-24 | 1 | -3/+1 |
| | | | |||||
| * | | use %r to __repr__ objects | Michael Kaye | 2019-10-24 | 1 | -1/+1 |
| |/ | | | | | | | This avoids calculating __repr__ unless we are going to log. | ||||
* / | Make user/room stats log line less verbose. | Michael Kaye | 2019-10-24 | 1 | -1/+1 |
|/ | |||||
* | Move schema delta files to the correct data store. | Erik Johnston | 2019-10-24 | 2 | -0/+0 |
| | | | | They were put in the global schema delta directory due to a bad merge. | ||||
* | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-10-22 | 1 | -11/+37 |
|\ | | | | | | | erikj/refactor_stores | ||||
| * | Merge branch 'develop' into cross-signing_sig_upload | Hubert Chathi | 2019-10-18 | 38 | -908/+1949 |
| |\ | |||||
| * | | make changes based on PR feedback | Hubert Chathi | 2019-09-24 | 1 | -11/+6 |
| | | | |||||
| * | | Merge branch 'develop' into cross-signing_sig_upload | Hubert Chathi | 2019-09-07 | 4 | -81/+142 |
| |\ \ | |||||
| * | | | make black happy | Hubert Chathi | 2019-09-04 | 1 | -15/+9 |
| | | | | |||||
| * | | | allow uploading signatures of master key signed by devices | Hubert Chathi | 2019-09-04 | 1 | -1/+1 |
| | | | | |||||
| * | | | implement device signature uploading/fetching | Hubert Chathi | 2019-09-04 | 1 | -0/+38 |
| | | | | |||||
* | | | | Clean up prepare_database.py a bit and add comments | Erik Johnston | 2019-10-22 | 1 | -7/+30 |
| | | | | |||||
* | | | | Delete background_update table creation in main data_store | Erik Johnston | 2019-10-22 | 1 | -21/+0 |
| | | | | |||||
* | | | | Move README into synapse/storage/__init__.py | Erik Johnston | 2019-10-22 | 2 | -13/+12 |
| | | | | |||||
* | | | | Add a basic README to synapse.storage | Erik Johnston | 2019-10-22 | 1 | -0/+13 |
| | | | | |||||
* | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-10-22 | 6 | -12/+337 |
|\ \ \ \ | | |_|/ | |/| | | | | | | erikj/refactor_stores | ||||
| * | | | Merge branch 'develop' into uhoreg/e2e_cross-signing_merged | Hubert Chathi | 2019-10-18 | 38 | -903/+1945 |
| |\ \ \ | |||||
| * | | | | use the right function for when we're already in runInteraction | Hubert Chathi | 2019-10-18 | 1 | -4/+4 |
| | | | | | |||||
| * | | | | Merge branch 'develop' into uhoreg/e2e_cross-signing_merged | Hubert Chathi | 2019-09-07 | 4 | -81/+142 |
| |\ \ \ \ | | |_|/ / | |/| | / | | | |/ | | |/| | |||||
| * | | | Merge branch 'develop' into cross-signing_keys | Hubert Chathi | 2019-09-04 | 16 | -377/+958 |
| |\ \ \ | |||||
| * \ \ \ | Merge branch 'uhoreg/e2e_cross-signing_merged' into cross-signing_keys | Hubert Chathi | 2019-08-28 | 14 | -328/+653 |
| |\ \ \ \ | |||||
| | * \ \ \ | Merge branch 'develop' into uhoreg/e2e_cross-signing_merged | Hubert Chathi | 2019-08-28 | 14 | -307/+632 |
| | |\ \ \ \ | |||||
| | * | | | | | Cross-signing [1/4] -- hidden devices (#5759) | Hubert Chathi | 2019-08-12 | 3 | -10/+48 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * allow devices to be marked as "hidden" This is a prerequisite for cross-signing, as it allows us to create other things that live within the device namespace, so they can be used for signatures. | ||||
| * | | | | | | use stream ID generator instead of timestamp | Hubert Chathi | 2019-08-28 | 3 | -19/+20 |
| | | | | | | | |||||
| * | | | | | | apply PR review suggestions | Hubert Chathi | 2019-08-21 | 2 | -10/+11 |
| | | | | | | | |||||
| * | | | | | | make changes from PR review | Hubert Chathi | 2019-08-01 | 2 | -41/+55 |
| | | | | | | | |||||
| * | | | | | | Merge branch 'cross-signing_hidden' into cross-signing_keys | Hubert Chathi | 2019-08-01 | 40 | -452/+566 |
| |\ \ \ \ \ \ | |||||
| | * | | | | | | don't need to return the hidden column any more | Hubert Chathi | 2019-08-01 | 1 | -1/+1 |
| | | | | | | | | |||||
| | * | | | | | | really fix queries to work with Postgres | Hubert Chathi | 2019-07-31 | 1 | -19/+11 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (by going back to not using SQL directly) | ||||
| | * | | | | | | PostgreSQL, Y U no like? | Hubert Chathi | 2019-07-31 | 1 | -3/+4 |
| | | | | | | | | |||||
| | * | | | | | | remove extra SQL query param | Hubert Chathi | 2019-07-31 | 1 | -1/+0 |
| | | | | | | | | |||||
| | * | | | | | | Merge branch 'develop' into cross-signing_hidden | Hubert Chathi | 2019-07-30 | 40 | -432/+554 |
| | |\ \ \ \ \ \ | |||||
| * | | | | | | | | Merge branch 'cross-signing_hidden' into cross-signing_keys | Hubert Chathi | 2019-07-30 | 3 | -21/+17 |
| |\| | | | | | | | |||||
| | * | | | | | | | apply changes from PR review | Hubert Chathi | 2019-07-30 | 3 | -20/+17 |
| | | | | | | | | | |||||
| * | | | | | | | | allow uploading keys for cross-signing | Hubert Chathi | 2019-07-25 | 4 | -3/+274 |
| |/ / / / / / / | |||||
| * | | | | | | | allow devices to be marked as "hidden" | Hubert Chathi | 2019-07-24 | 2 | -16/+65 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a prerequisite for cross-signing, as it allows us to create other things that live within the device namespace, so they can be used for signatures. | ||||
* | | | | | | | | Fix schema management to work with multiple data stores. | Erik Johnston | 2019-10-21 | 1 | -41/+108 |
| | | | | | | | | |||||
* | | | | | | | | Move storage classes into a main "data store". | Erik Johnston | 2019-10-21 | 239 | -4292/+4466 |
| |_|_|_|_|_|/ |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | This is in preparation for having multiple data stores that offer different functionality, e.g. splitting out state or event storage. | ||||
* | | | | | | | Merge pull request #6193 from matrix-org/uhoreg/interpret_device_key_in_storage | Hubert Chathi | 2019-10-11 | 1 | -4/+14 |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | make storage layer in charge of interpreting the device key data | ||||
| * | | | | | | | expand on comment | Hubert Chathi | 2019-10-11 | 1 | -1/+2 |
| | | | | | | | | |||||
| * | | | | | | | make sure we actually return something | Hubert Chathi | 2019-10-10 | 1 | -2/+4 |
| | | | | | | | | |||||
| * | | | | | | | make storage layer in charge of interpreting the device key data | Hubert Chathi | 2019-10-10 | 1 | -2/+9 |
| | | | | | | | | |||||
* | | | | | | | | Fix MAU reaping where reserved users are specified. (#6168) | Neil Johnson | 2019-10-11 | 1 | -39/+62 |
| | | | | | | | | |||||
* | | | | | | | | Merge pull request #6156 from matrix-org/erikj/postgres_any | Erik Johnston | 2019-10-10 | 14 | -109/+189 |
|\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | Use Postgres ANY for selecting many values. | ||||
| * | | | | | | | | Fix SQLite take 2 | Erik Johnston | 2019-10-10 | 1 | -1/+1 |
| | | | | | | | | | |||||
| * | | | | | | | | Fix SQLite | Erik Johnston | 2019-10-10 | 1 | -1/+1 |
| | | | | | | | | | |||||
| * | | | | | | | | Remove add_in_list_sql_clause | Erik Johnston | 2019-10-10 | 4 | -34/+25 |
| | | | | | | | | | |||||
| * | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/postgres_any | Erik Johnston | 2019-10-10 | 1 | -3/+4 |
| |\ \ \ \ \ \ \ \ | |||||
| * | | | | | | | | | Replace IN usage with helper funcs | Erik Johnston | 2019-10-10 | 11 | -97/+138 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Add helper funcs to use postgres ANY | Erik Johnston | 2019-10-10 | 1 | -8/+56 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This means that we can write queries with `col = ANY(?)`, which helps postgres. | ||||
* | | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-10-10 | 1 | -3/+4 |
|\ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / | |/| | | | | | | | | | | | | | | | | | | erikj/disable_sql_bytes | ||||
| * | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/patch_inner | Erik Johnston | 2019-10-10 | 2 | -35/+61 |
| |\| | | | | | | | | |||||
| * | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/patch_inner | Erik Johnston | 2019-10-09 | 23 | -706/+1180 |
| |\ \ \ \ \ \ \ \ \ | | | |/ / / / / / / | | |/| | | | | | | | |||||
| * | | | | | | | | | Patch inlinecallbacks for log contexts | Erik Johnston | 2019-09-27 | 2 | -4/+5 |
| | | | | | | | | | | |||||
* | | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-10-10 | 16 | -725/+1030 |
|\ \ \ \ \ \ \ \ \ \ | | |_|/ / / / / / / | |/| | | | | | | | | | | | | | | | | | | erikj/disable_sql_bytes | ||||
| * | | | | | | | | | Fix races in room stats (and other) updates. (#6187) | Richard van der Hoff | 2019-10-10 | 1 | -9/+29 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Hopefully this will fix the occasional failures we were seeing in the room directory. The problem was that events are not necessarily persisted (and `current_state_delta_stream` updated) in the same order as their stream_id. So for instance current_state_delta 9 might be persisted *before* current_state_delta 8. Then, when the room stats saw stream_id 9, it assumed it had done everything up to 9, and never came back to do stream_id 8. We can solve this easily by only processing up to the stream_id where we know all events have been persisted. | ||||
| * | | | | | | | | | Rewrite the user_filter migration again (#6184) | Richard van der Hoff | 2019-10-10 | 1 | -26/+32 |
| | |/ / / / / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | you can't plausibly ALTER TABLE in sqlite, so we create the new table with the right schema to start with. | ||||
| * | | | | | | | | Merge pull request #6185 from matrix-org/erikj/fix_censored_evnets | Erik Johnston | 2019-10-09 | 2 | -4/+28 |
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | Fix inserting bytes as text in `censor_redactions` | ||||
| * | | | | | | | | | Fix RegistrationStore | Brendan Abolivier | 2019-10-08 | 1 | -1/+1 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Cleanup client_ips | Brendan Abolivier | 2019-10-08 | 1 | -7/+0 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Don't end up with 4 classes in registration | Brendan Abolivier | 2019-10-08 | 1 | -52/+50 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Lint | Brendan Abolivier | 2019-10-07 | 3 | -3/+3 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move roommember's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -108/+114 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move user_directory's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -84/+94 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move state's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -190/+204 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move search's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -25/+31 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move registration's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -95/+103 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move media_repository's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -3/+9 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move devices's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -22/+27 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move deviceinbox's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -15/+22 |
| | | | | | | | | | | |||||
| * | | | | | | | | | Move client_ips's bg updates to a dedicated store | Brendan Abolivier | 2019-10-07 | 1 | -94/+106 |
| | | | | | | | | | | |||||
| * | | | | | | | | | add some logging to the rooms stats updates, to try to track down a flaky ↵ | Richard van der Hoff | 2019-10-07 | 1 | -0/+3 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | test (#6167) | ||||
| * | | | | | | | | | Merge pull request #6175 from matrix-org/babolivier/fix_unique_user_filter_index | Brendan Abolivier | 2019-10-07 | 1 | -2/+2 |
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | Fix unique_user_filter_index schema update | ||||
| | * | | | | | | | | | Fix unique_user_filter_index schema update | Brendan Abolivier | 2019-10-07 | 1 | -2/+2 |
| | | | | | | | | | | | |||||
| * | | | | | | | | | | Merge pull request #6159 from matrix-org/erikj/cache_memberships | Erik Johnston | 2019-10-07 | 1 | -19/+45 |
| |\ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / | |/| | | | | | | | | | Cache room membership lookups in _get_joined_users_from_context | ||||
| | * | | | | | | | | | Fix bug where we didn't pull out event ID | Erik Johnston | 2019-10-07 | 1 | -1/+1 |
| | | | | | | | | | | | |||||
| | * | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-10-03 | 1 | -6/+15 |
| | |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | erikj/cache_memberships | ||||
| | * | | | | | | | | | | Use the right error.... | Erik Johnston | 2019-10-03 | 1 | -1/+1 |
| | | | | | | | | | | | | |||||
| | * | | | | | | | | | | pep8 | Erik Johnston | 2019-10-03 | 1 | -1/+0 |
| | | | | | | | | | | | | |||||
| | * | | | | | | | | | | Fixup names and comments | Erik Johnston | 2019-10-03 | 1 | -6/+7 |
| | | | | | | | | | | | | |||||
| | * | | | | | | | | | | cachedList descriptor doesn't like typing | Erik Johnston | 2019-10-03 | 1 | -2/+2 |
| | | | | | | | | | | | | |||||
| | * | | | | | | | | | | Cache room membership lookups in _get_joined_users_from_context | Erik Johnston | 2019-10-03 | 1 | -19/+45 |
| | | | | | | | | | | | | |||||
| * | | | | | | | | | | | Update `user_filters` table to have a unique index, and non-null columns (#1172) | Alexander Maznev | 2019-10-04 | 1 | -0/+46 |
| | |/ / / / / / / / / | |/| | | | | | | | | | |||||
| * | | | | | | | | | | add some metrics on the federation sender (#6160) | Richard van der Hoff | 2019-10-03 | 1 | -6/+15 |
| |/ / / / / / / / / | |||||
| * | | | | | | | | | Merge pull request #6154 from matrix-org/erikj/fix_appservice_pagination | Erik Johnston | 2019-10-02 | 1 | -18/+18 |
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | Fix appservice room list pagination | ||||
| | * | | | | | | | | | Fix appservice room list pagination | Erik Johnston | 2019-10-02 | 1 | -18/+18 |
| | | | | | | | | | | | |||||
| * | | | | | | | | | | Merge pull request #6153 from matrix-org/erikj/fix_room_list_non_federatable | Erik Johnston | 2019-10-02 | 1 | -0/+3 |
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | Fix not showing non-federatable rooms to remote room list queries | ||||
| | * | | | | | | | | | | Fix not showing non-federatable rooms to remote room list queries | Erik Johnston | 2019-10-02 | 1 | -0/+3 |
| | |/ / / / / / / / / | |||||
| * | | | | | | | | | | Merge pull request #6148 from matrix-org/erikj/find_next_generated | Erik Johnston | 2019-10-02 | 1 | -1/+3 |
| |\ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / | |/| | | | | | | | | | Bound find_next_generated_user_id DB query. | ||||
| | * | | | | | | | | | Bound find_next_generated_user_id DB query. | Erik Johnston | 2019-10-02 | 1 | -1/+3 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We can easily bound the set of user IDs we pull out of the DB, so lets do that. | ||||
| * | | | | | | | | | | Fix public room list pagination. | Erik Johnston | 2019-10-02 | 1 | -17/+36 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We incorrectly used `room_id` as to bound the result set, even though we order by `joined_members, room_id`, leading to incorrect results after pagination. | ||||
| * | | | | | | | | | | Land improved room list based on room stats (#6019) | Erik Johnston | 2019-10-02 | 2 | -77/+167 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Use room_stats and room_state for room directory search | ||||
| * | | | | | | | | | | Fix yields and copy instead of move push rules on room upgrade (#6144) | Andrew Morgan | 2019-10-02 | 1 | -10/+6 |
| |/ / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Copy push rules during a room upgrade from the old room to the new room, instead of deleting them from the old room. For instance, we've defined upgrading of a room multiple times to be possible, and push rules won't be transferred on the second upgrade if they're deleted during the first. Also fix some missing yields that probably broke things quite a bit. | ||||
| * | | | | | | | | | Merge branch 'release-v1.4.0' of github.com:matrix-org/synapse into develop | Erik Johnston | 2019-10-02 | 5 | -18/+142 |
| |\ \ \ \ \ \ \ \ \ | |||||
| * \ \ \ \ \ \ \ \ \ | Merge branch 'erikj/fixup_devices_last_seen_query' of ↵ | Erik Johnston | 2019-10-01 | 3 | -7/+54 |
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | github.com:matrix-org/synapse into develop | ||||
| * | | | | | | | | | | | Drop unused tables (#6115) | Richard van der Hoff | 2019-09-30 | 1 | -0/+20 |
| | |_|_|/ / / / / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | These tables are unused since #5893 (as amended by #6047), so we can now drop them. Fixes #6048. | ||||
* | | | | | | | | | | | Do the update as a background index | Erik Johnston | 2019-10-09 | 2 | -9/+51 |
| | | | | | | | | | | | |||||
* | | | | | | | | | | | Disable bytes usage with postgres | Erik Johnston | 2019-10-08 | 3 | -3/+10 |
| |_|_|/ / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | More often than not passing bytes to `txn.execute` is a bug (where we meant to pass a string) that just happens to work if `BYTEA_OUTPUT` is set to `ESCAPE`. However, this is a bit of a footgun so we want to instead error when this happens, and force using `bytearray` if we actually want to use bytes. | ||||
* | | | | | | | | | | Fix existing hex encoded json values in DB | Erik Johnston | 2019-10-08 | 1 | -0/+26 |
| | | | | | | | | | | |||||
* | | | | | | | | | | Fix inserting bytes as text | Erik Johnston | 2019-10-08 | 1 | -4/+2 |
| |_|/ / / / / / / |/| | | | | | | | | |||||
* | | | | | | | | | Merge pull request #6146 from matrix-org/erikj/fix_destination_retry_timings | Erik Johnston | 2019-10-02 | 1 | -0/+18 |
|\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | Fix errors storing large retry intervals. | ||||
| * | | | | | | | | | Fix errors storing large retry intervals. | Erik Johnston | 2019-10-02 | 1 | -0/+18 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We have set the max retry interval to a value larger than a postgres or sqlite int can hold, which caused exceptions when updating the destinations table. To fix postgres we need to change the column to a bigint, and for sqlite we lower the max interval to 2**62 (which is still incredibly long). | ||||
* | | | | | | | | | | Merge pull request #6145 from matrix-org/erikj/fix_censored_redactions | Erik Johnston | 2019-10-02 | 1 | -0/+14 |
|\ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / |/| | | | | | | | | | Fix fetching censored redactions from DB | ||||
| * | | | | | | | | | Fix fetching censored redactions from DB | Erik Johnston | 2019-10-02 | 1 | -0/+14 |
| | |/ / / / / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fetching a censored redactions caused an exception due to the code expecting redactions to have a `redact` key, which redacted redactions don't have. | ||||
* | | | | | | | | | Use `received_ts` to find uncensored redacted events | Erik Johnston | 2019-10-01 | 1 | -14/+7 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Joining against `events` and ordering by `stream_ordering` is inefficient as it forced scanning the entirety of the redactions table. This isn't the case if we use `redactions.received_ts` column as we can then use an index. | ||||
* | | | | | | | | | Add received_ts column to redactions. | Erik Johnston | 2019-10-01 | 3 | -9/+92 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This will allow us to efficiently search for uncensored redactions in the DB before a given time. | ||||
* | | | | | | | | | Don't repeatedly attempt to censor events we don't have. | Erik Johnston | 2019-10-01 | 1 | -1/+17 |
|/ / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Currently we don't set `have_censored` column if we don't have the target event of a redaction, which means we repeatedly attempt to censor the same non-existant event. When we persist non-redacted events we unset the `have_censored` column for any redactions that target said event. | ||||
* / / / / / / / | Fix `devices_last_seen` background update. | Erik Johnston | 2019-09-30 | 3 | -7/+54 |
|/ / / / / / / | | | | | | | | | | | | | | | | | | | | | | Fixes #6134. | ||||
* | | | | | | | Fix dummy event insertion consent bug (#6053) | Neil Johnson | 2019-09-26 | 1 | -3/+15 |
| | | | | | | | | | | | | | | | | | | | | | Fixes #5905 | ||||
* | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-09-25 | 4 | -9/+94 |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | erikj/cleanup_user_ips_2 | ||||
| * \ \ \ \ \ \ | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-09-25 | 3 | -8/+93 |
| |\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | erikj/cleanup_user_ips | ||||
| | * \ \ \ \ \ \ | Merge pull request #6092 from ↵ | Brendan Abolivier | 2019-09-24 | 2 | -6/+6 |
| | |\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | matrix-org/babolivier/background_update_deactivated_return Fix the return value in the users_set_deactivated_flag background job | ||||
| | | * | | | | | | | Incorporate review | Brendan Abolivier | 2019-09-24 | 1 | -3/+3 |
| | | | | | | | | | | |||||
| | | * | | | | | | | Fix logging | Brendan Abolivier | 2019-09-24 | 1 | -1/+1 |
| | | | | | | | | | | |||||
| | | * | | | | | | | Typo | Brendan Abolivier | 2019-09-23 | 1 | -1/+1 |
| | | | | | | | | | | |||||
| | | * | | | | | | | Fix the return value in the users_set_deactivated_flag background job | Brendan Abolivier | 2019-09-23 | 1 | -4/+4 |
| | | | | | | | | | | |||||
| | * | | | | | | | | Merge remote-tracking branch 'origin/develop' into rav/saml_mapping_work | Richard van der Hoff | 2019-09-24 | 1 | -1/+1 |
| | |\ \ \ \ \ \ \ \ | |||||
| | | * | | | | | | | | remove unused parameter to get_user_id_by_threepid (#6099) | Richard van der Hoff | 2019-09-24 | 1 | -1/+1 |
| | | |/ / / / / / / | | | | | | | | | | | | | | | | | | | | | Added in #5377, apparently in error | ||||
| | * | | | | | | | | Merge remote-tracking branch 'origin/develop' into rav/saml_mapping_work | Richard van der Hoff | 2019-09-24 | 2 | -28/+45 |
| | |\| | | | | | | | |||||
| | | * | | | | | | | Implement MSC2290 (#6043) | Andrew Morgan | 2019-09-23 | 1 | -1/+21 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Implements MSC2290. This PR adds two new endpoints, /unstable/account/3pid/add and /unstable/account/3pid/bind. Depending on the progress of that MSC the unstable prefix may go away. This PR also removes the blacklist on some 3PID tests which occurs in #6042, as the corresponding Sytest PR changes them to use the new endpoints. Finally, it also modifies the account deactivation code such that it doesn't just try to deactivate 3PIDs that were bound to the user's account, but any 3PIDs that were bound through the homeserver on that user's account. | ||||
| | * | | | | | | | | Merge branch 'develop' into rav/saml_mapping_work | Richard van der Hoff | 2019-09-19 | 28 | -552/+1649 |
| | |\ \ \ \ \ \ \ \ | |||||
| | * | | | | | | | | | Record mappings from saml users in an external table | Richard van der Hoff | 2019-09-13 | 2 | -0/+65 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We want to assign unique mxids to saml users based on an incrementing suffix. For that to work, we need to record the allocated mxid in a separate table. | ||||
| * | | | | | | | | | | Use if `is not None` | Erik Johnston | 2019-09-25 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> | ||||
* | | | | | | | | | | | Review comments | Erik Johnston | 2019-09-25 | 2 | -5/+2 |
| | | | | | | | | | | | |||||
* | | | | | | | | | | | Prune rows in user_ips older than configured period | Erik Johnston | 2019-09-24 | 1 | -8/+54 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Defaults to pruning everything older than 28d. | ||||
* | | | | | | | | | | | Add has_completed_background_update | Erik Johnston | 2019-09-24 | 1 | -1/+24 |
|/ / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This allows checking if a specific background update has completed. | ||||
* | | | | | | | | | | Query devices table for last seen info. | Erik Johnston | 2019-09-23 | 1 | -49/+8 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a) simpler than querying user_ips directly and b) means we can purge older entries from user_ips without losing the required info. The storage functions now no longer return the access_token, since it was unused. | ||||
* | | | | | | | | | | Add BG update to populate devices last seen info | Erik Johnston | 2019-09-23 | 2 | -0/+55 |
| | | | | | | | | | | |||||
* | | | | | | | | | | Add last seen info to devices table. | Erik Johnston | 2019-09-23 | 2 | -0/+36 |
| |_|/ / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This allows us to purge old user_ips entries without having to preserve the latest last seen info for active devices. | ||||
* | | | | | | | | | Allow HS to send emails when adding an email to the HS (#6042) | Andrew Morgan | 2019-09-20 | 1 | -7/+24 |
| | | | | | | | | | |||||
* | | | | | | | | | Undo the deletion of some tables (#6047) | Richard van der Hoff | 2019-09-19 | 1 | -20/+0 |
| |/ / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a partial revert of #5893. The problem is that if we drop these tables in the same release as removing the code that writes to them, it prevents users users from being able to roll back to a previous release. So let's leave the tables in place for now, and remember to drop them in a subsequent release. (Note that these tables haven't been *read* for *years*, so any missing rows resulting from a temporary upgrade to vNext won't cause a problem.) | ||||
* | | | | | | | | Add 'failure_ts' column to 'destinations' table (#6016) | Richard van der Hoff | 2019-09-17 | 2 | -7/+41 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Track the time that a server started failing at, for general analysis purposes. | ||||
* | | | | | | | | Clean up some code in the retry logic (#6017) | Richard van der Hoff | 2019-09-11 | 1 | -20/+0 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * remove some unused code * make things which were constants into constants for efficiency and clarity | ||||
* | | | | | | | | Merge pull request #6004 from matrix-org/jaywink/autojoin-create-real-users | Jason Robinson | 2019-09-09 | 1 | -0/+37 |
|\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | Only count real users when checking for auto-creation of auto-join room | ||||
| * | | | | | | | | Fix code style, again | Jason Robinson | 2019-09-09 | 1 | -3/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Jason Robinson <jasonr@matrix.org> | ||||
| * | | | | | | | | Simplify count_real_users SQL to only count user_type is null rows | Jason Robinson | 2019-09-09 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Jason Robinson <jasonr@matrix.org> | ||||
| * | | | | | | | | Simplify is_real_user_txn check to trust user_type is null if real user | Jason Robinson | 2019-09-09 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Jason Robinson <jasonr@matrix.org> | ||||
| * | | | | | | | | Auto-fix a few code style issues | Jason Robinson | 2019-09-09 | 1 | -4/+4 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Jason Robinson <jasonr@matrix.org> | ||||
| * | | | | | | | | Only count real users when checking for auto-creation of auto-join room | Jason Robinson | 2019-09-09 | 1 | -0/+39 |
| | |_|_|_|_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previously if the first registered user was a "support" or "bot" user, when the first real user registers, the auto-join rooms were not created. Fix to exclude non-real (ie users with a special user type) users when counting how many users there are to determine whether we should auto-create a room. Signed-off-by: Jason Robinson <jasonr@matrix.org> | ||||
* | | | | | | | | Merge pull request #5934 from matrix-org/erikj/censor_redactions | Erik Johnston | 2019-09-09 | 2 | -1/+119 |
|\ \ \ \ \ \ \ \ | |/ / / / / / / |/| | | | | | | | Censor redactions in DB after a month | ||||
| * | | | | | | | Fix comments | Erik Johnston | 2019-09-09 | 1 | -2/+3 |
| | | | | | | | | |||||
| * | | | | | | | Use better names in SQL | Erik Johnston | 2019-09-09 | 1 | -5/+8 |
| | | | | | | | | |||||
| * | | | | | | | Fixup comment | Erik Johnston | 2019-09-09 | 1 | -4/+12 |
| | | | | | | | | |||||
| * | | | | | | | Don't start looping call unless enabled | Erik Johnston | 2019-09-09 | 1 | -1/+2 |
| | | | | | | | | |||||
| * | | | | | | | Handle setting retention period to 0 | Erik Johnston | 2019-09-09 | 1 | -1/+1 |
| | | | | | | | | |||||
| * | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-09-05 | 16 | -378/+959 |
| |\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | erikj/censor_redactions | ||||
| * | | | | | | | | Make redaction retention period configurable | Erik Johnston | 2019-09-05 | 1 | -2/+4 |
| | | | | | | | | | |||||
| * | | | | | | | | Censor redactions in DB after a month | Erik Johnston | 2019-08-30 | 2 | -1/+104 |
| | |_|_|_|_|/ / | |/| | | | | | | |||||
* | | | | | | | | Servers-known-about statistic (#5981) | Amber Brown | 2019-09-07 | 1 | -0/+59 |
| | | | | | | | | |||||
* | | | | | | | | Merge pull request #5998 from matrix-org/erikj/fixup_federate_flag | Erik Johnston | 2019-09-06 | 1 | -1/+3 |
|\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | Correctly handle non-bool m.federate flag | ||||
| * | | | | | | | | Correctly handle non-bool m.federate flag | Erik Johnston | 2019-09-06 | 1 | -1/+3 |
| | |/ / / / / / | |/| | | | | | | |||||
* | | | | | | | | Move delete_threepid_session into RegistrationWorkerStore | Andrew Morgan | 2019-09-06 | 1 | -25/+25 |
| | | | | | | | | |||||
* | | | | | | | | Move get_threepid_validation_session into RegistrationWorkerStore | Andrew Morgan | 2019-09-06 | 1 | -54/+54 |
|/ / / / / / / | |||||
* | | | | | / | Opentracing context cannot be none | Jorik Schellekens | 2019-09-05 | 1 | -1/+1 |
| |_|_|_|_|/ |/| | | | | | |||||
* | | | | | | Fix and refactor room and user stats (#5971) | Erik Johnston | 2019-09-04 | 5 | -345/+904 |
| | | | | | | | | | | | | | | | | | | Previously the stats were not being correctly populated. | ||||
* | | | | | | Remove double return statements (#5962) | Andrew Morgan | 2019-09-03 | 3 | -4/+0 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Remove all the "double return" statements which were a result of us removing all the instances of ``` defer.returnValue(...) return ``` statements when we switched to python3 fully. | ||||
* | | | | | | Opentrace device lists (#5853) | Jorik Schellekens | 2019-09-03 | 2 | -0/+26 |
| | | | | | | | | | | | | | | | | | | Trace device list changes. | ||||
* | | | | | | Remove unnecessary parentheses around return statements (#5931) | Andrew Morgan | 2019-08-30 | 10 | -28/+28 |
|/ / / / / | | | | | | | | | | | | | | | | | | | | | Python will return a tuple whether there are parentheses around the returned values or not. I'm just sick of my editor complaining about this all over the place :) | ||||
* | | | | | Merge pull request #5902 from matrix-org/hs/exempt-support-users-from-consent | Will Hunt | 2019-08-28 | 1 | -0/+1 |
|\ \ \ \ \ | | | | | | | | | | | | | Exempt support users from consent | ||||
| * | | | | | Ignore consent for support users | Half-Shot | 2019-08-23 | 1 | -0/+1 |
| | | | | | | |||||
* | | | | | | Fix a cache-invalidation bug for worker-based deployments (#5920) | Richard van der Hoff | 2019-08-28 | 1 | -8/+16 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some of the caches on worker processes were not being correctly invalidated when a room's state was changed in a way that did not affect the membership list of the room. We need to make sure we send out cache invalidations even when no memberships are changing. | ||||
* | | | | | | Allow schema deltas to be engine-specific (#5911) | reivilibre | 2019-08-27 | 1 | -5/+19 |
|\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Allow schema deltas to be engine-specific Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> * Newsfile Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> * Code style (Black) Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> | ||||
| * | | | | | | Code style (Black) | Olivier Wilkinson (reivilibre) | 2019-08-27 | 1 | -3/+1 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> | ||||
| * | | | | | | Allow schema deltas to be engine-specific | Olivier Wilkinson (reivilibre) | 2019-08-27 | 1 | -5/+21 |
| |/ / / / / | | | | | | | | | | | | | | | | | | | Signed-off-by: Olivier Wilkinson (reivilibre) <olivier@librepush.net> | ||||
* / / / / / | Add Admin API capability to set adminship of a user (#5878) | reivilibre | 2019-08-27 | 1 | -0/+23 |
|/ / / / / | | | | | | | | | | | Admin API: Set adminship of a user | ||||
* | | | | | Propagate opentracing contexts through EDUs (#5852) | Jorik Schellekens | 2019-08-22 | 2 | -6/+53 |
| | | | | | | | | | | | | | | | | | | | | | | | | | Propagate opentracing contexts through EDUs Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> | ||||
* | | | | | Opentrace e2e keys (#5855) | Jorik Schellekens | 2019-08-22 | 2 | -3/+49 |
| | | | | | | | | | | | | | | | Add opentracing tags and logs for e2e keys | ||||
* | | | | | Add missing index on users_in_public_rooms. (#5894) | Richard van der Hoff | 2019-08-22 | 1 | -0/+17 |
| | | | | | |||||
* | | | | | Servlet to purge old rooms (#5845) | Richard van der Hoff | 2019-08-22 | 1 | -0/+137 |
| | | | | | |||||
* | | | | | Drop some unused tables. (#5893) | Richard van der Hoff | 2019-08-21 | 3 | -47/+22 |
| | | | | | | | | | | | | | | | These tables are never used, so we may as well drop them. | ||||
* | | | | | Merge pull request #5857 from matrix-org/uhoreg/fix_e2e_room_keys_index | Hubert Chathi | 2019-08-16 | 2 | -1/+19 |
|\ \ \ \ \ | |/ / / / |/| | | | | add the version field to the index for e2e_room_keys | ||||
| * | | | | update set_e2e_room_key to agree with fixed index | Hubert Chathi | 2019-08-14 | 1 | -1/+1 |
| | | | | | |||||
| * | | | | add the version field to the index for e2e_room_keys | Hubert Chathi | 2019-08-14 | 1 | -0/+18 |
| | |_|/ | |/| | | |||||
* | | | | Merge pull request #5809 from matrix-org/erikj/handle_pusher_stop | Erik Johnston | 2019-08-13 | 1 | -8/+22 |
|\ \ \ \ | | | | | | | | | | | Handle pusher being deleted during processing. | ||||
| * | | | | Clarify docstring | Erik Johnston | 2019-08-13 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> | ||||
| * | | | | Handle pusher being deleted during processing. | Erik Johnston | 2019-08-01 | 1 | -8/+22 |
| | |_|/ | |/| | | | | | | | | | | | | | | Instead of throwing a StoreError lets break out of processing loop and mark the pusher as stopped. | ||||
* | | | | Merge pull request #5826 from matrix-org/erikj/reduce_event_pauses | Erik Johnston | 2019-08-13 | 1 | -128/+142 |
|\ \ \ \ | | | | | | | | | | | Don't unnecessarily block notifying of new events. | ||||
| * | | | | Don't unnecessarily block notifying of new events. | Erik Johnston | 2019-08-06 | 1 | -128/+142 |
| | |/ / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When persisting events we calculate new stream orderings up front. Before we notify about an event all events with lower stream orderings must have finished being persisted. This PR moves the assignment of stream ordering till *after* calculated the new current state and split the batch of events into separate chunks for persistence. This means that if it takes a long time to calculate new current state then it will not block events in other rooms being notified about. This should help reduce some global pauses in the events stream which can last for tens of seconds (if not longer), caused by some particularly expensive state resolutions. | ||||
* | | | | Merge pull request #5788 from matrix-org/rav/metaredactions | Richard van der Hoff | 2019-08-12 | 1 | -101/+112 |
|\ \ \ \ | |/ / / |/| | | | Fix handling of redactions of redactions | ||||
| * | | | Handle loops in redaction events | Richard van der Hoff | 2019-07-30 | 1 | -60/+36 |
| | | | | |||||
| * | | | recursively fetch redactions | Richard van der Hoff | 2019-07-30 | 1 | -32/+36 |
| | | | | |||||
| * | | | split _get_events_from_db out of _enqueue_events | Richard van der Hoff | 2019-07-29 | 1 | -32/+51 |
| | | | | |||||
| * | | | Return dicts from _fetch_event_list | Richard van der Hoff | 2019-07-29 | 1 | -15/+27 |
| | | | | |||||
* | | | | Have ClientReaderSlavedStore inherit RegistrationStore (#5806) | Andrew Morgan | 2019-08-01 | 1 | -21/+21 |
| |/ / |/| | | | | | Fixes #5803 | ||||
* | | | Don't recreate column | Erik Johnston | 2019-07-30 | 2 | -1/+22 |
| | | | |||||
* | | | Fix current_state_events membership background update. | Erik Johnston | 2019-07-30 | 2 | -1/+1 |
|/ / | | | | | | | | | | | Turns out not all rooms are in `rooms`, so lets fetch the room list from `current_state_events`. We move the delta file to force it to be run again. | ||||
* | | Merge pull request #5774 from matrix-org/erikj/fix_rejected_membership | Erik Johnston | 2019-07-29 | 1 | -0/+6 |
|\ \ | | | | | | | Fix room summary when rejected events are in state | ||||
| * | | Fix room summary when rejected events are in state | Erik Johnston | 2019-07-26 | 1 | -0/+6 |
| | | | | | | | | | | | | | | | | | | Annoyingly, `current_state_events` table can include rejected events, in which case the membership column will be null. To work around this lets just always filter out null membership for now. | ||||
* | | | Merge pull request #5752 from matrix-org/erikj/forgotten_user | Erik Johnston | 2019-07-29 | 2 | -35/+123 |
|\ \ \ | | | | | | | | | Remove some more joins on room_memberships | ||||
| * | | | Expand comment | Erik Johnston | 2019-07-29 | 1 | -0/+5 |
| | | | | |||||
| * | | | Remove lost comment | Erik Johnston | 2019-07-29 | 1 | -7/+0 |
| |/ / | |||||
| * | | Remove join when calculating room summaries. | Erik Johnston | 2019-07-24 | 1 | -13/+21 |
| | | | |||||
| * | | Remove join on room_memberships when fetching rooms for user. | Erik Johnston | 2019-07-24 | 1 | -22/+36 |
| | | | |||||
| * | | Add function to get all forgotten rooms for user | Erik Johnston | 2019-07-24 | 2 | -0/+68 |
| | | | | | | | | | | | | | | | | | | This will allow us to efficiently filter out rooms that have been forgotten in other queries without having to join against the `room_memberships` table. | ||||
* | | | Fix current_state bg update to work on old SQLite | Erik Johnston | 2019-07-29 | 1 | -2/+2 |
| | | | |||||
* | | | Merge branch 'master' into develop | Richard van der Hoff | 2019-07-26 | 1 | -0/+4 |
|\ \ \ | |||||
| * | | | Fix DoS when there is a cycle in redaction events | Richard van der Hoff | 2019-07-26 | 1 | -0/+4 |
| | | | | | | | | | | | | | | | | | | | | Make sure that synapse doesn't explode when a redaction redacts itself, or there is a larger cycle. | ||||
* | | | | Merge pull request #5767 from matrix-org/rav/redactions/cross_room_id | Richard van der Hoff | 2019-07-25 | 1 | -0/+27 |
|\| | | | | | | | | | | | log when a redaction attempts to redact an event in a different room | ||||
| * | | | log when a redaction attempts to redact an event in a different room | Richard van der Hoff | 2019-07-25 | 1 | -0/+27 |
| | | | | |||||
* | | | | Stop trying to fetch events with event_id=None. (#5753) | Richard van der Hoff | 2019-07-24 | 2 | -10/+15 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | `None` is not a valid event id, so queuing up a database fetch for it seems like a silly thing to do. I considered making `get_event` return `None` if `event_id is None`, but then its interaction with `allow_none` seemed uninituitive, and strong typing ftw. | ||||
* | | | | Replace returnValue with return (#5736) | Amber Brown | 2019-07-23 | 37 | -362/+321 |
| |/ / |/| | | |||||
* | | | Speed up current state background update. | Erik Johnston | 2019-07-23 | 1 | -18/+30 |
| | | | | | | | | | | | | | | | Turns out that storing huge JSON arrays in the progress JSON isn't something that postgres particularly likes. | ||||
* | | | Add `user_type` to returned fields in admin API user list endpoints | Jason Robinson | 2019-07-22 | 1 | -3/+3 |
| |/ |/| | | | | | | | | | | | Mostly user type will be empty (normal user) but there is also the "support" user type. Signed-off-by: Jason Robinson <jasonr@matrix.org> | ||||
* | | Merge pull request #5720 from matrix-org/erikj/transactions_upsert | Erik Johnston | 2019-07-19 | 1 | -0/+20 |
|\ \ | | | | | | | Use upsert when updating destination retry interval | ||||
| * | | Use upsert when updating destination retry interval | Erik Johnston | 2019-07-19 | 1 | -0/+20 |
| |/ | |||||
* | | Merge pull request #5713 from matrix-org/erikj/use_cache_for_filtered_state | Erik Johnston | 2019-07-19 | 1 | -2/+6 |
|\ \ | | | | | | | Delegate to cached version when using get_filtered_current_state_ids | ||||
| * | | Delegate to cached version when using get_filtered_current_state_ids | Erik Johnston | 2019-07-18 | 1 | -2/+6 |
| |/ | | | | | | | In the case where it gets called with `StateFilter.all()` | ||||
* | | Merge pull request #5706 from matrix-org/erikj/add_memberships_to_current_state | Erik Johnston | 2019-07-19 | 7 | -41/+194 |
|\ \ | |/ |/| | Add membership column to current_state_events table | ||||
| * | LoggingTransaction accepts None for callback lists. | Erik Johnston | 2019-07-19 | 3 | -6/+16 |
| | | | | | | | | | | Its a bit disingenuousto give LoggingTransaction lists to append callbacks to if we're not going to run the callbacks. | ||||
| * | Update comment for new column | Erik Johnston | 2019-07-19 | 1 | -0/+3 |
| | | |||||
| * | Use the current_state_events.membership column | Erik Johnston | 2019-07-18 | 1 | -17/+37 |
| | | |||||
| * | Track if current_state_events.membership is up to date | Erik Johnston | 2019-07-18 | 1 | -0/+45 |
| | | |||||
| * | Add background update for current_state_events.membership column | Erik Johnston | 2019-07-18 | 2 | -0/+54 |
| | | |||||
| * | Add membership column to current_state_events table. | Erik Johnston | 2019-07-18 | 5 | -20/+41 |
| | | | | | | | | | | It turns out that doing a join is surprisingly expensive for the DB to do when room_membership table is larger than the disk cache. | ||||
* | | Ignore redactions of m.room.create events (#5701) | Richard van der Hoff | 2019-07-17 | 1 | -0/+12 |
| | | |||||
* | | More refactoring in `get_events_as_list` (#5707) | Richard van der Hoff | 2019-07-17 | 1 | -27/+37 |
| | | | | | | | | | | | | | | | | We can now use `_get_events_from_cache_or_db` rather than going right back to the database, which means that (a) we can benefit from caching, and (b) it opens the way forward to more extensive checks on the original event. We now always require the original event to exist before we will serve up a redaction. | ||||
* | | Fix redaction authentication (#5700) | Richard van der Hoff | 2019-07-17 | 1 | -85/+129 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Ensures that redactions are correctly authenticated for recent room versions. There are a few things going on here: * `_fetch_event_rows` is updated to return a dict rather than a list of rows. * Rather than returning multiple copies of an event which was redacted multiple times, it returns the redactions as a list within the dict. * It also returns the actual rejection reason, rather than merely the fact that it was rejected, so that we don't have to query the table again in `_get_event_from_row`. * The redaction handling is factored out of `_get_event_from_row`, and now checks if any of the redactions are valid. | ||||
* | | Refactor `get_events_as_list` (#5699) | Richard van der Hoff | 2019-07-17 | 1 | -48/+74 |
|/ | | | | | | | | | | | A couple of changes here: * get rid of a redundant `allow_rejected` condition - we should already have filtered out any rejected events before we get to that point in the code, and the redundancy is confusing. Instead, let's stick in an assertion just to make double-sure we aren't leaking rejected events by mistake. * factor out a `_get_events_from_cache_or_db` method, which is going to be important for a forthcoming fix to redactions. | ||||
* | Merge pull request #5589 from matrix-org/erikj/admin_exfiltrate_data | Erik Johnston | 2019-07-15 | 2 | -6/+28 |
|\ | | | | | Add basic function to get all data for a user out of synapse | ||||
| * | Fixup docstrings | Erik Johnston | 2019-07-12 | 1 | -7/+5 |
| | | |||||
| * | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2019-07-05 | 6 | -39/+25 |
| |\ | | | | | | | | | | erikj/admin_exfiltrate_data | ||||
| * | | Assume key existence. Update docstrings | Erik Johnston | 2019-07-05 | 1 | -6/+10 |
| | | | |||||
| * | | Add basic function to get all data for a user out of synapse | Erik Johnston | 2019-07-02 | 1 | -0/+20 |
| | | | |||||
* | | | Implement access token expiry (#5660) | Richard van der Hoff | 2019-07-12 | 2 | -5/+32 |
| | | | | | | | | | | | | Record how long an access token is valid for, and raise a soft-logout once it expires. | ||||
* | | | fix typo: backgroud -> background | Andrew Morgan | 2019-07-12 | 1 | -4/+4 |
| | | | |||||
* | | | small typo fix (#5655) | Andrew Morgan | 2019-07-11 | 1 | -1/+1 |
| | | | |||||
* | | | Remove access-token support from RegistrationStore.register (#5642) | Richard van der Hoff | 2019-07-10 | 1 | -20/+4 |
| | | | | | | | | | | | | | | | The 'token' param is no longer used anywhere except the tests, so let's kill that off too. | ||||
* | | | Include the original event in /relations (#5626) | Andrew Morgan | 2019-07-09 | 1 | -1/+1 |
| | | | | | | | | | When asking for the relations of an event, include the original event in the response. This will mostly be used for efficiently showing edit history, but could be useful in other circumstances. | ||||
* | | | Remove support for invite_3pid_guest. (#5625) | Richard van der Hoff | 2019-07-05 | 1 | -47/+0 |
| |/ |/| | | | | | | | | | | | | | | | This has never been documented, and I'm not sure it's ever been used outside sytest. It's quite a lot of poorly-maintained code, so I'd like to get rid of it. For now I haven't removed the database table; I suggest we leave that for a future clearout. | ||||
* | | remove dead transaction persist code (#5622) | Richard van der Hoff | 2019-07-05 | 1 | -28/+0 |
| | | | | | | | | this hasn't done anything for years | ||||
* | | Move logging utilities out of the side drawer of util/ and into logging/ (#5606) | Amber Brown | 2019-07-04 | 4 | -7/+7 |
| | | |||||
* | | Fix a number of "Starting txn from sentinel context" warnings (#5605) | Richard van der Hoff | 2019-07-03 | 2 | -4/+18 |
|/ | | | | Fixes #5602, #5603 | ||||
* | Review comments | Erik Johnston | 2019-06-27 | 1 | -3/+1 |
| | |||||
* | Use batch_iter and correct docstring | Erik Johnston | 2019-06-26 | 1 | -15/+12 |
| | |||||
* | Rename get_users_whose_devices_changed | Erik Johnston | 2019-06-26 | 1 | -3/+3 |
| | |||||
* | Refactor get_user_ids_changed to pull less from DB | Erik Johnston | 2019-06-26 | 1 | -10/+41 |
| | | | | | | | | | | | When a client asks for users whose devices have changed since a token we used to pull *all* users from the database since the token, which could easily be thousands of rows for old tokens. This PR changes this to only check for changes for users the client is actually interested in. Fixes #5553 | ||||
* | Merge pull request #5499 from matrix-org/rav/cleanup_metrics | Richard van der Hoff | 2019-06-24 | 1 | -22/+13 |
|\ | | | | | Cleanups and sanity-checking in cpu and db metrics | ||||
| * | black | Richard van der Hoff | 2019-06-24 | 1 | -6/+2 |
| | | |||||
| * | Merge branch 'develop' into rav/cleanup_metrics | Richard van der Hoff | 2019-06-24 | 33 | -254/+306 |
| |\ |