Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Optionally measure size of cache by sum of length of values | Erik Johnston | 2017-01-13 | 2 | -2/+3 |
| | |||||
* | Merge pull request #1793 from matrix-org/erikj/change_device_inbox_index | Erik Johnston | 2017-01-13 | 3 | -3/+55 |
|\ | | | | | Change device_inbox stream index to include user | ||||
| * | Add comment | Erik Johnston | 2017-01-13 | 1 | -0/+1 |
| | | |||||
| * | Explicitly close the cursor | Erik Johnston | 2017-01-10 | 1 | -0/+1 |
| | | |||||
| * | Don't disable autocommit | Erik Johnston | 2017-01-10 | 1 | -8/+4 |
| | | |||||
| * | Change device_inbox stream index to include user | Erik Johnston | 2017-01-10 | 3 | -3/+57 |
| | | | | | | | | | | This makes fetching the nost recently changed users much tricker, and brings it in line with e.g. presence_stream indices. | ||||
* | | Limit number of entries to prefill from cache | Erik Johnston | 2017-01-10 | 2 | -3/+6 |
|/ | | | | | | | | | Some tables, like device_inbox, take a long time to query at startup for the stream change cache prefills. This is likely because they are slower growing streams and so are more fragmented on disk. For now, lets pull fewer entries out to make startup quicker. In future, we should add a better index to make it even faster. | ||||
* | Merge branch 'release-v0.18.6' into develop | Matthew Hodgson | 2017-01-05 | 2 | -3/+3 |
|\ | |||||
| * | fix annoying typos | Matthew Hodgson | 2017-01-05 | 2 | -3/+3 |
| | | |||||
* | | Merge branch 'release-v0.18.6' into develop | Matthew Hodgson | 2017-01-05 | 1 | -0/+2 |
|\| | |||||
| * | More logging for the linearizer and for get_events | Mark Haines | 2017-01-05 | 1 | -0/+2 |
| | | |||||
* | | Add /account/3pid/delete endpoint | David Baker | 2016-12-20 | 1 | -0/+11 |
|/ | | | | Also fix a typo in a comment | ||||
* | Add some logging for syncing to_device events | Richard van der Hoff | 2016-12-15 | 1 | -1/+2 |
| | | | | | Attempt to track down the loss of to_device events (https://github.com/vector-im/riot-web/issues/2711 etc). | ||||
* | Fixup membership query | Erik Johnston | 2016-12-14 | 1 | -2/+2 |
| | |||||
* | Merge pull request #1697 from matrix-org/erikj/fix_bg_member | Erik Johnston | 2016-12-12 | 1 | -1/+1 |
|\ | | | | | Fix background update that prematurely stopped | ||||
| * | Fix background update that prematurely stopped | Erik Johnston | 2016-12-12 | 1 | -1/+1 |
| | | |||||
* | | Merge pull request #1676 from matrix-org/erikj/room_list | Erik Johnston | 2016-12-12 | 2 | -20/+196 |
|\ \ | |/ |/| | Add new API appservice specific public room list | ||||
| * | Add cache to get_public_room_ids_at_stream_id | Erik Johnston | 2016-12-12 | 1 | -0/+2 |
| | | |||||
| * | Notify replication. Use correct network_id | Erik Johnston | 2016-12-12 | 1 | -1/+3 |
| | | |||||
| * | Docstring | Erik Johnston | 2016-12-12 | 1 | -0/+12 |
| | | |||||
| * | Comments | Erik Johnston | 2016-12-07 | 1 | -0/+2 |
| | | |||||
| * | Add new API appservice specific public room list | Erik Johnston | 2016-12-06 | 2 | -20/+178 |
| | | |||||
* | | Merge pull request #1680 from matrix-org/erikj/joined_rooms | Erik Johnston | 2016-12-09 | 4 | -3/+123 |
|\ \ | | | | | | | Add new room membership APIs | ||||
| * | | Add /room/<room_id>/joined_members API | Erik Johnston | 2016-12-08 | 1 | -3/+13 |
| | | | | | | | | | | | | | | | | | | This returns the currently joined members in the room with their display names and avatar urls. This is more efficient than /members for large rooms where you don't need the full events. | ||||
| * | | Add profile data to the room_membership table for joins | Erik Johnston | 2016-12-08 | 4 | -0/+110 |
| |/ | |||||
* / | Fix result of insert_receipt | Richard van der Hoff | 2016-12-08 | 1 | -1/+1 |
|/ | | | | This should fix the absence of notifications when new receipts arrive. | ||||
* | Rip out more refresh_token code | Richard van der Hoff | 2016-11-30 | 2 | -67/+0 |
| | | | | | | | | We might as well treat all refresh_tokens as invalid. Just return a 403 from /tokenrefresh, so that we don't have a load of dead, untestable code hanging around. Still TODO: removing the table from the schema. | ||||
* | Don't send old events as federation | Erik Johnston | 2016-11-24 | 1 | -1/+1 |
| | |||||
* | Comment | Erik Johnston | 2016-11-23 | 1 | -1/+3 |
| | |||||
* | More efficient notif count queries | Erik Johnston | 2016-11-23 | 2 | -8/+48 |
| | |||||
* | Merge pull request #1635 from matrix-org/erikj/split_out_fed_txn | Erik Johnston | 2016-11-23 | 8 | -29/+156 |
|\ | | | | | Split out federation transaction sending to a worker | ||||
| * | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-11-23 | 1 | -0/+8 |
| |\ | | | | | | | | | | erikj/split_out_fed_txn | ||||
| * | | Fix tests and flake8 | Erik Johnston | 2016-11-22 | 1 | -1/+0 |
| | | | |||||
| * | | Invalidate retry cache in both directions | Erik Johnston | 2016-11-22 | 1 | -12/+36 |
| | | | |||||
| * | | Fix tests | Erik Johnston | 2016-11-21 | 1 | -2/+2 |
| | | | |||||
| * | | Store federation stream positions in the database | Erik Johnston | 2016-11-21 | 3 | -4/+52 |
| | | | |||||
| * | | Handle sending events and device messages over federation | Erik Johnston | 2016-11-17 | 4 | -13/+62 |
| | | | |||||
| * | | Hook up the send queue and create a federation sender worker | Erik Johnston | 2016-11-16 | 1 | -0/+7 |
| | | | |||||
* | | | Ignore AS users when fetching push rules | Erik Johnston | 2016-11-23 | 2 | -2/+18 |
| |/ |/| | | | | | | | By ignoring AS users early on when fetching push rules for a room we can avoid needlessly hitting the DB and filling up the caches. | ||||
* | | Fail with a coherent error message if `/sync?filter=` is invalid | Kegan Dougal | 2016-11-21 | 1 | -0/+8 |
|/ | |||||
* | Merge pull request #1617 from matrix-org/erikj/intern_state_dict | Erik Johnston | 2016-11-15 | 1 | -1/+4 |
|\ | | | | | Correctly intern keys in state cache | ||||
| * | Correctly intern keys in state cache | Erik Johnston | 2016-11-08 | 1 | -1/+4 |
| | | |||||
* | | New Flake8 fixes | Erik Johnston | 2016-11-15 | 1 | -0/+1 |
|/ | |||||
* | Comment | Erik Johnston | 2016-11-04 | 1 | -0/+1 |
| | |||||
* | Remove unused but buggy function | Erik Johnston | 2016-11-04 | 1 | -11/+1 |
| | |||||
* | Remove spurious comment | Erik Johnston | 2016-11-03 | 1 | -2/+2 |
| | |||||
* | Replace postgres GIN with GIST | Erik Johnston | 2016-11-03 | 3 | -1/+45 |
| | | | | | This is because GIN can be slow to write too, especially when the table gets large. | ||||
* | Continue to clean up received_transactions | Erik Johnston | 2016-11-01 | 1 | -0/+14 |
| | |||||
* | Removed unused stuff | Erik Johnston | 2016-10-31 | 1 | -163/+3 |
| | |||||
* | Increase batching of sent transaction inserts | Erik Johnston | 2016-10-31 | 1 | -1/+1 |
| | | | | | | This should further reduce the number of individual inserts, transactions and updates that are required for keeping sent_transactions up to date. | ||||
* | Use most recently added binding, not most recently seen user. | Erik Johnston | 2016-10-27 | 1 | -19/+11 |
| | |||||
* | Fix user_threepids schema delta | Erik Johnston | 2016-10-27 | 1 | -1/+38 |
| | | | | | | | | | | | The delta `37/user_threepids.sql` aimed to update all the email addresses to be lower case, however duplicate emails may exist in the table already. This commit adds a step where the delta moves the duplicate emails to a new `medium` `email_old`. Only the most recently used account keeps the binding intact. We move rather than delete so that we retain some record of which emails were associated with which account. | ||||
* | Fix incredubly slow back pagination query | Erik Johnston | 2016-10-24 | 1 | -6/+13 |
| | | | | | | | If a client didn't specify a from token when paginating backwards synapse would attempt to query the (global) maximum topological token. This a) doesn't make much sense since they're room specific and b) there are no indices that lets postgres do this efficiently. | ||||
* | Merge pull request #1164 from pik/error-codes | Erik Johnston | 2016-10-19 | 1 | -1/+0 |
|\ | | | | | Clarify Error codes for GET /filter/ | ||||
| * | Refactor test_filter to use real DataStore | pik | 2016-10-18 | 1 | -1/+0 |
| | | | | | | | | * add tests for filter api errors | ||||
* | | Latest delta is now 37 | David Baker | 2016-10-19 | 1 | -0/+0 |
| | | |||||
* | | Merge remote-tracking branch 'origin/develop' into ↵ | David Baker | 2016-10-19 | 3 | -2/+82 |
|\ \ | | | | | | | | | | dbkr/password_reset_case_insensitive | ||||
| * | | Bump schema version | Erik Johnston | 2016-10-17 | 2 | -1/+1 |
| | | | |||||
| * | | Remove TODO | Erik Johnston | 2016-10-17 | 1 | -2/+0 |
| | | | |||||
| * | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/remove_auth | Erik Johnston | 2016-10-17 | 12 | -72/+429 |
| |\ \ | |||||
| * | | | Drop some unused indices | Erik Johnston | 2016-10-17 | 3 | -17/+83 |
| | | | | |||||
| * | | | Remove redundant event_auth index | Erik Johnston | 2016-09-13 | 1 | -0/+16 |
| | | | | |||||
* | | | | Convert emails to lowercase when storing | David Baker | 2016-10-19 | 1 | -1/+8 |
| | | | | | | | | | | | | | | | | And db migration sql to convert existing addresses. | ||||
* | | | | Revert part of 6207399 | David Baker | 2016-10-14 | 1 | -20/+10 |
| | | | | | | | | | | | | | | | | | | | | older sqlite doesn't support indexes on expressions, lets just store things lowercase in the db | ||||
* | | | | Merge remote-tracking branch 'origin/develop' into ↵ | David Baker | 2016-10-14 | 1 | -0/+3 |
|\ \ \ \ | | |/ / | |/| | | | | | | dbkr/password_reset_case_insensitive | ||||
| * | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-10-11 | 3 | -44/+64 |
| |\ \ \ | | | | | | | | | | | | | | | | erikj/replication_noop | ||||
| * | | | | Reduce DB hits for replication | Erik Johnston | 2016-09-23 | 1 | -0/+3 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some streams will occaisonally advance their positions without actually having any new rows to send over federation. Currently this means that the token will not advance on the workers, leading to them repeatedly sending a slightly out of date token. This in turns requires the master to hit the DB to check if there are any new rows, rather than hitting the no op logic where we check if the given token matches the current token. This commit changes the API to always return an entry if the position for a stream has changed, allowing workers to advance their tokens correctly. | ||||
* | | | | | Make password reset email field case insensitive | David Baker | 2016-10-14 | 2 | -10/+36 |
| |/ / / |/| | | | |||||
* | | | | storage/appservice: make appservice methods only relying on the cache ↵ | Patrik Oldsberg | 2016-10-06 | 1 | -6/+6 |
| |_|/ |/| | | | | | | | | synchronous | ||||
* | | | Merge pull request #1145 from matrix-org/erikj/fix_reindex | Erik Johnston | 2016-09-29 | 1 | -15/+29 |
|\ \ \ | | | | | | | | | Fix background reindex of origin_server_ts | ||||
| * | | | Fix background reindex of origin_server_ts | Erik Johnston | 2016-09-27 | 1 | -15/+29 |
| |/ / | | | | | | | | | | | | | | | | | | | | | | The storage function `_get_events_txn` was removed everywhere except from this background reindex. The function was removed due to it being (almost) completely unused while also being large and complex. Therefore, instead of resurrecting `_get_events_txn` we manually reimplement the bits that are needed directly. | ||||
* | | | Remove duplication | Erik Johnston | 2016-09-27 | 1 | -31/+19 |
| | | | |||||
* | | | Remove unused variable | Erik Johnston | 2016-09-27 | 1 | -3/+0 |
| | | | |||||
* | | | Fix perf of fetching state in SQLite | Erik Johnston | 2016-09-26 | 1 | -20/+41 |
|/ / | |||||
* | | Match against event_id, rather than room_id | Erik Johnston | 2016-09-21 | 1 | -1/+1 |
| | | |||||
* | | Remove spurious AS clause | Erik Johnston | 2016-09-21 | 1 | -1/+1 |
| | | |||||
* | | Update correct table | Erik Johnston | 2016-09-21 | 1 | -6/+10 |
| | | |||||
* | | Readd entries to public_room_list_stream that were deleted | Erik Johnston | 2016-09-21 | 2 | -1/+23 |
| | | |||||
* | | Fix _delete_old_forward_extrem_cache query | Erik Johnston | 2016-09-21 | 1 | -5/+4 |
| | | |||||
* | | Comment | Erik Johnston | 2016-09-16 | 1 | -0/+2 |
| | | |||||
* | | Filter remote rooms lists locally | Erik Johnston | 2016-09-16 | 1 | -1/+1 |
| | | |||||
* | | Handling expiring stream extrems correctly. | Erik Johnston | 2016-09-15 | 2 | -3/+22 |
| | | |||||
* | | Change get_pos_of_last_change to return upper bound | Erik Johnston | 2016-09-15 | 1 | -3/+2 |
| | | |||||
* | | Use stream_change cache to make get_forward_extremeties_for_room cache more ↵ | Erik Johnston | 2016-09-15 | 1 | -1/+10 |
| | | | | | | | | effective | ||||
* | | Add cache to get_forward_extremeties_for_room | Erik Johnston | 2016-09-15 | 1 | -0/+1 |
| | | |||||
* | | Merge pull request #1121 from matrix-org/erikj/public_room_paginate | Erik Johnston | 2016-09-15 | 6 | -15/+288 |
|\ \ | | | | | | | Add pagination support to publicRooms | ||||
| * | | Stream public room changes down replication | Erik Johnston | 2016-09-15 | 1 | -0/+16 |
| | | | |||||
| * | | Base public room list off of public_rooms stream | Erik Johnston | 2016-09-15 | 1 | -0/+52 |
| | | | |||||
| * | | Calculate the public room list from a stream_ordering | Erik Johnston | 2016-09-14 | 1 | -0/+3 |
| | | | |||||
| * | | Add a room visibility stream | Erik Johnston | 2016-09-14 | 4 | -16/+100 |
| | | | |||||
| * | | Add a DB index to figure out past state at a stream ordering in a room | Erik Johnston | 2016-09-14 | 2 | -0/+118 |
| |/ | |||||
* | | Fix reindex | Erik Johnston | 2016-09-14 | 1 | -15/+16 |
| | | |||||
* | | Ensure we don't mutate state cache entries | Erik Johnston | 2016-09-14 | 1 | -20/+25 |
|/ | |||||
* | Remove where clause | Erik Johnston | 2016-09-12 | 1 | -1/+0 |
| | |||||
* | Index contains_url for file search queries | Erik Johnston | 2016-09-12 | 2 | -0/+25 |
| | |||||
* | Add WHERE clause support to index creation | Erik Johnston | 2016-09-12 | 2 | -10/+17 |
| | |||||
* | Merge pull request #1106 from matrix-org/erikj/state_reindex_concurrent | Erik Johnston | 2016-09-12 | 1 | -1/+1 |
|\ | | | | | Create new index concurrently | ||||
| * | Create new index concurrently | Erik Johnston | 2016-09-12 | 1 | -1/+1 |
| | | |||||
* | | Merge pull request #1105 from matrix-org/erikj/make_notif_highlight_query_fast | Erik Johnston | 2016-09-12 | 2 | -1/+29 |
|\ \ | |/ |/| | Optimise /notifications query | ||||
| * | Change the index to be stream_ordering, highlight | Erik Johnston | 2016-09-12 | 1 | -1/+1 |
| | | |||||
| * | Remove unused import | Erik Johnston | 2016-09-12 | 1 | -1/+0 |
| | | |||||
| * | Use register_background_index_update | Erik Johnston | 2016-09-12 | 1 | -24/+4 |
| | | |||||
| * | Add back in query change | Erik Johnston | 2016-09-12 | 1 | -1/+3 |
| | | |||||
| * | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-09-12 | 8 | -22/+60 |
| |\ | | | | | | | | | | erikj/make_notif_highlight_query_fast | ||||
| * | | Make reindex happen in bg | Erik Johnston | 2016-09-12 | 2 | -3/+32 |
| | | | |||||
* | | | Merge pull request #1104 from matrix-org/markjh/direct_to_device_federation_sync | Mark Haines | 2016-09-12 | 1 | -0/+2 |
|\ \ \ | |_|/ |/| | | Fix direct to device messages recieved over federation to notify sync | ||||
| * | | Fix direct to device messages recieved over federation to notify sync | Mark Haines | 2016-09-12 | 1 | -0/+2 |
| | | | |||||
* | | | Add comments to existing schema deltas that used "CREATE INDEX" directly | Mark Haines | 2016-09-12 | 6 | -0/+24 |
|/ / | |||||
* | | Revert "Add index to event_push_actions" | Erik Johnston | 2016-09-12 | 2 | -21/+1 |
| | | |||||
* | | Change state fetch query for postgres to be faster | Erik Johnston | 2016-09-12 | 1 | -19/+35 |
|/ | | | | | | It turns out that postgres doesn't like doing a list of OR's and is about 1000x slower, so we just issue a query for each specific type seperately. | ||||
* | Merge remote-tracking branch 'origin/develop' into ↵ | David Baker | 2016-09-09 | 9 | -40/+360 |
|\ | | | | | | | dbkr/make_notif_highlight_query_fast | ||||
| * | Use the previous MAX value if any to set the stream_id | Mark Haines | 2016-09-09 | 1 | -1/+2 |
| | | |||||
| * | Track the max_stream_device_id in a separate table, since we delete from the ↵ | Mark Haines | 2016-09-09 | 3 | -3/+36 |
| | | | | | | | | inbox table | ||||
| * | Merge pull request #1087 from matrix-org/markjh/reapply_delta | Mark Haines | 2016-09-09 | 1 | -1/+4 |
| |\ | | | | | | | Reapply 34/device_outbox in 35/device_outbox_again.py since the schem… | ||||
| | * | Just move the schema and add some DROPs | Mark Haines | 2016-09-09 | 2 | -35/+4 |
| | | | |||||
| | * | Only catch databas errors | Mark Haines | 2016-09-08 | 1 | -1/+1 |
| | | | |||||
| | * | Add a stub run_upgrade | Mark Haines | 2016-09-08 | 1 | -0/+4 |
| | | | |||||
| | * | Reapply 34/device_outbox in 35/device_outbox_again.py since the schema was ↵ | Mark Haines | 2016-09-08 | 1 | -0/+30 |
| | | | | | | | | | | | | bumped before it landed on develop | ||||
| * | | Merge branch 'release-v0.17.3' of github.com:matrix-org/synapse into develop | Erik Johnston | 2016-09-09 | 1 | -1/+1 |
| |\ \ | |||||
| | * | | Reduce batch size to be under SQL limit | Erik Johnston | 2016-09-09 | 1 | -1/+1 |
| | | | | |||||
| * | | | Merge pull request #1081 from matrix-org/dbkr/notifications_only_highlight | Matthew Hodgson | 2016-09-09 | 1 | -1/+8 |
| |\ \ \ | | | | | | | | | | | Implement `only=highlight` on `/notifications` | ||||
| * \ \ \ | Merge pull request #1080 from matrix-org/dbkr/fix_notifications_api_with_from | David Baker | 2016-09-08 | 1 | -1/+1 |
| |\ \ \ \ | | | | | | | | | | | | | Fix /notifications API when used with `from` param | ||||
| | * | | | | Fix /notifications API when used with `from` param | David Baker | 2016-09-08 | 1 | -1/+1 |
| | | | | | | |||||
| * | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-09-08 | 1 | -18/+36 |
| |\ \ \ \ \ | | | |_|_|/ | | |/| | | | | | | | | | erikj/reindex_state_groups | ||||
| | * | | | | Support wildcard device_ids for direct to device messages | Mark Haines | 2016-09-08 | 1 | -18/+36 |
| | | | | | | |||||
| * | | | | | Add delta file | Erik Johnston | 2016-09-08 | 1 | -0/+20 |
| | | | | | | |||||
| * | | | | | Reindex state_groups_state after pruning | Erik Johnston | 2016-09-08 | 2 | -2/+37 |
| |/ / / / | |||||
| * | | | | Merge branch 'develop' into markjh/direct_to_device_federation | Mark Haines | 2016-09-08 | 6 | -75/+444 |
| |\ \ \ \ | |||||
| * | | | | | Fix the stream change cache to work over replication | Mark Haines | 2016-09-07 | 1 | -1/+1 |
| | | | | | | |||||
| * | | | | | Add stream change caches for device messages | Mark Haines | 2016-09-07 | 2 | -0/+49 |
| | | | | | | |||||
| * | | | | | Comment the add_messages storage functions | Mark Haines | 2016-09-07 | 1 | -8/+16 |
| | | | | | | |||||
| * | | | | | Send device messages over federation | Mark Haines | 2016-09-06 | 2 | -14/+9 |
| | | | | | | |||||
| * | | | | | Add storage methods for federated device messages | Mark Haines | 2016-09-06 | 1 | -7/+132 |
| | | | | | | |||||
| * | | | | | Add tables for federated device messages | Mark Haines | 2016-09-06 | 1 | -0/+38 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Adds tables for storing the messages that need to be sent to a remote device and for deduplicating messages received. | ||||
| * | | | | | Move _add_messages_to_device_inbox_txn into a separate method | Mark Haines | 2016-09-06 | 1 | -37/+32 |
| | |_|_|/ | |/| | | | |||||
* | | | | | Add index to event_push_actions | David Baker | 2016-09-09 | 2 | -1/+21 |
| |_|_|/ |/| | | | | | | | | | | | | | | | | | | | and remove room_id caluse so it uses it Mostly from @negativemjark | ||||
* | | | | Implement `only=highlight` on `/notifications` | David Baker | 2016-09-08 | 1 | -1/+8 |
| |/ / |/| | | |||||
* | | | Log delta files we're applying | Erik Johnston | 2016-09-08 | 1 | -2/+2 |
| | | | |||||
* | | | Temporarily disable sequential scans for state fetching | Erik Johnston | 2016-09-08 | 1 | -0/+4 |
| |/ |/| | |||||
* | | Merge pull request #1077 from matrix-org/markjh/device_logging | Mark Haines | 2016-09-07 | 1 | -2/+6 |
|\ \ | | | | | | | Log the types and values when failing to store devices | ||||
| * | | Log the types and values when failing to store devices | Mark Haines | 2016-09-07 | 1 | -2/+6 |
| |/ | |||||
* | | Comment | Erik Johnston | 2016-09-07 | 1 | -0/+4 |
| | | |||||
* | | Add appopriate framing clause | Erik Johnston | 2016-09-07 | 1 | -0/+1 |
| | | |||||
* | | Use windowing function to make use of index | Erik Johnston | 2016-09-07 | 1 | -5/+5 |
| | | |||||
* | | Scale the batch size so that we're not bitten by the minimum | Erik Johnston | 2016-09-05 | 1 | -1/+5 |
| | | |||||
* | | Correctly handle reindexing state groups that already have an edge | Erik Johnston | 2016-09-05 | 1 | -0/+19 |
| | | |||||
* | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage | Erik Johnston | 2016-09-05 | 1 | -13/+9 |
|\| | |||||
| * | Remove unused imports | Erik Johnston | 2016-09-05 | 1 | -1/+0 |
| | | |||||
| * | Only fetch local pushers | Erik Johnston | 2016-09-05 | 1 | -1/+3 |
| | | |||||
| * | Make bulk_get_push_rules_for_room use get_joined_users_from_context cache | Erik Johnston | 2016-09-05 | 1 | -12/+7 |
| | | |||||
* | | Take value in a better way | Erik Johnston | 2016-09-05 | 2 | -3/+3 |
| | | |||||
* | | Comment about sqlite and WITH RECURSIVE | Erik Johnston | 2016-09-05 | 1 | -0/+4 |
| | | |||||
* | | Correctly delete old state groups in purge history API | Erik Johnston | 2016-09-05 | 2 | -20/+80 |
| | | |||||
* | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage | Erik Johnston | 2016-09-05 | 1 | -3/+5 |
|\| | |||||
| * | Merge pull request #1066 from matrix-org/markjh/direct_to_device_lowerbound | Mark Haines | 2016-09-02 | 1 | -3/+5 |
| |\ | | | | | | | Only return new device messages in /sync | ||||
| | * | Only return new device messages in /sync | Mark Haines | 2016-09-02 | 1 | -3/+5 |
| | | | |||||
* | | | Add comments | Erik Johnston | 2016-09-05 | 1 | -41/+38 |
| | | | |||||
* | | | Add upgrade script that will slowly prune state_groups_state entries | Erik Johnston | 2016-09-05 | 2 | -75/+220 |
| | | | |||||
* | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage | Erik Johnston | 2016-09-02 | 1 | -1/+1 |
|\| | | |||||
| * | | Bump max_entries on get_destination_retry_timings | Erik Johnston | 2016-09-02 | 1 | -1/+1 |
| |/ | |||||
* | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage | Erik Johnston | 2016-09-02 | 4 | -2/+78 |
|\| | |||||
| * | Merge pull request #1060 from matrix-org/erikj/state_ids | Erik Johnston | 2016-09-01 | 4 | -62/+72 |
| |\ | | | | | | | Assign state groups in state handler. | ||||
| * | | Lower get_linearized_receipts_for_room cache size | Erik Johnston | 2016-08-31 | 1 | -1/+1 |
| | | | |||||
| * | | Merge pull request #1059 from matrix-org/erikj/sent_transaction_delete | Erik Johnston | 2016-08-31 | 2 | -0/+34 |
| |\ \ | | | | | | | | | Clean up old sent transactions | ||||
| | * | | Clean up old sent transactions | Erik Johnston | 2016-08-31 | 2 | -0/+34 |
| | | | | |||||
| * | | | Return the current stream position from add_messages_to_device_inbox | Mark Haines | 2016-08-31 | 1 | -1/+4 |
| | | | | |||||
| * | | | Add a replication stream for direct to device messages | Mark Haines | 2016-08-31 | 1 | -0/+39 |
| |/ / | |||||
* | | | Limit the length of state chains | Erik Johnston | 2016-09-02 | 2 | -43/+106 |
| | | | |||||
* | | | Move to storing state_groups_state as deltas | Erik Johnston | 2016-09-01 | 3 | -60/+124 |
| |/ |/| | |||||
* | | Use state_groups table to test existence | Erik Johnston | 2016-08-31 | 1 | -1/+1 |
| | | |||||
* | | Correctly handle the difference between prev and current state | Erik Johnston | 2016-08-31 | 2 | -7/+23 |
| | | |||||
* | | Generate state group ids in state layer | Erik Johnston | 2016-08-31 | 2 | -16/+18 |
| | | |||||
* | | Make _state_groups_id_gen a normal IdGenerator | Erik Johnston | 2016-08-30 | 3 | -48/+40 |
|/ | |||||
* | Merge pull request #1049 from matrix-org/erikj/presence_users_in_room | Erik Johnston | 2016-08-30 | 2 | -10/+2 |
|\ | | | | | Use state handler instead of get_users_in_room/get_joined_hosts | ||||
| * | Use state handler instead of get_users_in_room/get_joined_hosts | Erik Johnston | 2016-08-26 | 2 | -10/+2 |
| | | |||||
* | | Merge remote-tracking branch 'origin/develop' into markjh/direct_to_device | Mark Haines | 2016-08-26 | 3 | -32/+173 |
|\| | |||||
| * | Add is_host_joined to slave storage | Erik Johnston | 2016-08-26 | 1 | -3/+4 |
| | | |||||
| * | Cache check_host_in_room | Erik Johnston | 2016-08-26 | 1 | -0/+35 |
| | | |||||
| * | Make sync not pull out full state | Erik Johnston | 2016-08-25 | 1 | -0/+33 |
| | | |||||
| * | Add desc | Erik Johnston | 2016-08-25 | 1 | -1/+2 |
| | | |||||
| * | Replace context.current_state with context.current_state_ids | Erik Johnston | 2016-08-25 | 3 | -16/+66 |
| | | |||||
| * | Pull out event ids rather than full events for state | Erik Johnston | 2016-08-25 | 1 | -17/+38 |
| | | |||||
* | | Merge branch 'develop' into markjh/direct_to_device | Mark Haines | 2016-08-25 | 2 | -9/+13 |
|\| | |||||
| * | Preserve some logcontexts | Erik Johnston | 2016-08-24 | 2 | -9/+13 |
| | | |||||
* | | Fix the deduplication of incoming direct-to-device messages | Mark Haines | 2016-08-25 | 1 | -0/+4 |
| | | |||||
* | | Add store-and-forward direct-to-device messaging | Mark Haines | 2016-08-25 | 3 | -0/+165 |
|/ | |||||
* | Merge pull request #1038 from matrix-org/erikj/receved_txn_purge | Erik Johnston | 2016-08-23 | 2 | -4/+45 |
|\ | | | | | Delete old received_transactions rows | ||||
| * | Delete old received_transactions | Erik Johnston | 2016-08-22 | 2 | -4/+45 |
| | | |||||
* | | Merge pull request #1028 from matrix-org/dbkr/notifications_api | Erik Johnston | 2016-08-22 | 2 | -0/+55 |
|\ \ | |/ |/| | Add the Notifications API | ||||
| * | Merge branch 'develop' into dbkr/notifications_api | Matthew Hodgson | 2016-08-20 | 8 | -11/+70 |
| |\ | |||||
| * | | Explicit join | David Baker | 2016-08-18 | 1 | -2/+2 |
| | | | |||||
| * | | Merge remote-tracking branch 'origin/develop' into dbkr/notifications_api | David Baker | 2016-08-18 | 12 | -164/+382 |
| |\ \ | |||||
| * \ \ | Merge remote-tracking branch 'origin/develop' into dbkr/notifications_api | David Baker | 2016-08-11 | 38 | -657/+1984 |
| |\ \ \ | |||||
| * | | | | Include the ts the notif was received at | David Baker | 2016-05-24 | 1 | -5/+7 |
| | | | | | |||||
| * | | | | Add GET /notifications API | David Baker | 2016-05-23 | 2 | -0/+53 |
| | | | | | |||||
* | | | | | Merge pull request #1031 from matrix-org/erikj/measure_notifier | Erik Johnston | 2016-08-22 | 1 | -40/+42 |
|\ \ \ \ \ | |_|_|_|/ |/| | | | | Add more Measure blocks | ||||
| * | | | | Move defer.returnValue out of Measure | Erik Johnston | 2016-08-19 | 1 | -1/+1 |
| | | | | | |||||
| * | | | | Measure _get_event_from_row | Erik Johnston | 2016-08-19 | 1 | -41/+43 |
| | | | | | |||||
* | | | | | Merge pull request #1030 from matrix-org/erikj/cache_contexts | Erik Johnston | 2016-08-19 | 7 | -9/+65 |
|\ \ \ \ \ | |/ / / / |/| | | | | Add concept of cache contexts | ||||
| * | | | | Rename to on_invalidate | Erik Johnston | 2016-08-19 | 1 | -3/+3 |
| | | | | | |||||
| * | | | | Make cache_context an explicit option | Erik Johnston | 2016-08-19 | 1 | -1/+1 |
| | | | | | |||||
| * | | | | Move _bulk_get_push_rules_for_room to storage layer | Erik Johnston | 2016-08-19 | 1 | -0/+56 |
| | | | | | |||||
| * | | | | Remove lru option | Erik Johnston | 2016-08-19 | 7 | -9/+9 |
| | |_|/ | |/| | | |||||
* / | | | Make get_new_events_for_appservice use indices | Erik Johnston | 2016-08-19 | 1 | -2/+5 |
|/ / / | |||||
* | | | Add appservice worker | Erik Johnston | 2016-08-18 | 2 | -85/+93 |
| | | | |||||
* | | | Make AppserviceHandler stream events from database | Erik Johnston | 2016-08-18 | 2 | -0/+62 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This is for two reasons: 1. Suppresses duplicates correctly, as the notifier doesn't do any duplicate suppression. 2. Makes it easier to connect the AppserviceHandler to the replication stream. | ||||
* | | | Fix push_display_name_rename schema update | Erik Johnston | 2016-08-17 | 1 | -0/+3 |
| | | | |||||
* | | | Merge pull request #1011 from matrix-org/dbkr/contains_display_name_override | David Baker | 2016-08-17 | 1 | -0/+17 |
|\ \ \ | | | | | | | | | Move display name rule | ||||
| * | | | Add migration script | David Baker | 2016-08-16 | 1 | -0/+17 |
| | | | | | | | | | | | | | | | | To port existing rule actions & enable entries to the new name | ||||
* | | | | Do it in storage function | Erik Johnston | 2016-08-16 | 1 | -0/+3 |
|/ / / | |||||
* | | | Merge pull request #1010 from matrix-org/erikj/refactor_deletions | Erik Johnston | 2016-08-16 | 2 | -38/+33 |
|\ \ \ | | | | | | | | | Refactor user_delete_access_tokens. Invalidate get_user_by_access_token to slaves. | ||||
| * | | | Use cached get_user_by_access_token in slaves | Erik Johnston | 2016-08-16 | 1 | -0/+1 |
| | | | | |||||
| * | | | Refactor user_delete_access_tokens. Invalidate get_user_by_access_token to ↵ | Erik Johnston | 2016-08-15 | 1 | -38/+32 |
| | | | | | | | | | | | | | | | | slaves. | ||||
* | | | | Merge branch 'fix_integrity_retry' of https://github.com/Ralith/synapse into ↵ | Erik Johnston | 2016-08-16 | 1 | -1/+2 |
|\ \ \ \ | |/ / / |/| | | | | | | | Ralith-fix_integrity_retry | ||||
| * | | | Add missing database corruption recovery case | Benjamin Saunders | 2016-08-14 | 1 | -1/+2 |
| | |/ | |/| | | | | | | | Signed-off-by: Benjamin Saunders <ben.e.saunders@gmail.com> | ||||
* | | | Doc get_next() context manager usage | Erik Johnston | 2016-08-15 | 1 | -0/+4 |
| | | | |||||
* | | | Rename table. Add docs. | Erik Johnston | 2016-08-15 | 3 | -5/+15 |
| | | | |||||
* | | | Implement cache replication stream | Erik Johnston | 2016-08-15 | 2 | -15/+43 |
| | | | |||||
* | | | Add some invalidations to a cache_stream | Erik Johnston | 2016-08-15 | 7 | -31/+117 |
| | | | |||||
* | | | Always run txn.after_callbacks | Erik Johnston | 2016-08-15 | 1 | -7/+8 |
|/ / | |||||
* | | Raise 404 when couldn't find event | Erik Johnston | 2016-08-05 | 1 | -1/+1 |
| | | |||||
* | | Delete more tables | Erik Johnston | 2016-08-05 | 1 | -0/+5 |
| | | |||||
* | | Tweak integrity error recovery to work as intended | Benjamin Saunders | 2016-08-04 | 1 | -0/+3 |
| | | |||||
* | | Fix typo | Erik Johnston | 2016-08-04 | 1 | -3/+4 |
| | | |||||
* | | Retry event persistence on IntegrityError | Erik Johnston | 2016-08-04 | 1 | -4/+65 |
| | | | | | | | | | | | | | | | | | | | | Due to a bug in the porting script some backfilled events were not correctly persisted, causing irrecoverable IntegrityErrors on future attempts to persist those events. This commit adds a retry mechanism invoked upon IntegrityError, where when retried the tables are purged for all references to the events being persisted. | ||||
* | | PEP8 | Richard van der Hoff | 2016-08-03 | 1 | -10/+10 |
| | | |||||
* | | Include device name in /keys/query response | Richard van der Hoff | 2016-08-03 | 1 | -17/+43 |
| | | | | | | | | Add an 'unsigned' section which includes the device display name. | ||||
* | | Merge branch 'rav/null_default_device_displayname' into develop | Richard van der Hoff | 2016-08-03 | 2 | -1/+21 |
|\ \ | |||||
| * | | Default device_display_name to null | Richard van der Hoff | 2016-08-03 | 2 | -1/+21 |
| | | | | | | | | | | | | | | | | | | It turns out that it's more useful to return a null device display name (and let clients decide how to handle it: eg, falling back to device_id) than using a constant string like "unknown device". | ||||
* | | | Remove other bit of deduplication | Erik Johnston | 2016-08-03 | 1 | -19/+0 |
| | | | |||||
* | | | Ensure we only persist an event once at a time | Erik Johnston | 2016-08-03 | 1 | -1/+18 |
|/ / | |||||
* | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/fed_reader | Erik Johnston | 2016-07-29 | 12 | -120/+552 |
|\ \ | |||||
| * | | Fix SQL to supply arguments in the same order | Mark Haines | 2016-07-29 | 1 | -1/+1 |
| | | | |||||
| * | | Create separate methods for getting messages to push | Mark Haines | 2016-07-28 | 1 | -45/+154 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | for the email and http pushers rather than trying to make a single method that will work with their conflicting requirements. The http pusher needs to get the messages in ascending stream order, and doesn't want to miss a message. The email pusher needs to get the messages in descending timestamp order, and doesn't mind if it misses messages. | ||||
| * | | Comment get_unread_push_actions_for_user_in_range function | Kegan Dougal | 2016-07-28 | 1 | -2/+26 |
| | | | |||||
| * | | Merge pull request #956 from matrix-org/rav/check_device_id_on_key_upload | Richard van der Hoff | 2016-07-27 | 2 | -0/+34 |
| |\ \ | | | | | | | | | Make the device id on e2e key upload optional | ||||
| | * | | SQL syntax fix | Richard van der Hoff | 2016-07-27 | 1 | -1/+1 |
| | | | | |||||
| | * | | Delete e2e keys on device delete | Richard van der Hoff | 2016-07-27 | 1 | -0/+15 |
| | | | | |||||
| | * | | Make the device id on e2e key upload optional | Richard van der Hoff | 2016-07-26 | 1 | -0/+19 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We should now be able to get our device_id from the access_token, so the device_id on the upload request is optional. Where it is supplied, we should check that it matches. For active access_tokens without an associated device_id, we ought to register the device in the devices table. Also update the table on upgrade so that all of the existing e2e keys are associated with real devices. | ||||
| * | | | Fix a couple of bugs in the transaction and keyring code | Mark Haines | 2016-07-26 | 1 | -1/+2 |
| |/ / | |||||
| * | | Fix typo | Richard van der Hoff | 2016-07-26 | 1 | -1/+1 |
| | | | |||||
| * | | Merge branch 'develop' into rav/delete_refreshtoken_on_delete_device | Richard van der Hoff | 2016-07-26 | 1 | -50/+110 |
| |\ \ | |||||
| | * \ | Merge pull request #948 from matrix-org/markjh/auth_fixes | Mark Haines | 2016-07-26 | 1 | -50/+110 |
| | |\ \ | | | | | | | | | | | Don't add rejections to the state_group, persist all rejections | ||||
| | | * | | Fix how push_actions are redacted. | Mark Haines | 2016-07-26 | 1 | -8/+10 |
| | | | | | |||||
| | | * | | Don't add rejected events if we've seen them befrore. Add some comments to ↵ | Mark Haines | 2016-07-26 | 1 | -5/+48 |
| | | | | | | | | | | | | | | | | | | | | explain what the code is doing mechanically | ||||
| | | * | | Only update the events and event_json tables for rejected events | Mark Haines | 2016-07-25 | 2 | -52/+63 |
| | | | | | |||||
| | | * | | Don't add the events to forward extremities if the event is rejected | Mark Haines | 2016-07-25 | 1 | -3/+6 |
| | | | | | |||||
| | | * | | Don't add rejections to the state_group, persist all rejections | Mark Haines | 2016-07-25 | 2 | -5/+6 |
| | | | | | |||||
| * | | | | Delete refresh tokens when deleting devices | Richard van der Hoff | 2016-07-26 | 1 | -13/+45 |
| |/ / / | |||||
| * | | | Implement updating devices | Richard van der Hoff | 2016-07-26 | 1 | -1/+26 |
| | | | | | | | | | | | | | | | | You can update the displayname of devices now. |