Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Fix up docs | Erik Johnston | 2017-03-31 | 1 | -1/+1 |
| | |||||
* | Add new storage functions for new replication | Erik Johnston | 2017-03-30 | 3 | -3/+133 |
| | | | | | The new replication protocol will keep all the streams separate, rather than muxing multiple streams into one. | ||||
* | Use txn.fetchall() so we can reuse txn | Erik Johnston | 2017-03-30 | 1 | -1/+1 |
| | |||||
* | Increase cache size for _get_state_group_for_event | Erik Johnston | 2017-03-29 | 1 | -1/+1 |
| | |||||
* | Decrank last commit | Erik Johnston | 2017-03-29 | 1 | -4/+5 |
| | |||||
* | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2017-03-29 | 17 | -164/+164 |
|\ | | | | | | | erikj/e2e_one_time_upsert | ||||
| * | Merge pull request #2063 from matrix-org/erikj/device_list_batch | Erik Johnston | 2017-03-28 | 1 | -0/+4 |
| |\ | | | | | | | Batch sending of device list pokes | ||||
| | * | Batch sending of device list pokes | Erik Johnston | 2017-03-24 | 1 | -0/+4 |
| | | | |||||
| * | | Typo | Erik Johnston | 2017-03-27 | 1 | -1/+1 |
| | | | |||||
| * | | Short circuit if all new events have same state group | Erik Johnston | 2017-03-27 | 1 | -36/+51 |
| |/ | |||||
| * | Merge pull request #2062 from matrix-org/erikj/presence_replication | Erik Johnston | 2017-03-24 | 1 | -2/+2 |
| |\ | | | | | | | Use presence replication stream to invalidate cache | ||||
| | * | Actually call invalidate | Erik Johnston | 2017-03-24 | 1 | -1/+1 |
| | | | |||||
| | * | Use presence replication stream to invalidate cache | Erik Johnston | 2017-03-24 | 1 | -2/+2 |
| | | | | | | | | | | | | | | | | | | Instead of using the cache invalidation replication stream to invalidate the _get_presence_cache, we can instead rely on the presence replication stream. This reduces the amount of replication traffic considerably. | ||||
| * | | Cache hosts in room | Erik Johnston | 2017-03-24 | 1 | -0/+10 |
| |/ | |||||
| * | Replace some calls to cursor_to_dict | Erik Johnston | 2017-03-24 | 2 | -38/+13 |
| | | | | | | | | | | cursor_to_dict can be surprisinglh expensive for large result sets, so lets only call it when we need to. | ||||
| * | Use iter(items|values) | Erik Johnston | 2017-03-24 | 3 | -51/+48 |
| | | |||||
| * | User Cursor.__iter__ instead of fetchall | Erik Johnston | 2017-03-23 | 15 | -39/+38 |
| | | | | | | | | This prevents unnecessary construction of lists | ||||
* | | Correctly look up key | Erik Johnston | 2017-03-29 | 1 | -6/+5 |
| | | |||||
* | | The algorithm is part of the key id | Erik Johnston | 2017-03-28 | 1 | -4/+4 |
| | | |||||
* | | Raise a more helpful exception | Erik Johnston | 2017-03-23 | 1 | -2/+4 |
| | | |||||
* | | Don't user upsert to persist new one time keys | Erik Johnston | 2017-03-23 | 1 | -9/+48 |
|/ | | | | | Instead we no-op duplicate one time key uploads, an error if the key_id already exists but encodes a different key. | ||||
* | fix up some key verif docstrings | Richard van der Hoff | 2017-03-21 | 1 | -2/+3 |
| | |||||
* | Merge pull request #2033 from matrix-org/erikj/repl_speed | Erik Johnston | 2017-03-21 | 1 | -17/+14 |
|\ | | | | | Don't send the full event json over replication | ||||
| * | Don't send the full event json over replication | Erik Johnston | 2017-03-17 | 1 | -17/+14 |
| | | |||||
* | | Merge pull request #2027 from matrix-org/rav/logcontext_leaks | Richard van der Hoff | 2017-03-20 | 1 | -12/+3 |
|\ \ | | | | | | | A few fixes to logcontext things | ||||
| * | | Remove broken use of clock.call_later | Richard van der Hoff | 2017-03-18 | 1 | -12/+3 |
| |/ | | | | | | | | | | | | | | | | | background_updates was using `call_later` in a way that leaked the logcontext into the reactor. We could have rewritten it to do it properly, but given that we weren't using the fancier facilities provided by `call_later`, we might as well just use `async.sleep`, which does the logcontext stuff properly. | ||||
* | | Avoid resetting state on rejected events | Richard van der Hoff | 2017-03-17 | 2 | -4/+14 |
| | | | | | | | | | | | | | | When we get a rejected event, give it the same state_group as its prev_event, rather than no state_group at all. This should fix https://github.com/matrix-org/synapse/issues/1935. | ||||
* | | Refactoring and cleanups | Richard van der Hoff | 2017-03-17 | 2 | -72/+225 |
|/ | | | | | | | | | | | | A few non-functional changes: * A bunch of docstrings to document types * Split `EventsStore._persist_events_txn` up a bit. Hopefully it's a bit more readable. * Rephrase `EventFederationStore._update_min_depth_for_room_txn` to avoid mind-bending conditional. * Rephrase rejected/outlier conditional in `_update_outliers_txn` to avoid mind-bending conditional. | ||||
* | Comments | Erik Johnston | 2017-03-16 | 1 | -0/+2 |
| | |||||
* | Don't recreate so many sets | Erik Johnston | 2017-03-16 | 1 | -5/+6 |
| | |||||
* | Fix assertion to stop transaction queue getting wedged | Richard van der Hoff | 2017-03-15 | 3 | -4/+18 |
| | | | | | | | | ... and update some docstrings to correctly reflect the types being used. get_new_device_msgs_for_remote can return a long under some circumstances, which was being stored in last_device_list_stream_id_by_dest, and was then upsetting things on the next loop. | ||||
* | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2017-03-14 | 3 | -3/+86 |
|\ | | | | | | | erikj/public_list_speed | ||||
| * | Fix current_state_events table to not lie | Erik Johnston | 2017-03-14 | 1 | -3/+28 |
| | | | | | | | | | | If we try and persist two state events that have the same ancestor we calculate the wrong current state when persisting those events. | ||||
| * | Implement _simple_delete_many_txn, use it to delete devices | Luke Barnard | 2017-03-13 | 2 | -0/+58 |
| | | | | | | | | | | | | (But this doesn't implement the same for deleting access tokens or e2e keys. Also respond to code review. | ||||
* | | Assume rooms likely haven't changed | Erik Johnston | 2017-03-13 | 1 | -0/+3 |
| | | |||||
* | | Get current state by using current_state_events table | Erik Johnston | 2017-03-10 | 2 | -11/+21 |
|/ | |||||
* | Noop repated delete device inbox calls from /sync | Erik Johnston | 2017-03-10 | 1 | -1/+35 |
| | |||||
* | Remove spurious SQL logging (#1972) | Richard van der Hoff | 2017-03-08 | 1 | -8/+0 |
| | | | | | looks like the upsert function was accidentally sending sql logging to the general logger. We already log the sql in `txn.execute`. | ||||
* | Select distinct devices from DB | Erik Johnston | 2017-03-06 | 1 | -1/+1 |
| | | | | | Otherwise we might pull out tonnes of duplicate user_ids and this can make synapse sad. | ||||
* | Fix up | Erik Johnston | 2017-03-03 | 2 | -8/+8 |
| | |||||
* | Add index to device_lists_stream | Erik Johnston | 2017-03-01 | 3 | -4/+28 |
| | |||||
* | Clobber old device list stream entries | Erik Johnston | 2017-03-01 | 1 | -0/+10 |
| | |||||
* | Merge pull request #1959 from matrix-org/erikj/intern_once | Erik Johnston | 2017-02-28 | 1 | -3/+2 |
|\ | | | | | Intern table column names once | ||||
| * | Intern table column names once | Erik Johnston | 2017-02-28 | 1 | -3/+2 |
| | | |||||
* | | Add stream_id index to device_lists_outbound_pokes | Erik Johnston | 2017-02-28 | 2 | -1/+17 |
|/ | | | | As this is used for replication streaming | ||||
* | Fix up txn name | Erik Johnston | 2017-02-28 | 1 | -1/+1 |
| | |||||
* | Remove needless check | Erik Johnston | 2017-02-27 | 1 | -2/+0 |
| | |||||
* | It should be all | Erik Johnston | 2017-02-27 | 1 | -1/+1 |
| | |||||
* | Don't fetch current state in common case | Erik Johnston | 2017-02-27 | 1 | -0/+17 |
| | | | | | | Currently we fetch the list of current state events whenever we send something in a room. This is overkill for the common case of persisting a simple chain of non-state events, so lets handle that case specially. | ||||
* | Merge pull request #1954 from matrix-org/erikj/cache_device2 | Erik Johnston | 2017-02-27 | 1 | -45/+73 |
|\ | | | | | Cache get_user_devices_from_cache | ||||
| * | Cache get_user_devices_from_cache | Erik Johnston | 2017-02-27 | 1 | -45/+73 |
| | | |||||
* | | Strip newlines from SQL queries | Erik Johnston | 2017-02-23 | 1 | -0/+6 |
| | | |||||
* | | Remove lock from rotate notifs | Erik Johnston | 2017-02-22 | 1 | -3/+0 |
|/ | |||||
* | Store looping call | Erik Johnston | 2017-02-21 | 1 | -1/+3 |
| | |||||
* | Fix up notif rotation | Erik Johnston | 2017-02-18 | 1 | -14/+22 |
| | |||||
* | Use TEXT rather than VARCHAR | David Baker | 2017-02-17 | 1 | -6/+6 |
| | | | | While we're changing anyway | ||||
* | Make the pushers lang field column longer | David Baker | 2017-02-17 | 1 | -0/+39 |
| | | | | | | To accommodate things like zh-Hans-CN Fixes https://github.com/vector-im/riot-ios/issues/1031 | ||||
* | Comment | Erik Johnston | 2017-02-16 | 1 | -1/+4 |
| | |||||
* | Comment | Erik Johnston | 2017-02-16 | 1 | -7/+14 |
| | |||||
* | Store the default push actions in a more efficient manner | Erik Johnston | 2017-02-16 | 1 | -11/+40 |
| | |||||
* | Merge pull request #1916 from matrix-org/erikj/push_actions_delete | Erik Johnston | 2017-02-16 | 3 | -57/+248 |
|\ | | | | | Aggregate event push actions | ||||
| * | Less aggressive timers | Erik Johnston | 2017-02-14 | 1 | -2/+2 |
| | | |||||
| * | Aggregate event push actions | Erik Johnston | 2017-02-14 | 3 | -57/+248 |
| | | |||||
* | | Merge pull request #1921 from matrix-org/rav/fix_key_changes | Richard van der Hoff | 2017-02-15 | 2 | -2/+29 |
|\ \ | |/ |/| | Fix bugs in the /keys/changes api | ||||
| * | Fix bugs in the /keys/changes api | Richard van der Hoff | 2017-02-14 | 2 | -2/+29 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * `get_forward_extremeties_for_room` takes a numeric `stream_ordering`. We were passing a `RoomStreamToken`, which meant that it returned the *current* extremities, rather than those corresponding to the `from_token`. However: * `get_state_ids_for_events` required a second ('types') parameter; this meant that a `TypeError` was thrown and we ended up acting as though there was *no* prev state. * `get_state_ids_for_events` actually returns a map from event_id to state dictionary - just looking up the state keys in it again meant that we acted as though there was no prev state. We now check if each member's state has changed since *any* of the extremities. Also add/fix some comments. | ||||
* | | Merge pull request #1873 from matrix-org/erikj/delete_push_actions | Erik Johnston | 2017-02-14 | 1 | -3/+8 |
|\ \ | |/ |/| | Be more agressive about purging old room event_push_actions | ||||
| * | Be more agressive about purging old room event_push_actions | Erik Johnston | 2017-02-01 | 1 | -3/+8 |
| | | |||||
* | | Cache get_presence storage | Erik Johnston | 2017-02-13 | 1 | -3/+11 |
| | | |||||
* | | Make None check explicit | Erik Johnston | 2017-02-08 | 1 | -1/+1 |
| | | |||||
* | | Merge pull request #1892 from matrix-org/erikj/rejection_fwd_extrem | Erik Johnston | 2017-02-08 | 1 | -9/+6 |
|\ \ | | | | | | | Ignore new rejected events when working out forward extremities. | ||||
| * | | Ignore new rejected events when working out forward extremeties. | Erik Johnston | 2017-02-08 | 1 | -9/+6 |
| | | | |||||
* | | | Merge pull request #1784 from morteza-araby/user-admin | Erik Johnston | 2017-02-06 | 2 | -0/+235 |
|\ \ \ | |/ / |/| | | Administration functionalities | ||||
| * | | admin,storage: added more administrator functionalities | Morteza Araby | 2017-02-02 | 2 | -0/+235 |
| |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | administrators can now: - Set displayname of users - Update user avatars - Search for users by user_id - Browse all users in a paginated API - Reset user passwords - Deactivate users Helpers for doing paginated queries has also been added to storage Signed-off-by: Morteza Araby <morteza.araby@ericsson.com> | ||||
* | | Bump cache sizes for common membership queries | Erik Johnston | 2017-02-02 | 1 | -3/+3 |
| | | |||||
* | | Comment | Erik Johnston | 2017-02-02 | 1 | -1/+2 |
| | | |||||
* | | Make presence.get_new_events a bit faster | Erik Johnston | 2017-02-02 | 1 | -0/+16 |
|/ | | | | We do this by caching the set of users a user shares rooms with. | ||||
* | Doc args | Erik Johnston | 2017-02-01 | 1 | -0/+4 |
| | |||||
* | Comment | Erik Johnston | 2017-02-01 | 1 | -0/+3 |
| | |||||
* | Include newly joined users in /keys/changes API | Erik Johnston | 2017-02-01 | 1 | -0/+7 |
| | |||||
* | Merge pull request #1870 from matrix-org/erikj/cache_get_all_new_events | Erik Johnston | 2017-02-01 | 1 | -0/+2 |
|\ | | | | | Add a small cache get_all_new_events | ||||
| * | Add a small cache get_all_new_events | Erik Johnston | 2017-02-01 | 1 | -0/+2 |
| | | |||||
* | | Merge pull request #1868 from matrix-org/erikj/replication_cache | Erik Johnston | 2017-02-01 | 2 | -22/+0 |
|\ \ | | | | | | | Only invalidate membership caches based on the cache stream | ||||
| * | | Only invalidate membership caches based on the cache stream | Erik Johnston | 2017-01-31 | 2 | -22/+0 |
| | | | | | | | | | | | | | | | Before we completely invalidated get_users_in_room whenever we updated any current_state_events table. This was way too aggressive. | ||||
* | | | Add m.room.member type to query | Erik Johnston | 2017-02-01 | 1 | -1/+1 |
| | | | |||||
* | | | Merge pull request #1867 from matrix-org/erikj/member_index | Erik Johnston | 2017-02-01 | 3 | -1/+26 |
|\ \ \ | |_|/ |/| | | Add an index to make membership queries faster | ||||
| * | | Add an index to make membership queries faster | Erik Johnston | 2017-01-31 | 3 | -1/+26 |
| |/ | |||||
* / | Up get_latest_event_ids_in_room cache | Erik Johnston | 2017-02-01 | 1 | -1/+1 |
|/ | |||||
* | Merge pull request #1864 from matrix-org/erikj/device_list_fixes | Erik Johnston | 2017-01-31 | 1 | -8/+26 |
|\ | | | | | Fix clearing out old device list outbound pokes | ||||
| * | Fix deletion of old sent devices correctly | Erik Johnston | 2017-01-31 | 1 | -5/+17 |
| | | |||||
| * | Only fetch with row ts and count > 1 | Erik Johnston | 2017-01-31 | 1 | -1/+2 |
| | | |||||
| * | Fix clearing out old device list outbound pokes | Erik Johnston | 2017-01-31 | 1 | -2/+7 |
| | | |||||
* | | Merge pull request #1862 from matrix-org/erikj/presence_update | Erik Johnston | 2017-01-31 | 1 | -2/+6 |
|\ \ | |/ |/| | Use DB cache of joined users for presence | ||||
| * | Stream cache invalidations for room membership storage functions | Erik Johnston | 2017-01-30 | 1 | -2/+6 |
| | | |||||
* | | Don't have such a large cache | Erik Johnston | 2017-01-30 | 1 | -1/+1 |
| | | |||||
* | | Fix unit tests | Erik Johnston | 2017-01-30 | 1 | -2/+10 |
| | | |||||
* | | Noop device key changes if they're the same | Erik Johnston | 2017-01-30 | 2 | -11/+40 |
| | | |||||
* | | Fix query | Erik Johnston | 2017-01-30 | 1 | -1/+1 |
|/ | |||||
* | Use get_users_in_room and declare it iterable | Erik Johnston | 2017-01-30 | 1 | -1/+1 |
| | |||||
* | Rename func | Erik Johnston | 2017-01-30 | 1 | -1/+1 |
| | |||||
* | Clear out old destination pokes. | Erik Johnston | 2017-01-30 | 1 | -0/+42 |
| | |||||
* | Always use the latest stream_id, sent or unsent | Erik Johnston | 2017-01-30 | 1 | -4/+4 |
| | |||||
* | Add ts column to device_lists_outbound_pokes | Erik Johnston | 2017-01-27 | 2 | -1/+5 |
| | |||||
* | Hook device list updates to replication | Erik Johnston | 2017-01-27 | 1 | -0/+15 |
| | |||||
* | Comment | Erik Johnston | 2017-01-27 | 1 | -0/+2 |
| | |||||
* | Comment | Erik Johnston | 2017-01-27 | 1 | -0/+2 |
| | |||||
* | SQL param ordering | Erik Johnston | 2017-01-27 | 1 | -1/+1 |
| | |||||
* | User if rather than for | Erik Johnston | 2017-01-27 | 1 | -1/+4 |
| | |||||
* | Better name | Erik Johnston | 2017-01-27 | 1 | -1/+1 |
| | |||||
* | Remove unused param | Erik Johnston | 2017-01-27 | 1 | -2/+1 |
| | |||||
* | Fix on sqlite: use left rather than outer join | Erik Johnston | 2017-01-26 | 1 | -3/+3 |
| | |||||
* | Handle users leaving rooms | Erik Johnston | 2017-01-26 | 1 | -0/+8 |
| | |||||
* | Add comments | Erik Johnston | 2017-01-26 | 2 | -3/+42 |
| | |||||
* | Implement device key caching over federation | Erik Johnston | 2017-01-26 | 3 | -26/+199 |
| | |||||
* | Fix up sending of m.device_list_update edus | Erik Johnston | 2017-01-25 | 1 | -20/+20 |
| | |||||
* | Add basic implementation of local device list changes | Erik Johnston | 2017-01-25 | 5 | -21/+244 |
| | |||||
* | Typo | Erik Johnston | 2017-01-23 | 1 | -1/+1 |
| | |||||
* | Refactor to calculate state delta outside transaction | Erik Johnston | 2017-01-23 | 1 | -87/+118 |
| | |||||
* | Comments | Erik Johnston | 2017-01-20 | 1 | -8/+19 |
| | |||||
* | Insert delta of current_state_events to be more efficient | Erik Johnston | 2017-01-20 | 2 | -78/+52 |
| | |||||
* | Spelling | Erik Johnston | 2017-01-20 | 1 | -1/+1 |
| | |||||
* | Update all call sites after rename | Erik Johnston | 2017-01-20 | 1 | -1/+1 |
| | |||||
* | Comments | Erik Johnston | 2017-01-20 | 1 | -0/+11 |
| | |||||
* | Calculate the forward extremeties once | Erik Johnston | 2017-01-20 | 2 | -126/+92 |
| | |||||
* | Derive current_state_events from state groups | Erik Johnston | 2017-01-20 | 1 | -70/+118 |
| | |||||
* | Lower loading events log to DEBUG | Erik Johnston | 2017-01-17 | 1 | -2/+2 |
| | |||||
* | Increase state_group_cache_size | Erik Johnston | 2017-01-17 | 1 | -1/+1 |
| | |||||
* | Up cache max entries for state | Erik Johnston | 2017-01-16 | 2 | -2/+2 |
| | |||||
* | Increase cache size limit | Erik Johnston | 2017-01-16 | 2 | -2/+2 |
| | |||||
* | Optionally measure size of cache by sum of length of values | Erik Johnston | 2017-01-13 | 2 | -2/+3 |
| | |||||
* | Merge pull request #1793 from matrix-org/erikj/change_device_inbox_index | Erik Johnston | 2017-01-13 | 3 | -3/+55 |
|\ | | | | | Change device_inbox stream index to include user | ||||
| * | Add comment | Erik Johnston | 2017-01-13 | 1 | -0/+1 |
| | | |||||
| * | Explicitly close the cursor | Erik Johnston | 2017-01-10 | 1 | -0/+1 |
| | | |||||
| * | Don't disable autocommit | Erik Johnston | 2017-01-10 | 1 | -8/+4 |
| | | |||||
| * | Change device_inbox stream index to include user | Erik Johnston | 2017-01-10 | 3 | -3/+57 |
| | | | | | | | | | | This makes fetching the nost recently changed users much tricker, and brings it in line with e.g. presence_stream indices. | ||||
* | | Limit number of entries to prefill from cache | Erik Johnston | 2017-01-10 | 2 | -3/+6 |
|/ | | | | | | | | | Some tables, like device_inbox, take a long time to query at startup for the stream change cache prefills. This is likely because they are slower growing streams and so are more fragmented on disk. For now, lets pull fewer entries out to make startup quicker. In future, we should add a better index to make it even faster. | ||||
* | Merge branch 'release-v0.18.6' into develop | Matthew Hodgson | 2017-01-05 | 2 | -3/+3 |
|\ | |||||
| * | fix annoying typos | Matthew Hodgson | 2017-01-05 | 2 | -3/+3 |
| | | |||||
* | | Merge branch 'release-v0.18.6' into develop | Matthew Hodgson | 2017-01-05 | 1 | -0/+2 |
|\| | |||||
| * | More logging for the linearizer and for get_events | Mark Haines | 2017-01-05 | 1 | -0/+2 |
| | | |||||
* | | Add /account/3pid/delete endpoint | David Baker | 2016-12-20 | 1 | -0/+11 |
|/ | | | | Also fix a typo in a comment | ||||
* | Add some logging for syncing to_device events | Richard van der Hoff | 2016-12-15 | 1 | -1/+2 |
| | | | | | Attempt to track down the loss of to_device events (https://github.com/vector-im/riot-web/issues/2711 etc). | ||||
* | Fixup membership query | Erik Johnston | 2016-12-14 | 1 | -2/+2 |
| | |||||
* | Merge pull request #1697 from matrix-org/erikj/fix_bg_member | Erik Johnston | 2016-12-12 | 1 | -1/+1 |
|\ | | | | | Fix background update that prematurely stopped | ||||
| * | Fix background update that prematurely stopped | Erik Johnston | 2016-12-12 | 1 | -1/+1 |
| | | |||||
* | | Merge pull request #1676 from matrix-org/erikj/room_list | Erik Johnston | 2016-12-12 | 2 | -20/+196 |
|\ \ | |/ |/| | Add new API appservice specific public room list | ||||
| * | Add cache to get_public_room_ids_at_stream_id | Erik Johnston | 2016-12-12 | 1 | -0/+2 |
| | | |||||
| * | Notify replication. Use correct network_id | Erik Johnston | 2016-12-12 | 1 | -1/+3 |
| | | |||||
| * | Docstring | Erik Johnston | 2016-12-12 | 1 | -0/+12 |
| | | |||||
| * | Comments | Erik Johnston | 2016-12-07 | 1 | -0/+2 |
| | | |||||
| * | Add new API appservice specific public room list | Erik Johnston | 2016-12-06 | 2 | -20/+178 |
| | | |||||
* | | Merge pull request #1680 from matrix-org/erikj/joined_rooms | Erik Johnston | 2016-12-09 | 4 | -3/+123 |
|\ \ | | | | | | | Add new room membership APIs | ||||
| * | | Add /room/<room_id>/joined_members API | Erik Johnston | 2016-12-08 | 1 | -3/+13 |
| | | | | | | | | | | | | | | | | | | This returns the currently joined members in the room with their display names and avatar urls. This is more efficient than /members for large rooms where you don't need the full events. | ||||
| * | | Add profile data to the room_membership table for joins | Erik Johnston | 2016-12-08 | 4 | -0/+110 |
| |/ | |||||
* / | Fix result of insert_receipt | Richard van der Hoff | 2016-12-08 | 1 | -1/+1 |
|/ | | | | This should fix the absence of notifications when new receipts arrive. | ||||
* | Rip out more refresh_token code | Richard van der Hoff | 2016-11-30 | 2 | -67/+0 |
| | | | | | | | | We might as well treat all refresh_tokens as invalid. Just return a 403 from /tokenrefresh, so that we don't have a load of dead, untestable code hanging around. Still TODO: removing the table from the schema. | ||||
* | Don't send old events as federation | Erik Johnston | 2016-11-24 | 1 | -1/+1 |
| | |||||
* | Comment | Erik Johnston | 2016-11-23 | 1 | -1/+3 |
| | |||||
* | More efficient notif count queries | Erik Johnston | 2016-11-23 | 2 | -8/+48 |
| | |||||
* | Merge pull request #1635 from matrix-org/erikj/split_out_fed_txn | Erik Johnston | 2016-11-23 | 8 | -29/+156 |
|\ | | | | | Split out federation transaction sending to a worker | ||||
| * | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-11-23 | 1 | -0/+8 |
| |\ | | | | | | | | | | erikj/split_out_fed_txn | ||||
| * | | Fix tests and flake8 | Erik Johnston | 2016-11-22 | 1 | -1/+0 |
| | | | |||||
| * | | Invalidate retry cache in both directions | Erik Johnston | 2016-11-22 | 1 | -12/+36 |
| | | | |||||
| * | | Fix tests | Erik Johnston | 2016-11-21 | 1 | -2/+2 |
| | | | |||||
| * | | Store federation stream positions in the database | Erik Johnston | 2016-11-21 | 3 | -4/+52 |
| | | | |||||
| * | | Handle sending events and device messages over federation | Erik Johnston | 2016-11-17 | 4 | -13/+62 |
| | | | |||||
| * | | Hook up the send queue and create a federation sender worker | Erik Johnston | 2016-11-16 | 1 | -0/+7 |
| | | | |||||
* | | | Ignore AS users when fetching push rules | Erik Johnston | 2016-11-23 | 2 | -2/+18 |
| |/ |/| | | | | | | | By ignoring AS users early on when fetching push rules for a room we can avoid needlessly hitting the DB and filling up the caches. | ||||
* | | Fail with a coherent error message if `/sync?filter=` is invalid | Kegan Dougal | 2016-11-21 | 1 | -0/+8 |
|/ | |||||
* | Merge pull request #1617 from matrix-org/erikj/intern_state_dict | Erik Johnston | 2016-11-15 | 1 | -1/+4 |
|\ | | | | | Correctly intern keys in state cache | ||||
| * | Correctly intern keys in state cache | Erik Johnston | 2016-11-08 | 1 | -1/+4 |
| | | |||||
* | | New Flake8 fixes | Erik Johnston | 2016-11-15 | 1 | -0/+1 |
|/ | |||||
* | Comment | Erik Johnston | 2016-11-04 | 1 | -0/+1 |
| | |||||
* | Remove unused but buggy function | Erik Johnston | 2016-11-04 | 1 | -11/+1 |
| | |||||
* | Remove spurious comment | Erik Johnston | 2016-11-03 | 1 | -2/+2 |
| | |||||
* | Replace postgres GIN with GIST | Erik Johnston | 2016-11-03 | 3 | -1/+45 |
| | | | | | This is because GIN can be slow to write too, especially when the table gets large. | ||||
* | Continue to clean up received_transactions | Erik Johnston | 2016-11-01 | 1 | -0/+14 |
| | |||||
* | Removed unused stuff | Erik Johnston | 2016-10-31 | 1 | -163/+3 |
| | |||||
* | Increase batching of sent transaction inserts | Erik Johnston | 2016-10-31 | 1 | -1/+1 |
| | | | | | | This should further reduce the number of individual inserts, transactions and updates that are required for keeping sent_transactions up to date. | ||||
* | Use most recently added binding, not most recently seen user. | Erik Johnston | 2016-10-27 | 1 | -19/+11 |
| | |||||
* | Fix user_threepids schema delta | Erik Johnston | 2016-10-27 | 1 | -1/+38 |
| | | | | | | | | | | | The delta `37/user_threepids.sql` aimed to update all the email addresses to be lower case, however duplicate emails may exist in the table already. This commit adds a step where the delta moves the duplicate emails to a new `medium` `email_old`. Only the most recently used account keeps the binding intact. We move rather than delete so that we retain some record of which emails were associated with which account. | ||||
* | Fix incredubly slow back pagination query | Erik Johnston | 2016-10-24 | 1 | -6/+13 |
| | | | | | | | If a client didn't specify a from token when paginating backwards synapse would attempt to query the (global) maximum topological token. This a) doesn't make much sense since they're room specific and b) there are no indices that lets postgres do this efficiently. | ||||
* | Merge pull request #1164 from pik/error-codes | Erik Johnston | 2016-10-19 | 1 | -1/+0 |
|\ | | | | | Clarify Error codes for GET /filter/ | ||||
| * | Refactor test_filter to use real DataStore | pik | 2016-10-18 | 1 | -1/+0 |
| | | | | | | | | * add tests for filter api errors | ||||
* | | Latest delta is now 37 | David Baker | 2016-10-19 | 1 | -0/+0 |
| | | |||||
* | | Merge remote-tracking branch 'origin/develop' into ↵ | David Baker | 2016-10-19 | 3 | -2/+82 |
|\ \ | | | | | | | | | | dbkr/password_reset_case_insensitive | ||||
| * | | Bump schema version | Erik Johnston | 2016-10-17 | 2 | -1/+1 |
| | | | |||||
| * | | Remove TODO | Erik Johnston | 2016-10-17 | 1 | -2/+0 |
| | | | |||||
| * | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/remove_auth | Erik Johnston | 2016-10-17 | 12 | -72/+429 |
| |\ \ | |||||
| * | | | Drop some unused indices | Erik Johnston | 2016-10-17 | 3 | -17/+83 |
| | | | | |||||
| * | | | Remove redundant event_auth index | Erik Johnston | 2016-09-13 | 1 | -0/+16 |
| | | | | |||||
* | | | | Convert emails to lowercase when storing | David Baker | 2016-10-19 | 1 | -1/+8 |
| | | | | | | | | | | | | | | | | And db migration sql to convert existing addresses. | ||||
* | | | | Revert part of 6207399 | David Baker | 2016-10-14 | 1 | -20/+10 |
| | | | | | | | | | | | | | | | | | | | | older sqlite doesn't support indexes on expressions, lets just store things lowercase in the db | ||||
* | | | | Merge remote-tracking branch 'origin/develop' into ↵ | David Baker | 2016-10-14 | 1 | -0/+3 |
|\ \ \ \ | | |/ / | |/| | | | | | | dbkr/password_reset_case_insensitive | ||||
| * | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-10-11 | 3 | -44/+64 |
| |\ \ \ | | | | | | | | | | | | | | | | erikj/replication_noop | ||||
| * | | | | Reduce DB hits for replication | Erik Johnston | 2016-09-23 | 1 | -0/+3 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some streams will occaisonally advance their positions without actually having any new rows to send over federation. Currently this means that the token will not advance on the workers, leading to them repeatedly sending a slightly out of date token. This in turns requires the master to hit the DB to check if there are any new rows, rather than hitting the no op logic where we check if the given token matches the current token. This commit changes the API to always return an entry if the position for a stream has changed, allowing workers to advance their tokens correctly. | ||||
* | | | | | Make password reset email field case insensitive | David Baker | 2016-10-14 | 2 | -10/+36 |
| |/ / / |/| | | | |||||
* | | | | storage/appservice: make appservice methods only relying on the cache ↵ | Patrik Oldsberg | 2016-10-06 | 1 | -6/+6 |
| |_|/ |/| | | | | | | | | synchronous | ||||
* | | | Merge pull request #1145 from matrix-org/erikj/fix_reindex | Erik Johnston | 2016-09-29 | 1 | -15/+29 |
|\ \ \ | | | | | | | | | Fix background reindex of origin_server_ts | ||||
| * | | | Fix background reindex of origin_server_ts | Erik Johnston | 2016-09-27 | 1 | -15/+29 |
| |/ / | | | | | | | | | | | | | | | | | | | | | | The storage function `_get_events_txn` was removed everywhere except from this background reindex. The function was removed due to it being (almost) completely unused while also being large and complex. Therefore, instead of resurrecting `_get_events_txn` we manually reimplement the bits that are needed directly. | ||||
* | | | Remove duplication | Erik Johnston | 2016-09-27 | 1 | -31/+19 |
| | | | |||||
* | | | Remove unused variable | Erik Johnston | 2016-09-27 | 1 | -3/+0 |
| | | | |||||
* | | | Fix perf of fetching state in SQLite | Erik Johnston | 2016-09-26 | 1 | -20/+41 |
|/ / | |||||
* | | Match against event_id, rather than room_id | Erik Johnston | 2016-09-21 | 1 | -1/+1 |
| | | |||||
* | | Remove spurious AS clause | Erik Johnston | 2016-09-21 | 1 | -1/+1 |
| | | |||||
* | | Update correct table | Erik Johnston | 2016-09-21 | 1 | -6/+10 |
| | | |||||
* | | Readd entries to public_room_list_stream that were deleted | Erik Johnston | 2016-09-21 | 2 | -1/+23 |
| | | |||||
* | | Fix _delete_old_forward_extrem_cache query | Erik Johnston | 2016-09-21 | 1 | -5/+4 |
| | | |||||
* | | Comment | Erik Johnston | 2016-09-16 | 1 | -0/+2 |
| | | |||||
* | | Filter remote rooms lists locally | Erik Johnston | 2016-09-16 | 1 | -1/+1 |
| | | |||||
* | | Handling expiring stream extrems correctly. | Erik Johnston | 2016-09-15 | 2 | -3/+22 |
| | | |||||
* | | Change get_pos_of_last_change to return upper bound | Erik Johnston | 2016-09-15 | 1 | -3/+2 |
| | | |||||
* | | Use stream_change cache to make get_forward_extremeties_for_room cache more ↵ | Erik Johnston | 2016-09-15 | 1 | -1/+10 |
| | | | | | | | | effective | ||||
* | | Add cache to get_forward_extremeties_for_room | Erik Johnston | 2016-09-15 | 1 | -0/+1 |
| | | |||||
* | | Merge pull request #1121 from matrix-org/erikj/public_room_paginate | Erik Johnston | 2016-09-15 | 6 | -15/+288 |
|\ \ | | | | | | | Add pagination support to publicRooms | ||||
| * | | Stream public room changes down replication | Erik Johnston | 2016-09-15 | 1 | -0/+16 |
| | | | |||||
| * | | Base public room list off of public_rooms stream | Erik Johnston | 2016-09-15 | 1 | -0/+52 |
| | | | |||||
| * | | Calculate the public room list from a stream_ordering | Erik Johnston | 2016-09-14 | 1 | -0/+3 |
| | | | |||||
| * | | Add a room visibility stream | Erik Johnston | 2016-09-14 | 4 | -16/+100 |
| | | | |||||
| * | | Add a DB index to figure out past state at a stream ordering in a room | Erik Johnston | 2016-09-14 | 2 | -0/+118 |
| |/ | |||||
* | | Fix reindex | Erik Johnston | 2016-09-14 | 1 | -15/+16 |
| | | |||||
* | | Ensure we don't mutate state cache entries | Erik Johnston | 2016-09-14 | 1 | -20/+25 |
|/ | |||||
* | Remove where clause | Erik Johnston | 2016-09-12 | 1 | -1/+0 |
| | |||||
* | Index contains_url for file search queries | Erik Johnston | 2016-09-12 | 2 | -0/+25 |
| | |||||
* | Add WHERE clause support to index creation | Erik Johnston | 2016-09-12 | 2 | -10/+17 |
| | |||||
* | Merge pull request #1106 from matrix-org/erikj/state_reindex_concurrent | Erik Johnston | 2016-09-12 | 1 | -1/+1 |
|\ | | | | | Create new index concurrently | ||||
| * | Create new index concurrently | Erik Johnston | 2016-09-12 | 1 | -1/+1 |
| | | |||||
* | | Merge pull request #1105 from matrix-org/erikj/make_notif_highlight_query_fast | Erik Johnston | 2016-09-12 | 2 | -1/+29 |
|\ \ | |/ |/| | Optimise /notifications query | ||||
| * | Change the index to be stream_ordering, highlight | Erik Johnston | 2016-09-12 | 1 | -1/+1 |
| | | |||||
| * | Remove unused import | Erik Johnston | 2016-09-12 | 1 | -1/+0 |
| | | |||||
| * | Use register_background_index_update | Erik Johnston | 2016-09-12 | 1 | -24/+4 |
| | | |||||
| * | Add back in query change | Erik Johnston | 2016-09-12 | 1 | -1/+3 |
| | | |||||
| * | Merge branch 'develop' of github.com:matrix-org/synapse into ↵ | Erik Johnston | 2016-09-12 | 8 | -22/+60 |
| |\ | | | | | | | | | | erikj/make_notif_highlight_query_fast | ||||
| * | | Make reindex happen in bg | Erik Johnston | 2016-09-12 | 2 | -3/+32 |
| | | | |||||
* | | | Merge pull request #1104 from matrix-org/markjh/direct_to_device_federation_sync | Mark Haines | 2016-09-12 | 1 | -0/+2 |
|\ \ \ | |_|/ |/| | | Fix direct to device messages recieved over federation to notify sync | ||||
| * | | Fix direct to device messages recieved over federation to notify sync | Mark Haines | 2016-09-12 | 1 | -0/+2 |
| | | | |||||
* | | | Add comments to existing schema deltas that used "CREATE INDEX" directly | Mark Haines | 2016-09-12 | 6 | -0/+24 |
|/ / | |||||
* | | Revert "Add index to event_push_actions" | Erik Johnston | 2016-09-12 | 2 | -21/+1 |
| | | |||||
* | | Change state fetch query for postgres to be faster | Erik Johnston | 2016-09-12 | 1 | -19/+35 |
|/ | | | | | | It turns out that postgres doesn't like doing a list of OR's and is about 1000x slower, so we just issue a query for each specific type seperately. | ||||
* | Merge remote-tracking branch 'origin/develop' into ↵ | David Baker | 2016-09-09 | 9 | -40/+360 |
|\ | | | | | | | dbkr/make_notif_highlight_query_fast | ||||
| * | Use the previous MAX value if any to set the stream_id | Mark Haines | 2016-09-09 | 1 | -1/+2 |
| | | |||||
| * | Track the max_stream_device_id in a separate table, since we delete from the ↵ | Mark Haines | 2016-09-09 | 3 | -3/+36 |
| | | | | | | | | inbox table | ||||
| * | Merge pull request #1087 from matrix-org/markjh/reapply_delta | Mark Haines | 2016-09-09 | 1 | -1/+4 |
| |\ | | | | | | | Reapply 34/device_outbox in 35/device_outbox_again.py since the schem… | ||||
| | * | Just move the schema and add some DROPs | Mark Haines | 2016-09-09 | 2 | -35/+4 |
| | | | |||||
| | * | Only catch databas errors | Mark Haines | 2016-09-08 | 1 | -1/+1 |
| | | | |||||
| | * | Add a stub run_upgrade | Mark Haines | 2016-09-08 | 1 | -0/+4 |
| | | | |||||
| | * | Reapply 34/device_outbox in 35/device_outbox_again.py since the schema was ↵ | Mark Haines | 2016-09-08 | 1 | -0/+30 |
| | | | | | | | | | | | | bumped before it landed on develop | ||||
| * | | Merge branch 'release-v0.17.3' of github.com:matrix-org/synapse into develop | Erik Johnston | 2016-09-09 | 1 | -1/+1 |
| |\ \ | |||||
| | * | | Reduce batch size to be under SQL limit | Erik Johnston | 2016-09-09 | 1 | -1/+1 |
| | | | | |||||
| * | | | Merge pull request #1081 from matrix-org/dbkr/notifications_only_highlight | Matthew Hodgson | 2016-09-09 | 1 | -1/+8 |
| |\ \ \ | | | | | | | | | | | Implement `only=highlight` on `/notifications` | ||||
| * \ \ \ | Merge pull request #1080 from matrix-org/dbkr/fix_notifications_api_with_from | David Baker | 2016-09-08 | 1 | -1/+1 |
| |\ \ \ \ | | | | | | | | | | | | | Fix /notifications API when used with `from` param |