summary refs log tree commit diff
path: root/synapse/storage/events.py (follow)
Commit message (Expand)AuthorAgeFilesLines
* Basic compact event github/erikj/compact_event erikj/compact_eventErik Johnston2018-02-231-3/+3
* (Really) fix tablescan of event_push_actions on purgeRichard van der Hoff2018-02-161-1/+0
* Remove context.push_actionsErik Johnston2018-02-151-4/+3
* Update event_push_actions table from staging tableErik Johnston2018-02-151-1/+1
* purge_history: fix sqlite syntax errorRichard van der Hoff2018-02-141-1/+4
* purge_history: handle sqlite asshatteryRichard van der Hoff2018-02-141-19/+27
* purge_history: fix index useRichard van der Hoff2018-02-141-0/+14
* Rework event purge to use a temporary tableRichard van der Hoff2018-02-141-35/+58
* Fix log message in purge_historyRichard van der Hoff2018-02-131-2/+1
* Merge pull request #2864 from matrix-org/rav/persist_event_cachingRichard van der Hoff2018-02-131-56/+40
|\
| * style nitRichard van der Hoff2018-02-131-1/+1
| * Use StateResolutionHandler to resolve state in persist eventsRichard van der Hoff2018-02-051-48/+24
| * Flatten _get_new_state_after_eventsRichard van der Hoff2018-02-051-44/+46
| * Check that events being persisted have state_groupRichard van der Hoff2018-02-051-4/+9
| * Add event_map param to resolve_state_groupsRichard van der Hoff2018-02-051-0/+1
* | Merge pull request #2858 from matrix-org/rav/purge_updatesRichard van der Hoff2018-02-091-33/+61
|\ \
| * | purge: move room_depth update to endRichard van der Hoff2018-02-091-6/+12
| * | delete_local_events for purge_historyRichard van der Hoff2018-02-091-7/+28
| * | purge: Move cache invalidation to more appropriate placeRichard van der Hoff2018-02-091-4/+4
| * | bump purge logging to infoRichard van der Hoff2018-02-091-13/+14
| * | rename delete_old_state -> purge_historyRichard van der Hoff2018-02-091-7/+7
* | | Store state groups separately from events (#2784)Erik Johnston2018-02-061-6/+4
| |/ |/|
* | Remove redundant return value from _calculate_state_deltaRichard van der Hoff2018-02-051-10/+23
* | factor _get_new_state_after_events out of _calculate_state_deltaRichard van der Hoff2018-01-311-18/+39
* | Improve exception handling in persist_eventRichard van der Hoff2018-01-291-3/+3
|/
* Merge pull request #2805 from matrix-org/rav/log_state_resRichard van der Hoff2018-01-171-0/+6
|\
| * Log room when doing state resolutionRichard van der Hoff2018-01-171-0/+6
* | Split resolve_events into two functionsRichard van der Hoff2018-01-171-2/+2
* | Fix a logcontext leak in persist_eventsRichard van der Hoff2018-01-161-1/+8
|/
* Make __init__ consitstent across Store heirarchyRichard van der Hoff2017-11-131-2/+2
* replace 'except:' with 'except Exception:'Richard van der Hoff2017-10-231-1/+1
* Fix logcontext handling for persist_eventsRichard van der Hoff2017-10-171-7/+17
* Invalidate cacheErik Johnston2017-10-031-0/+3
* Make into listErik Johnston2017-06-291-1/+1
* Prefill forward extrems and event to state groupsErik Johnston2017-06-291-0/+5
* Merge pull request #2286 from matrix-org/erikj/split_out_user_dirErik Johnston2017-06-161-0/+18
|\
| * Initial worker implErik Johnston2017-06-161-0/+18
* | Merge pull request #2281 from matrix-org/erikj/phone_home_statsErik Johnston2017-06-151-58/+43
|\ \ | |/ |/|
| * Add some more statsErik Johnston2017-06-151-0/+15
| * Fix phone home statsErik Johnston2017-06-141-59/+29
* | Add cache for is_host_joinedErik Johnston2017-06-131-0/+5
* | Merge pull request #2259 from matrix-org/erikj/fix_state_woesErik Johnston2017-06-071-1/+1
|\ \
| * | Fix bug where state_group tables got corruptedErik Johnston2017-06-071-1/+1
| |/
* | Fix typoErik Johnston2017-05-311-1/+1
* | Add stream change cacheErik Johnston2017-05-311-0/+4
* | Add clobbered event_idErik Johnston2017-05-301-0/+1
* | Add current_state_delta_stream tableErik Johnston2017-05-301-8/+23
* | Only store event_auth for state eventsErik Johnston2017-05-241-0/+1
|/
* Merge pull request #2224 from matrix-org/erikj/prefill_stateErik Johnston2017-05-161-5/+10
|\
| * Remove spurious merge artifactsErik Johnston2017-05-161-13/+0
| * CommentsErik Johnston2017-05-151-3/+3
| * Add more granular event send metricsErik Johnston2017-05-151-0/+12
| * Prefill state cachesErik Johnston2017-05-151-2/+8
* | Don't create event_search index on sqliteRichard van der Hoff2017-05-111-0/+1
* | Add more logging for purgingRichard van der Hoff2017-05-111-7/+14
* | Add an index to event_searchRichard van der Hoff2017-05-111-0/+11
|/
* Tidy purge code and add some commentsRichard van der Hoff2017-05-111-12/+19
* Don't de-delta state groups we're about to deleteRichard van der Hoff2017-05-101-11/+9
* add some logging to purge_historyRichard van der Hoff2017-05-101-4/+21
* Expand docstring a bitErik Johnston2017-05-081-1/+7
* Don't update event cache hit ratio from get_joined_usersErik Johnston2017-05-081-2/+11
* Revert "Prefill state caches"Erik Johnston2017-05-041-11/+5
* CommentsErik Johnston2017-05-031-3/+3
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/prefill_stateErik Johnston2017-05-031-0/+18
|\
| * Add more granular event send metricsErik Johnston2017-05-021-0/+16
* | Prefill state cachesErik Johnston2017-05-021-2/+6
|/
* Correct logic in is_event_afterLuke Barnard2017-04-131-1/+1
* Simplify is_event_after logicLuke Barnard2017-04-121-10/+3
* travis flake8..Luke Barnard2017-04-111-0/+1
* Refactor event ordering check to events storeLuke Barnard2017-04-111-0/+28
* Add new storage functions for new replicationErik Johnston2017-03-301-0/+88
* TypoErik Johnston2017-03-271-1/+1
* Short circuit if all new events have same state groupErik Johnston2017-03-271-36/+51
* Use iter(items|values)Erik Johnston2017-03-241-18/+14
* User Cursor.__iter__ instead of fetchallErik Johnston2017-03-231-1/+1
* Merge pull request #2033 from matrix-org/erikj/repl_speedErik Johnston2017-03-211-17/+14
|\
| * Don't send the full event json over replicationErik Johnston2017-03-171-17/+14
* | Avoid resetting state on rejected eventsRichard van der Hoff2017-03-171-4/+4
* | Refactoring and cleanupsRichard van der Hoff2017-03-171-60/+213
|/
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/public_lis...Erik Johnston2017-03-141-3/+28
|\
| * Fix current_state_events table to not lieErik Johnston2017-03-141-3/+28
* | Get current state by using current_state_events tableErik Johnston2017-03-101-10/+8
|/
* Remove needless checkErik Johnston2017-02-271-2/+0
* It should be allErik Johnston2017-02-271-1/+1
* Don't fetch current state in common caseErik Johnston2017-02-271-0/+17
* Ignore new rejected events when working out forward extremeties.Erik Johnston2017-02-081-9/+6
* Merge pull request #1870 from matrix-org/erikj/cache_get_all_new_eventsErik Johnston2017-02-011-0/+2
|\
| * Add a small cache get_all_new_eventsErik Johnston2017-02-011-0/+2
* | Only invalidate membership caches based on the cache streamErik Johnston2017-01-311-20/+0
|/
* Stream cache invalidations for room membership storage functionsErik Johnston2017-01-301-2/+6
* TypoErik Johnston2017-01-231-1/+1
* Refactor to calculate state delta outside transactionErik Johnston2017-01-231-87/+118
* CommentsErik Johnston2017-01-201-8/+19
* Insert delta of current_state_events to be more efficientErik Johnston2017-01-201-26/+52
* SpellingErik Johnston2017-01-201-1/+1
* Update all call sites after renameErik Johnston2017-01-201-1/+1
* CommentsErik Johnston2017-01-201-0/+11
* Calculate the forward extremeties onceErik Johnston2017-01-201-56/+86
* Derive current_state_events from state groupsErik Johnston2017-01-201-70/+118
* Lower loading events log to DEBUGErik Johnston2017-01-171-2/+2
* More logging for the linearizer and for get_eventsMark Haines2017-01-051-0/+2
* New Flake8 fixesErik Johnston2016-11-151-0/+1
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/remove_authErik Johnston2016-10-171-15/+29
|\
| * Fix background reindex of origin_server_tsErik Johnston2016-09-271-15/+29
* | Drop some unused indicesErik Johnston2016-10-171-1/+0
|/
* Index contains_url for file search queriesErik Johnston2016-09-121-0/+8
* Take value in a better wayErik Johnston2016-09-051-1/+1
* Correctly delete old state groups in purge history APIErik Johnston2016-09-051-20/+79
* Limit the length of state chainsErik Johnston2016-09-021-21/+28
* Generate state group ids in state layerErik Johnston2016-08-311-9/+1
* Make _state_groups_id_gen a normal IdGeneratorErik Johnston2016-08-301-44/+39
* Use state handler instead of get_users_in_room/get_joined_hostsErik Johnston2016-08-261-1/+0
* Preserve some logcontextsErik Johnston2016-08-241-6/+10
* Move defer.returnValue out of MeasureErik Johnston2016-08-191-1/+1
* Measure _get_event_from_rowErik Johnston2016-08-191-41/+43
* Add missing database corruption recovery caseBenjamin Saunders2016-08-141-1/+2
* Raise 404 when couldn't find eventErik Johnston2016-08-051-1/+1
* Delete more tablesErik Johnston2016-08-051-0/+5
* Tweak integrity error recovery to work as intendedBenjamin Saunders2016-08-041-0/+3
* Fix typoErik Johnston2016-08-041-3/+4
* Retry event persistence on IntegrityErrorErik Johnston2016-08-041-4/+65
* Remove other bit of deduplicationErik Johnston2016-08-031-19/+0
* Ensure we only persist an event once at a timeErik Johnston2016-08-031-1/+18
* Fix how push_actions are redacted.Mark Haines2016-07-261-8/+10
* Don't add rejected events if we've seen them befrore. Add some comments to ex...Mark Haines2016-07-261-5/+48
* Only update the events and event_json tables for rejected eventsMark Haines2016-07-251-51/+62
* Don't add the events to forward extremities if the event is rejectedMark Haines2016-07-251-3/+6
* Don't add rejections to the state_group, persist all rejectionsMark Haines2016-07-251-4/+5
* Merge pull request #922 from matrix-org/erikj/file_api2Erik Johnston2016-07-201-0/+82
|\
| * Add sender and contains_url field to events tableErik Johnston2016-07-141-0/+82
* | Fix /purge_history bugErik Johnston2016-07-151-19/+15
* | event_backwards_extremeties may not be emptyErik Johnston2016-07-151-1/+11
|/
* CommentErik Johnston2016-07-071-0/+3
* Return 400 rather than 500Erik Johnston2016-07-071-1/+4
* Add rest servlet. Fix SQL.Erik Johnston2016-07-061-5/+4
* Add purge_history APIErik Johnston2016-07-051-0/+6
* Add storage function to purge history for a roomErik Johnston2016-07-041-0/+140
* Use similar naming we use in email notifs for pushDavid Baker2016-06-241-7/+0
* Merge pull request #841 from matrix-org/erikj/event_counterErik Johnston2016-06-061-0/+9
|\
| * Add metric counter for number of persisted eventsErik Johnston2016-06-061-0/+9
* | Add events to cache when we persist themErik Johnston2016-06-061-0/+41
|/
* Don't rely on options when inserting event into cacheErik Johnston2016-06-031-40/+43
* Change the way we cache eventsErik Johnston2016-06-031-39/+41
* Remove event fetching from DB threadsErik Johnston2016-06-031-138/+0
* Use state to calculate get_users_in_roomErik Johnston2016-06-011-3/+0
* Merge remote-tracking branch 'origin/develop' into dbkr/email_notifsDavid Baker2016-05-101-11/+149
|\
| * Remove unused importErik Johnston2016-05-061-1/+1
| * Pull loop one level upErik Johnston2016-05-061-36/+41
| * Queue events for persistenceErik Johnston2016-05-061-11/+144
* | Merge remote-tracking branch 'origin/develop' into dbkr/email_notifsDavid Baker2016-04-291-2/+8
|\|
| * Check that somethign has happend before running the selectsMark Haines2016-04-271-2/+8
* | First bits of emailpusherDavid Baker2016-04-191-0/+2
|/
* Add back backfilled parameter that was removedErik Johnston2016-04-121-3/+4
* Check if we've already backfilled eventsErik Johnston2016-04-121-0/+16
* Merge remote-tracking branch 'origin/develop' into dbkr/pushers_use_event_act...David Baker2016-04-071-2/+2
|\
| * Add a slaved events store classMark Haines2016-04-061-2/+2
* | pep8David Baker2016-04-061-1/+3
* | Make pushers use the event_push_actions table instead of listening on an even...David Baker2016-04-061-0/+12
|/
* Store invites in a separate table.Erik Johnston2016-04-041-9/+4
* Merge pull request #684 from matrix-org/markjh/backfill_id_genMark Haines2016-04-011-14/+5
|\
| * Use a stream id generator for backfilled idsMark Haines2016-04-011-14/+5
* | Fix the invalidation of the names and aliases cacheMark Haines2016-04-011-1/+1
|/
* Move the check for backfilled outside the for loopMark Haines2016-03-311-5/+5
* Remove the is_new_state argument to persist event.Mark Haines2016-03-311-40/+50
* Merge pull request #676 from matrix-org/markjh/replicate_stateIIIMark Haines2016-03-311-2/+76
|\
| * Use a namedtuple rather than tuple unpackingMark Haines2016-03-311-2/+9
| * Add replication streams for ex outliers and current state resetsMark Haines2016-03-301-1/+59
| * Add a entry to current_state_resets table when the current state is resetMark Haines2016-03-301-0/+9
* | return the state_group for backfillMark Haines2016-03-301-1/+2
|/
* Add a replication stream for state groupsMark Haines2016-03-301-1/+5
* Use a stream id generator to assign state group idsMark Haines2016-03-301-40/+50
* Merge pull request #665 from matrix-org/erikj/dont_cache_eventsErik Johnston2016-03-231-2/+2
|\
| * Don't cache events in get_current_state_for_keyErik Johnston2016-03-231-2/+2
* | Make StateHandler._state_cache only store event_ids.Erik Johnston2016-03-221-0/+25
|/
* Remove unused backfilled parameter from persist_eventMark Haines2016-03-211-18/+4
* Dedupe requested event list in _get_eventsErik Johnston2016-03-181-14/+12
* Fix relative imports so they work in both py3 and py27Mark Haines2016-03-081-1/+1
* Merge pull request #489 from matrix-org/markjh/replicationMark Haines2016-03-011-0/+45
|\
| * Add a /replication API for extracting the updates that happened onMark Haines2016-03-011-0/+45
* | Load the current id in the IdGenerator constructorMark Haines2016-03-011-3/+3
|/
* Remove unused param from get_max_tokenErik Johnston2016-02-181-1/+1
* Rename functionsErik Johnston2016-02-101-2/+2
* Atomically persit push actions when we persist the eventErik Johnston2016-02-091-10/+16
* Fix up logcontextsErik Johnston2016-02-081-14/+20
* Fix flake8 warnings for new flake8Daniel Wagner-Hall2016-02-021-3/+3
* Cache tags and account dataErik Johnston2016-01-281-1/+1
* Invalidate caches properly. Remove unused argErik Johnston2016-01-281-3/+6
* PEP8Erik Johnston2016-01-271-1/+3
* Use the same path for incremental with gap or without gapErik Johnston2016-01-271-1/+0
* Add cache to room streamErik Johnston2016-01-271-0/+2
* Add a Homeserver.setup method.Erik Johnston2016-01-261-9/+5
* copyrightsMatthew Hodgson2016-01-071-1/+1
* Log when we skip daily messagesDaniel Wagner-Hall2016-01-061-1/+10
* Track the time spent in the database per request.Mark Haines2015-12-071-1/+1
* Allow paginating search ordered by recentsErik Johnston2015-11-301-0/+77
* Implementation of state rollback in /syncRichard van der Hoff2015-11-131-2/+4
* Return world_readable and guest_can_join in /publicRoomsDaniel Wagner-Hall2015-11-101-0/+2
* Open up /events to anonymous users for room events onlyDaniel Wagner-Hall2015-11-051-0/+2
* Keep FTS indexes up to date. Only search through rooms currently joinedErik Johnston2015-10-121-0/+2
* Remove unused functions from synapse/storage/events.pyMark Haines2015-09-231-11/+0
* Add docstringDaniel Wagner-Hall2015-09-221-0/+6
* Implement configurable stats reportingDaniel Wagner-Hall2015-09-221-1/+57
* Merge pull request #281 from matrix-org/erikj/update_extremetiesErik Johnston2015-09-151-0/+2
|\
| * When updating a stored event from outlier to non-outlier, remember to update ...Erik Johnston2015-09-151-0/+2
* | Fix indentMark Haines2015-08-241-1/+1
* | Remove syutil dependency in favour of smaller single-purpose librariesMark Haines2015-08-241-11/+12
|/
* Fix bug where we didn't correctly serialize the redacted_because key over fed...Erik Johnston2015-08-211-0/+2
* Change Cache to not use *args in its interfaceErik Johnston2015-08-071-10/+11
* Remove commented out codeErik Johnston2015-07-101-14/+0
* Add bulk insert events APIErik Johnston2015-06-251-166/+249
* Don't explode if we don't have the eventErik Johnston2015-06-011-1/+3
* Add config option to turn off freezing events. Use new encode_json api and uj...Erik Johnston2015-05-291-10/+13
* Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2015-05-221-7/+18
|\
| * Add caches for things requested by the pushersMark Haines2015-05-211-7/+12
| * Add a cache for get_current_state with state_keyMark Haines2015-05-211-0/+6
* | Merge pull request #155 from matrix-org/erikj/perfErik Johnston2015-05-211-51/+337
|\ \
| * | s/for events/for requests for events/Erik Johnston2015-05-211-1/+1
| * | s/for events/for requests for events/Erik Johnston2015-05-211-1/+1
| * | Add commentsErik Johnston2015-05-211-3/+14
| * | Split up _get_events into defer and txn versionsErik Johnston2015-05-201-24/+35
| * | Make not return a deferred _get_event_from_row_txnErik Johnston2015-05-201-20/+5
| * | PEP8Erik Johnston2015-05-201-2/+2
| * | Split out _get_event_from_row back into defer and _txn versionErik Johnston2015-05-201-11/+57
| * | Comments and shuffle of functionsErik Johnston2015-05-181-38/+42
| * | Remove rejected events if we don't want rejected eventsErik Johnston2015-05-181-0/+3
| * | PEP8Erik Johnston2015-05-151-1/+1
| * | Revert limiting of fetching, it didn't help perf.Erik Johnston2015-05-151-9/+2
| * | init jErik Johnston2015-05-151-0/+1
| * | Don't completely drain the listErik Johnston2015-05-151-2/+9
| * | Make store.get_current_state fetch events asynclyErik Johnston2015-05-151-1/+0
| * | Remove more debug loggingErik Johnston2015-05-151-2/+0
| * | Remove debug loggingErik Johnston2015-05-151-11/+3
| * | preserve log contextErik Johnston2015-05-151-1/+2
| * | Add a waitErik Johnston2015-05-151-2/+11
| * | Srsly. Don't use closures. BaaaaaadErik Johnston2015-05-151-10/+8
| * | Correctly pass through paramsErik Johnston2015-05-151-3/+3
| * | Sort out error handlingErik Johnston2015-05-151-25/+22
| * | Fix daedlockErik Johnston2015-05-151-52/+73
| * | Remove race conditionErik Johnston2015-05-141-35/+46
| * | Call from right threadErik Johnston2015-05-141-1/+3
| * | Count and loopErik Johnston2015-05-141-36/+34
| * | Don't start up more fetch_eventsErik Johnston2015-05-141-0/+1
| * | Awful idea for speeding up fetching of eventsErik Johnston2015-05-141-36/+131
| * | Turn off preemptive transactionsErik Johnston2015-05-141-17/+7
| * | PEP8Erik Johnston2015-05-141-2/+1
| * | Move from _base to eventsErik Johnston2015-05-141-0/+246
* | | Merge pull request #152 from matrix-org/notifier_performanceMark Haines2015-05-181-0/+3
|\ \ \
| * | | Merge branch 'notifier_unify' into notifier_performanceMark Haines2015-05-141-0/+1
| |\| |
| * | | Don't bother checking for updates if the stream token hasn't advanced for a userMark Haines2015-05-131-0/+3
* | | | Move get_events functions to storage.eventsErik Johnston2015-05-181-0/+132
| |/ / |/| |