summary refs log tree commit diff
path: root/synapse/storage/events.py (follow)
Commit message (Expand)AuthorAgeFilesLines
* Move storage classes into a main "data store".Erik Johnston2019-10-211-2489/+0
* Replace IN usage with helper funcsErik Johnston2019-10-101-17/+27
* Fix inserting bytes as textErik Johnston2019-10-081-4/+2
* Use `received_ts` to find uncensored redacted eventsErik Johnston2019-10-011-14/+7
* Add received_ts column to redactions.Erik Johnston2019-10-011-9/+11
* Don't repeatedly attempt to censor events we don't have.Erik Johnston2019-10-011-1/+17
* Fix commentsErik Johnston2019-09-091-2/+3
* Use better names in SQLErik Johnston2019-09-091-5/+8
* Fixup commentErik Johnston2019-09-091-4/+12
* Don't start looping call unless enabledErik Johnston2019-09-091-1/+2
* Handle setting retention period to 0Erik Johnston2019-09-091-1/+1
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/censor_red...Erik Johnston2019-09-051-7/+8
|\
| * Fix and refactor room and user stats (#5971)Erik Johnston2019-09-041-2/+3
| * Remove unnecessary parentheses around return statements (#5931)Andrew Morgan2019-08-301-5/+5
* | Make redaction retention period configurableErik Johnston2019-09-051-2/+4
* | Censor redactions in DB after a monthErik Johnston2019-08-301-1/+87
|/
* Servlet to purge old rooms (#5845)Richard van der Hoff2019-08-221-0/+137
* Drop some unused tables. (#5893)Richard van der Hoff2019-08-211-12/+2
* Don't unnecessarily block notifying of new events.Erik Johnston2019-08-061-128/+142
* Replace returnValue with return (#5736)Amber Brown2019-07-231-18/+16
* Add membership column to current_state_events table.Erik Johnston2019-07-181-12/+14
* Move logging utilities out of the side drawer of util/ and into logging/ (#5606)Amber Brown2019-07-041-2/+2
* Fix a number of "Starting txn from sentinel context" warnings (#5605)Richard van der Hoff2019-07-031-1/+8
* BlackErik Johnston2019-06-201-2/+2
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/histogram_...Erik Johnston2019-06-201-1/+1
|\
| * Run Black. (#5482)Amber Brown2019-06-201-1/+1
* | Add descriptions and remove redundant set(..)Erik Johnston2019-06-191-3/+5
* | Add metrics for len of new extremities persisted.Erik Johnston2019-06-171-1/+23
|/
* Prometheus histograms are cumalativeErik Johnston2019-06-141-1/+2
* Expose statistics on extrems to prometheus (#5384)Amber Brown2019-06-131-13/+31
* Move event background updates to a separate fileErik Johnston2019-05-301-369/+2
* Fixup comments and loggingErik Johnston2019-05-301-9/+12
* Log actual number of entries deletedErik Johnston2019-05-291-2/+4
* Add DB bg update to cleanup extremities.Erik Johnston2019-05-291-0/+186
* Correctly filter out extremities with soft failed prevs (#5274)Erik Johnston2019-05-291-3/+79
* Exclude soft-failed events from fwd-extremity candidates. (#5146)Richard van der Hoff2019-05-211-2/+7
* Correctly update aggregation counts after redactionErik Johnston2019-05-201-0/+3
* Fix relations in worker modeErik Johnston2019-05-161-4/+8
* Add simple send_relation API and track in DBErik Johnston2019-05-151-0/+2
* drop tables listed in #1830 (#4992)Neil Johnson2019-04-081-12/+0
* Fix sync bug when accepting invites (#4956)Richard van der Hoff2019-04-021-6/+18
* Merge pull request #4955 from matrix-org/rav/merge_state_into_eventsRichard van der Hoff2019-03-281-3/+0
|\
| * Combine the CurrentStateDeltaStream into the EventStreamRichard van der Hoff2019-03-271-3/+0
* | Run `black` on some storage modules that the stats branch touches (#4959)Amber Brown2019-03-291-294/+248
|/
* Make `prev_state` field optionalErik Johnston2019-03-081-15/+0
* Implement soft failErik Johnston2019-03-061-0/+1
* Batch cache invalidation over replicationErik Johnston2019-02-181-24/+1
* Fix flake8 (#4519)Amber Brown2019-01-301-84/+84
* Add support for persisting event format versionsErik Johnston2019-01-231-0/+1
* Fix race when persisting create event (#4404)Erik Johnston2019-01-181-1/+12
* Add helpers for getting prev and auth events (#4139)Erik Johnston2018-11-061-4/+4
* Move _find_unreferenced_groupsErik Johnston2018-10-291-2/+83
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/purge_stat...Erik Johnston2018-10-261-22/+25
|\
| * Refactor state group lookup to reduce DB hits (#4011)Erik Johnston2018-10-251-1/+1
| * Update event_auth table for rejected eventsErik Johnston2018-10-161-15/+21
| * Add v2 state res algorithm.Erik Johnston2018-10-161-6/+3
* | pep8Erik Johnston2018-10-191-1/+1
* | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/purge_stat...Erik Johnston2018-10-191-33/+69
|\|
| * actually exclude outliersRichard van der Hoff2018-10-031-1/+2
| * remove debuggingRichard van der Hoff2018-10-021-10/+0
| * Fix bug in forward_extremity update logicRichard van der Hoff2018-10-021-33/+78
* | Batch process handling state groupsErik Johnston2018-10-191-60/+21
* | Delete unreferened state groups during purgeErik Johnston2018-10-041-6/+27
|/
* commentErik Johnston2018-09-131-0/+2
* pep8Erik Johnston2018-09-131-1/+0
* Create indices after insertionErik Johnston2018-09-131-14/+18
* Make purge history slightly fasterErik Johnston2018-09-131-2/+9
* Speed up lazy loading (#3827)Matthew Hodgson2018-09-121-0/+4
* Port storage/ to Python 3 (#3725)Amber Brown2018-08-311-5/+5
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/refactor_s...Erik Johnston2018-08-201-84/+2
|\
| * speed up /members and add at= and membership params (#3568)Matthew Hodgson2018-08-151-1/+1
| * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_fede...Erik Johnston2018-08-151-1/+1
| |\
| | * Rename async to async_helpers because `async` is a keyword on Python 3.7 (#3678)Amber Brown2018-08-101-1/+1
| * | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_fede...Erik Johnston2018-08-091-3/+8
| |\|
| * | Move necessary storage functions to worker classesErik Johnston2018-08-061-82/+0
* | | Choose state algorithm based on room versionErik Johnston2018-08-091-1/+3
| |/ |/|
* | Fix occasional glitches in the synapse_event_persisted_position metricRichard van der Hoff2018-08-071-3/+8
|/
* Merge pull request #3621 from matrix-org/erikj/split_fed_storeErik Johnston2018-08-021-2/+12
|\
| * update docsErik Johnston2018-08-011-1/+1
| * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_fed_...Erik Johnston2018-07-301-2/+0
| |\
| * | Split out DB writes in federation handlerErik Johnston2018-07-251-2/+12
* | | Python 3: Convert some unicode/bytes uses (#3569)Amber Brown2018-08-021-4/+10
* | | Merge pull request #3612 from matrix-org/rav/store_heirarchyRichard van der Hoff2018-07-311-1/+5
|\ \ \ | |_|/ |/| |
| * | reinstate explicit include of EventsWorkerStoreRichard van der Hoff2018-07-311-1/+3
| * | Make EventStore inherit from EventFederationStoreRichard van der Hoff2018-07-261-2/+4
| |/
* | Merge pull request #3614 from matrix-org/rav/stop_populating_event_contentRichard van der Hoff2018-07-261-1/+0
|\ \
| * | Stop populating events.contentRichard van der Hoff2018-07-261-1/+0
| |/
* / Remove some redundant joins on event_edges.room_idRichard van der Hoff2018-07-261-1/+0
|/
* Merge pull request #3603 from matrix-org/erikj/handle_outliersErik Johnston2018-07-251-6/+8
|\
| * Actually fix it by adding continueErik Johnston2018-07-251-0/+1
| * Fix typo in conditionalErik Johnston2018-07-251-1/+1
| * Correctly handle outliers during persist eventsErik Johnston2018-07-251-6/+7
* | Merge pull request #3606 from matrix-org/rav/logcontext_fixes_once_moreRichard van der Hoff2018-07-251-5/+4
|\ \
| * | Fix another logcontext leak in _persist_eventsRichard van der Hoff2018-07-251-5/+4
| |/
* / Fix occasional 'tuple index out of range' errorRichard van der Hoff2018-07-251-1/+1
|/
* Expand on docstring comment about return valueErik Johnston2018-07-241-0/+5
* Remove unnecessary iteritemsErik Johnston2018-07-241-1/+1
* Fixup comment (and indent)Erik Johnston2018-07-241-16/+20
* Don't fetch state from the database unless neededErik Johnston2018-07-241-12/+18
* Have _get_new_state_after_events return deltaErik Johnston2018-07-241-17/+48
* Don't require to_delete to have event_idsErik Johnston2018-07-241-36/+55
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/speed_up_c...Erik Johnston2018-07-241-12/+23
|\
| * Merge branch 'develop' into rav/logcontext_fixesRichard van der Hoff2018-07-241-11/+21
| |\
| | * fix idiocyRichard van der Hoff2018-07-241-2/+8
| | * Add some measure blocks to persist_eventsRichard van der Hoff2018-07-231-11/+15
| * | Logcontext fixesRichard van der Hoff2018-07-241-2/+3
| |/
* | Remove unnecessary ifErik Johnston2018-07-241-2/+1
* | Speed up _calculate_state_deltaErik Johnston2018-07-241-10/+3
|/
* CommentsErik Johnston2018-07-231-0/+3
* Only get cached state from context in persist_eventErik Johnston2018-07-231-1/+3
* Use new gettersErik Johnston2018-07-231-1/+1
* Run things as background processesRichard van der Hoff2018-07-181-6/+4
* run isortAmber Brown2018-07-091-19/+15
* Invalidate cache on correct threadErik Johnston2018-07-021-1/+2
* Attempt to be more performant on PyPy (#3462)Amber Brown2018-06-281-1/+2
* Deleting from event_push_actions needs to use an indexMark Haines2018-06-221-1/+8
* Consistently use six's iteritems and wrap lazy keys/values in list() if they'...Amber Brown2018-05-311-22/+25
* cleanupAmber Brown2018-05-221-3/+6
* Merge remote-tracking branch 'origin/develop' into 3218-official-promAmber Brown2018-05-221-24/+53
|\
| * Clarify commentErik Johnston2018-05-161-1/+2
| * CommentsErik Johnston2018-05-161-0/+8
| * Move and rename variableErik Johnston2018-05-161-3/+3
| * Make purge_history operate on tokensErik Johnston2018-05-151-8/+9
| * Use events_to_purge table rather than tokenErik Johnston2018-05-151-15/+34
* | rest of the changesAmber Brown2018-05-211-17/+11
|/
* Fix up grammarErik Johnston2018-05-031-3/+3
* Refactor event storage to not require stateErik Johnston2018-04-271-37/+67
* Refactor store.have_eventsRichard van der Hoff2018-04-201-7/+42
* Track where event stream processing have gotten up toErik Johnston2018-04-111-0/+3
* Use static JSONEncodersRichard van der Hoff2018-03-291-15/+8
* CommentErik Johnston2018-03-271-4/+5
* Fix indentErik Johnston2018-03-271-1/+1
* CommentErik Johnston2018-03-271-0/+7
* Add counter metrics for calculating state deltaErik Johnston2018-03-271-1/+30
* Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2018-03-191-1/+0
|\
| * Remove wrong commentErik Johnston2018-03-161-1/+0
| * Replace ujson with simplejsonErik Johnston2018-03-151-2/+2
* | Replace some ujson with simplejson to make it workErik Johnston2018-03-161-1/+1
* | Add Measure block for persist_eventsRichard van der Hoff2018-03-131-4/+5
* | Fix race in sync when joining roomErik Johnston2018-03-071-1/+1
* | Add some caches to help read marker APIErik Johnston2018-03-011-2/+2
* | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/handle_unp...Erik Johnston2018-02-261-359/+7
|\ \
| * | Split EventsWorkerStore into separate fileErik Johnston2018-02-231-360/+5
| * | Update copyrightErik Johnston2018-02-231-0/+1
| * | Remove redundant clockErik Johnston2018-02-231-3/+0
| * | _event_persist_queue shouldn't be in worker storeErik Johnston2018-02-231-4/+4
| * | Split out get_events and co into a worker storeErik Johnston2018-02-211-345/+350
* | | Ensure all push actions are deleted from stagingErik Johnston2018-02-201-1/+10
* | | Refactor _set_push_actions_for_event_and_users_txn to use events_and_contextsErik Johnston2018-02-201-5/+6
|/ /
* | (Really) fix tablescan of event_push_actions on purgeRichard van der Hoff2018-02-161-1/+0
* | Remove context.push_actionsErik Johnston2018-02-151-4/+3
* | Update event_push_actions table from staging tableErik Johnston2018-02-151-1/+1
* | purge_history: fix sqlite syntax errorRichard van der Hoff2018-02-141-1/+4
* | purge_history: handle sqlite asshatteryRichard van der Hoff2018-02-141-19/+27
* | purge_history: fix index useRichard van der Hoff2018-02-141-0/+14
* | Rework event purge to use a temporary tableRichard van der Hoff2018-02-141-35/+58
* | Fix log message in purge_historyRichard van der Hoff2018-02-131-2/+1
* | Merge pull request #2864 from matrix-org/rav/persist_event_cachingRichard van der Hoff2018-02-131-56/+40
|\ \
| * | style nitRichard van der Hoff2018-02-131-1/+1
| * | Use StateResolutionHandler to resolve state in persist eventsRichard van der Hoff2018-02-051-48/+24
| * | Flatten _get_new_state_after_eventsRichard van der Hoff2018-02-051-44/+46
| * | Check that events being persisted have state_groupRichard van der Hoff2018-02-051-4/+9
| * | Add event_map param to resolve_state_groupsRichard van der Hoff2018-02-051-0/+1
* | | Merge pull request #2858 from matrix-org/rav/purge_updatesRichard van der Hoff2018-02-091-33/+61
|\ \ \
| * | | purge: move room_depth update to endRichard van der Hoff2018-02-091-6/+12
| * | | delete_local_events for purge_historyRichard van der Hoff2018-02-091-7/+28
| * | | purge: Move cache invalidation to more appropriate placeRichard van der Hoff2018-02-091-4/+4
| * | | bump purge logging to infoRichard van der Hoff2018-02-091-13/+14
| * | | rename delete_old_state -> purge_historyRichard van der Hoff2018-02-091-7/+7
* | | | Store state groups separately from events (#2784)Erik Johnston2018-02-061-6/+4
| |/ / |/| |
* | | Remove redundant return value from _calculate_state_deltaRichard van der Hoff2018-02-051-10/+23
* | | factor _get_new_state_after_events out of _calculate_state_deltaRichard van der Hoff2018-01-311-18/+39
* | | Improve exception handling in persist_eventRichard van der Hoff2018-01-291-3/+3
|/ /
* | Merge pull request #2805 from matrix-org/rav/log_state_resRichard van der Hoff2018-01-171-0/+6
|\ \
| * | Log room when doing state resolutionRichard van der Hoff2018-01-171-0/+6
| |/
* | Split resolve_events into two functionsRichard van der Hoff2018-01-171-2/+2
* | Fix a logcontext leak in persist_eventsRichard van der Hoff2018-01-161-1/+8
|/
* Make __init__ consitstent across Store heirarchyRichard van der Hoff2017-11-131-2/+2
* replace 'except:' with 'except Exception:'Richard van der Hoff2017-10-231-1/+1
* Fix logcontext handling for persist_eventsRichard van der Hoff2017-10-171-7/+17
* Invalidate cacheErik Johnston2017-10-031-0/+3
* Make into listErik Johnston2017-06-291-1/+1
* Prefill forward extrems and event to state groupsErik Johnston2017-06-291-0/+5
* Merge pull request #2286 from matrix-org/erikj/split_out_user_dirErik Johnston2017-06-161-0/+18
|\
| * Initial worker implErik Johnston2017-06-161-0/+18
* | Merge pull request #2281 from matrix-org/erikj/phone_home_statsErik Johnston2017-06-151-58/+43
|\ \ | |/ |/|
| * Add some more statsErik Johnston2017-06-151-0/+15
| * Fix phone home statsErik Johnston2017-06-141-59/+29
* | Add cache for is_host_joinedErik Johnston2017-06-131-0/+5
* | Merge pull request #2259 from matrix-org/erikj/fix_state_woesErik Johnston2017-06-071-1/+1
|\ \
| * | Fix bug where state_group tables got corruptedErik Johnston2017-06-071-1/+1
| |/
* | Fix typoErik Johnston2017-05-311-1/+1
* | Add stream change cacheErik Johnston2017-05-311-0/+4
* | Add clobbered event_idErik Johnston2017-05-301-0/+1
* | Add current_state_delta_stream tableErik Johnston2017-05-301-8/+23
* | Only store event_auth for state eventsErik Johnston2017-05-241-0/+1
|/
* Merge pull request #2224 from matrix-org/erikj/prefill_stateErik Johnston2017-05-161-5/+10
|\
| * Remove spurious merge artifactsErik Johnston2017-05-161-13/+0
| * CommentsErik Johnston2017-05-151-3/+3
| * Add more granular event send metricsErik Johnston2017-05-151-0/+12
| * Prefill state cachesErik Johnston2017-05-151-2/+8
* | Don't create event_search index on sqliteRichard van der Hoff2017-05-111-0/+1
* | Add more logging for purgingRichard van der Hoff2017-05-111-7/+14
* | Add an index to event_searchRichard van der Hoff2017-05-111-0/+11
|/
* Tidy purge code and add some commentsRichard van der Hoff2017-05-111-12/+19
* Don't de-delta state groups we're about to deleteRichard van der Hoff2017-05-101-11/+9
* add some logging to purge_historyRichard van der Hoff2017-05-101-4/+21
* Expand docstring a bitErik Johnston2017-05-081-1/+7
* Don't update event cache hit ratio from get_joined_usersErik Johnston2017-05-081-2/+11
* Revert "Prefill state caches"Erik Johnston2017-05-041-11/+5
* CommentsErik Johnston2017-05-031-3/+3
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/prefill_stateErik Johnston2017-05-031-0/+18
|\
| * Add more granular event send metricsErik Johnston2017-05-021-0/+16
* | Prefill state cachesErik Johnston2017-05-021-2/+6
|/
* Correct logic in is_event_afterLuke Barnard2017-04-131-1/+1
* Simplify is_event_after logicLuke Barnard2017-04-121-10/+3
* travis flake8..Luke Barnard2017-04-111-0/+1
* Refactor event ordering check to events storeLuke Barnard2017-04-111-0/+28
* Add new storage functions for new replicationErik Johnston2017-03-301-0/+88
* TypoErik Johnston2017-03-271-1/+1
* Short circuit if all new events have same state groupErik Johnston2017-03-271-36/+51
* Use iter(items|values)Erik Johnston2017-03-241-18/+14
* User Cursor.__iter__ instead of fetchallErik Johnston2017-03-231-1/+1
* Merge pull request #2033 from matrix-org/erikj/repl_speedErik Johnston2017-03-211-17/+14
|\
| * Don't send the full event json over replicationErik Johnston2017-03-171-17/+14
* | Avoid resetting state on rejected eventsRichard van der Hoff2017-03-171-4/+4
* | Refactoring and cleanupsRichard van der Hoff2017-03-171-60/+213
|/
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/public_lis...Erik Johnston2017-03-141-3/+28
|\
| * Fix current_state_events table to not lieErik Johnston2017-03-141-3/+28
* | Get current state by using current_state_events tableErik Johnston2017-03-101-10/+8
|/
* Remove needless checkErik Johnston2017-02-271-2/+0
* It should be allErik Johnston2017-02-271-1/+1
* Don't fetch current state in common caseErik Johnston2017-02-271-0/+17
* Ignore new rejected events when working out forward extremeties.Erik Johnston2017-02-081-9/+6
* Merge pull request #1870 from matrix-org/erikj/cache_get_all_new_eventsErik Johnston2017-02-011-0/+2
|\
| * Add a small cache get_all_new_eventsErik Johnston2017-02-011-0/+2
* | Only invalidate membership caches based on the cache streamErik Johnston2017-01-311-20/+0
|/
* Stream cache invalidations for room membership storage functionsErik Johnston2017-01-301-2/+6
* TypoErik Johnston2017-01-231-1/+1
* Refactor to calculate state delta outside transactionErik Johnston2017-01-231-87/+118
* CommentsErik Johnston2017-01-201-8/+19
* Insert delta of current_state_events to be more efficientErik Johnston2017-01-201-26/+52
* SpellingErik Johnston2017-01-201-1/+1
* Update all call sites after renameErik Johnston2017-01-201-1/+1
* CommentsErik Johnston2017-01-201-0/+11
* Calculate the forward extremeties onceErik Johnston2017-01-201-56/+86
* Derive current_state_events from state groupsErik Johnston2017-01-201-70/+118
* Lower loading events log to DEBUGErik Johnston2017-01-171-2/+2
* More logging for the linearizer and for get_eventsMark Haines2017-01-051-0/+2
* New Flake8 fixesErik Johnston2016-11-151-0/+1