summary refs log tree commit diff
path: root/MAP.rst (unfollow)
Commit message (Collapse)AuthorFilesLines
2018-02-16(Really) fix tablescan of event_push_actions on purgeRichard van der Hoff1-1/+0
commit 278d21b5 added new code to avoid the tablescan, but didn't remove the old :/
2018-02-16Fix typo of double is_highlightErik Johnston1-1/+1
2018-02-16CommentsErik Johnston3-1/+9
2018-02-15Fix unit testErik Johnston1-4/+6
2018-02-15Ensure that we delete staging push actions on errorsErik Johnston2-3/+25
2018-02-15Remove context.push_actionsErik Johnston5-20/+11
2018-02-15Update event_push_actions table from staging tableErik Johnston2-22/+39
2018-02-15Store push actions in staging areaErik Johnston3-0/+54
2018-02-15Don't serialize current state over replicationErik Johnston3-8/+51
2018-02-15Fix state group storage bug in workersErik Johnston1-41/+41
We needed to move `_count_state_group_hops_txn` to the StateGroupWorkerStore.
2018-02-15Don't log errors propogated from send_eventErik Johnston1-1/+10
2018-02-14purge_history: fix sqlite syntax errorRichard van der Hoff1-1/+4
apparently sqlite insists on indexes being named
2018-02-14purge_history: handle sqlite asshatteryRichard van der Hoff1-19/+27
apparently creating a temporary table commits the transaction. because that's a useful thing.
2018-02-14remove overzealous exception handlingRichard van der Hoff1-18/+10
2018-02-14purge_history: fix index useRichard van der Hoff1-0/+14
event_push_actions doesn't have an index on event_id, so we need to specify room_id.
2018-02-14Rework event purge to use a temporary tableRichard van der Hoff1-35/+58
... which should speed things up by reducing the amount of data being shuffled across the connection
2018-02-13Update docsErik Johnston1-1/+4
2018-02-13Fix log message in purge_historyRichard van der Hoff1-2/+1
(we don't just remove remote events)
2018-02-13move search reindex to schema 47Richard van der Hoff2-1/+1
We're up to schema v47 on develop now, so this will have to go in there to have an effect. This might cause an error if somebody has already run it in the v46 guise, and runs it again in the v47 guise, because it will cause a duplicate entry in the bbackground_updates table. On the other hand, the entry is removed once it is complete, and it is unlikely that anyone other than matrix.org has run it on v46. The update itself is harmless to re-run because it deliberately copes with the index already existing.
2018-02-13GIN reindex: Fix syntax errors, improve exception handlingRichard van der Hoff1-13/+27
2018-02-13style nitRichard van der Hoff1-1/+1
2018-02-13Fix typos in purge api & docRichard van der Hoff2-4/+2
* It's supposed to be purge_local_events, not ..._history * Fix the doc to have valid json
2018-02-12Update workers docs to include http portErik Johnston1-5/+20
2018-02-09purge: move room_depth update to endRichard van der Hoff1-6/+12
... to avoid locking the table for too long
2018-02-09delete_local_events for purge_historyRichard van der Hoff5-15/+67
Add a flag which makes the purger delete local events
2018-02-09purge: Move cache invalidation to more appropriate placeRichard van der Hoff1-4/+4
it was a bit of a non-sequitur there
2018-02-09bump purge logging to infoRichard van der Hoff1-13/+14
this thing takes ages and the only sign of any progress is the logs, so having some logs is useful.
2018-02-09rename delete_old_state -> purge_historyRichard van der Hoff2-8/+8
(beacause it deletes more than state)
2018-02-07Tell storage providers about new file so they can uploadErik Johnston1-0/+6
2018-02-07Add note in docs/workers.rstErik Johnston1-0/+11
2018-02-07Move presence handling into handle_new_client_eventErik Johnston1-6/+6
As we want to have it run on the main synapse instance
2018-02-07Add event_creator workerErik Johnston3-1/+190
2018-02-07Add replication http endpoint for event sendingErik Johnston8-13/+304
2018-02-07Remove pointless ratelimit checkErik Johnston1-5/+0
The intention was for the check to be called as early as possible in the request, but actually was called just before the main ratelimit check, so was fairly pointless.
2018-02-06Update copyrightErik Johnston6-1/+6
2018-02-06s/_create_new_client_event/create_new_client_event/Erik Johnston4-12/+12
2018-02-06Store state groups separately from events (#2784)Erik Johnston12-189/+326
* Split state group persist into seperate storage func * Add per database engine code for state group id gen * Move store_state_group to StateReadStore This allows other workers to use it, and so resolve state. * Hook up store_state_group * Fix tests * Rename _store_mult_state_groups_txn * Rename StateGroupReadStore * Remove redundant _have_persisted_state_group_txn * Update comments * Comment compute_event_context * Set start val for state_group_id_seq ... otherwise we try to recreate old state groups * Update comments * Don't store state for outliers * Update comment * Update docstring as state groups are ints
2018-02-05Use StateResolutionHandler to resolve state in persist eventsRichard van der Hoff1-48/+24
... and thus benefit (hopefully) from its cache.
2018-02-05Flatten _get_new_state_after_eventsRichard van der Hoff1-44/+46
rejig the if statements to simplify the logic and reduce indentation
2018-02-05Check that events being persisted have state_groupRichard van der Hoff1-4/+9
2018-02-05Add event_map param to resolve_state_groupsRichard van der Hoff2-4/+31
2018-02-05Remove redundant return value from _calculate_state_deltaRichard van der Hoff1-10/+23
we already have the state from _get_new_state_after_events, so returning it from _calculate_state_delta is just confusing.
2018-02-05Factor out common code for search insertRichard van der Hoff1-33/+62
we can reuse the same code as is used for event insert, for doing the background index population.
2018-02-05Updates testsErik Johnston2-8/+6
2018-02-05Update places where we create eventsErik Johnston7-38/+42
2018-02-05Split event creation into a separate handlerErik Johnston1-146/+160
2018-02-05Move store_event_search_txn to SearchStoreRichard van der Hoff2-35/+41
... as a precursor to making event storing and doing the bg update share some code.
2018-02-05report metrics on number of cache evictionsRichard van der Hoff5-5/+56
2018-02-05Fix broken unit test for media storageErik Johnston1-1/+6
2018-02-05Add .vscode to gitignoreErik Johnston1-0/+2
2018-02-04Factor out common code for search insertRichard van der Hoff1-33/+56
we can reuse the same code as is used for event insert, for doing the background index population.
2018-02-03Clean up work_mem handlingRichard van der Hoff1-11/+41
Add some comments and improve exception handling when twiddling work_mem for the search update
2018-02-03Move store_event_search_txn to SearchStoreRichard van der Hoff2-37/+43
... as a precursor to making event storing and doing the bg update share some code.
2018-02-02Reinstate event_search_postgres_gist handlerRichard van der Hoff3-6/+31
People may have queued updates for this, so we can't just delete it.
2018-02-02Handle url_previews with no content-typeRichard van der Hoff1-21/+34
avoid failing with an exception if the remote server doesn't give us a Content-Type header. Also, clean up the exception handling a bit.
2018-02-01