summary refs log tree commit diff
path: root/synapse/push/mailer.py (unfollow)
Commit message (Collapse)AuthorFilesLines
2018-02-21Add hacky cache factor override systemErik Johnston4-4/+18
2018-02-20(Really) fix tablescan of event_push_actions on purgeRichard van der Hoff1-1/+0
commit 278d21b5 added new code to avoid the tablescan, but didn't remove the old :/
2018-02-15Don't serialize current state over replicationErik Johnston3-8/+51
2018-02-15Fix state group storage bug in workersErik Johnston1-41/+41
We needed to move `_count_state_group_hops_txn` to the StateGroupWorkerStore.
2018-02-15Don't log errors propogated from send_eventErik Johnston1-1/+10
2018-02-15Avoid doing presence updates on replication reconnect github/matrix-org-hotfixes-refactor matrix-org-hotfixes-refactorRichard van der Hoff2-0/+3
Presence is supposed to be disabled on matrix.org, so we shouldn't send a load of USER_SYNC commands every time the synchrotron reconnects to the master.
2018-02-15Disable auth on room_members for nowhera1-1/+1
because the moznet bridge is broken (https://github.com/matrix-org/matrix-appservice-irc/issues/506)
2018-02-15Bump LAST_SEEN_GRANULARITY in client_ipsErik Johnston1-1/+1
2018-02-15Prefill client_ip_last_seen in replicationErik Johnston1-0/+2
2018-02-15Move event sending to end in shutdown room admin apiErik Johnston1-11/+11
2018-02-15Add dummy presence REST handler to frontend proxyErik Johnston1-0/+31
The handler no-ops all requests as presence is disabled.
2018-02-15Don't intern type/state_keys in state storeErik Johnston1-2/+1
2018-02-15Increase store._state_group_cache cache sizeErik Johnston1-1/+1
2018-02-15Make _get_joined_hosts_cache cache non-iterableErik Johnston1-1/+1
2018-02-15Increase MAX_EVENTS_BEHIND for replication clientsErik Johnston1-1/+1
2018-02-15Disable presence in txn queueErik Johnston1-0/+1
2018-02-15Handle exceptions in get_hosts_for_room when sending events over federationErik Johnston1-11/+16
2018-02-15Limit concurrent AS joinsErik Johnston1-13/+19
2018-02-15Disable presenceErik Johnston6-7/+15
This reverts commit 0ebd376a53bb75ade6d65db2d716478758c2c9f0 and disables presence a bit more
2018-02-15Make push actions rotation configurableErik Johnston1-3/+5
2018-02-15Deleting from event_push_actions needs to use an indexMark Haines1-1/+8
2018-02-15Disable auto search for prefixes in event searchErik Johnston1-1/+1
2018-02-15Add timeout to ResponseCache of /public_roomsErik Johnston1-1/+1
2018-02-14purge_history: fix sqlite syntax errorRichard van der Hoff1-1/+4
apparently sqlite insists on indexes being named
2018-02-14purge_history: handle sqlite asshatteryRichard van der Hoff1-19/+27
apparently creating a temporary table commits the transaction. because that's a useful thing.
2018-02-14remove overzealous exception handlingRichard van der Hoff1-18/+10
2018-02-14purge_history: fix index useRichard van der Hoff1-0/+14
event_push_actions doesn't have an index on event_id, so we need to specify room_id.
2018-02-14Rework event purge to use a temporary tableRichard van der Hoff1-35/+58
... which should speed things up by reducing the amount of data being shuffled across the connection
2018-02-13Update docsErik Johnston1-1/+4
2018-02-13Fix log message in purge_historyRichard van der Hoff1-2/+1
(we don't just remove remote events)
2018-02-13move search reindex to schema 47Richard van der Hoff2-1/+1
We're up to schema v47 on develop now, so this will have to go in there to have an effect. This might cause an error if somebody has already run it in the v46 guise, and runs it again in the v47 guise, because it will cause a duplicate entry in the bbackground_updates table. On the other hand, the entry is removed once it is complete, and it is unlikely that anyone other than matrix.org has run it on v46. The update itself is harmless to re-run because it deliberately copes with the index already existing.
2018-02-13GIN reindex: Fix syntax errors, improve exception handlingRichard van der Hoff1-13/+27
2018-02-13style nitRichard van der Hoff1-1/+1
2018-02-13Fix typos in purge api & docRichard van der Hoff2-4/+2
* It's supposed to be purge_local_events, not ..._history * Fix the doc to have valid json
2018-02-12Update workers docs to include http portErik Johnston1-5/+20
2018-02-09purge: move room_depth update to endRichard van der Hoff1-6/+12
... to avoid locking the table for too long
2018-02-09delete_local_events for purge_historyRichard van der Hoff5-15/+67
Add a flag which makes the purger delete local events
2018-02-09purge: Move cache invalidation to more appropriate placeRichard van der Hoff1-4/+4
it was a bit of a non-sequitur there
2018-02-09bump purge logging to infoRichard van der Hoff1-13/+14
this thing takes ages and the only sign of any progress is the logs, so having some logs is useful.
2018-02-09rename delete_old_state -> purge_historyRichard van der Hoff2-8/+8
(beacause it deletes more than state)
2018-02-07Tell storage providers about new file so they can uploadErik Johnston1-0/+6
2018-02-07Add note in docs/workers.rstErik Johnston1-0/+11
2018-02-07Move presence handling into handle_new_client_eventErik Johnston1-6/+6
As we want to have it run on the main synapse instance
2018-02-07Add event_creator workerErik Johnston3-1/+190
2018-02-07Add replication http endpoint for event sendingErik Johnston8-13/+304
2018-02-07Remove pointless ratelimit checkErik Johnston1-5/+0
The intention was for the check to be called as early as possible in the request, but actually was called just before the main ratelimit check, so was fairly pointless.
2018-02-06Update copyrightErik Johnston6-1/+6
2018-02-06s/_create_new_client_event/create_new_client_event/Erik Johnston4-12/+12
2018-02-06Store state groups separately from events (#2784)Erik Johnston12-189/+326
* Split state group persist into seperate storage func * Add per database engine code for state group id gen * Move store_state_group to StateReadStore This allows other workers to use it, and so resolve state. * Hook up store_state_group * Fix tests * Rename _store_mult_state_groups_txn * Rename StateGroupReadStore * Remove redundant _have_persisted_state_group_txn * Update comments * Comment compute_event_context * Set start val for state_group_id_seq ... otherwise we try to recreate old state groups * Update comments * Don't store state for outliers * Update comment * Update docstring as state groups are ints
2018-02-05Use StateResolutionHandler to resolve state in persist eventsRichard van der Hoff1-48/+24
... and thus benefit (hopefully) from its cache.
2018-02-05Flatten _get_new_state_after_eventsRichard van der Hoff1-44/+46
rejig the if statements to simplify the logic and reduce indentation
2018-02-05Check that events being persisted have state_groupRichard van der Hoff1-4/+9
2018-02-05Add event_map param to resolve_state_groupsRichard van der Hoff2-4/+31
2018-02-05Remove redundant return value from _calculate_state_deltaRichard van der Hoff1-10/+23
we already have the state from _get_new_state_after_events, so returning it from _calculate_state_delta is just confusing.
2018-02-05Factor out common code for search insertRichard van der Hoff1-33/+62
we can reuse the same code as is used for event insert, for doing the background index population.
2018-02-05Updates testsErik Johnston2-8/+6
2018-02-05Update places where we create eventsErik Johnston7-38/+42
2018-02-05Split event creation into a separate handlerErik Johnston1-146/+160
2018-02-05Move store_event_search_txn to SearchStoreRichard van der Hoff2-35/+41
... as a precursor to making event storing and doing the bg update share some code.
2018-02-05report metrics on number of cache evictionsRichard van der Hoff5-5/+56
2018-02-05Fix broken unit test for media storageErik Johnston1-1/+6
2018-02-05Add .vscode to gitignoreErik Johnston1-0/+2
2018-02-04Factor out common code for search insertRichard van der Hoff1-33/+56
we can reuse the same code as is used for event insert, for doing the background index population.
2018-02-03Clean up work_mem handlingRichard van der Hoff1-11/+41
Add some comments and improve exception handling when twiddling work_mem for the search update
2018-02-03Move store_event_search_txn to SearchStoreRichard van der Hoff2-37/+43
... as a precursor to making event storing and doing the bg update share some code.
2018-02-02Reinstate event_search_postgres_gist handlerRichard van der Hoff3-6/+31
People may have queued updates for this, so we can't just delete it.
2018-02-02Handle url_previews with no content-typeRichard van der Hoff1-21/+34
avoid failing with an exception if the remote server doesn't give us a Content-Type header. Also, clean up the exception handling a bit.
2018-02-01doc arg types for _seperateRichard van der Hoff1-0/+15
2018-02-01More docstring fixesRichard van der Hoff1-4/+4
Fix a couple of errors in docstrings
2018-02-01Fix docstring for StateHandler.resolve_state_groupsRichard van der Hoff1-4/+9
The return type was a complete lie, so fix it
2018-02-01Factor out resolve_state_groups to a separate handlerRichard van der Hoff4-54/+108
We extract the storage-independent bits of the state group resolution out to a separate functiom, and stick it in a new handler, in preparation for its use from the storage layer.
2018-02-01Rename resolve_state_groups -> resolve_state_groups_for_eventsRichard van der Hoff2-12/+11
(to make way for a method that actually just does the state group resolution)
2018-01-31