summary refs log tree commit diff
path: root/synapse/app/synchrotron.py (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Move storage classes into a main "data store".Erik Johnston2019-10-211-1/+1
| | | | | This is in preparation for having multiple data stores that offer different functionality, e.g. splitting out state or event storage.
* Implement a structured logging output system. (#5680)Amber Brown2019-08-281-2/+2
|
* Call startup commands as system triggers.Erik Johnston2019-07-221-1/+3
| | | | | This helps ensures that we only consider ourselves "up" once all the startup functions have completed.
* Support Prometheus_client 0.4.0+ (#5636)Amber Brown2019-07-181-2/+1
|
* Move logging utilities out of the side drawer of util/ and into logging/ (#5606)Amber Brown2019-07-041-1/+1
|
* Run Black. (#5482)Amber Brown2019-06-201-43/+47
|
* Make EventStream rows have a typeRichard van der Hoff2019-03-271-1/+4
| | | | ... as a precursor to combining it with the CurrentStateDelta stream.
* Deduplicate some code in synapse.app (#4567)Amber Brown2019-02-081-6/+1
|
* Fix typing being reset causing infinite syncs (#4127)Amber Brown2018-11-031-0/+14
|
* Make workers work on Py3 (#4027)Amber Brown2018-10-131-6/+6
|
* Replaced all occurences of e.message with str(e)Schnuffle2018-09-271-1/+1
| | | | Signed-off-by: Schnuffle <schnuffle@github.com>
* Fix some instances of ExpiringCache not expiring cache itemsErik Johnston2018-09-211-1/+0
| | | | | | | | ExpiringCache required that `start()` be called before it would actually start expiring entries. A number of places didn't do that. This PR removes `start` from ExpiringCache, and automatically starts backround reaping process on creation instead.
* Make sure that we close db connections opened during initRichard van der Hoff2018-08-281-4/+1
| | | | | | | | | We should explicitly close any db connections we open, because failing to do so can block other transactions as per https://github.com/matrix-org/synapse/issues/3682. Let's also try to factor out some of the boilerplate by having server classes define their datastore class rather than duplicating the whole of `setup`.
* Merge pull request #3709 from matrix-org/rav/logcontext_for_replication_commandsRichard van der Hoff2018-08-171-1/+2
|\ | | | | Logcontexts for replication command handlers
| * Logcontexts for replication command handlersRichard van der Hoff2018-08-171-1/+2
| | | | | | | | | | | | | | | | | | | | Run the handlers for replication commands as background processes. This should improve the visibility in our metrics, and reduce the number of "running db transaction from sentinel context" warnings. Ideally it means converting the things that fire off deferreds into the night into things that actually return a Deferred when they are done. I've made a bit of a stab at this, but it will probably be leaky.
* | Integrate presence from hotfixes (#3694)Amber Brown2018-08-181-5/+11
|/
* Pull out did_forget to worker storeErik Johnston2018-07-241-4/+1
|
* run isortAmber Brown2018-07-091-5/+6
|
* The flag is named enable_metrics, not collect_metricsTravis Ralston2018-06-121-1/+1
| | | Signed-off-by: Travis Ralston <travpc@gmail.com>
* Run Prometheus on a different port, optionally. (#3274)Amber Brown2018-05-311-1/+9
|
* Set Server header in SynapseRequestRichard van der Hoff2018-05-101-0/+1
| | | | | | | | | | | | (instead of everywhere that writes a response. Or rather, the subset of places which write responses where we haven't forgotten it). This also means that we don't have to have the mysterious version_string attribute in anything with a request handler. Unfortunately it does mean that we have to pass the version string wherever we instantiate a SynapseSite, which has been c&ped 150 times, but that is code that ought to be cleaned up anyway really.
* Merge remote-tracking branch 'origin/develop' into rav/use_run_in_backgroundRichard van der Hoff2018-04-271-46/+49
|\
| * Improve exception handling for background processesRichard van der Hoff2018-04-271-46/+49
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | There were a bunch of places where we fire off a process to happen in the background, but don't have any exception handling on it - instead relying on the unhandled error being logged when the relevent deferred gets garbage-collected. This is unsatisfactory for a number of reasons: - logging on garbage collection is best-effort and may happen some time after the error, if at all - it can be hard to figure out where the error actually happened. - it is logged as a scary CRITICAL error which (a) I always forget to grep for and (b) it's not really CRITICAL if a background process we don't care about fails. So this is an attempt to add exception handling to everything we fire off into the background.
* | Use run_in_background in preference to preserve_fnRichard van der Hoff2018-04-271-3/+2
|/ | | | | | While I was going through uses of preserve_fn for other PRs, I converted places which only use the wrapped function once to use run_in_background, to avoid creating the function object.
* Use six.itervalues in some placesAdrian Tschira2018-04-151-1/+3
| | | | | | There's more where that came from Signed-off-by: Adrian Tschira <nota@notafile.com>
* 404 correctly on missing paths via NoResourceMatthew Hodgson2018-03-231-2/+2
| | | | fixes https://github.com/matrix-org/synapse/issues/2043 and https://github.com/matrix-org/synapse/issues/2029
* Move storage functions for push calculationsErik Johnston2018-02-271-6/+2
| | | | This will allow push actions for an event to be calculated on workers.
* Factor out get_db_conn to HomeServer base classRichard van der Hoff2018-01-261-13/+0
| | | | | This function is identical to all subclasses, so we may as well push it up to the base class to reduce duplication (and make use of it in the tests)
* Implement listen_tcp method in remaining workersSilke2017-12-181-21/+17
| | | | Signed-off-by: Silke <silke@slxh.eu>
* Add a comment which might save some confusionRichard van der Hoff2017-11-241-0/+1
|
* Remove dead sync_callbackRichard van der Hoff2017-11-241-2/+0
| | | | This is never used; let's remove it to stop confusing things.
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/groups_mergedErik Johnston2017-09-191-49/+20
|\
| * Factor out common application startRichard van der Hoff2017-08-151-49/+20
| | | | | | | | | | We have 10 copies of this code, and I don't really want to update each one separately.
* | Fix replication. And notifyErik Johnston2017-07-201-0/+6
|/
* Make workers report to master for user ip updatesErik Johnston2017-06-271-2/+2
|
* Move get_presence_list_* to SlaveStoreErik Johnston2017-04-111-11/+1
|
* Move get_interested_partiesErik Johnston2017-04-111-3/+2
|
* Reduce federation presence replication trafficErik Johnston2017-04-101-4/+2
| | | | | | | | This is mainly done by moving the calculation of where to send presence updates from the presence handler to the transaction queue, so we only need to send the presence event (and not the destinations) across the replication connection. Before we were duplicating by sending the full state across once per destination.
* Merge pull request #2103 from matrix-org/erikj/no-double-encodeErik Johnston2017-04-071-3/+1
|\ | | | | Don't double encode replication data
| * Don't double json encode typing replication dataErik Johnston2017-04-051-3/+1
| |
* | CommentErik Johnston2017-04-061-1/+1
| |
* | DocsErik Johnston2017-04-061-0/+7
| |
* | Don't immediately notify the master about users whose syncs have gone awayErik Johnston2017-04-051-4/+36
|/
* Add the appropriate amount of preserve_fnErik Johnston2017-04-041-7/+6
|
* Shuffle and comment synchrotron presenceErik Johnston2017-04-041-9/+11
|
* Update all the workers and master to use TCP replicationErik Johnston2017-04-031-196/+110
|
* Merge pull request #2033 from matrix-org/erikj/repl_speedErik Johnston2017-03-211-4/+8
|\ | | | | Don't send the full event json over replication
| * PEP8Erik Johnston2017-03-201-1/+0
| |
| * Don't send the full event json over replicationErik Johnston2017-03-171-3/+8
| |
* | Run the reactor with the sentinel logcontextRichard van der Hoff2017-03-181-2/+7
|/ | | | | | This fixes a class of 'Unexpected logcontext' messages, which were happening because the logcontext was somewhat arbitrarily swapping between the sentinel and the `run` logcontext.
* Don't recreate so many setsErik Johnston2017-03-161-2/+1
|
* Refactor logger config for workersRichard van der Hoff2017-03-101-1/+1
| | | | - to make it easier to add more config options.
* Add db functions needed for room initial sync to slaveMark Haines2017-02-131-0/+4
|
* Remove debug loggingErik Johnston2017-01-301-1/+0
|
* Hook device list updates to replicationErik Johnston2017-01-271-1/+26
|
* Restore default bind addressErik Johnston2017-01-101-10/+2
|
* Fix check for bind_addressJohannes Löthberg2016-12-201-2/+2
| | | | | | | The empty string is a valid setting for the bind_address option, so explicitly check for None here instead. Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>
* Add support for specifying multiple bind addressesJohannes Löthberg2016-12-181-20/+34
| | | | Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>
* Respect use_frozen_dicts option in workersErik Johnston2016-11-081-0/+2
|
* Support /initialSync in synchrotron workerErik Johnston2016-09-211-0/+6
|
* Enable state caches on workersErik Johnston2016-09-151-0/+1
|
* CommentErik Johnston2016-09-091-0/+3
|
* Fix up the calls to the notifier for device messagesMark Haines2016-09-011-0/+3
|
* Add new direct message storage functions to slave storeErik Johnston2016-08-301-0/+2
|
* Remove broken cache stuffErik Johnston2016-08-151-5/+0
|
* Implement cache replication streamErik Johnston2016-08-151-13/+0
|
* Make synchrotron accept /eventsErik Johnston2016-08-121-2/+34
|
* Synced up synchrotron set_state with PresenceHandler set_stateWill Hunt2016-08-111-1/+1
|
* Add federation /version APIErik Johnston2016-08-051-1/+1
|
* Fix setting gc thresholds in the workersMark Haines2016-06-171-1/+2
|
* Use worker_ prefixes for worker config, use existing support for multiple ↵Mark Haines2016-06-161-17/+12
| | | | config files
* Access the event_cache_size directly from the server object.Mark Haines2016-06-161-3/+3
| | | | | This means that the workers can override the event_cache_size directly without clobbering the value in the main synapse config.
* Access replication_url from the worker config directlyMark Haines2016-06-161-2/+3
|
* Inline the synchrotron and pusher configs into the main configMark Haines2016-06-161-103/+34
|
* Add gc_threshold to pusher and synchrotronErik Johnston2016-06-071-0/+14
|
* Allow setting of gc.set_thresholdsErik Johnston2016-06-071-5/+10
|
* Merge pull request #845 from matrix-org/markjh/synchrotron_presenceMark Haines2016-06-061-1/+4
|\ | | | | Fix a KeyError in the synchrotron presence
| * Fix a KeyError in the synchrotron presenceMark Haines2016-06-061-1/+4
| |
* | Yield on the sleeps intended to backoff replicationMark Haines2016-06-061-1/+1
|/
* Fix spellingMark Haines2016-06-031-1/+1
|
* Add get_presence_list_accepted to the broken caches in synchrotronMark Haines2016-06-031-4/+9
|
* Clear the list of ongoing syncs on shutdownMark Haines2016-06-031-0/+9
|
* Appease flake8Mark Haines2016-06-031-1/+1
|
* Use ClientIpStore to record client ipsMark Haines2016-06-031-3/+4
|
* Send updates to the syncing users every ten seconds or immediately if ↵Mark Haines2016-06-031-10/+43
| | | | they've just come online
* Add a separate process that can handle /sync requestsMark Haines2016-06-031-0/+467
generated by cgit-pink 1.4.1 (git 2.36.1) at 2024-11-16 23:37:39 +0000