summary refs log tree commit diff
path: root/synapse/replication (follow)
Commit message (Expand)AuthorAgeFilesLines
* Remove unused server_tls_certificates functions (#5028)Richard van der Hoff2019-04-081-3/+0
* Remove presence lists (#4989)Neil Johnson2019-04-031-10/+0
* Fix sync bug when accepting invites (#4956)Richard van der Hoff2019-04-021-9/+22
* Combine the CurrentStateDeltaStream into the EventStreamRichard van der Hoff2019-03-273-23/+33
* Make EventStream rows have a typeRichard van der Hoff2019-03-273-16/+94
* Skip building a ROW_TYPE when building updatesRichard van der Hoff2019-03-271-2/+2
* Add parse_row method to replication stream classRichard van der Hoff2019-03-273-3/+19
* move FederationStream out to its own fileRichard van der Hoff2019-03-274-23/+43
* move EventsStream out to its own fileRichard van der Hoff2019-03-273-23/+42
* Move replication.tcp.streams into a packageRichard van der Hoff2019-03-272-33/+51
* Fix/improve some docstrings in the replication code. (#4949)Richard van der Hoff2019-03-272-7/+19
* Fix ClientReplicationStreamProtocol.__str__ (#4929)Richard van der Hoff2019-03-252-4/+5
* Fix bug where read-receipts lost their timestamps (#4927)Richard van der Hoff2019-03-252-11/+27
* Add a config option for torture-testing worker replication. (#4902)Richard van der Hoff2019-03-201-1/+17
* Prefill client IPs cache on workersErik Johnston2019-03-061-0/+2
* Merge pull request #4792 from matrix-org/anoa/replication_tokensAndrew Morgan2019-03-061-3/+28
|\
| * Simplify token replication logicAndrew Morgan2019-03-051-23/+14
| * Clean up logic and add commentsAndrew Morgan2019-03-041-11/+18
| * Clearer branching, fix missing list clearAndrew Morgan2019-03-041-4/+11
| * Prevent replication wedgingAndrew Morgan2019-03-041-4/+24
* | Add rate-limiting on registration (#4735)Brendan Abolivier2019-03-051-2/+6
* | Fixup slave storesErik Johnston2019-03-043-36/+26
|/
* When presence is enabled don't send over replicationErik Johnston2019-02-271-2/+5
* Merge pull request #4749 from matrix-org/erikj/replication_connection_backoffErik Johnston2019-02-273-5/+39
|\
| * Move connecting logic into ClientReplicationStreamProtocolErik Johnston2019-02-272-18/+17
| * Increase the max delay between retry attemptsErik Johnston2019-02-261-1/+1
| * Fix tightloop over connecting to replication serverErik Johnston2019-02-262-4/+39
* | Limit cache invalidation replication line length (#4748)Erik Johnston2019-02-271-1/+16
|/
* Fix state cache invalidation on workersErik Johnston2019-02-221-6/+1
* Fix registration on workers (#4682)Erik Johnston2019-02-203-3/+58
* Batch cache invalidation over replicationErik Johnston2019-02-181-7/+12
* Move register_device into handlerErik Johnston2019-02-181-14/+3
* Split out registration to workerErik Johnston2019-02-183-1/+179
* Fix replication for room v3 (#4523)Erik Johnston2019-01-301-1/+4
* Fix receiving events from federation via a workerErik Johnston2019-01-291-1/+1
* Replace missed usages of FrozenEventErik Johnston2019-01-252-4/+12
* Revert "Require event format version to parse or create events"Erik Johnston2019-01-252-12/+4
* Replace missed usages of FrozenEventErik Johnston2019-01-242-4/+12
* Don't truncate command name in metricsErik Johnston2018-10-291-2/+2
* Make the replication logger quieter (#4108)Amber Brown2018-10-291-1/+1
* Make workers work on Py3 (#4027)Amber Brown2018-10-136-30/+30
* Fix minor typo in exceptionTravis Ralston2018-09-131-1/+1
* merge (#3576)Amber Brown2018-09-141-7/+16
* Remove conn_idErik Johnston2018-09-041-2/+2
* Remove conn_id from repl prometheus metricsErik Johnston2018-09-031-10/+10
* Merge pull request #3713 from matrix-org/erikj/fixup_fed_loggingErik Johnston2018-08-201-1/+1
|\
| * Fix logging bug in EDU handling over replicationErik Johnston2018-08-171-1/+1
* | Logcontexts for replication command handlersRichard van der Hoff2018-08-173-15/+43
|/
* Use federation handler function rather than duplicateErik Johnston2018-08-151-41/+3
* Rename slave TransactionStore to SlaveTransactionStoreErik Johnston2018-08-151-1/+1
* Move clean_room_for_join to masterErik Johnston2018-08-091-0/+35
* Fixup doc commentsErik Johnston2018-08-091-0/+17
* Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_fede...Erik Johnston2018-08-094-17/+63
|\
| * Merge pull request #3632 from matrix-org/erikj/refactor_repl_servletErik Johnston2018-08-093-243/+374
| |\
| | * Fixup wording and remove dead codeErik Johnston2018-08-091-2/+1
| | * Rename POST param to METHODErik Johnston2018-08-082-13/+22
| | * Fixup logging and docstringsErik Johnston2018-08-082-2/+40
| * | Basic support for room versioningRichard van der Hoff2018-08-031-1/+1
* | | Import all functions from TransactionStoreErik Johnston2018-08-061-11/+2
* | | Add EDU/query handling over replicationErik Johnston2018-08-061-1/+1
* | | Add replication APIs for persisting federation eventsErik Johnston2018-08-062-1/+247
| |/ |/|
* | Fix isortErik Johnston2018-08-061-4/+1
* | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/refactor_r...Erik Johnston2018-08-031-4/+3
|\|
| * Kill off MatrixCodeMessageExceptionRichard van der Hoff2018-08-012-16/+12
* | Use new helper base class for membership requestsErik Johnston2018-07-311-171/+91
* | Use new helper base class for ReplicationSendEventRestServletErik Johnston2018-07-311-79/+36
* | Add helper base class for generating new replication endpointsErik Johnston2018-07-311-0/+208
|/
* Fix unit testsRichard van der Hoff2018-07-251-1/+1
* Wrap a number of things that run in the backgroundRichard van der Hoff2018-07-251-6/+8
* Fix missing attributes on workers.Erik Johnston2018-07-231-2/+5
* Use stream cache in get_linearized_receipts_for_roomErik Johnston2018-07-101-1/+1
* run isortAmber Brown2018-07-0924-66/+91
* Attempt to be more performant on PyPy (#3462)Amber Brown2018-06-281-6/+10
* Merge pull request #3441 from matrix-org/erikj/redo_erasureErik Johnston2018-06-251-0/+2
|\
| * Add UserErasureWorkerStore to workersErik Johnston2018-06-251-0/+2
* | Remove all global reactor imports & pass it around explicitly (#3424)Amber Brown2018-06-252-5/+5
|/
* Pass around the reactor explicitly (#3385)Amber Brown2018-06-221-3/+3
* Fix tcp protocol metrics naming (#3410)Amber Brown2018-06-211-18/+35
* Fix replication metricsRichard van der Hoff2018-06-041-2/+2
* Merge remote-tracking branch 'origin/develop' into 3218-official-promAmber Brown2018-05-282-8/+9
|\
| * Merge pull request #3244 from NotAFile/py3-six-4Amber Brown2018-05-242-5/+7
| |\
| | * replace some iteritems with sixAdrian Tschira2018-05-192-5/+7
* | | more cleanupAmber Brown2018-05-222-6/+10
* | | fix the test failuresAmber Brown2018-05-221-1/+1
* | | cleanups, self-registrationAmber Brown2018-05-221-4/+5
* | | Merge remote-tracking branch 'origin/develop' into 3218-official-promAmber Brown2018-05-221-0/+2
|\| |
| * | Send users a server notice about consentRichard van der Hoff2018-05-221-0/+2
| |/
* | rest of the changesAmber Brown2018-05-211-16/+14
* | replacing portionsAmber Brown2018-05-211-54/+34
|/
* make imports localAdrian Tschira2018-04-282-4/+4
* Refactor ResponseCache usageRichard van der Hoff2018-04-121-12/+6
* Add metrics for ResponseCacheRichard van der Hoff2018-04-101-1/+1
* Fix json encoding bug in replicationRichard van der Hoff2018-04-031-1/+1
* Use static JSONEncodersRichard van der Hoff2018-03-291-3/+5
* Explicitly use simplejsonErik Johnston2018-03-201-7/+7
* Fix replication after switch to simplejsonErik Johnston2018-03-191-2/+4
* Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2018-03-191-1/+1
|\
| * Replace ujson with simplejsonErik Johnston2018-03-151-1/+1
* | Merge pull request #2992 from matrix-org/erikj/implement_member_workreErik Johnston2018-03-142-3/+336
|\ \
| * | Fix importsErik Johnston2018-03-142-7/+4
| * | s/join/joined/ in notify_user_membership_changeErik Johnston2018-03-141-3/+3
| * | Implement RoomMemberWorkerHandlerErik Johnston2018-03-132-0/+336
* | | Split up ProfileStoreErik Johnston2018-03-131-0/+21
|/ /
* | extra_users is actually a list of UserIDsErik Johnston2018-03-131-4/+4
* | Split Directory storeErik Johnston2018-03-051-5/+3
* | Split registration storeErik Johnston2018-03-021-15/+3
* | Merge pull request #2928 from matrix-org/erikj/read_marker_cachesErik Johnston2018-03-011-1/+1
|\ \
| * | Fix typo in getting replication account data processingErik Johnston2018-03-011-1/+1
* | | Merge pull request #2925 from matrix-org/erikj/split_sig_fedErik Johnston2018-03-011-47/+9
|\ \ \
| * | | Remove unused DataStoreErik Johnston2018-03-011-1/+0
| * | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_sig_fedErik Johnston2018-03-012-65/+11
| |\ \ \
| * | | | Split out SignatureStore and EventFederationStoreErik Johnston2018-03-011-42/+8
* | | | | Merge pull request #2927 from matrix-org/erikj/read_marker_cachesErik Johnston2018-03-011-0/+4
|\ \ \ \ \ | |_|/ / / |/| | / / | | |/ / | |/| |
| * | | Improve caching for read_marker APIErik Johnston2018-03-011-0/+3
| * | | Add some caches to help read marker APIErik Johnston2018-03-011-0/+1
| |/ /
* | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_stre...Erik Johnston2018-03-012-19/+4
|\ \ \
| * \ \ Merge pull request #2923 from matrix-org/erikj/stream_ago_workerErik Johnston2018-03-011-1/+0
| |\ \ \
| | * | | Calculate stream_ordering_month_ago correctly on workersErik Johnston2018-03-011-1/+0
| | |/ /
| * / / Split up RoomStoreErik Johnston2018-03-011-17/+4
| |/ /
* / / Split out stream storeErik Johnston2018-03-011-45/+9
|/ /
* | Log in the correct placesErik Johnston2018-03-011-2/+4
* | Don't do preserve_fn for every requestErik Johnston2018-03-011-1/+2
* | Add some loggingErik Johnston2018-03-011-0/+2
* | Make repl send_event idempotent and retry on timeoutsErik Johnston2018-03-011-6/+38
* | Correctly send ratelimit and extra_users paramsErik Johnston2018-03-011-1/+13
* | Calculate push actions on workerErik Johnston2018-02-281-1/+1
* | Merge pull request #2904 from matrix-org/erikj/receipt_cache_invalidationErik Johnston2018-02-271-0/+2
|\ \
| * | Fix missing invalidations for receipt storageErik Johnston2018-02-211-0/+2
* | | Merge pull request #2903 from matrix-org/erikj/split_roommember_storeErik Johnston2018-02-271-28/+5
|\ \ \
| * \ \ Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_room...Erik Johnston2018-02-234-84/+23
| |\ \ \
| * | | | Update copyrightErik Johnston2018-02-231-0/+1
| * | | | Split out RoomMemberStoreErik Johnston2018-02-211-27/+3
* | | | | Merge pull request #2901 from matrix-org/erikj/split_as_storesErik Johnston2018-02-271-28/+7
|\ \ \ \ \ | |_|/ / / |/| | | |
| * | | | Update copyrightErik Johnston2018-02-231-0/+1
| * | | | Split AS storesErik Johnston2018-02-211-28/+6
| |/ / /
* | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/split_even...Erik Johnston2018-02-234-74/+21
|\ \ \ \
| * \ \ \ Merge pull request #2902 from matrix-org/erikj/split_events_storeErik Johnston2018-02-231-11/+3
| |\ \ \ \
| | * | | | Split EventsWorkerStore into separate fileErik Johnston2018-02-231-1/+1
| | * | | | Update copyrightErik Johnston2018-02-231-0/+1
| | |/ / /
| | * / / Split out get_events and co into a worker storeErik Johnston2018-02-211-11/+2
| | |/ /
| * | | Merge pull request #2899 from matrix-org/erikj/split_pushersErik Johnston2018-02-231-9/+3
| |\ \ \
| | * | | Update copyrightErik Johnston2018-02-231-0/+1
| | * | | Split PusherStoreErik Johnston2018-02-211-9/+2
| | |/ /
| * | | Merge pull request #2898 from matrix-org/erikj/split_push_rules_storeErik Johnston2018-02-231-17/+7
| |\ \ \
| | * | | Update copyrightErik Johnston2018-02-231-0/+1
| | * | | Split PushRulesStoreErik Johnston2018-02-211-17/+6
| | |/ /
| * | | Update copyrightErik Johnston2018-02-231-0/+1
| * | | Use absolute importsErik Johnston2018-02-231-2/+2
| * | | Split AccountDataStore and TagStoreErik Johnston2018-02-211-34/+4
| |/ /
* / / Split out EventPushActionWorkerStoreErik Johnston2018-02-211-20/+3
|/ /
* | Fix commentErik Johnston2018-02-201-1/+1
* | Use abstract base class to access stream IDsErik Johnston2018-02-201-2/+7
* | Split ReceiptsStoreErik Johnston2018-02-201-28/+5
* | Don't serialize current state over replicationErik Johnston2018-02-151-2/+2
* | Don't log errors propogated from send_eventErik Johnston2018-02-151-1/+10
* | Add event_creator workerErik Johnston2018-02-071-0/+20
* | Add replication http endpoint for event sendingErik Johnston2018-02-072-0/+139
* | Store state groups separately from events (#2784)Erik Johnston2018-02-061-2/+2
* | Metrics for number of RDATA commands receivedRichard van der Hoff2018-01-151-5/+14
|/
* Fix some logcontext leaks in replication resourceRichard van der Hoff2017-11-231-2/+4
* Pull out bits of StateStore to a mixinRichard van der Hoff2017-11-141-33/+6
* Make __init__ consitstent across Store heirarchyRichard van der Hoff2017-11-131-1/+1
* replace 'except:' with 'except Exception:'Richard van der Hoff2017-10-231-1/+1
* log when we get an exception handling replication updateshera2017-10-121-1/+5
* Fix replication. And notifyErik Johnston2017-07-202-0/+74
* Reduce log levels in tcp replicationErik Johnston2017-07-111-2/+2
* Serialize user ip command as jsonErik Johnston2017-06-271-5/+9
* Fix upErik Johnston2017-06-271-2/+1
* Make workers report to master for user ip updatesErik Johnston2017-06-275-0/+103
* Initialise exclusive_user_regexErik Johnston2017-06-211-0/+2
* Fix for workersErik Johnston2017-06-211-0/+3
* Initial worker implErik Johnston2017-06-161-0/+22
* Add cache for is_host_joinedErik Johnston2017-06-131-1/+1
* Merge pull request #2266 from matrix-org/erikj/host_in_roomErik Johnston2017-06-121-1/+0
|\
| * Fix replicationErik Johnston2017-06-091-1/+0
* | Fix replicationErik Johnston2017-06-091-1/+1
* | Add missing notifierErik Johnston2017-06-091-1/+2
|/
* Faster cache for get_joined_hostsErik Johnston2017-05-251-0/+2
* Add missing storage function to slave storeErik Johnston2017-05-221-0/+2
* Add new storage functions to slave storeErik Johnston2017-05-041-0/+3
* Remove unused cacheErik Johnston2017-04-241-3/+0
* Merge pull request #2115 from matrix-org/erikj/dedupe_federation_replErik Johnston2017-04-122-0/+11
|\
| * Move get_presence_list_* to SlaveStoreErik Johnston2017-04-111-0/+10
| * Reduce federation presence replication trafficErik Johnston2017-04-101-0/+1
* | Remove HTTP replication APIsErik Johnston2017-04-114-749/+0
|/
* TypoErik Johnston2017-04-101-1/+1
* Merge pull request #2109 from matrix-org/erikj/send_queue_fixErik Johnston2017-04-101-2/+2
|\
| * CommentsErik Johnston2017-04-101-2/+2
* | Up replication ping timeoutErik Johnston2017-04-101-2/+4
|/
* Merge pull request #2103 from matrix-org/erikj/no-double-encodeErik Johnston2017-04-071-28/+76
|\
| * Document types of the replication streamsErik Johnston2017-04-061-28/+76
* | Fix incorrect type when using InvalidateCacheCommandErik Johnston2017-04-061-1/+1
* | Add log linesErik Johnston2017-04-051-1/+2
* | Rearrange metricsErik Johnston2017-04-051-16/+31
* | Fix typoErik Johnston2017-04-051-2/+2
* | Fixup some metrics for tcp replErik Johnston2017-04-051-0/+16
|/
* Merge pull request #2097 from matrix-org/erikj/repl_tcp_clientErik Johnston2017-04-0511-171/+302
|\
| * Change slave storage to use new replication interfaceErik Johnston2017-04-0310-171/+106
| * Add basic replication client handler and factoryErik Johnston2017-04-031-0/+196
* | Merge pull request #2098 from matrix-org/erikj/repl_tcp_fixErik Johnston2017-04-043-6/+15
|\ \
| * | Advance replication streams even if nothing is listeningErik Johnston2017-04-043-6/+15
| |/
* / Fiddle tcp replication loggingErik Johnston2017-04-041-2/+2
|/
* Always advance stream tokensErik Johnston2017-04-031-1/+4
* Use callbacks to notify tcp replication rather than deferredsErik Johnston2017-03-311-14/+1
* Add a timestamp to USER_SYNC commandErik Johnston2017-03-313-9/+17
* Fix up docsErik Johnston2017-03-312-19/+3
* Add server side resource for tcp replicationErik Johnston2017-03-301-0/+300
* Initial TCP protocol implementationErik Johnston2017-03-303-0/+974
* Define the various streams we will replicateErik Johnston2017-03-302-0/+423
* Make federation send queue take the current positionErik Johnston2017-03-301-1/+1
* Add new storage functions for new replicationErik Johnston2017-03-301-1/+1
* Use presence replication stream to invalidate cacheErik Johnston2017-03-241-0/+1
* Replace some calls to cursor_to_dictErik Johnston2017-03-241-1/+0
* PEP8Erik Johnston2017-03-201-2/+0
* Don't send the full event json over replicationErik Johnston2017-03-172-30/+16
* Fix assertion to stop transaction queue getting wedgedRichard van der Hoff2017-03-151-0/+5
* Add new storage function to slave storeErik Johnston2017-03-131-0/+4
* Fix it for the workersErik Johnston2017-03-101-0/+8
* Don't log unknown cache warnings in workersErik Johnston2017-02-281-1/+3
* Aggregate event push actionsErik Johnston2017-02-141-0/+6
* Cache get_presence storageErik Johnston2017-02-131-1/+3
* Merge pull request #1912 from matrix-org/markjh/roominitialsyncErik Johnston2017-02-131-0/+6
|\
| * Add db functions needed for room initial sync to slaveMark Haines2017-02-131-0/+6
* | Fix replicationErik Johnston2017-02-021-0/+3
* | Only invalidate membership caches based on the cache streamErik Johnston2017-01-312-19/+5
|/
* Rename funcErik Johnston2017-01-301-1/+1
* Hook device list updates to replicationErik Johnston2017-01-272-1/+91
* Insert delta of current_state_events to be more efficientErik Johnston2017-01-201-10/+0
* Add cache to get_public_room_ids_at_stream_idErik Johnston2016-12-121-1/+2
* Add new API appservice specific public room listErik Johnston2016-12-061-1/+1
* Ensure only main or federation_sender process can send federation trafficErik Johnston2016-11-231-1/+1
* Explicit federation ackErik Johnston2016-11-231-5/+10
* Invalidate retry cache in both directionsErik Johnston2016-11-224-6/+84
* Store federation stream positions in the databaseErik Johnston2016-11-211-0/+3
* Handle sending events and device messages over federationErik Johnston2016-11-174-7/+25
* Hook up the send queue and create a federation sender workerErik Johnston2016-11-163-0/+32
* Fix check of wrong variableErik Johnston2016-10-111-1/+1
* Reduce DB hits for replicationErik Johnston2016-09-231-36/+103
* Fix public room pagination for client_reader appErik Johnston2016-09-161-0/+1
* Add new storage function to slave storeErik Johnston2016-09-161-0/+1
* Use stream_change cache to make get_forward_extremeties_for_room cache more e...Erik Johnston2016-09-151-1/+4
* Add cache to get_forward_extremeties_for_roomErik Johnston2016-09-151-1/+1
* Stream public room changes down replicationErik Johnston2016-09-153-1/+58
* Correctly handle typing stream id resettingErik Johnston2016-09-091-1/+8
* Drop replication log levelsErik Johnston2016-09-091-2/+2
* Track the max_stream_device_id in a separate table, since we delete from the ...Mark Haines2016-09-091-1/+1
* Merge branch 'develop' into markjh/direct_to_device_federationMark Haines2016-09-081-0/+3
|\
| * Add upgrade script that will slowly prune state_groups_state entriesErik Johnston2016-09-051-0/+3
* | Fix the stream change cache to work over replicationMark Haines2016-09-071-0/+11
|/
* Merge pull request #1060 from matrix-org/erikj/state_idsErik Johnston2016-09-012-23/+2
|\