summary refs log tree commit diff
path: root/synapse/storage (unfollow)
Commit message (Collapse)AuthorFilesLines
2015-06-01Also cache user_id -> UserID conversionErik Johnston3-3/+9
2015-05-31contrib/systemd: log_config.yaml: do not disable existing loggersIvan Shapovalov1-0/+2
It turned out that merely configuring the root logger is not enough for "catch-all" semantics. The logging subsystem also needs to be told not to disable existing loggers (so that their messages will get propagated to handlers up the logging hierarchy, not just silently discarded). Signed-off-by: Ivan Shapovalov <intelfx100@gmail.com>
2015-05-29Remove log lineErik Johnston1-1/+0
2015-05-29Don't copy twiceErik Johnston1-1/+1
2015-05-29Use pyinstrumentErik Johnston1-6/+9
2015-05-29Bump syutil versionErik Johnston1-3/+3
2015-05-29Add config option to turn off freezing events. Use new encode_json api and ↵Erik Johnston8-17/+44
ujson.loads
2015-05-29Add config for setting the recaptcha verify api endpoint, so we can test it ↵Mark Haines2-3/+7
in sytest
2015-05-29Use cProfile. Hook into doIteration. Track utime.Erik Johnston1-11/+15
2015-05-28SYN-395: Fix CAPTCHA, don't double decode jsonErik Johnston1-2/+3
2015-05-28Correctly pass connection pool parameterErik Johnston2-2/+2
2015-05-28Unused importErik Johnston1-2/+0
2015-05-28Up maxPersistentPerHost countErik Johnston2-0/+2
2015-05-28Add connection pooling to SimpleHttpClientErik Johnston1-2/+4
2015-05-28Use connection pool for federation connectionsErik Johnston1-2/+3
2015-05-28Remove a deep copyErik Johnston1-9/+1
2015-05-28Registration should be disabled by defaultErik Johnston1-1/+1
2015-05-27Use pyinstrumentErik Johnston1-1/+1
2015-05-27Include duration in output nameErik Johnston1-2/+2
2015-05-27Use pyinstrumentErik Johnston1-7/+11
2015-05-27Profile and output long iterations of runUntilConcurrentErik Johnston1-8/+16
2015-05-26changelogErik Johnston1-2/+2
2015-05-26Iterate over the user_streams not the user_idsMark Haines1-1/+1
2015-05-26Take a dict of the rule, not the rule listMark Haines1-1/+1
2015-05-26changelogErik Johnston1-1/+1
2015-05-26changelogErik Johnston1-2/+4
2015-05-26changelogErik Johnston1-0/+25
2015-05-26SYN-390: Don't modify the dictionary returned from the database here eitherMark Haines1-4/+7
2015-05-26SYN-390: Don't modify the dictionary returned from the data storeMark Haines1-5/+8
2015-05-22Bump versionErik Johnston1-1/+1
2015-05-22Fix the presence testsMark Haines3-17/+23
2015-05-22Remove redundant for loopErik Johnston1-3/+0
2015-05-22Add a cache for getting the presence list for a userMark Haines2-17/+42
2015-05-22Remove spurious TODO commentMark Haines1-1/+0
2015-05-22Add doc stringsErik Johnston3-0/+7
2015-05-22s/metric_interface/metric_bind_host/Erik Johnston2-5/+5
2015-05-22Update log lineErik Johnston1-1/+4
2015-05-22Remove unused importMark Haines1-1/+1
2015-05-22Log origin and stats of incoming transactionsErik Johnston1-0/+8
2015-05-22Add txn_id to some log linesErik Johnston1-6/+11
2015-05-22Log less lines at INFO level, but include more helpful informationErik Johnston1-6/+10
2015-05-22Enable changing the interface the metrics listener binds toErik Johnston2-2/+6
2015-05-22Invalidate the get_latest_event_ids_in_room cache when deleting from ↵Mark Haines1-0/+1
event_forward_extremities
2015-05-22Revert register_new_matrix_user to use v1 apiErik Johnston1-2/+3
2015-05-22Make the appservice use 'users_in_room' rather than get_room_members since ↵Mark Haines3-19/+7
it is cached
2015-05-22Add a cache for get_push rules for user, fix cache invalidationMark Haines1-1/+17
2015-05-21Changelog v0.9.0-r5Erik Johnston1-0/+6
2015-05-21Bump versionErik Johnston1-1/+1
2015-05-21Don't try to use a txn when not in one, remove spurious debug loggingMark Haines2-5/+1
2015-05-21Add caches for things requested by the pushersMark Haines7-33/+44
2015-05-21Add a cache for get_current_state with state_keyMark Haines5-2/+46
2015-05-21Actually return something from lambdaErik Johnston1-1/+1
2015-05-21Sort backfill eventsErik Johnston1-1/+5
2015-05-21Remove dead codeErik Johnston1-5/+0
2015-05-21Only get non-stateErik Johnston1-1/+2
2015-05-21Skip events we've already seenErik Johnston1-0/+3
2015-05-21Correctly prepopulate queueErik Johnston1-2/+10
2015-05-21Don't prepopulate event_resultsErik Johnston1-1/+1
2015-05-21Don't readd things that are already in event_resultsErik Johnston1-1/+2
2015-05-21PriorityQueue gives lowest firstErik Johnston1-2/+2
2015-05-21Correctly capture Queue.Empty exceptionErik Johnston1-2/+5
2015-05-21Oops, get_rooms_for_user returns a namedtuple, not a room_idMark Haines2-1/+7
2015-05-21s/for events/for requests for events/Erik Johnston1-1/+1
2015-05-21s/for events/for requests for events/Erik Johnston1-1/+1
2015-05-21Add commentsErik Johnston1-3/+14
2015-05-20Removed unused 'is_visible' methodMark Haines1-27/+0
2015-05-20Split up _get_events into defer and txn versionsErik Johnston1-24/+35
2015-05-20Fix the presence testsMark Haines2-10/+6
2015-05-20Clean up the presence_list checking logic a bitMark Haines1-12/+9
2015-05-20Make not return a deferred _get_event_from_row_txnErik Johnston1-20/+5
2015-05-20PEP8Erik Johnston1-2/+2
2015-05-20Split out _get_event_from_row back into defer and _txn versionErik Johnston1-11/+57
2015-05-20Fix _get_backfill_events to return events in the correct orderErik Johnston1-27/+28
2015-05-20Actually fetch state for new backwards extremeties when backfilling.Erik Johnston2-62/+108
2015-05-19Ensure event_results is a setErik Johnston1-1/+1
2015-05-19Add None checkErik Johnston1-1/+1
2015-05-19Fix event_backwards_extrem insertion to ignore outliersErik Johnston1-2/+3
2015-05-19Add a timeout param to get_eventErik Johnston4-16/+25
2015-05-19Handle the case when things return empty but non none thingsErik Johnston1-2/+2
2015-05-19Don't always hit get_server_verify_key_v1_directErik Johnston1-5/+10
2015-05-19Handle the case when things return empty but non none thingsErik Johnston1-2/+2
2015-05-19Don't apply new room join hack if depth > 5Erik Johnston1-3/+6
2015-05-19Don't always hit get_server_verify_key_v1_directErik Johnston1-5/+10
2015-05-19Disable GZip encoding on static file resources as per commentDavid Baker1-1/+7
2015-05-19Add forgotten .items()Erik Johnston1-1/+1
2015-05-19Fix scripts-dev/convert_server_keys.py to have correct formatErik Johnston1-1/+4
2015-05-19SYN-383: Actually, we expect this value to be a dictErik Johnston1-1/+2
2015-05-19Revert accidental commitErik Johnston1-3/+3
2015-05-19SYN-383: Actually, we expect this value to be a dictErik Johnston1-1/+2
2015-05-19SYN-383: Handle the fact the server might not have signed thingsErik Johnston2-4/+4
2015-05-19Don't reuse var namesErik Johnston1-2/+2
2015-05-19Don't reuse var namesErik Johnston1-2/+2
2015-05-19SYN-383: Fix parsing of verify_keys and catching of _DefGen_ReturnErik Johnston1-18/+18
2015-05-19SYN-383: Extract the response list from 'server_keys' in the response JSON ↵Mark Haines1-1/+3
as it might work better than iterating over the top level dict
2015-05-18Speed up the get_pagination_rows as wellMark Haines1-3/+17
2015-05-18Do work in parellel when joining a roomErik Johnston1-19/+50
2015-05-18Cache the most recent serial for each roomMark Haines1-6/+22
2015-05-18Move updating the serial and state of the presence cache into a single functionMark Haines1-17/+43
2015-05-18Comments and shuffle of functionsErik Johnston1-38/+42
2015-05-18Remove unused metricErik Johnston1-1/+0
2015-05-18Don't bother sorting by the room_stream_ids, it shouldn't matter which order ↵Mark Haines1-1/+1
they are notified in
2015-05-18Remove rejected events if we don't want rejected eventsErik Johnston1-0/+3
2015-05-18Add more doc string, reduce C+P boilerplate for getting room listMark Haines1-6/+22
2015-05-18Make sure the notifier stream token goes forward when it is updated. Sort ↵Mark Haines2-4/+21
the pending events by the correct room_stream_id
2015-05-18Move get_events functions to storage.eventsErik Johnston2-155/+132
2015-05-18Remove pointless newlineErik Johnston1-1/+0
2015-05-18Newline, remove debug loggingErik Johnston3-4/+1
2015-05-18Remove debug loggingErik Johnston1-8/+0
2015-05-15PEP8Erik Johnston2-2/+1
2015-05-15Revert limiting of fetching, it didn't help perf.Erik Johnston1-9/+2
2015-05-15init jErik Johnston1-0/+1
2015-05-15Don't completely drain the listErik Johnston1-2/+9
2015-05-15Don't fetch prev_content for current_stateErik Johnston1-1/+1
2015-05-15Err, defer.gatherResults ftwErik Johnston1-21/+12
2015-05-15Make store.get_current_state fetch events asynclyErik Johnston2-4/+4
2015-05-15Remove more debug loggingErik Johnston1-2/+0
2015-05-15Remove debug loggingErik Johnston1-11/+3
2015-05-15preserve log contextErik Johnston1-1/+2
2015-05-15Add a waitErik Johnston2-3/+12
2015-05-15Srsly. Don't use closures. BaaaaaadErik Johnston1-10/+8
2015-05-15Correctly pass through paramsErik Johnston1-3/+3
2015-05-15More whitespaceMark Haines1-0/+1
2015-05-15Sort out error handlingErik Johnston1-25/+22
2015-05-15Fix daedlockErik Johnston7-84/+122
2015-05-14Add some missed argument types, cleanup the whitespace a bitMark Haines1-6/+17
2015-05-14More doc-stringsMark Haines1-39/+202
2015-05-14Remove race conditionErik Johnston4-96/+157
2015-05-14Support gzip encoding for client, client v2 and web client resources (SYN-176).David Baker1-5/+16
2015-05-14Call from right threadErik Johnston1-1/+3
2015-05-14Count and loopErik Johnston2-37/+35
2015-05-14Don't start up more fetch_eventsErik Johnston1-0/+1
2015-05-14Awful idea for speeding up fetching of eventsErik Johnston3-40/+139
2015-05-14Remove unused arguments and doc PresenceHandler.push_update_to_clientsMark Haines3-60/+21
2015-05-14Turn off preemptive transactionsErik Johnston1-17/+7
2015-05-14PEP8Erik Johnston1-2/+1
2015-05-14Move from _base to eventsErik Johnston2-232/+247
2015-05-14Add some doc-strings to notifierMark Haines1-19/+33
2015-05-14Jump out earlyErik Johnston1-0/+6
2015-05-14Actually, we probably want to run this in a transactionErik Johnston1-15/+12
2015-05-14Treat setting your display name to the empty string as removing it (SYN-186).David Baker1-0/+3
2015-05-14Preemptively jump into a transaction if we ask for get_prev_contentErik Johnston1-12/+22
2015-05-14loop -> gatherResultsErik Johnston1-10/+14
2015-05-14Err, we probably want a bigger limitErik Johnston1-1/+1
2015-05-14Move fetching of events into their own transactionsErik Johnston4-53/+45
2015-05-14Refactor _get_eventsErik Johnston3-253/+123
2015-05-14Disallow whitespace in aliases here tooDavid Baker1-0/+5
2015-05-14Throw error when creating room if alias contains whitespace #SYN-335David Baker1-0/+5
2015-05-14Use the current token when timing out a notifier, make sure the user_id is a ↵Mark Haines1-2/+2
string in on_new_user_event
2015-05-14Make shared secret registration work againDavid Baker1-1/+4
2015-05-14Add ID generator for push_rules_enable to #resolve SYN-378David Baker2-2/+13
2015-05-14Fix v2 sync, update the last_notified_ms only if there was an active listenerMark Haines2-6/+7
2015-05-14Specify python 2.7 in the virtualenv setup (SYN-319) #resolvedDavid Baker1-1/+1
2015-05-13Add index on eventsErik Johnston2-1/+20
2015-05-13Fix metric counterMark Haines1-2/+2
2015-05-13Actually use async methodErik Johnston1-3/+1
2015-05-13Fetch events from events_id in their own transactionsErik Johnston3-18/+168
2015-05-13Discard unused NotifierUserStreamsMark Haines3-16/+38
2015-05-13TypoErik Johnston1-1/+1
2015-05-13Don't insert NoneErik Johnston1-1/+4
2015-05-13Don't set a timer if there's already a result to returnMark Haines1-3/+10
2015-05-13Don't return NoneErik Johnston1-1/+1
2015-05-13Limit batch sizeErik Johnston1-5/+10
2015-05-13Fetch events in bulkErik Johnston2-34/+63
2015-05-13Don't bother checking for new events from a source if the stream token ↵Mark Haines1-2/+6
hasn't advanced for that source
2015-05-13Don't fetch redaction and rejection stuff for each event, so we can use ↵Erik Johnston2-6/+24
index only scan
2015-05-13Don't bother checking for updates if the stream token hasn't advanced for a userMark Haines12-55/+123
2015-05-13Temp turn off checking for rejections and redactionsErik Johnston1-5/+2
2015-05-13defer.gatherResults loopErik Johnston1-1/+7
2015-05-13Batch fetching of events for state groupsErik Johnston1-1/+24
2015-05-13Load events for state group seperatelyErik Johnston2-5/+11
2015-05-12Don't talk to yourself when backfillingErik Johnston1-0/+2
2015-05-12You need to call contextmanagerErik Johnston1-0/+1
2015-05-12Revert "Improvement to performance of presence event stream handling"Mark Haines1-20/+6
2015-05-12Err, delete the right stuffErik Johnston1-4/+5
2015-05-12NewlinesErik Johnston1-2/+0
2015-05-12We do actually want to delete rows out of event_backward_extremitiesErik Johnston1-4/+11
2015-05-12Fix up _handle_prev_events to not try to insert duplicate rowsErik Johnston1-23/+13
2015-05-12Do state groups persistence /after/ checking if we have already persisted ↵Erik Johnston1-6/+9
the event
2015-05-12s/backfil/backfill/Erik Johnston1-4/+4
2015-05-12Typos everywhereErik Johnston1-1/+1
2015-05-12And another typo.Erik Johnston1-3/+3
2015-05-12Err, gatherResults doesn't take a dict...Erik Johnston1-4/+7
2015-05-12Make distributer.fire work as it didErik Johnston1-20/+30
2015-05-12Unwrap defer.gatherResults failuresErik Johnston6-7/+18
2015-05-12Update the end_token correctly, otherwise the token doesn't advance and the ↵Mark Haines1-1/+1
client gets duplicate events
2015-05-12SYN-377: Make sure that the StreamIdGenerator.get_next.__exit__ is called ↵Mark Haines2-23/+27
from the main thread after the transaction completes, not from database thread before the transaction completes.
2015-05-12Add a NotifierUserStream to hold all the notification listeners for a userMark Haines1-114/+116
2015-05-12Handle the case where the other side is unreachable when backfillingErik Johnston1-14/+42
2015-05-12Make get_current_token accept a direction parameter, which tells whether the ↵Erik Johnston4-8/+26
source whether we want a token for going 'forwards' or 'backwards'
2015-05-11Initial hack at wiring together pagination and backfillErik Johnston3-5/+141
2015-05-11Move storage.stream._StreamToken to types.RoomStreamTokenErik Johnston2-85/+85
2015-05-11Don't bother passing the events to the notifier since it isn't using themMark Haines1-95/+18
2015-05-11Use wait_for_events to implement 'get_events'Mark Haines1-79/+30
2015-05-11