summary refs log tree commit diff
path: root/synapse/storage (follow)
Commit message (Expand)AuthorAgeFilesLines
* Don't readd things that are already in event_resultsErik Johnston2015-05-211-1/+2
* PriorityQueue gives lowest firstErik Johnston2015-05-211-2/+2
* Correctly capture Queue.Empty exceptionErik Johnston2015-05-211-2/+5
* Merge branch 'erikj/join_perf' of github.com:matrix-org/synapse into erikj/ba...Erik Johnston2015-05-2110-181/+544
|\
| * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/join_perfErik Johnston2015-05-2110-181/+544
| |\
| | * Merge pull request #155 from matrix-org/erikj/perfErik Johnston2015-05-2110-181/+544
| | |\
| | | * s/for events/for requests for events/Erik Johnston2015-05-211-1/+1
| | | * s/for events/for requests for events/Erik Johnston2015-05-211-1/+1
| | | * Add commentsErik Johnston2015-05-211-3/+14
| | | * Split up _get_events into defer and txn versionsErik Johnston2015-05-201-24/+35
| | | * Make not return a deferred _get_event_from_row_txnErik Johnston2015-05-201-20/+5
| | | * PEP8Erik Johnston2015-05-201-2/+2
| | | * Split out _get_event_from_row back into defer and _txn versionErik Johnston2015-05-201-11/+57
| | | * Comments and shuffle of functionsErik Johnston2015-05-181-38/+42
| | | * Remove unused metricErik Johnston2015-05-181-1/+0
| | | * Remove rejected events if we don't want rejected eventsErik Johnston2015-05-181-0/+3
| | | * Newline, remove debug loggingErik Johnston2015-05-182-2/+1
| | | * PEP8Erik Johnston2015-05-152-2/+1
| | | * Revert limiting of fetching, it didn't help perf.Erik Johnston2015-05-151-9/+2
| | | * init jErik Johnston2015-05-151-0/+1
| | | * Don't completely drain the listErik Johnston2015-05-151-2/+9
| | | * Don't fetch prev_content for current_stateErik Johnston2015-05-151-1/+1
| | | * Make store.get_current_state fetch events asynclyErik Johnston2015-05-152-4/+4
| | | * Remove more debug loggingErik Johnston2015-05-151-2/+0
| | | * Remove debug loggingErik Johnston2015-05-151-11/+3
| | | * preserve log contextErik Johnston2015-05-151-1/+2
| | | * Add a waitErik Johnston2015-05-152-3/+12
| | | * Srsly. Don't use closures. BaaaaaadErik Johnston2015-05-151-10/+8
| | | * Correctly pass through paramsErik Johnston2015-05-151-3/+3
| | | * Sort out error handlingErik Johnston2015-05-151-25/+22
| | | * Fix daedlockErik Johnston2015-05-153-68/+85
| | | * Remove race conditionErik Johnston2015-05-144-96/+157
| | | * Call from right threadErik Johnston2015-05-141-1/+3
| | | * Count and loopErik Johnston2015-05-142-37/+35
| | | * Don't start up more fetch_eventsErik Johnston2015-05-141-0/+1
| | | * Awful idea for speeding up fetching of eventsErik Johnston2015-05-142-36/+135
| | | * Turn off preemptive transactionsErik Johnston2015-05-141-17/+7
| | | * PEP8Erik Johnston2015-05-141-2/+1
| | | * Move from _base to eventsErik Johnston2015-05-142-232/+247
| | | * Jump out earlyErik Johnston2015-05-141-0/+6
| | | * Actually, we probably want to run this in a transactionErik Johnston2015-05-141-15/+12
| | | * Preemptively jump into a transaction if we ask for get_prev_contentErik Johnston2015-05-141-12/+22
| | | * loop -> gatherResultsErik Johnston2015-05-141-10/+14
| | | * Err, we probably want a bigger limitErik Johnston2015-05-141-1/+1
| | | * Move fetching of events into their own transactionsErik Johnston2015-05-144-53/+45
| | | * Refactor _get_eventsErik Johnston2015-05-142-253/+95
| | | * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/perfErik Johnston2015-05-142-2/+13
| | | |\
| | | * | Add index on eventsErik Johnston2015-05-132-1/+20
| | | * | Actually use async methodErik Johnston2015-05-131-3/+1
| | | * | Fetch events from events_id in their own transactionsErik Johnston2015-05-133-18/+168
| | | * | TypoErik Johnston2015-05-131-1/+1
| | | * | Don't insert NoneErik Johnston2015-05-131-1/+4
| | | * | Don't return NoneErik Johnston2015-05-131-1/+1
| | | * | Limit batch sizeErik Johnston2015-05-131-5/+10
| | | * | Fetch events in bulkErik Johnston2015-05-132-34/+63
| | | * | Don't fetch redaction and rejection stuff for each event, so we can use index...Erik Johnston2015-05-132-6/+24
| | | * | Temp turn off checking for rejections and redactionsErik Johnston2015-05-131-5/+2
| | | * | defer.gatherResults loopErik Johnston2015-05-131-1/+7
| | | * | Batch fetching of events for state groupsErik Johnston2015-05-131-1/+24
| | | * | Load events for state group seperatelyErik Johnston2015-05-132-5/+11
* | | | | Fix _get_backfill_events to return events in the correct orderErik Johnston2015-05-201-27/+28
* | | | | Ensure event_results is a setErik Johnston2015-05-191-1/+1
|/ / / /
* / / / Fix event_backwards_extrem insertion to ignore outliersErik Johnston2015-05-191-2/+3
|/ / /
* | | Merge pull request #152 from matrix-org/notifier_performanceMark Haines2015-05-181-0/+3
|\ \ \
| * \ \ Merge branch 'develop' into notifier_performanceMark Haines2015-05-182-2/+13
| |\ \ \ | | | |/ | | |/|
| * | | Merge branch 'notifier_unify' into notifier_performanceMark Haines2015-05-141-0/+1
| |\ \ \ | | | |/ | | |/|
| * | | Don't bother checking for updates if the stream token hasn't advanced for a userMark Haines2015-05-131-0/+3
* | | | Move get_events functions to storage.eventsErik Johnston2015-05-182-155/+132
| |_|/ |/| |
* | | Add ID generator for push_rules_enable to #resolve SYN-378David Baker2015-05-142-2/+13
| |/ |/|
* | You need to call contextmanagerErik Johnston2015-05-121-0/+1
|/
* Merge pull request #144 from matrix-org/erikj/logging_contextMark Haines2015-05-121-5/+6
|\
| * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/logging_co...Erik Johnston2015-05-126-82/+115
| |\
| * | Change the way we do logging contexts so that they survive divergencesErik Johnston2015-05-081-5/+6
* | | Merge pull request #149 from matrix-org/erikj/backfillMark Haines2015-05-123-116/+103
|\ \ \ | |_|/ |/| |
| * | Err, delete the right stuffErik Johnston2015-05-121-4/+5
| * | NewlinesErik Johnston2015-05-121-2/+0
| * | We do actually want to delete rows out of event_backward_extremitiesErik Johnston2015-05-121-4/+11
| * | Fix up _handle_prev_events to not try to insert duplicate rowsErik Johnston2015-05-121-23/+13
| * | Do state groups persistence /after/ checking if we have already persisted the...Erik Johnston2015-05-121-6/+9
| * | Make get_current_token accept a direction parameter, which tells whether the ...Erik Johnston2015-05-121-2/+18
| * | Initial hack at wiring together pagination and backfillErik Johnston2015-05-111-2/+26
| * | Move storage.stream._StreamToken to types.RoomStreamTokenErik Johnston2015-05-111-85/+33
* | | SYN-377: Make sure that the StreamIdGenerator.get_next.__exit__ is called fro...Mark Haines2015-05-122-23/+27
|/ /
* | Prefer to use _simple_*.Erik Johnston2015-05-111-44/+41
* | push_rules table expects an 'id' fieldErik Johnston2015-05-112-13/+13
* | Fix push rule bug: can't insert bool into small int columnErik Johnston2015-05-101-1/+1
* | Drop the old table not the new tableMark Haines2015-05-081-1/+1
* | Rename unique constraintMark Haines2015-05-081-1/+1
* | Remove unsignedMark Haines2015-05-081-2/+2
* | Bump schema versionMark Haines2015-05-081-1/+1
* | Make the timestamps in server_keys_json bigintsMark Haines2015-05-081-0/+32
|/
* Merge branch 'erikj/executemany' of github.com:matrix-org/synapse into erikj/...Erik Johnston2015-05-055-25/+97
|\
| * And use buffer(...) there as wellErik Johnston2015-05-051-1/+2
| * Merge branch 'develop' of github.com:matrix-org/synapse into erikj/executemanyErik Johnston2015-05-055-24/+87
| |\
| | * Use buffer(...) when inserting into bytea columnErik Johnston2015-05-051-1/+2
| | * Merge pull request #139 from matrix-org/bugs/SYN-369Mark Haines2015-05-054-16/+80
| | |\
| | | * Add some doc-stringMark Haines2015-05-051-0/+4
| | | * Collect the invalidate callbacks on the transaction object rather than passin...Mark Haines2015-05-057-51/+51
| | | * SYN-369: Add comments to the sequence number logic in the cacheMark Haines2015-05-051-0/+7
| | | * Add debug flag in synapse/storage/_base.py for debugging the cache logic by c...Mark Haines2015-05-051-1/+12
| | | * Invalidate the room_member cache if the current state events updatesMark Haines2015-05-051-0/+5
| | | * Missing return for when the event was already persistedMark Haines2015-05-051-1/+1
| | | * Invalidate the caches from the correct threadMark Haines2015-05-056-29/+46
| | | * Sequence the modifications to the cache so that selects don't race with insertsMark Haines2015-05-051-3/+23
| * | | Add a comment about the zip(*[zip(sorted(...),...)])Erik Johnston2015-05-051-0/+8
* | | | Don't insert without deduplication. In this case we never actually use this t...Erik Johnston2015-05-051-22/+0
|/ / /
* | | Fix indentationErik Johnston2015-05-051-10/+10
* | | Add support for using executemanyErik Johnston2015-05-054-59/+97
|/ /
* / Don't call 'encode_parameter' no-opErik Johnston2015-05-053-10/+0
|/
* Correctly name transactionErik Johnston2015-05-051-1/+1
* Remove some unused indexesErik Johnston2015-05-011-0/+18
* user_id now in user_threepidsDavid Baker2015-05-011-3/+3
* Don't use self.execute: it's designed for fetching stuffDavid Baker2015-05-011-3/+8
* No id field on userDavid Baker2015-05-011-5/+1
* More missed get_user_by_id API changesDavid Baker2015-05-011-3/+3
* Cache latest_event_ids_in_roomErik Johnston2015-05-011-1/+4
* Don't lock user_ips table for upsert.Erik Johnston2015-05-012-4/+10
* Fix bug where we reconnected to the database on every query.Erik Johnston2015-05-012-1/+2
* Split a storage function in two so that we don't have to do extra work.Erik Johnston2015-05-011-0/+11
* Remove pointless joinErik Johnston2015-04-301-5/+4
* Fix broken SQLErik Johnston2015-04-301-1/+1
* Need more yieldErik Johnston2015-04-301-1/+1
* Add missing paramErik Johnston2015-04-301-1/+1
* More join conditionsErik Johnston2015-04-301-2/+6
* Add more conditions on JOINs to make postgres go a little faster.Erik Johnston2015-04-302-4/+6
* Fix up get_current_state and get_room_name_and_aliases queries to parse event...Erik Johnston2015-04-302-32/+30
* Add get_rooms_for_user cacheErik Johnston2015-04-301-0/+2
* Don't use sub queries, it makes postgres sadErik Johnston2015-04-301-11/+5
* SYN-367: Use upsert rather than insert_or_replaceMark Haines2015-04-301-2/+6
* Don't needlessly join on state_eventsErik Johnston2015-04-302-6/+4
* Make simple query rather than long one and then throw away half the resultsErik Johnston2015-04-301-0/+10
* Correctly decode, for sqlite and postgres, rows from pushers tableErik Johnston2015-04-291-19/+24
* pushkey' are also bytes.Erik Johnston2015-04-291-8/+17
* TypoErik Johnston2015-04-291-1/+1
* Also remove yield from within lock in the other generatorErik Johnston2015-04-291-8/+6
* Fix deadlock in id_generators. No idea why this was an actual deadlock.Erik Johnston2015-04-291-14/+16
* Actually return rowsErik Johnston2015-04-291-0/+2
* Typo, args wrong way roundErik Johnston2015-04-291-4/+1
* Decode buffers in same threadErik Johnston2015-04-291-13/+19
* We store pusher data as bytesErik Johnston2015-04-291-2/+2
* Decode the data json in the storage layer (was moved but this part was missed)David Baker2015-04-291-0/+9
* Oops, update the contraint tooDavid Baker2015-04-291-1/+1
* Be more postgressiveDavid Baker2015-04-292-4/+4
* Be postgressiveDavid Baker2015-04-291-4/+3
* Oops, forgot the schema delta fileDavid Baker2015-04-291-0/+10
* txn.execute doesn't return cursorsErik Johnston2015-04-291-4/+4
* txn.execute doesn't return cursorsErik Johnston2015-04-291-2/+2
* Fix invalid SQL to work in postgres landErik Johnston2015-04-291-4/+6
* pushers table requires an access_tokenErik Johnston2015-04-291-0/+1
* We can't use REPLACE when upgrading databases now we have postgresErik Johnston2015-04-291-1/+2
* Merge pull request #129 from matrix-org/key_distributionErik Johnston2015-04-293-1/+90
|\
| * bump database schema versionMark Haines2015-04-292-1/+1
| * Use bytea rather than BLOBMark Haines2015-04-291-1/+1
| * Merge branch 'develop' into key_distributionMark Haines2015-04-2960-734/+2046
| |\
| * | And don't bump the schema version unnecessarilyMark Haines2015-04-281-1/+1
| * | Add server_keys.sql to the current delta rather than creating a new deltaMark Haines2015-04-281-0/+0
| * | Merge branch 'develop' into key_distributionMark Haines2015-04-242-0/+28
| |\ \
| * | | Implement remote key lookup apiMark Haines2015-04-221-13/+22
| * | | Add methods for storing and retrieving the raw key jsonMark Haines2015-04-152-3/+59
| * | | Return a sha256 fingerprint rather than the entire tls certificateMark Haines2015-04-142-1/+25
* | | | Make postgres database error slightly more helpfulErik Johnston2015-04-291-1/+2
* | | | Use __all__ instead of assert to stop pyflakes from warning about unused impo...Erik Johnston2015-04-291-2/+3
* | | | Appease PEP8Erik Johnston2015-04-291-0/+2
* | | | Check that postgres database has correct charset setErik Johnston2015-04-294-0/+33
| |_|/ |/| |
* | | Merge branch 'develop' of github.com:matrix-org/synapse into postgresErik Johnston2015-04-284-74/+133
|\ \ \
| * \ \ Merge pull request #126 from matrix-org/csauthMark Haines2015-04-283-55/+124
| |\ \ \
| | * | | pep8David Baker2015-04-171-1/+1
| | * | | Password reset, finally.David Baker2015-04-171-1/+15
| | * | | Add endpoint to get threepids from serverDavid Baker2015-04-171-0/+11
| | * | | pep8David Baker2015-04-171-1/+1
| | * | | make add3pid servlet workDavid Baker2015-04-171-0/+11
| | * | | Merge branch 'develop' into csauthDavid Baker2015-04-175-196/+373
| | |\| |
| | * | | Delete pushers when changing passwordDavid Baker2015-03-261-35/+10
| | * | | Allow multiple pushers for a single app ID & pushkey, honouring the 'append' ...David Baker2015-03-252-15/+39
| | * | | 1) Pushers are now associated with an access tokenDavid Baker2015-03-243-2/+5
| | * | | Make deleting other access tokens when you change your password actually workDavid Baker2015-03-241-5/+11
| | * | | Implement password changing (finally) along with a start on making client/ser...David Baker2015-03-231-4/+29
| * | | | pep8David Baker2015-04-271-1/+1
| * | | | Run database check before daemonizing, at the cost of database hygiene.David Baker2015-04-272-18/+10
| * | | | rename db method to be more informativeDavid Baker2015-04-271-4/+4
| * | | | pep8David Baker2015-04-241-2/+2
| * | | | Check users in our table aren't on a different domain to the one we're config...David Baker2015-04-241-0/+18
| | |_|/ | |/| |
* | | | Use TEXT instead of VARCHAR(n), since PostgreSQL treats them the same except ...Erik Johnston2015-04-2832-289/+289
* | | | Make get_max_token into inlineCallbacks so that the lock works.Erik Johnston2015-04-271-3/+4
* | | | Merge branch 'develop' of github.com:matrix-org/synapse into postgresErik Johnston2015-04-272-0/+28
|\| | |
| * | | Copyright noticesMark Haines2015-04-242-0/+28
| | |/ | |/|
* | | Shuffle operations so that locking upsert happens last in the txn. This ensur...Erik Johnston2015-04-275-56/+56
* | | Handle the fact that postgres databases can be restarted from under usErik Johnston2015-04-273-1/+33
* | | Revert needless change to storage.profileErik Johnston2015-04-171-6/+1
* | | Add unique index to room_aliases, remove duplicates on upgrade. Convert some ...Erik Johnston2015-04-177-4/+19
* | | PEP8Erik Johnston2015-04-162-5/+0
* | | Go back to storing JSON in TEXTErik Johnston2015-04-1611-41/+20
* | | Move encoding and decoding of JSON into storage layerErik Johnston2015-04-161-20/+6
* | | Remove mysql/maria supportErik Johnston2015-04-153-53/+1
* | | Change full_schemas/11 to work with postgresErik Johnston2015-04-1513-84/+90
* | | Remove debug loggingErik Johnston2015-04-151-2/+0
* | | Add missing yieldErik Johnston2015-04-151-1/+1
* | | pushers table requires a unique id.Erik Johnston2015-04-152-3/+11
* | | Don't pass in removed flagErik Johnston2015-04-151-1/+0
* | | Postgres does not allow you to continue using a cursor after a DB exception h...Erik Johnston2015-04-151-11/+14
* | | Turn off persistance of sent_transactions.response_jsonErik Johnston2015-04-151-1/+1
* | | Add index on events (topological_ordering, stream_ordering) to help with ORDE...Erik Johnston2015-04-152-0/+2
* | | Use try..finally in contextlib.contextmanagerErik Johnston2015-04-151-3/+5
* | | Use True for True rather than 1Erik Johnston2015-04-151-5/+7
* | | Add missing yield in storage funcErik Johnston2015-04-151-1/+1
* | | Correctly identify deadlocksErik Johnston2015-04-151-1/+1
* | | Add postgres database engineErik Johnston2015-04-141-0/+44
* | | Rename user_ips.user -> user_idErik Johnston2015-04-143-8/+8
* | | Add support for postgres instead of mysql. Change sql accourdingly. blob + va...Erik Johnston2015-04-1420-140/+151
* | | Correctly increment the _next_id initiallyErik Johnston2015-04-141-2/+4
* | | For backwards compat, make state_groups.id have a type of int, not varcharErik Johnston2015-04-132-2/+2
* | | Remove duplicate rowsErik Johnston2015-04-101-0/+9
* | | Use case sensitive collationsErik Johnston2015-04-101-1/+1
* | | DROP indexes before recreating themErik Johnston2015-04-102-1/+9
* | | Use LONGBLOB and TEXT for arbitary length rowsErik Johnston2015-04-1012-34/+34
* | | Handle the fact that in sqlite binary data might be stored as unicode or bytesErik Johnston2015-04-105-5/+20
* | | Bump schema versionErik Johnston2015-04-101-1/+1
* | | Use unsigned bigintErik Johnston2015-04-1019-50/+50
* | | SQLite wants INTEGER and not BIGINT for primary keysErik Johnston2015-04-106-9/+9
* | | Update full_schemas/16 to match delta files. Add delta/16 scriptsErik Johnston2015-04-106-0/+245
* | | Revert non-trivial changes to upgrade scriptsErik Johnston2015-04-103-5/+5
* | | Fix schema againErik Johnston2015-04-102-3/+3
* | | Revert non-trivial schema changes and move them to a new schema version.Erik Johnston2015-04-1019-27/+636
* | | Remove unused importErik Johnston2015-04-091-1/+1
* | | Remove spurious spacesErik Johnston2015-04-0915-50/+50
* | | Merge branch 'develop' of github.com:matrix-org/synapse into mysqlErik Johnston2015-04-092-21/+30
|\| |
| * | Merge pull request #114 from matrix-org/improve_get_event_cacheMark Haines2015-04-082-21/+30
| |\ \
| | * | Appease pep8Paul "LeoNerd" Evans2015-03-261-1/+2
| | * | Implement the main getEvent cache using Cache() instead of a custom applicati...Paul "LeoNerd" Evans2015-03-251-12/+7
| | * | Use FrozenEvent's reject_reason to decide whether to return it; don't include...Paul "LeoNerd" Evans2015-03-251-10/+14
| | * | Store the rejected reason in (Frozen)Event structsPaul "LeoNerd" Evans2015-03-251-2/+8
| | * | Indirect invalidations of _get_event_cache via a helper method to keep all us...Paul "LeoNerd" Evans2015-03-252-2/+5
* | | | Stream ordering and out of order insertions.Erik Johnston2015-04-095-65/+153
* | | | Use generic db exceptions rather than sqlite3 specific onesErik Johnston2015-04-082-6/+2
* | | | Merge branch 'develop' of github.com:matrix-org/synapse into mysqlErik Johnston2015-04-081-1/+2
|\| | |
| * | | Move database timer logging to seperate loggerErik Johnston2015-04-081-1/+2
* | | | Retry transaction, not SQL queryErik Johnston2015-04-081-21/+25
* | | | Fix maria engine to correctly recognize deadlocksErik Johnston2015-04-081-2/+2
* | | | Merge branch 'develop' of github.com:matrix-org/synapse into mysqlErik Johnston2015-04-075-207/+429
|\| | |
| * | | Add same user_id char checks as registration.Kegan Dougal2015-03-311-1/+7
| * | | Use a sender localpart instead of a user ID.Kegan Dougal2015-03-311-2/+9
| * | | Edit SQL schema to use string IDs not ints. Use token as ID. Update tests.Kegan Dougal2015-03-312-13/+17
| * | | Fix tests and missing returns on deferreds.Kegan Dougal2015-03-311-7/+11
| * | | Remove more reg/unreg methods. Read config not database for cache.Kegan Dougal2015-03-311-160/+59
| * | | Revert "Add another @cached wrapper, this time on get_presence_state()"Paul "LeoNerd" Evans2015-03-271-8/+2
| * | | Add another @cached wrapper, this time on get_presence_state()Paul "LeoNerd" Evans2015-03-271-2/+8
| * | | Fixes from PR commentsKegan Dougal2015-03-261-2/+2
| * | | Merge branch 'develop' into application-services-txn-reliabilityKegan Dougal2015-03-2619-644/+795
| |\| |
| | * | Allow a choice of LRU behaviour for Cache() by using LruCache() or OrderedDict()Paul "LeoNerd" Evans2015-03-251-8/+12
| | |/
| | * Put a cache on get_aliases_for_roomPaul "LeoNerd" Evans2015-03-201-2/+8
generated by cgit-pink 1.4.1 (git 2.36.1) at 2024-11-25 18:51:15 +0000