summary refs log tree commit diff
path: root/synapse/storage/search.py (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Move storage classes into a main "data store".Erik Johnston2019-10-211-713/+0
| | | | | This is in preparation for having multiple data stores that offer different functionality, e.g. splitting out state or event storage.
* Remove add_in_list_sql_clauseErik Johnston2019-10-101-5/+7
|
* Replace IN usage with helper funcsErik Johnston2019-10-101-4/+7
|
* LintBrendan Abolivier2019-10-071-1/+0
|
* Move search's bg updates to a dedicated storeBrendan Abolivier2019-10-071-25/+31
|
* Replace returnValue with return (#5736)Amber Brown2019-07-231-30/+26
|
* Run Black. (#5482)Amber Brown2019-06-201-3/+3
|
* Remove Postgres 9.4 support (#5448)Amber Brown2019-06-181-22/+0
|
* Expose DataStore._get_events as get_events_as_listErik Johnston2019-05-141-2/+2
| | | | This is in preparation for reaction work which requires it.
* Run black on the rest of the storage module (#4996)Amber Brown2019-04-031-103/+94
|
* Add an option to disable search for homeservers which may not be interested ↵Travis Ralston2018-12-041-0/+6
| | | | | | in it (#4230) This is useful for homeservers not intended for users, such as bot-only homeservers or ones that only process IoT data.
* run isortAmber Brown2018-07-091-3/+5
|
* Attempt to be more performant on PyPy (#3462)Amber Brown2018-06-281-1/+1
|
* Consistently use six's iteritems and wrap lazy keys/values in list() if ↵Amber Brown2018-05-311-2/+2
| | | | they're not meant to be lazy (#3307)
* remaining isintance fixesAdrian Tschira2018-05-241-2/+3
| | | | Signed-off-by: Adrian Tschira <nota@notafile.com>
* Also fix reindexing of searchErik Johnston2018-04-251-1/+1
|
* Remove uses of events.contentRichard van der Hoff2018-03-291-2/+4
|
* Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2018-03-191-1/+1
|\
| * Replace ujson with simplejsonErik Johnston2018-03-151-1/+1
| |
* | remove overzealous exception handlingRichard van der Hoff2018-02-141-18/+10
| |
* | Merge branch 'matthew/gin_work_mem' into matthew/hit_the_ginRichard van der Hoff2018-02-131-24/+117
|\ \
| * \ Merge branch 'develop' into matthew/gin_work_memRichard van der Hoff2018-02-131-6/+7
| |\ \
| | * | Factor out common code for search insertRichard van der Hoff2018-02-051-33/+62
| | | | | | | | | | | | | | | | | | | | we can reuse the same code as is used for event insert, for doing the background index population.
| | * | Move store_event_search_txn to SearchStoreRichard van der Hoff2018-02-051-0/+33
| | |/ | | | | | | | | | | | | ... as a precursor to making event storing and doing the bg update share some code.
| * | Factor out common code for search insertRichard van der Hoff2018-02-041-33/+56
| | | | | | | | | | | | | | | we can reuse the same code as is used for event insert, for doing the background index population.
| * | Clean up work_mem handlingRichard van der Hoff2018-02-031-11/+41
| | | | | | | | | | | | | | | Add some comments and improve exception handling when twiddling work_mem for the search update
| * | Move store_event_search_txn to SearchStoreRichard van der Hoff2018-02-031-0/+35
| | | | | | | | | | | | | | | ... as a precursor to making event storing and doing the bg update share some code.
| * | oopshera2018-01-091-1/+1
| | |
| * | avoid 80s GIN inserts by tweaking work_memMatthew Hodgson2018-01-091-0/+4
| |/ | | | | | | see https://github.com/matrix-org/synapse/issues/2753 for details
* | GIN reindex: Fix syntax errors, improve exception handlingRichard van der Hoff2018-02-131-13/+27
| |
* | Reinstate event_search_postgres_gist handlerRichard van der Hoff2018-02-021-0/+11
| | | | | | | | People may have queued updates for this, so we can't just delete it.
* | fix GIST->GIN switchMatthew Hodgson2018-01-091-12/+16
| |
* | switch back from GIST to GIN indexesMatthew Hodgson2018-01-091-8/+13
|/
* Make __init__ consitstent across Store heirarchyRichard van der Hoff2017-11-131-2/+2
| | | | | | Add db_conn parameters to the `__init__` methods of the *Store classes, so that they are all consistent, which makes the multiple inheritance work correctly (and so that we can later extract mixins which can be used in the slavedstores)
* replace 'except:' with 'except Exception:'Richard van der Hoff2017-10-231-2/+2
| | | | what could possibly go wrong
* Remove spurious commentErik Johnston2016-11-031-2/+2
|
* Replace postgres GIN with GISTErik Johnston2016-11-031-0/+27
| | | | | This is because GIN can be slow to write too, especially when the table gets large.
* Remove event fetching from DB threadsErik Johnston2016-06-031-13/+16
|
* Simplify query and handle finishing correctlyErik Johnston2016-04-221-16/+14
|
* Order NULLs firstErik Johnston2016-04-211-3/+14
|
* Fix queryErik Johnston2016-04-211-2/+2
|
* Use special UPDATE syntaxErik Johnston2016-04-211-20/+12
|
* TypoErik Johnston2016-04-211-1/+1
|
* Need to do _background_update_progress_txn in actual transactionErik Johnston2016-04-211-6/+8
|
* Update progress when creating indexErik Johnston2016-04-211-0/+7
|
* Fix SQL statementErik Johnston2016-04-211-3/+3
|
* Create index must be on a connErik Johnston2016-04-211-6/+13
|
* Create index concurrentlyErik Johnston2016-04-211-1/+13
|
* Optimise event_search in postgresErik Johnston2016-04-211-1/+60
|
* copyrightsMatthew Hodgson2016-01-071-1/+1
|
* Fix 500 error when back-paginating search resultsRichard van der Hoff2015-12-171-2/+4
| | | | | We were mistakenly adding pagination clauses to the count query, which then failed because the count query doesn't join to the events table.
* Merge branch 'release-v0.12.0' into developMark Haines2015-12-141-0/+5
|\
| * Skip events that where the body, name or topic isn't a string when back ↵Mark Haines2015-12-141-0/+5
| | | | | | | | populating the FTS index
* | Fix typo in sql for full text search on sqlite3Mark Haines2015-12-141-1/+1
| |
* | Include approximate count of search resultsErik Johnston2015-12-111-2/+54
| |
* | Use more efficient query formErik Johnston2015-12-111-8/+13
|/
* Throw if unrecognized DB typeErik Johnston2015-12-021-1/+4
|
* Fix so highlight matching works againErik Johnston2015-12-021-8/+13
|
* Remove deuplication. Add comment about regex.Erik Johnston2015-12-021-21/+11
|
* Search: Add prefix matching supportErik Johnston2015-12-021-5/+32
|
* Allow paginating search ordered by recentsErik Johnston2015-11-301-16/+25
|
* Return words to highlight in search resultsErik Johnston2015-11-271-19/+104
|
* Trailing whitespaceErik Johnston2015-11-121-1/+1
|
* Expand commentErik Johnston2015-11-121-0/+6
|
* CommentErik Johnston2015-11-121-0/+2
|
* Fix SQL syntaxErik Johnston2015-11-121-2/+3
|
* Use a (hopefully) more efficient SQL query for doing recency based room searchErik Johnston2015-11-121-4/+6
|
* Merge pull request #359 from matrix-org/markjh/incremental_indexingErik Johnston2015-11-111-2/+101
|\ | | | | Incremental background updates for db indexes
| * Fix the background updateMark Haines2015-11-111-8/+8
| |
| * Use a background task to update databases to use the full text searchMark Haines2015-11-101-4/+4
| |
| * Run the background updates when starting synapse.Mark Haines2015-11-101-3/+8
| |
| * Add background update task for reindexing event searchMark Haines2015-11-091-2/+96
| |
* | fix comedy important missing comma breaking recent-ordered FTS on sqliteMatthew Hodgson2015-11-081-1/+1
|/
* Error handlingErik Johnston2015-11-051-1/+8
|
* Implement basic pagination for search resultsErik Johnston2015-11-051-36/+19
|
* Implement order and group byErik Johnston2015-11-041-0/+96
|
* Implement rank function for SQLite FTSErik Johnston2015-10-231-1/+2
|
* Actually filter resultsErik Johnston2015-10-221-3/+5
|
* LESS THANErik Johnston2015-10-221-1/+2
|
* Use namedtuple as return valueErik Johnston2015-10-221-3/+15
|
* Limit max number of SQL varsErik Johnston2015-10-221-4/+6
|
* TypingErik Johnston2015-10-161-2/+2
|
* Explicitly check for Sqlite3EngineErik Johnston2015-10-161-2/+5
|
* Add docstringErik Johnston2015-10-161-0/+11
|
* Comment on the LIMIT 500Erik Johnston2015-10-161-0/+2
|
* Add paranoia limitErik Johnston2015-10-131-1/+1
|
* Remove constraints in preperation of using filtersErik Johnston2015-10-131-20/+10
|
* Add SQLite supportErik Johnston2015-10-131-5/+12
|
* Filter events to only thsoe that the user is allowed to seeErik Johnston2015-10-121-7/+7
|
* Keep FTS indexes up to date. Only search through rooms currently joinedErik Johnston2015-10-121-1/+6
|
* Add basic full text search impl.Erik Johnston2015-10-091-0/+75