summary refs log tree commit diff
path: root/scripts/synapse_port_db (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Merge commit 'f43c66d23' into anoa/dinsic_release_1_21_xAndrew Morgan2020-10-211-0/+1
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit 'f43c66d23': Add support for running Complement against the local checkout (#8317) Filter out appservices from mau count (#8404) Only assert valid next_link params when provided (#8417) Add metrics to track success/otherwise of replication requests (#8406) Fix handling of connection timeouts in outgoing http requests (#8400) Changelog Don't check whether a 3pid is allowed to register during password reset Add checks for postgres sequence consistency (#8402) Create a mechanism for marking tests "logcontext clean" (#8399) Add `ui_auth_sessions_ips` table to `synapse_port_db` ignore list (#8410) A pair of tiny cleanups in the federation request code. (#8401) typo
| * Add `ui_auth_sessions_ips` table to `synapse_port_db` ignore list (#8410)Dagfinn Ilmari Mannsåker2020-09-281-0/+1
| | | | | | | | | | | | This table was created in #8034 (1.20.0). It references `ui_auth_sessions`, which is ignored, so this one should be too. Signed-off-by: Dagfinn Ilmari Mannsåker <ilmari@ilmari.org>
* | Merge commit '31acc5c30' into anoa/dinsic_release_1_21_xAndrew Morgan2020-10-211-0/+24
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit '31acc5c30': Escape the error description on the sso_error template. (#8405) Fix occasional "Re-starting finished log context" from keyring (#8398) Allow existing users to login via OpenID Connect. (#8345) Fix schema delta for servers that have not backfilled (#8396) Fix MultiWriteIdGenerator's handling of restarts. (#8374) s/URLs/variables in changelog s/accidentally/incorrectly in changelog Update changelog wording Add type annotations to SimpleHttpClient (#8372) Add new sequences to port DB script (#8387) Add EventStreamPosition type (#8388) Mark the shadow_banned column as boolean in synapse_port_db. (#8386)
| * Add new sequences to port DB script (#8387)Erik Johnston2020-09-241-0/+24
| |
| * Mark the shadow_banned column as boolean in synapse_port_db. (#8386)Patrick Cloke2020-09-241-0/+1
| |
* | Merge commit '920dd1083' into anoa/dinsic_release_1_21_xAndrew Morgan2020-10-211-0/+1
|\ \ | | | | | | | | | | | | | | | | | | * commit '920dd1083': 1.20.1 Mark the shadow_banned column as boolean in synapse_port_db. (#8386) Hotfix: disable autoescape by default when rendering Jinja2 templates (#8394)
| * | Mark the shadow_banned column as boolean in synapse_port_db. (#8386)Patrick Cloke2020-09-241-0/+1
| |/
* | Merge commit '2ffd6783c' into anoa/dinsic_release_1_21_xAndrew Morgan2020-10-191-1/+1
|\| | | | | | | | | * commit '2ffd6783c': Revert #7736 (#8039)
| * Revert #7736 (#8039)Brendan Abolivier2020-08-061-1/+1
| |
* | Merge commit 'a7bdf98d0' into anoa/dinsic_release_1_21_xAndrew Morgan2020-10-161-40/+40
|\| | | | | | | | | * commit 'a7bdf98d0': Rename database classes to make some sense (#8033)
| * Rename database classes to make some sense (#8033)Erik Johnston2020-08-051-39/+39
| |
* | Merge commit '3950ae51e' into anoa/dinsic_release_1_21_xAndrew Morgan2020-10-161-1/+1
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit '3950ae51e': Ensure that remove_pusher is always async (#7981) Ensure the msg property of HttpResponseException is a string. (#7979) Remove from the event_relations table when purging historical events. (#7978) Add additional logging for SAML sessions. (#7971) Add MSC reference to changelog for #7736 Re-implement unread counts (#7736) Various improvements to the docs (#7899) Convert storage layer to async/await. (#7963) Add an option to disable purge in delete room admin API (#7964) Move some log lines from default logger to sql/transaction loggers (#7952) Use the JSON module from the std library instead of simplejson. (#7936) Fix exit code for `check_line_terminators.sh` (#7970) Option to allow server admins to join complex rooms (#7902) Fix typo in metrics docs (#7966) Add script for finding files with unix line terminators (#7965) Convert the remaining media repo code to async / await. (#7947) Convert a synapse.events to async/await. (#7949) Convert groups and visibility code to async / await. (#7951) Convert push to async/await. (#7948)
| * Re-implement unread counts (#7736)Brendan Abolivier2020-07-291-1/+1
| |
* | Merge commit 'de119063f' into anoa/dinsic_release_1_18_xAndrew Morgan2020-08-031-1/+11
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit 'de119063f': (31 commits) Convert room list handler to async/await. (#7912) Element CSS and logo in email templates (#7919) Lint the contrib/ directory in CI and linting scripts, add synctl to linting script (#7914) Remove unused code from synapse.logging.utils. (#7897) Fix a typo in the sample config. (#7890) Fix deprecation warning: import ABC from collections.abc (#7892) Change sample config's postgres user to synapse_user (#7889) Fix deprecation warning due to invalid escape sequences (#7895) Remove Ubuntu Eoan that is now EOL (#7888) Fix the trace function for async functions. (#7872) Add help for creating a user via docker (#7885) Switch to Debian:Slim from Alpine for the docker image (#7839) Stop using 'device_max_stream_id' (#7882) Fix TypeError in synapse.notifier (#7880) Add a default limit (of 100) to get/sync operations. (#7858) Change "unknown room ver" logging to warning. (#7881) Convert device handler to async/await (#7871) Convert synapse.app to async/await. (#7868) Convert _base, profile, and _receipts handlers to async/await (#7860) Add admin endpoint to get members in a room. (#7842) ...
| * Use a postgres sequence to generate guest user IDsRichard van der Hoff2020-07-161-1/+11
| |
* | Merge commit 'dc80a0762' into dinsicAndrew Morgan2020-08-031-4/+13
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * commit 'dc80a0762': 1.16.0rc1 Back out MSC2625 implementation (#7761) Additional configuration options for auto-join rooms (#7763) Add some metrics for inbound and outbound federation processing times (#7755) Explain the purpose of the "tests" conditional dependency requirement (#7751) Add another yield point to state res v2 (#7746) Move flake8 to end. Don't exit script on failure (#7738) Make tox actions work on Debian 10 (#7703) Yield during large v2 state res. (#7735) add org.matrix.login.jwt so that m.login.jwt can be deprecated (#7675) Set Content-Length for Metrics requests (#7730) Sync ignored table names in synapse_port_db to current database schema (#7717) Allow local media to be marked as safe from being quarantined. (#7718) Convert directory handler to async/await (#7727) Speed up state res v2 across large state differences. (#7725)
| * Sync ignored table names in synapse_port_db to current database schema (#7717)Patrick Cloke2020-06-231-4/+12
| |
| * Allow local media to be marked as safe from being quarantined. (#7718)Patrick Cloke2020-06-221-0/+1
| |
* | Merge commit '6418b0379' into dinsicAndrew Morgan2020-08-031-7/+12
|\| | | | | | | | | * commit '6418b0379': Ignore the UI Auth sessions when porting from sqlite to postgresql (#7711)
| * Ignore the UI Auth sessions when porting from sqlite to postgresql (#7711)Patrick Cloke2020-06-171-7/+12
| |
* | Merge commit 'a3f11567d' into dinsicAndrew Morgan2020-08-031-3/+1
|\| | | | | | | | | * commit 'a3f11567d': Replace all remaining six usage with native Python 3 equivalents (#7704)
| * Replace all remaining six usage with native Python 3 equivalents (#7704)Dagfinn Ilmari Mannsåker2020-06-161-3/+1
| |
* | Merge branch 'release-v1.14.0' of github.com:matrix-org/synapse into ↵Andrew Morgan2020-06-101-2/+5
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dinsic-release-v1.14.x * 'release-v1.14.0' of github.com:matrix-org/synapse: (108 commits) Fix typo in PR link Update debian changelog 1.14.0 Improve changelog wording 1.14.0rc2 Fix sample config docs error (#7581) Fix up comments Fix specifying cache factors via env vars with * in name. (#7580) Don't apply cache factor to event cache. (#7578) Ensure ReplicationStreamer is always started when replication enabled. (#7579) Remove the changes to the debian changelog Not full release yet, this is rc1 Merge event persistence move changelog entries More changelog fix Changelog fixes 1.14.0 Replace device_27_unique_idx bg update with a fg one (#7562) Fix incorrect exception handling in KeyUploadServlet.on_POST (#7563) Fix recording of federation stream token (#7564) Simplify reap_monthly_active_users (#7558) ...
| * Add option to move event persistence off master (#7517)Erik Johnston2020-05-221-0/+3
| |
| * Support any process writing to cache invalidation stream. (#7436)Erik Johnston2020-05-071-2/+2
| |
* | Add ProfileStore to synapse_port_db as it has a dinsic background updateAndrew Morgan2020-05-281-0/+2
|/
* Port synapse_port_db to async/await (#6718)Brendan Abolivier2020-01-211-82/+112
| | | | | | | | | | | | | | | | | | | | | | | | | | * Raise an exception if there are pending background updates So we return with a non-0 code * Changelog * Port synapse_port_db to async/await * Port update_database to async/await * Add version string to mocked homeservers * Remove unused imports * Convert overseen bits to async/await * Fixup logging contexts * Fix imports * Add a way to print an error without raising an exception * Incorporate review
* Add `local_current_membership` table (#6655)Erik Johnston2020-01-151-1/+1
| | | | | | | Currently we rely on `current_state_events` to figure out what rooms a user was in and their last membership event in there. However, if the server leaves the room then the table may be cleaned up and that information is lost. So lets add a table that separately holds that information.
* Refuse to start if sqlite is older than 3.11.0Richard van der Hoff2020-01-091-4/+12
|
* Modify check_database to take a connection rather than a cursorRichard van der Hoff2020-01-091-18/+7
| | | | We might not need the cursor at all.
* Add a background update to clear tombstoned rooms from the directory (#6648)Richard van der Hoff2020-01-071-0/+5
| | | | | | * Add a background update to clear tombstoned rooms from the directory * use the ABC metaclass
* Split state groups into a separate data store (#6296)Erik Johnston2019-12-201-4/+4
|
* Add database config class (#6513)Erik Johnston2019-12-181-34/+24
| | | | | This encapsulates config for a given database and is the way to get new connections.
* Fix port db scriptErik Johnston2019-12-061-34/+2
|
* Fix DB scriptsErik Johnston2019-12-051-5/+9
|
* Move DB pool and helper functions into dedicated Database classErik Johnston2019-12-051-36/+37
|
* Merge pull request #6464 from matrix-org/erikj/make_public_sql_baseErik Johnston2019-12-051-9/+9
|\ | | | | Clean up SQLBaseStore private function usage
| * Remove underscore from SQLBaseStore functionsErik Johnston2019-12-041-9/+9
| |
* | Fix background updates for synapse_port_dbBrendan Abolivier2019-12-041-0/+2
| |
* | Make synapse_port_db exit with a non-0 code if something failedBrendan Abolivier2019-12-041-0/+1
|/
* Fix error when using synapse_port_db on a vanilla synapse dbAndrew Morgan2019-12-021-1/+4
|
* Remove usage of deprecated logger.warn method from codebase (#6271)Andrew Morgan2019-10-311-3/+3
| | | Replace every instance of `logger.warn` with `logger.warning` as the former is deprecated.
* Merge pull request #6247 from matrix-org/babolivier/port_db_columnBrendan Abolivier2019-10-241-0/+1
|\ | | | | Add new boolean column to synapse_port_db
| * Add new boolean column to synapse_port_dbBrendan Abolivier2019-10-241-0/+1
| |
* | Fix up changelog v1.5.0rc1Andrew Morgan2019-10-241-7/+9
|/
* Fix import paths in synapse_port_dbBrendan Abolivier2019-10-231-11/+19
|
* Make synapse_port_db correctly create indexes (#6102)Brendan Abolivier2019-10-231-52/+130
| | | | | | | Make `synapse_port_db` correctly create indexes in the PostgreSQL database, by having it run the background updates on the database before migrating the data. To ensure we're migrating the right data, also block the port if the SQLite3 database still has pending or ongoing background updates. Fixes #4877
* Add missing BOOLEAN_COLUMNs to synapse_port_db (#6216)Bart Noordervliet2019-10-181-0/+2
| | | | Small fix to synapse_port_db to be able to convert from database schema v56.
* Add account_validity's email_sent column to the list of boolean columns in ↵Brendan Abolivier2019-06-031-0/+1
| | | | | | synapse_port_db Fixes #5306
* drop tables listed in #1830 (#4992)Neil Johnson2019-04-081-5/+0
| | | | | | | | | | | | | | | Tables dropped: * application_services, * application_services_regex, * transaction_id_to_pdu, * stats_reporting * current_state_resets * event_content_hashes * event_destinations * event_edge_hashes * event_signatures * feedback * room_hosts * state_forward_extremities
* Fix issue #4596Anders2019-04-031-1/+1
| | | | | Make synapse_port_db --curses work with Python 3. Signed-off-by: Anders Jensen-Waud <anders@jensenwaud.com>
* Consider e2e_room_keys.is_verified column as booleanEric2019-02-201-0/+1
| | | | | | | This column was considered as an int, crashing the whole migration process Signed-off-by: Eric <eric@pedr0.net>
* Fix a number of flake8 errorsRichard van der Hoff2018-10-241-1/+2
| | | | | | | | | | | | Broadly three things here: * disable W504 which seems a bit whacko * remove a bunch of `as e` expressions from exception handlers that don't use them * use `r""` for strings which include backslashes Also, we don't use pep8 any more, so we can get rid of the duplicate config there.
* Make scripts/ and scripts-dev/ pass pyflakes (and the rest of the codebase ↵Amber Brown2018-10-201-150/+122
| | | | on py3) (#4068)
* Replace some type checks with six type checksAdrian Tschira2018-04-071-1/+3
| | | | Signed-off-by: Adrian Tschira <nota@notafile.com>
* Port script: Set up state_group_id_seqRichard van der Hoff2018-04-061-0/+13
| | | | Fixes https://github.com/matrix-org/synapse/issues/3050.
* Port script: clean up a bitRichard van der Hoff2018-04-061-25/+29
| | | | | Improve logging and comments. Group all the stuff to do with inspecting tables together rather than creating the port tables in the middle.
* Port script: avoid nasty errors when setting upRichard van der Hoff2018-04-061-8/+6
| | | | We really shouldn't spit out "Failed to create port table", it looks scary.
* Less s'sErik Johnston2017-11-141-2/+2
|
* Add new boolean columns to port scriptErik Johnston2017-11-141-0/+7
|
* Make the port script drop NUL values in all tablesDavid Baker2017-10-311-7/+19
| | | | | | Postgres doesn't support NULs in strings so it makes the script throw an exception and stop if any values contain \0. Drop them with appropriate warning.
* Add groups table to BOOLEAN_COLUMNS in synapse_port_dbLuke Barnard2017-10-261-0/+1
|
* Fix port scriptErik Johnston2017-10-261-0/+1
| | | | | | | We changed _simple_update_one_txn to use _simple_update_txn but didn't yank it out in the port script. Fixes #2565
* Drop search values with nul charactersRichard van der Hoff2017-10-021-4/+7
| | | | | | https://github.com/matrix-org/synapse/issues/2187 contains a report of a port failing due to nul characters somewhere in the search table. Let's try dropping the offending rows.
* Extend commentErik Johnston2017-07-201-1/+2
|
* Fix port script for user directory tablesErik Johnston2017-07-201-0/+18
|
* add missing boolean to synapse_port_dbMatthew2017-06-161-0/+1
|
* fix synapse_port scriptMatthew2017-06-161-1/+1
|
* Don't assume postgres tables are in the public schema during db portJohn Kristensen2017-03-171-3/+1
| | | | | | | When fetching the list of tables from the postgres database during the db port, it is assumed that the tables are in the public schema. This is not always the case, so lets just rely on postgres to determine the default schema to use.
* Fix typoKevin Liu2017-02-111-1/+1
| | | This is what I get for not proofreading
* Fix synapse_port_db failure (fixes #1902)Kevin Liu2017-02-111-0/+1
| | | | | See https://matrix.to/#/!cURbafjkfsMDVwdRDQ:matrix.org/$148686272020hCgRD:potatofrom.space Signed-off-by: Kevin Liu <kevin@potatofrom.space>
* Update port script with recently added tablesErik Johnston2016-09-271-0/+9
| | | | | | This also fixes a bug where the port script would explode when it encountered the newly added boolean column `public_room_list_stream.visibility`
* Allow upgrading from old port_from_sqlite3 formatErik Johnston2016-08-041-0/+21
|
* Handle the fact that some tables have negative rowid rowsErik Johnston2016-08-041-43/+111
|
* Update port scriptErik Johnston2016-04-221-42/+81
|
* Don't require config to create databaseErik Johnston2016-04-061-8/+5
|
* Mark AS users with their AS's IDDaniel Wagner-Hall2016-02-111-2/+7
|
* copyrightsMatthew Hodgson2016-01-071-1/+1
|
* SpellingErik Johnston2015-11-191-1/+1
|
* Fix database port script to work with new event_search tableErik Johnston2015-11-181-11/+44
|
* Remove unused _execute_and_decode from scripts/synapse_port_dbMark Haines2015-09-231-2/+0
|
* Merge branch 'master' into developMark Haines2015-09-071-6/+9
|\ | | | | | | | | Conflicts: setup.py
| * Make port script handle empty sent_transactions tableErik Johnston2015-09-021-6/+9
| |
* | update logger to match new ambiguous script name...Matthew Hodgson2015-09-031-1/+1
|/
* Clean up scripts/Erik Johnston2015-08-271-0/+760
generated by cgit-magenta 1.5.1 (git 2.48.1) at 2025-08-07 20:52:02 +0000