summary refs log tree commit diff
path: root/synapse (follow)
Commit message (Collapse)AuthorAgeFilesLines
* LintBrendan Abolivier2019-11-193-51/+54
|
* Don't apply retention policy based filtering on state eventsBrendan Abolivier2019-11-061-6/+9
| | | | As per MSC1763, 'Retention is only considered for non-state events.', so don't filter out state events based on the room's retention policy.
* Implement per-room message retention policiesBrendan Abolivier2019-11-0410-6/+690
|
* Merge pull request #6301 from matrix-org/babolivier/msc2326Brendan Abolivier2019-11-016-4/+98
|\ | | | | Implement MSC2326 (label based filtering)
| * Incorporate reviewBrendan Abolivier2019-11-014-3/+9
| |
| * Update synapse/storage/data_stores/main/schema/delta/56/event_labels.sqlBrendan Abolivier2019-11-011-1/+1
| | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * Add more data to the event_labels table and fix the indexesBrendan Abolivier2019-11-013-5/+21
| |
| * Add unstable feature flagBrendan Abolivier2019-11-011-0/+3
| |
| * LintBrendan Abolivier2019-11-012-1/+2
| |
| * Incorporate reviewBrendan Abolivier2019-11-013-5/+18
| |
| * LintBrendan Abolivier2019-10-301-7/+1
| |
| * Add more integration testingBrendan Abolivier2019-10-301-1/+1
| |
| * Add unit testsBrendan Abolivier2019-10-301-1/+1
| |
| * Add index on labelBrendan Abolivier2019-10-301-1/+3
| |
| * Implement filteringBrendan Abolivier2019-10-302-2/+20
| |
| * Store labels for new eventsBrendan Abolivier2019-10-302-1/+22
| |
| * Add database table for keeping track of labels on eventsBrendan Abolivier2019-10-291-0/+20
| |
* | Factor out an _AsyncEventContextImpl (#6298)Richard van der Hoff2019-11-012-84/+61
| | | | | | | | | | | | The intention here is to make it clearer which fields we can expect to be populated when: notably, that the _event_type etc aren't used for the synchronous impl of EventContext.
* | Merge pull request #6313 from matrix-org/uhoreg/cross_signing_fix_sqlite_schemaHubert Chathi2019-11-011-0/+42
|\ \ | | | | | | fix hidden field in devices table for older sqlite
| * | fix hidden field in devices table for older sqliteHubert Chathi2019-10-311-0/+42
| | |
* | | Support for routing outbound HTTP requests via a proxy (#6239)Richard van der Hoff2019-11-0110-6/+429
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The `http_proxy` and `HTTPS_PROXY` env vars can be set to a `host[:port]` value which should point to a proxy. The address of the proxy should be excluded from IP blacklists such as the `url_preview_ip_range_blacklist`. The proxy will then be used for * push * url previews * phone-home stats * recaptcha validation * CAS auth validation It will *not* be used for: * Application Services * Identity servers * Outbound federation * In worker configurations, connections from workers to masters Fixes #4198.
* | | Remove last usages of deprecated logging.warn method (#6314)Andrew Morgan2019-11-012-3/+3
| | |
* | | Depublish a room from the public rooms list when it is upgraded (#6232)Andrew Morgan2019-11-014-30/+91
| | |
* | | Update synapse/storage/data_stores/main/devices.pyHubert Chathi2019-10-311-1/+1
| | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
* | | Merge branch 'develop' into cross-signing_federationHubert Chathi2019-10-31108-380/+803
|\| |
| * | Merge pull request #6254 from matrix-org/uhoreg/cross_signing_fix_workers_notifyHubert Chathi2019-10-315-3/+58
| |\ \ | | | | | | | | make notification of signatures work with workers
| | * \ Merge branch 'develop' into uhoreg/cross_signing_fix_workers_notifyHubert Chathi2019-10-31103-376/+742
| | |\ \
| | * | | clean up code a bitHubert Chathi2019-10-311-5/+9
| | | | |
| | * | | make user signatures a separate streamHubert Chathi2019-10-305-14/+50
| | | | |
| | * | | Merge branch 'develop' into uhoreg/cross_signing_fix_workers_notifyHubert Chathi2019-10-3043-1142/+1234
| | |\ \ \
| | * | | | make notification of signatures work with workersHubert Chathi2019-10-243-2/+17
| | | | | |
| * | | | | rstrip slashes from url on appservice (#6306)Will Hunt2019-10-311-1/+3
| | |_|/ / | |/| | |
| * | | | Update black to 19.10b0 (#6304)Amber Brown2019-11-0137-158/+179
| | | | | | | | | | | | | | | * update version of black and also fix the mypy config being overridden
| * | | | Merge pull request #6294 from matrix-org/erikj/add_state_storageErik Johnston2019-10-3119-66/+338
| |\ \ \ \ | | | | | | | | | | | | Add StateGroupStorage interface
| | * | | | Apply suggestions from code review Erik Johnston2019-10-311-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fix docstring Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| | * | | | Port to use state storageErik Johnston2019-10-3016-65/+102
| | | | | |
| | * | | | Add StateGroupStorage interfaceErik Johnston2019-10-303-1/+235
| | | |/ / | | |/| |
| * | | | Expose some homeserver functionality to spam checkers (#6259)Travis Ralston2019-10-312-1/+64
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Offer the homeserver instance to the spam checker * Newsfile * Linting * Expose a Spam Checker API instead of passing the homeserver object * Alter changelog * s/hs/api
| * | | | Fix /purge_room API.Erik Johnston2019-10-311-1/+0
| | | | | | | | | | | | | | | | | | | | It fails trying to clean the `topic` table which was recently removed.
| * | | | Remove usage of deprecated logger.warn method from codebase (#6271)Andrew Morgan2019-10-3162-145/+159
| | | | | | | | | | | | | | | Replace every instance of `logger.warn` with `logger.warning` as the former is deprecated.
| * | | | fix delete_existing for _persist_events (#6300)Richard van der Hoff2019-10-302-5/+2
| |/ / / | | | | | | | | this is part of _retry_on_integrity_error, so should only be on _persist_events_and_state_updates
* | | | rename get_devices_by_remote to get_device_updates_by_remoteHubert Chathi2019-10-302-6/+6
| | | |
* | | | Merge branch 'develop' into cross-signing_federationHubert Chathi2019-10-3042-1075/+1167
|\| | |
| * | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-3045-542/+555
| |\ \ \ | | | | | | | | | | | | | | | erikj/split_out_persistence_store
| | * \ \ Merge pull request #6291 from matrix-org/erikj/fix_cache_descriptorErik Johnston2019-10-301-4/+5
| | |\ \ \ | | | | | | | | | | | | Make ObservableDeferred.observe() always return deferred.
| | | * | | Clarify docstringErik Johnston2019-10-301-0/+4
| | | | | |
| | | * | | Make ObservableDeferred.observe() always return deferred.Erik Johnston2019-10-301-5/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This makes it easier to use in an async/await world. Also fixes a bug where cache descriptors would occaisonally return a raw value rather than a deferred.
| | * | | | Fix log line that was printing undefined value (#6278)Andrew Morgan2019-10-301-1/+1
| | | | | |
| | * | | | Fix small typo in comment (#6269)Andrew Morgan2019-10-301-1/+1
| | |/ / /
| | * | | Fix typo in domain name in account_threepid_delegates config option (#6273)Andrew Morgan2019-10-301-1/+1
| | | | |
| | * | | Handle FileNotFound error in checking git repository version (#6284)Andrew Morgan2019-10-301-4/+6
| | | | |
| | * | | Merge pull request #6280 from matrix-org/erikj/receipts_async_awaitErik Johnston2019-10-306-53/+32
| | |\ \ \ | | | | | | | | | | | | Port receipt and read markers to async/wait
| | | * \ \ Merge branch 'erikj/federation_server_async_await' of ↵Erik Johnston2019-10-291-1/+1
| | | |\ \ \ | | | | | | | | | | | | | | | | | | | | | github.com:matrix-org/synapse into erikj/receipts_async_await
| | | * | | | Port receipt and read markers to async/waitErik Johnston2019-10-296-53/+32
| | | | | | |
| | * | | | | Merge pull request #6274 from matrix-org/erikj/replication_asyncErik Johnston2019-10-306-44/+26
| | |\ \ \ \ \ | | | | | | | | | | | | | | | | Port replication http server endpoints to async/await
| | | * \ \ \ \ Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-291-1/+1
| | | |\ \ \ \ \ | | | | | |_|_|/ | | | | |/| | | | | | | | | | | erikj/replication_async
| | | * | | | | Port replication http server endpoints to async/awaitErik Johnston2019-10-296-44/+26
| | | | | | | |
| | * | | | | | Merge pull request #6275 from matrix-org/erikj/port_rest_eventsErik Johnston2019-10-301-94/+72
| | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | Port room rest handlers to async/await
| | | * \ \ \ \ \ Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-291-1/+1
| | | |\ \ \ \ \ \ | | | | | |/ / / / | | | | |/| | | | | | | | | | | | | erikj/port_rest_events
| | | * | | | | | Port room rest handlers to async/awaitErik Johnston2019-10-291-94/+72
| | | | |/ / / / | | | |/| | | |
| | * | | | | | Don't return coroutinesErik Johnston2019-10-291-6/+6
| | | |_|_|/ / | | |/| | | |
| | * | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-291-1/+1
| | |\ \ \ \ \ | | | | |/ / / | | | |/| / / | | | |_|/ / | | |/| | | erikj/federation_server_async_await
| | | * | | Merge branch 'master' into developRichard van der Hoff2019-10-291-1/+1
| | | |\ \ \ | | | | |/ / | | | |/| |
| | | | * | 1.5.0 v1.5.0 github/release-v1.5.0 release-v1.5.0Richard van der Hoff2019-10-291-1/+1
| | | | | |
| | * | | | Make concurrently_execute work with async/awaitErik Johnston2019-10-291-4/+3
| | | | | |
| | * | | | Port federation_server to async/awaitErik Johnston2019-10-291-118/+87
| | |/ / /
| | * | | Merge pull request #6263 from matrix-org/erikj/caches_return_deferredsErik Johnston2019-10-293-7/+6
| | |\ \ \ | | | | | | | | | | | | Quick fix to ensure cache descriptors always return deferreds
| | | * | | Update docstringErik Johnston2019-10-291-3/+2
| | | | | |
| | | * | | Quick fix to ensure cache descriptors always return deferredsErik Johnston2019-10-283-4/+4
| | | | | |
| | * | | | Merge branch 'release-v1.5.0' of github.com:matrix-org/synapse into developErik Johnston2019-10-291-4/+8
| | |\ \ \ \ | | | | |/ / | | | |/| |
| | | * | | Make room directory search case insensitiveErik Johnston2019-10-291-4/+8
| | | | | |
| | * | | | Add CI for synapse_port_db (#6140)Brendan Abolivier2019-10-281-3/+6
| | | |/ / | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds: * a test sqlite database * a configuration file for the sqlite database * a configuration file for a postgresql database (using the credentials in `.buildkite/docker-compose.pyXX.pgXX.yaml`) as well as a new script named `.buildkite/scripts/test_synapse_port_db.sh` that: 1. installs Synapse 2. updates the test sqlite database to the latest schema and runs background updates on it 3. creates an empty postgresql database 4. run the `synapse_port_db` script to migrate the test sqlite database to the empty postgresql database (with coverage) Step `2` is done via a new script located at `scripts-dev/update_database`. The test sqlite database is extracted from a SyTest run, so that it can be considered as an actual homeserver's database with actual data in it.
| | * | | Merge tag 'v1.5.0rc2' into developRichard van der Hoff2019-10-284-8/+28
| | |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.5.0rc2 (2019-10-28) ============================= Bugfixes -------- - Update list of boolean columns in `synapse_port_db`. ([\#6247](https://github.com/matrix-org/synapse/issues/6247)) - Fix /keys/query API on workers. ([\#6256](https://github.com/matrix-org/synapse/issues/6256)) - Improve signature checking on some federation APIs. ([\#6262](https://github.com/matrix-org/synapse/issues/6262)) Internal Changes ---------------- - Move schema delta files to the correct data store. ([\#6248](https://github.com/matrix-org/synapse/issues/6248)) - Small performance improvement by removing repeated config lookups in room stats calculation. ([\#6255](https://github.com/matrix-org/synapse/issues/6255))
| | | * | 1.5.0rc2 v1.5.0rc2Richard van der Hoff2019-10-281-1/+1
| | | | |
| | | * | Improve signature checking on some federation APIs (#6262)Richard van der Hoff2019-10-283-7/+27
| | | | | | | | | | | | | | | | | | | | | | | | | Make sure that we check that events sent over /send_join, /send_leave, and /invite, are correctly signed and come from the expected servers.
| | * | | Convert EventContext to attrs (#6218)Richard van der Hoff2019-10-282-62/+45
| | | | | | | | | | | | | | | | | | | | * make EventContext use an attr
| | * | | Merge pull request #6253 from matrix-org/uhoreg/e2e_backup_delete_keysHubert Chathi2019-10-252-0/+33
| | |\ \ \ | | | | | | | | | | | | delete keys when deleting backup versions
| | | * | | delete keys when deleting backupsHubert Chathi2019-10-242-0/+33
| | | | |/ | | | |/|
| | * | | Merge branch 'release-v1.5.0' of github.com:matrix-org/synapse into developErik Johnston2019-10-251-1/+3
| | |\ \ \ | | | | |/ | | | |/|
| | | * | Merge pull request #6255 from matrix-org/erikj/stats_configErik Johnston2019-10-251-1/+3
| | | |\ \ | | | | | | | | | | | | Remove repeated calls to config.stats_enabled.
| | | | * | Remove repeated calls to config.stats_enabled.Erik Johnston2019-10-251-1/+3
| | | | |/ | | | | | | | | | | | | | | | | | | | | Turns out that fetching variables from the config object is expensive, so doing it once at startup avoids unnecessary work.
| | * | | Merge branch 'release-v1.5.0' of github.com:matrix-org/synapse into developErik Johnston2019-10-251-67/+67
| | |\| |
| | | * | Fix /keys/query API on workers.Erik Johnston2019-10-251-67/+67
| | | |/ | | | | | | | | | | | | | | | | The necessary getters were added only to the master store and not the worker stores.
| | * | Merge pull request #6251 from matrix-org/michaelkaye/debug_guard_loggingErik Johnston2019-10-256-17/+24
| | |\ \ | | | | | | | | | | Reduce debug logging overhead
| | | * | Address codestyle concernsMichael Kaye2019-10-243-5/+10
| | | | |
| | | * | Delay printf until logging is required.Michael Kaye2019-10-242-9/+9
| | | | | | | | | | | | | | | | | | | | | | | | | Using % will cause the string to be generated even if debugging is off.
| | | * | use %r to __repr__ objectsMichael Kaye2019-10-243-4/+4
| | | | | | | | | | | | | | | | | | | | This avoids calculating __repr__ unless we are going to log.
| | | * | Don't encode object as UTF-8 string if not needed.Michael Kaye2019-10-241-2/+4
| | | |/ | | | | | | | | | | | | | | | | I believe that string formatting ~10-15 sized events will take a proportion of CPU time.
| | * / Make user/room stats log line less verbose.Michael Kaye2019-10-241-1/+1
| | |/
| * | Review commentsErik Johnston2019-10-304-13/+28
| | |
| * | Use new EventPersistenceStoreErik Johnston2019-10-233-3/+12
| | |
| * | Add DataStores and Storage classes.Erik Johnston2019-10-233-4/+34
| | |
| * | Move persist_events out from main data store.Erik Johnston2019-10-232-634/+711
| | | | | | | | | | | | | | | | | | This is in preparation for splitting out of state_groups_state from the main store into it own one, as persisting events depends on calculating state.
* | | blackHubert Chathi2019-10-301-1/+3
| | |
* | | apply changes as a result of PR reviewHubert Chathi2019-10-302-55/+46
| | |
* | | Merge branch 'develop' into cross-signing_federationHubert Chathi2019-10-24277-4434/+4751
|\ \ \ | | |/ | |/|
| * | Move schema delta files to the correct data store.Erik Johnston2019-10-242-0/+0
| | | | | | | | | | | | They were put in the global schema delta directory due to a bad merge.
| * | 1.5.0rc1Andrew Morgan2019-10-241-1/+1
| | |
| * | Option to suppress resource exceeded alerting (#6173)Neil Johnson2019-10-244-43/+96
| | | | | | | | | | | | The expected use case is to suppress MAU limiting on small instances
| * | Cleanup extra quotes from IDEs (#6236)Andrew Morgan2019-10-231-2/+1
| |/
| * Add config linting script that checks for bool casing (#6203)Andrew Morgan2019-10-239-15/+22
| | | | | | | | | | Add a linting script that enforces all boolean values in the default config be lowercase. This has annoyed me for a while so I decided to fix it.
| * Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-223-13/+479
| |\ | | | | | | | | | erikj/refactor_stores
| * | Clean up prepare_database.py a bit and add commentsErik Johnston2019-10-221-7/+30
| | |
| * | Delete background_update table creation in main data_storeErik Johnston2019-10-221-21/+0
| | |
| * | Move README into synapse/storage/__init__.pyErik Johnston2019-10-222-13/+12
| | |
| * | Add a basic README to synapse.storageErik Johnston2019-10-221-0/+13
| | |
| * | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-2219-198/+631
| |\ \ | | | | | | | | | | | | erikj/refactor_stores
| * | | Fix schema management to work with multiple data stores.Erik Johnston2019-10-211-41/+108
| | | |
| * | | Move storage classes into a main "data store".Erik Johnston2019-10-21261-4324/+4500
| | | | | | | | | | | | | | | | | | | | This is in preparation for having multiple data stores that offer different functionality, e.g. splitting out state or event storage.
* | | | don't error if federation query doesn't have cross-signing keysHubert Chathi2019-10-241-7/+9
| | | |
* | | | move get_e2e_cross_signing_key to EndToEndKeyWorkerStore so it works with ↵Hubert Chathi2019-10-231-67/+67
| | | | | | | | | | | | | | | | workers
* | | | blackHubert Chathi2019-10-221-1/+2
| | | |
* | | | vendor-prefix the EDU name until MSC1756 is merged into the specHubert Chathi2019-10-222-2/+4
| | | |
* | | | update to work with newer code, and fix formattingHubert Chathi2019-10-223-6/+7
| | | |
* | | | add missing paramHubert Chathi2019-10-221-1/+1
| | | |
* | | | make black happyHubert Chathi2019-10-222-27/+39
| | | |
* | | | don't crash if the user doesn't have cross-signing keysHubert Chathi2019-10-221-14/+25
| | | |
* | | | implement federation parts of cross-signingHubert Chathi2019-10-224-10/+179
| |_|/ |/| |
* | | Merge pull request #5726 from matrix-org/uhoreg/e2e_cross-signing2-part2Hubert Chathi2019-10-223-13/+479
|\ \ \ | |_|/ |/| | Cross-signing [3/4] -- uploading signatures edition
| * | Merge branch 'develop' into cross-signing_sig_uploadHubert Chathi2019-10-18152-2508/+5409
| |\ \
| * | | fix doc stringsHubert Chathi2019-10-181-9/+13
| | | |
| * | | make isort happyHubert Chathi2019-09-241-1/+0
| | | |
| * | | add some commentsHubert Chathi2019-09-241-2/+10
| | | |
| * | | drop some logger lines to debugHubert Chathi2019-09-241-3/+3
| | | |
| * | | make changes based on PR feedbackHubert Chathi2019-09-242-118/+165
| | | |
| * | | add function docsHubert Chathi2019-09-071-2/+24
| | | |
| * | | Merge branch 'develop' into cross-signing_sig_uploadHubert Chathi2019-09-0736-510/+1219
| |\ \ \
| * | | | run blackHubert Chathi2019-09-061-24/+10
| | | | |
| * | | | split out signature processing into separate functionsHubert Chathi2019-09-061-195/+204
| | | | |
| * | | | avoid modifying input parameterHubert Chathi2019-09-051-7/+7
| | | | |
| * | | | update with newer coding styleHubert Chathi2019-09-042-3/+3
| | | | |
| * | | | make black happyHubert Chathi2019-09-043-93/+79
| | | | |
| * | | | allow uploading signatures of master key signed by devicesHubert Chathi2019-09-043-84/+152
| | | | |
| * | | | implement device signature uploading/fetchingHubert Chathi2019-09-043-0/+338
| | | | |
* | | | | Remove Auth.check method (#6217)Richard van der Hoff2019-10-182-21/+5
| |_|/ / |/| | | | | | | This method was somewhat redundant, and confusing.
* | | | Merge branch 'uhoreg/e2e_cross-signing_merged' into developHubert Chathi2019-10-1812-21/+623
|\ \ \ \
| * \ \ \ Merge branch 'develop' into uhoreg/e2e_cross-signing_mergedHubert Chathi2019-10-18149-2344/+5400
| |\ \ \ \ | | | |_|/ | | |/| |
| * | | | use the right function for when we're already in runInteractionHubert Chathi2019-10-181-4/+4
| | | | |
| * | | | Merge branch 'develop' into uhoreg/e2e_cross-signing_mergedHubert Chathi2019-09-0736-510/+1219
| |\ \ \ \ | | |_|/ / | |/| | / | | | |/ | | |/|
| * | | add user signature stream change cache to slaved device storeHubert Chathi2019-09-041-0/+3
| | | |
| * | | Merge branch 'develop' into cross-signing_keysHubert Chathi2019-09-0496-1261/+1463
| |\ \ \
| * \ \ \ Merge branch 'uhoreg/e2e_cross-signing_merged' into cross-signing_keysHubert Chathi2019-08-2898-1378/+3636
| |\ \ \ \
| | * \ \ \ Merge branch 'develop' into uhoreg/e2e_cross-signing_mergedHubert Chathi2019-08-2885-1304/+3405
| | |\ \ \ \
| | * | | | | Cross-signing [1/4] -- hidden devices (#5759)Hubert Chathi2019-08-123-10/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * allow devices to be marked as "hidden" This is a prerequisite for cross-signing, as it allows us to create other things that live within the device namespace, so they can be used for signatures.
| * | | | | | blackHubert Chathi2019-08-281-3/+1
| | | | | | |
| * | | | | | use stream ID generator instead of timestampHubert Chathi2019-08-284-23/+23
| | | | | | |
| * | | | | | make isort happyHubert Chathi2019-08-211-1/+0
| | | | | | |
| * | | | | | apply PR review suggestionsHubert Chathi2019-08-214-53/+46
| | | | | | |
| * | | | | | make changes from PR reviewHubert Chathi2019-08-014-49/+75
| | | | | | |
| * | | | | | Merge branch 'cross-signing_hidden' into cross-signing_keysHubert Chathi2019-08-01187-1954/+2779
| |\ \ \ \ \ \
| | * | | | | | don't need to return the hidden column any moreHubert Chathi2019-08-011-1/+1
| | | | | | | |
| | * | | | | | really fix queries to work with PostgresHubert Chathi2019-07-311-19/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (by going back to not using SQL directly)
| | * | | | | | PostgreSQL, Y U no like?Hubert Chathi2019-07-311-3/+4
| | | | | | | |
| | * | | | | | remove extra SQL query paramHubert Chathi2019-07-311-1/+0
| | | | | | | |
| | * | | | | | Merge branch 'develop' into cross-signing_hiddenHubert Chathi2019-07-30187-1934/+2767
| | |\ \ \ \ \ \
| * | | | | | | | Merge branch 'cross-signing_hidden' into cross-signing_keysHubert Chathi2019-07-303-21/+17
| |\| | | | | | |
| | * | | | | | | apply changes from PR reviewHubert Chathi2019-07-303-20/+17
| | | | | | | | |
| * | | | | | | | allow uploading keys for cross-signingHubert Chathi2019-07-2510-12/+558
| |/ / / / / / /
| * | | | | | | allow devices to be marked as "hidden"Hubert Chathi2019-07-242-16/+65
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is a prerequisite for cross-signing, as it allows us to create other things that live within the device namespace, so they can be used for signatures.
* | | | | | | | Merge remote-tracking branch 'origin/develop' into rav/event_auth/1Richard van der Hoff2019-10-189-122/+125
|\ \ \ \ \ \ \ \
| * | | | | | | | Fix logging config for the docker image (#6197)Richard van der Hoff2019-10-181-3/+2
| | |_|_|_|_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Turns out that loggers that are instantiated before the config is loaded get turned off. Also bring the logging config that is generated by --generate-config into line. Fixes #6194.
| * | | | | | | Merge branch 'master' into developBrendan Abolivier2019-10-181-1/+1
| |\ \ \ \ \ \ \
| | * | | | | | | 1.4.1Brendan Abolivier2019-10-181-1/+1
| | | | | | | | |
| * | | | | | | | Merge pull request #6196 from matrix-org/erikj/awaitErik Johnston2019-10-186-114/+113
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Move rest/admin to use async/await.
| | * | | | | | | | Port synapse/rest/client/_base.py to async/awaitErik Johnston2019-10-111-9/+5
| | | | | | | | | |
| | * | | | | | | | Add maybe_awaitable and fix __init__ bugsErik Johnston2019-10-112-2/+34
| | | | | | | | | |
| | * | | | | | | | Port synaps/rest/client/users.py to async/awaitErik Johnston2019-10-111-11/+7
| | | | | | | | | |
| | * | | | | | | | Port synaps/rest/client/server_notice_servlet.py to async/awaitErik Johnston2019-10-111-6/+3
| | | | | | | | | |
| | * | | | | | | | Port synaps/rest/client/media.py to async/awaitErik Johnston2019-10-111-16/+11
| | | | | | | | | |
| | * | | | | | | | Port rest/admin/__init__.py to async/awaitErik Johnston2019-10-111-72/+55
| | | | | | | | | |
| * | | | | | | | | Fix presence timeouts when synchrotron restarts. (#6212)Erik Johnston2019-10-181-4/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Fix presence timeouts when synchrotron restarts. Handling timeouts would fail if there was an external process that had timed out, e.g. a synchrotron restarting. This was due to a couple of variable name typoes. Fixes #3715.
* | | | | | | | | | Merge remote-tracking branch 'origin/develop' into rav/event_auth/1Richard van der Hoff2019-10-1829-187/+354
|\| | | | | | | | |
| * | | | | | | | | Merge tag 'v1.4.1rc1' into developRichard van der Hoff2019-10-171-1/+1
| |\ \ \ \ \ \ \ \ \ | | | |/ / / / / / / | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Synapse 1.4.1rc1 (2019-10-17) ============================= Bugfixes -------- - Fix bug where redacted events were sometimes incorrectly censored in the database, breaking APIs that attempted to fetch such events. ([\#6185](https://github.com/matrix-org/synapse/issues/6185), [5b0e9948](https://github.com/matrix-org/synapse/commit/5b0e9948eaae801643e594b5abc8ee4b10bd194e))
| | * | | | | | | | 1.4.1rc1 v1.4.1rc1Richard van der Hoff2019-10-171-1/+1
| | | | | | | | | |
| | * | | | | | | | Do the update as a background indexErik Johnston2019-10-172-9/+51
| | | | | | | | | |
| | * | | | | | | | Merge pull request #6185 from matrix-org/erikj/fix_censored_evnetsErik Johnston2019-10-172-4/+28
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fix inserting bytes as text in `censor_redactions`
| * | | | | | | | | Merge pull request #6193 from matrix-org/uhoreg/interpret_device_key_in_storageHubert Chathi2019-10-112-12/+16
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | make storage layer in charge of interpreting the device key data
| | * | | | | | | | | expand on commentHubert Chathi2019-10-111-1/+2
| | | | | | | | | | |
| | * | | | | | | | | make sure we actually return somethingHubert Chathi2019-10-102-2/+9
| | | | | | | | | | |
| | * | | | | | | | | make storage layer in charge of interpreting the device key dataHubert Chathi2019-10-102-13/+9
| | | | | | | | | | |
| * | | | | | | | | | Merge pull request #6189 from matrix-org/uhoreg/e2e_backup_optional_versionHubert Chathi2019-10-112-3/+3
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | make version optional in body of e2e backup version update
| | * | | | | | | | | | make version optional in body of e2e backup version updateHubert Chathi2019-10-092-3/+3
| | |/ / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | to agree with latest version of the MSC
| * | | | | | | | | | Merge pull request #6195 from matrix-org/erikj/opentracing_preview_urlErik Johnston2019-10-112-5/+11
| |\ \ \ \ \ \ \ \ \ \ | | | |_|/ / / / / / / | | |/| | | | | | | | Trace non-JSON APIs, /media, /key etc
| | * | | | | | | | | Trace non-JSON APIs, /media, /key etcErik Johnston2019-10-112-5/+11
| | | | | | | | | | |
| * | | | | | | | | | cas: support setting display name (#6114)Valérian Rousset2019-10-112-1/+6
| |/ / / / / / / / / | | | | | | | | | | | | | | | | | | | | Now, the CAS server can return an attribute stating what's the desired displayname, instead of using the username directly.
| * | | | | | | | | Fix MAU reaping where reserved users are specified. (#6168)Neil Johnson2019-10-112-42/+65
| | | | | | | | | |
| * | | | | | | | | Merge pull request #6156 from matrix-org/erikj/postgres_anyErik Johnston2019-10-1014-109/+189
| |\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | Use Postgres ANY for selecting many values.
| | * | | | | | | | | Fix SQLite take 2Erik Johnston2019-10-101-1/+1
| | | | | | | | | | |
| | * | | | | | | | | Fix SQLiteErik Johnston2019-10-101-1/+1
| | | | | | | | | | |
| | * | | | | | | | | Remove add_in_list_sql_clauseErik Johnston2019-10-104-34/+25
| | | | | | | | | | |
| | * | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/postgres_anyErik Johnston2019-10-103-3/+231
| | |\ \ \ \ \ \ \ \ \
| | * | | | | | | | | | Replace IN usage with helper funcsErik Johnston2019-10-1011-97/+138
| | | | | | | | | | | |
| | * | | | | | | | | | Add helper funcs to use postgres ANYErik Johnston2019-10-101-8/+56
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This means that we can write queries with `col = ANY(?)`, which helps postgres.
| * | | | | | | | | | | Fix store_url_cache using bytesErik Johnston2019-10-101-2/+2
| | | | | | | | | | | |
| * | | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-103-3/+231
| |\ \ \ \ \ \ \ \ \ \ \ | | | |/ / / / / / / / / | | |/| | | | | | | | | | | | | | | | | | | | | erikj/disable_sql_bytes
| * | | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-1088-1620/+2239
| |\ \ \ \ \ \ \ \ \ \ \ | | | |/ / / / / / / / / | | |/| | | | | | | | | | | | | | | | | | | | | erikj/disable_sql_bytes
| * | | | | | | | | | | Do the update as a background indexErik Johnston2019-10-092-9/+51
| | | | | | | | | | | |
| * | | | | | | | | | | Disable bytes usage with postgresErik Johnston2019-10-083-3/+10
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | More often than not passing bytes to `txn.execute` is a bug (where we meant to pass a string) that just happens to work if `BYTEA_OUTPUT` is set to `ESCAPE`. However, this is a bit of a footgun so we want to instead error when this happens, and force using `bytearray` if we actually want to use bytes.
* | | | | | | | | | | | rip out some unreachable codeRichard van der Hoff2019-10-174-153/+0
| |_|/ / / / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The only possible rejection reason is AUTH_ERROR, so all of this is unreachable.
* | | | | | | | | | | Merge pull request #6127 from matrix-org/erikj/patch_innerErik Johnston2019-10-103-3/+231
|\ \ \ \ \ \ \ \ \ \ \ | |_|/ / / / / / / / / |/| | | | | | | | | | Add more log context checks when patching inlineCallbacks
| * | | | | | | | | | Fixup commentsErik Johnston2019-10-101-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
| * | | | | | | | | | Fix py3.5Erik Johnston2019-10-101-1/+1
| | | | | | | | | | |
| * | | | | | | | | | Fix py3.5Erik Johnston2019-10-101-1/+1
| | | | | | | | | | |
| * | | | | | | | | | sortErik Johnston2019-10-101-3/+1
| | | | | | | | | | |
| * | | | | | | | | | Appease mypyErik Johnston2019-10-101-13/+18
| | | | | | | | | | |
| * | | | | | | | | | Add comentsErik Johnston2019-10-101-5/+25
| | | | | | | | | | |
| * | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/patch_innerErik Johnston2019-10-1039-146/+521
| |\ \ \ \ \ \ \ \ \ \
| * | | | | | | | | | | Fix packagingErik Johnston2019-10-101-2/+4
| | | | | | | | | | | |
| * | | | | | | | | | | Log correct contextErik Johnston2019-10-101-6/+6
| | | | | | | | | | | |
| * | | | | | | | | | | Test for sentinel commitErik Johnston2019-10-101-2/+19
| | | | | | | | | | | |
| * | | | | | | | | | | Move patch_inline_callbacks into synapse/Erik Johnston2019-10-102-1/+180
| | | | | | | | | | | |
| * | | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into erikj/patch_innerErik Johnston2019-10-0962-1041/+1507
| |\ \ \ \ \ \ \ \ \ \ \ | | | |_|/ / / / / / / / | | |/| | | | | | | | |
| * | | | | | | | | | | Patch inlinecallbacks for log contextsErik Johnston2019-09-274-6/+13
| | | | | | | | | | | |
* | | | | | | | | | | | Add domain validation when creating room with list of invitees (#6121)werner2912019-10-101-1/+3
| | | | | | | | | | | |
* | | | | | | | | | | | before fulfilling a group invite,check if user is already joined/invited (#3436)Michael Telatynski2019-10-101-4/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes vector-im/riot-web#5645
* | | | | | | | | | | | send 404 as http-status when filter-id is unknown to the server (#2380)krombel2019-10-102-22/+31
| |_|/ / / / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This fixed the weirdness of 400 vs 404 as http status code in the case the filter id is not known by the server. As e.g. matrix-js-sdk expects 404 to catch this situation this leads to unwanted behaviour.
* | | | | | | | | | | Fix races in room stats (and other) updates. (#6187)Richard van der Hoff2019-10-104-23/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Hopefully this will fix the occasional failures we were seeing in the room directory. The problem was that events are not necessarily persisted (and `current_state_delta_stream` updated) in the same order as their stream_id. So for instance current_state_delta 9 might be persisted *before* current_state_delta 8. Then, when the room stats saw stream_id 9, it assumed it had done everything up to 9, and never came back to do stream_id 8. We can solve this easily by only processing up to the stream_id where we know all events have been persisted.
* | | | | | | | | | | Rewrite the user_filter migration again (#6184)Richard van der Hoff2019-10-101-26/+32
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | you can't plausibly ALTER TABLE in sqlite, so we create the new table with the right schema to start with.
* | | | | | | | | | | Move tag/push rules room upgrade checking ealier (#6155)Andrew Morgan2019-10-101-18/+44
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It turns out that _local_membership_update doesn't run when you join a new, remote room. It only runs if you're joining a room that your server already knows about. This would explain #4703 and #5295 and why the transfer would work in testing and some rooms, but not others. This would especially hit single-user homeservers. The check has been moved to right after the room has been joined, and works much more reliably. (Though it may still be a bit awkward of a place).
* | | | | | | | | | | Refactor HomeserverConfig so it can be typechecked (#6137)Amber Brown2019-10-1033-79/+385
| |/ / / / / / / / / |/| | | | | | | | |
* | | | | | | | | | Merge pull request #6185 from matrix-org/erikj/fix_censored_evnetsErik Johnston2019-10-092-4/+28
|\ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / | |/| | | | | | | | Fix inserting bytes as text in `censor_redactions`
| * | | | | | | | | Fix existing hex encoded json values in DBErik Johnston2019-10-081-0/+26
| | | | | | | | | |
| * | | | | | | | | Fix inserting bytes as textErik Johnston2019-10-081-4/+2
| | |/ / / / / / / | |/| | | | | | |
* | | | | | | | | Merge pull request #6178 from matrix-org/babolivier/factor_out_bg_updatesBrendan Abolivier2019-10-099-605/+670
|\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Factor out backgroung updates
| * | | | | | | | | Fix RegistrationStoreBrendan Abolivier2019-10-081-1/+1
| | | | | | | | | |
| * | | | | | | | | Cleanup client_ipsBrendan Abolivier2019-10-081-7/+0
| | | | | | | | | |
| * | | | | | | | | Don't end up with 4 classes in registrationBrendan Abolivier2019-10-081-52/+50
| | | | | | | | | |
| * | | | | | | | | LintBrendan Abolivier2019-10-073-3/+3
| | | | | | | | | |
| * | | | | | | | | Move roommember's bg updates to a dedicated storeBrendan Abolivier2019-10-071-108/+114
| | | | | | | | | |
| * | | | | | | | | Move user_directory's bg updates to a dedicated storeBrendan Abolivier2019-10-071-84/+94
| | | | | | | | | |
| * | | | | | | | | Move state's bg updates to a dedicated storeBrendan Abolivier2019-10-071-190/+204
| | | | | | | | | |
| * | | | | | | | | Move search's bg updates to a dedicated storeBrendan Abolivier2019-10-071-25/+31
| | | | | | | | | |
| * | | | | | | | | Move registration's bg updates to a dedicated storeBrendan Abolivier2019-10-071-95/+103
| | | | | | | | | |
| * | | | | | | | | Move media_repository's bg updates to a dedicated storeBrendan Abolivier2019-10-071-3/+9
| | | | | | | | | |
| * | | | | | | | | Move devices's bg updates to a dedicated storeBrendan Abolivier2019-10-071-22/+27
| | | | | | | | | |
| * | | | | | | | | Move deviceinbox's bg updates to a dedicated storeBrendan Abolivier2019-10-071-15/+22
| | | | | | | | | |
| * | | | | | | | | Move client_ips's bg updates to a dedicated storeBrendan Abolivier2019-10-071-94/+106
| | | | | | | | | |
* | | | | | | | | | add M_TOO_LARGE error code for uploading a too large file (#6151)Anshul Angaria2019-10-081-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes #6109
* | | | | | | | | | Remove unused public room list timeout param (#6179)Andrew Morgan2019-10-081-12/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Remove unused public room list timeout param * Add changelog
* | | | | | | | | | Fix /federation/v1/state for recent room versions (#6170)Richard van der Hoff2019-10-081-13/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Fix /federation/v1/state for recent room versions Turns out this endpoint was completely broken for v3 rooms. Hopefully this re-signing code is irrelevant nowadays anyway.
* | | | | | | | | | Merge pull request #6161 from matrix-org/erikj/dont_regen_user_id_on_failureErik Johnston2019-10-071-6/+4
|\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | Don't regenerate numeric user ID if registration fails.
| * | | | | | | | | | Remove unused variableErik Johnston2019-10-031-2/+0
| | | | | | | | | | |
| * | | | | | | | | | Don't regenerate numeric user ID if registration fails.Erik Johnston2019-10-031-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This causes huge amounts of DB IO if registrations start to fail e.g. because the DB is struggling with IO.
* | | | | | | | | | | Log responder we are using. (#6139)Michael Kaye2019-10-071-1/+1
| |/ / / / / / / / / |/| | | | | | | | | | | | | | | | | | | This prevents us logging "Responding to media request with responder %s".
* | | | | | | | | | add some logging to the rooms stats updates, to try to track down a flaky ↵Richard van der Hoff2019-10-072-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | test (#6167)
* | | | | | | | | | Merge pull request #6175 from matrix-org/babolivier/fix_unique_user_filter_indexBrendan Abolivier2019-10-071-2/+2
|\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | Fix unique_user_filter_index schema update
| * | | | | | | | | | Fix unique_user_filter_index schema updateBrendan Abolivier2019-10-071-2/+2
| | | | | | | | | | |
* | | | | | | | | | | Merge pull request #6159 from matrix-org/erikj/cache_membershipsErik Johnston2019-10-071-19/+45
|\ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / |/| | | | | | | | | | Cache room membership lookups in _get_joined_users_from_context
| * | | | | | | | | | Fix bug where we didn't pull out event IDErik Johnston2019-10-071-1/+1
| | | | | | | | | | |
| * | | | | | | | | | Merge branch 'develop' of github.com:matrix-org/synapse into ↵Erik Johnston2019-10-034-19/+43
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | erikj/cache_memberships