summary refs log tree commit diff
path: root/demo (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-11-14Make Dependabot only bump Rust deps in the lock file (#14434)Erik Johnston3-6/+8
This is to help downstream packagers.
2022-11-14Remove unused type-ignores (#14433)David Robertson3-6/+8
* Remove unused type-ignores Oversights in #14427 and #14429. * Changelog
2022-11-14Clean-up events persistance code (#14411)Patrick Cloke3-8/+4
By removing unused variables and making some arguments required which are always provided.
2022-11-14Bump gitpython from 3.1.27 to 3.1.29 (#14429)dependabot[bot]2-3/+4
* Bump gitpython from 3.1.27 to 3.1.29 Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.27 to 3.1.29. - [Release notes](https://github.com/gitpython-developers/GitPython/releases) - [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES) - [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.27...3.1.29) --- updated-dependencies: - dependency-name: gitpython dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump types-pyyaml from 6.0.12.1 to 6.0.12.2 (#14428)dependabot[bot]2-3/+4
* Bump types-pyyaml from 6.0.12.1 to 6.0.12.2 Bumps [types-pyyaml](https://github.com/python/typeshed) from 6.0.12.1 to 6.0.12.2. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-pyyaml dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump attrs from 21.4.0 to 22.1.0 (#14427)dependabot[bot]2-7/+8
* Bump attrs from 21.4.0 to 22.1.0 Bumps [attrs](https://github.com/python-attrs/attrs) from 21.4.0 to 22.1.0. - [Release notes](https://github.com/python-attrs/attrs/releases) - [Changelog](https://github.com/python-attrs/attrs/blob/main/CHANGELOG.rst) - [Commits](https://github.com/python-attrs/attrs/compare/21.4.0...22.1.0) --- updated-dependencies: - dependency-name: attrs dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump flake8 from 4.0.1 to 5.0.4 (#14431)dependabot[bot]2-20/+21
* Bump flake8 from 4.0.1 to 5.0.4 Bumps [flake8](https://github.com/pycqa/flake8) from 4.0.1 to 5.0.4. - [Release notes](https://github.com/pycqa/flake8/releases) - [Commits](https://github.com/pycqa/flake8/compare/4.0.1...5.0.4) --- updated-dependencies: - dependency-name: flake8 dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump types-jsonschema from 4.17.0.0 to 4.17.0.1 (#14430)dependabot[bot]2-3/+6
* Bump types-jsonschema from 4.17.0.0 to 4.17.0.1 Bumps [types-jsonschema](https://github.com/python/typeshed) from 4.17.0.0 to 4.17.0.1. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-jsonschema dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump blake2 from 0.10.4 to 0.10.5 (#14426)dependabot[bot]3-3/+4
* Bump blake2 from 0.10.4 to 0.10.5 Bumps [blake2](https://github.com/RustCrypto/hashes) from 0.10.4 to 0.10.5. - [Release notes](https://github.com/RustCrypto/hashes/releases) - [Commits](https://github.com/RustCrypto/hashes/compare/blake2-v0.10.4...blake2-v0.10.5) --- updated-dependencies: - dependency-name: blake2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump actions/upload-artifact from 2 to 3 (#14425)dependabot[bot]2-1/+2
* Bump actions/upload-artifact from 2 to 3 Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 2 to 3. - [Release notes](https://github.com/actions/upload-artifact/releases) - [Commits](https://github.com/actions/upload-artifact/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/upload-artifact dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-14Bump dawidd6/action-download-artifact from 2.24.1 to 2.24.2 (#14424)dependabot[bot]2-1/+2
* Bump dawidd6/action-download-artifact from 2.24.1 to 2.24.2 Bumps [dawidd6/action-download-artifact](https://github.com/dawidd6/action-download-artifact) from 2.24.1 to 2.24.2. - [Release notes](https://github.com/dawidd6/action-download-artifact/releases) - [Commits](https://github.com/dawidd6/action-download-artifact/compare/b12b127cf24433d14b4f93cee62f5465076ba82a...e6e25ac3a2b93187502a8be1ef9e9603afc34925) --- updated-dependencies: - dependency-name: dawidd6/action-download-artifact dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-11Update sample Nginx configuration to HTTP 1.1 (#14414)Brad Jones2-0/+4
Signed-off-by: Brad Jones <brad@kinksters.dating>
2022-11-11Add an Admin API endpoint for looking up users based on 3PID (#14405)Ashish Kumar5-13/+161
2022-11-11Merge/remove `Slaved*` stores into `WorkerStores` (#14375)Nick Mills-Barrett17-377/+202
2022-11-10Remove duplicated code to evict entries. (#14410)Patrick Cloke2-9/+3
This code was factored out to a method, but also left in-place. Calling this twice in a row makes no sense: the first call will reduce the size appropriately, but the loop will immediately exit since the cache size was already reduced.
2022-11-10Fix PostgreSQL sometimes using table scans for `event_search` (#14409)Sean Quah2-0/+34
PostgreSQL may underestimate the number of distinct `room_id`s in `event_search`, which can cause it to use table scans for queries for multiple rooms. Fix this by setting `n_distinct` on the column. Resolves #14402. Signed-off-by: Sean Quah <seanq@matrix.org>
2022-11-10Quieter logging for stateres failure at missing prev events (#14346)David Robertson2-3/+3
2022-11-09Drop support for Postgres 10 in full text search code. (#14397)Patrick Cloke4-95/+41
2022-11-09Bump dawidd6/action-download-artifact from 2.24.0 to 2.24.1 (#14398)dependabot[bot]2-1/+2
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com> Co-authored-by: reivilibre <oliverw@matrix.org>
2022-11-09Modernize configure_workers_and_start.py bootstrapping script for ↵realtyem2-15/+15
Dockerfile-workers. (#14294)
2022-11-09Build Debian packages for Ubuntu 22.10 Kinetic Kudu (#14396)Sean Quah2-0/+2
Signed-off-by: Sean Quah <seanq@matrix.org>
2022-11-09Test against PostgreSQL 15 in CI (#14394)Sean Quah3-2/+12
Resolves #14170. Signed-off-by: Sean Quah <seanq@matrix.org>
2022-11-08Remove support for PostgreSQL 10 (#14392)Sean Quah5-4/+15
Signed-off-by: Sean Quah <seanq@matrix.org>
2022-11-08Add all Stream Writer worker types to configure_workers_and_start.py (#14197)realtyem2-7/+70
Co-authored-by: reivilibre <oliverw@matrix.org>
2022-11-08Allow override for requesting specific worker types for Complement on ↵realtyem4-1/+18
command line. (#14324) * Expose getting SYNAPSE_WORKER_TYPES from external, allowing override of workers requested. * Add WORKER_TYPES variable option to complement.sh script that passes requested workers into start_for_complement.sh entrypoint. * Update docs to reflect this new ability. * Changelog * Don't rely on soft wrapping to format long strings Good idea dklimpel. Thanks for catching that. Co-authored-by: Dirk Klimpel <5740567+dklimpel@users.noreply.github.com> * Small nits just noticed in docs. * Fixup new line in docs. Co-authored-by: Dirk Klimpel <5740567+dklimpel@users.noreply.github.com>
2022-11-08Update CHANGES.md to mention PostgreSQL 10 end of life v1.71.0Sean Quah1-0/+2
2022-11-08Update CHANGES.mdSean Quah1-6/+5
2022-11-081.71.0Sean Quah3-1/+13
2022-11-07Correctly create power level event during initial room creation (#14361)Shay3-4/+26
2022-11-07Fix background update table-scanning `events` (#14374)Richard van der Hoff2-8/+9
When this background update did its last batch, it would try to update all the events that had been inserted since the bgupdate started, which could cause a table-scan. Make sure we limit the update correctly.
2022-11-07Add example on how to load balance /sync requests (#14297)aceArt-GmbH2-3/+6
Signed-off-by: lukas <lukas.walter@aceart.de> Signed-off-by: lukas <lukas.walter@aceart.de>
2022-11-07Do not reject `/sync` requests with unrecognised filter fields (#14369)Sean Quah3-6/+24
For forward compatibility, Synapse needs to ignore fields it does not recognise instead of raising an error. Fixes #14365. Signed-off-by: Sean Quah <seanq@matrix.org>
2022-11-07Bump types-jsonschema from 4.4.6 to 4.17.0.0 (#14386)dependabot[bot]2-3/+4
* Bump types-jsonschema from 4.4.6 to 4.17.0.0 Bumps [types-jsonschema](https://github.com/python/typeshed) from 4.4.6 to 4.17.0.0. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-jsonschema dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump types-pyyaml from 6.0.12 to 6.0.12.1 (#14385)dependabot[bot]2-5/+6
* Bump types-pyyaml from 6.0.12 to 6.0.12.1 Bumps [types-pyyaml](https://github.com/python/typeshed) from 6.0.12 to 6.0.12.1. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-pyyaml dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump cryptography from 36.0.1 to 38.0.3 (#14384)dependabot[bot]2-24/+31
* Bump cryptography from 36.0.1 to 38.0.3 Bumps [cryptography](https://github.com/pyca/cryptography) from 36.0.1 to 38.0.3. - [Release notes](https://github.com/pyca/cryptography/releases) - [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst) - [Commits](https://github.com/pyca/cryptography/compare/36.0.1...38.0.3) --- updated-dependencies: - dependency-name: cryptography dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump pillow from 9.2.0 to 9.3.0 (#14383)dependabot[bot]2-59/+63
* Bump pillow from 9.2.0 to 9.3.0 Bumps [pillow](https://github.com/python-pillow/Pillow) from 9.2.0 to 9.3.0. - [Release notes](https://github.com/python-pillow/Pillow/releases) - [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst) - [Commits](https://github.com/python-pillow/Pillow/compare/9.2.0...9.3.0) --- updated-dependencies: - dependency-name: pillow dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump types-setuptools from 65.5.0.1 to 65.5.0.2 (#14382)dependabot[bot]2-3/+4
* Bump types-setuptools from 65.5.0.1 to 65.5.0.2 Bumps [types-setuptools](https://github.com/python/typeshed) from 65.5.0.1 to 65.5.0.2. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-setuptools dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump pyo3 from 0.17.2 to 0.17.3 (#14381)dependabot[bot]3-11/+12
* Bump pyo3 from 0.17.2 to 0.17.3 Bumps [pyo3](https://github.com/pyo3/pyo3) from 0.17.2 to 0.17.3. - [Release notes](https://github.com/pyo3/pyo3/releases) - [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md) - [Commits](https://github.com/pyo3/pyo3/compare/v0.17.2...v0.17.3) --- updated-dependencies: - dependency-name: pyo3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump regex from 1.6.0 to 1.7.0 (#14380)dependabot[bot]3-3/+4
* Bump regex from 1.6.0 to 1.7.0 Bumps [regex](https://github.com/rust-lang/regex) from 1.6.0 to 1.7.0. - [Release notes](https://github.com/rust-lang/regex/releases) - [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/regex/compare/1.6.0...1.7.0) --- updated-dependencies: - dependency-name: regex dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump peaceiris/actions-mdbook from 1.1.14 to 1.2.0 (#14379)dependabot[bot]2-1/+2
* Bump peaceiris/actions-mdbook from 1.1.14 to 1.2.0 Bumps [peaceiris/actions-mdbook](https://github.com/peaceiris/actions-mdbook) from 1.1.14 to 1.2.0. - [Release notes](https://github.com/peaceiris/actions-mdbook/releases) - [Changelog](https://github.com/peaceiris/actions-mdbook/blob/main/CHANGELOG.md) - [Commits](https://github.com/peaceiris/actions-mdbook/compare/v1.1.14...adeb05db28a0c0004681db83893d56c0388ea9ea) --- updated-dependencies: - dependency-name: peaceiris/actions-mdbook dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-07Bump dawidd6/action-download-artifact from 2.15.0 to 2.24.0 (#14378)dependabot[bot]2-1/+2
* Bump dawidd6/action-download-artifact from 2.15.0 to 2.24.0 Bumps [dawidd6/action-download-artifact](https://github.com/dawidd6/action-download-artifact) from 2.15.0 to 2.24.0. - [Release notes](https://github.com/dawidd6/action-download-artifact/releases) - [Commits](https://github.com/dawidd6/action-download-artifact/compare/af92a8455a59214b7b932932f2662fdefbd78126...46b4ae883bf0726f5949d025d31cb62c7a5ac70c) --- updated-dependencies: - dependency-name: dawidd6/action-download-artifact dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-04Bump flake8-bugbear from 22.9.23 to 22.10.27 (#14329)dependabot[bot]5-9/+12
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com> Co-authored-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
2022-11-04Fix the trigger path for deploying documentation PRs (#14370)Brendan Abolivier2-1/+2
This was missed from #12947
2022-11-04Upload documentation PRs to Netlify (#12947)Michael Telatynski3-0/+69
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com> Co-authored-by: Erik Johnston <erik@matrix.org> Co-authored-by: David Robertson <davidr@element.io> Co-authored-by: Brendan Abolivier <babolivier@matrix.org>
2022-11-04Fix /refresh endpoint version (#14364)Tulir Asokan3-9/+10
2022-11-04Update CHANGES.md v1.71.0rc2Sean Quah1-11/+7
2022-11-041.71.0rc2Sean Quah7-5/+29
2022-11-04 Include monthly active user metrics in the list of legacy metrics names ↵David Robertson2-0/+4
(#14360)
2022-11-03Cherry-pick "Run trial tests against Python 3.11 (#13812)" and fixup commitDavid Robertson5-94/+146
4f5d492cd6a9438de03d1b768f4c220cb662ac06 The release branch CI is failing because poetry seems unable to install wrapt 1.13.3 when run under CPython 3.11. Develop has already bumped wrapt for 3.11 compatibility. Cherry-pick that commit here to try and get CI going again.
2022-11-03Update legacy `synapse_admin_mau:` metric names in docs (#14358)Will Hunt2-3/+4
* Rename legacy metrics in MAU docs * changelog
2022-11-03Implement MSC3912: Relation-based redactions (#14260)Brendan Abolivier10-28/+486
Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>
2022-11-02Use maintained action to install Rust in latest deps/twisted trunk jobs (#14351)David Robertson3-18/+13
* Use maintained action to install Rust Part of #14203. Like the changes in #14313. * Changelog
2022-11-02Disable legacy Prometheus metric names by default. They can still be ↵reivilibre5-3/+29
re-enabled for now, but they will be removed altogether in Synapse 1.73.0. (#14353)
2022-11-01Fix issue automation for Needs-Info (#14343)Kat Gerasimova1-27/+27
Run when an issue is labelled with X-Needs-Info only. Add to triage board. Use itemId which is output by actions/add-to-project to run the mutation to update the field value (i.e. move to the right column).
2022-11-01Fix typo in #13320 which could cause log spam (#14347)David Robertson2-1/+2
2022-11-01Enable testing MSC3874 in complement. (#14339)Patrick Cloke3-3/+4
2022-11-01Allow PUT/GET of aliases during faster join (#14292)David Robertson2-2/+3
without blocking on full state.
2022-11-01Bump twisted from 22.8.0 to 22.10.0 (#14340)dependabot[bot]2-12/+13
* Bump twisted from 22.8.0 to 22.10.0 Bumps [twisted](https://github.com/twisted/twisted) from 22.8.0 to 22.10.0. - [Release notes](https://github.com/twisted/twisted/releases) - [Changelog](https://github.com/twisted/twisted/blob/trunk/NEWS.rst) - [Commits](https://github.com/twisted/twisted/compare/twisted-22.8.0...twisted-22.10.0) --- updated-dependencies: - dependency-name: twisted dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-11-01Deal with another batch of GHA warning messages (#14313)David Robertson2-16/+39
2022-11-01Revert a testing commit from #13812David Robertson1-3/+3
It (4f5d492cd6a9438de03d1b768f4c220cb662ac06) should have been reverted before the merge to develop.
2022-11-01Run trial tests against Python 3.11 (#13812)David Robertson5-97/+149
2022-11-01Adjust changelog v1.71.0rc1David Robertson1-25/+34
2022-11-011.71.0rc1David Robertson55-54/+80
2022-11-01Revert "Fix event size checks (#13710)"David Robertson2-6/+5
This reverts commit fab495a9e1442d99e922367f65f41de5eaa488eb. As noted in https://github.com/matrix-org/synapse/pull/13710#issuecomment-1298396007: > We want to see this change land for the protocol's sake (and plan to un-revert it) but want to give this a little more time before releasing this.
2022-11-01Fix type annotation causing import time error in the Complement forking ↵reivilibre2-2/+3
launcher. (#14084) Co-authored-by: David Robertson <davidr@element.io>
2022-10-31Fix dehydrated device REST checks (#14336)David Robertson3-3/+37
2022-10-31Support OIDC backchannel logouts (#11414)Quentin Gliech13-66/+960
If configured an OIDC IdP can log a user's session out of Synapse when they log out of the identity provider. The IdP sends a request directly to Synapse (and must be configured with an endpoint) when a user logs out.
2022-10-31Bump sentry-sdk from 1.5.11 to 1.10.1 (#14330)dependabot[bot]2-10/+13
* Bump sentry-sdk from 1.5.11 to 1.10.1 Bumps [sentry-sdk](https://github.com/getsentry/sentry-python) from 1.5.11 to 1.10.1. - [Release notes](https://github.com/getsentry/sentry-python/releases) - [Changelog](https://github.com/getsentry/sentry-python/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-python/compare/1.5.11...1.10.1) --- updated-dependencies: - dependency-name: sentry-sdk dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-31Bump psycopg2 from 2.9.4 to 2.9.5 (#14331)dependabot[bot]2-12/+13
* Bump psycopg2 from 2.9.4 to 2.9.5 Bumps [psycopg2](https://github.com/psycopg/psycopg2) from 2.9.4 to 2.9.5. - [Release notes](https://github.com/psycopg/psycopg2/releases) - [Changelog](https://github.com/psycopg/psycopg2/blob/master/NEWS) - [Commits](https://github.com/psycopg/psycopg2/commits) --- updated-dependencies: - dependency-name: psycopg2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-31Bump twine from 3.8.0 to 4.0.1 (#14332)dependabot[bot]2-31/+31
* Bump twine from 3.8.0 to 4.0.1 Bumps [twine](https://github.com/pypa/twine) from 3.8.0 to 4.0.1. - [Release notes](https://github.com/pypa/twine/releases) - [Changelog](https://github.com/pypa/twine/blob/main/docs/changelog.rst) - [Commits](https://github.com/pypa/twine/compare/3.8.0...4.0.1) --- updated-dependencies: - dependency-name: twine dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-31Bump black from 22.3.0 to 22.10.0 (#14328)dependabot[bot]2-27/+26
* Bump black from 22.3.0 to 22.10.0 Bumps [black](https://github.com/psf/black) from 22.3.0 to 22.10.0. - [Release notes](https://github.com/psf/black/releases) - [Changelog](https://github.com/psf/black/blob/main/CHANGES.md) - [Commits](https://github.com/psf/black/compare/22.3.0...22.10.0) --- updated-dependencies: - dependency-name: black dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-31Avoid incrementing bg process utime/stime counters by negative durations ↵David Robertson6-5/+35
(#14323)
2022-10-28Prevent federation user keys query from returning device names if disallowed ↵Andrew Morgan3-9/+46
(#14304)
2022-10-28Improve `RawHeaders` type hints (#14303)David Robertson3-9/+24
2022-10-28Switch search SQL to triple-quote strings. (#14311)Patrick Cloke2-89/+100
For ease of reading we switch from concatenated strings to triple quote strings.
2022-10-28Add a note that #14300 did not get a fix for 1.70.1 (#14318)Andrew Morgan1-0/+8
2022-10-28Add docs for an empty `trusted_key_servers` config option (#13999)Dirk Klimpel2-0/+7
* Add docs for an empty `trusted_key_servers` config option * small rewording * Tweak changelog
2022-10-28Tweak changelog v1.70.1Olivier Wilkinson (reivilibre)1-1/+1
2022-10-281.70.1Olivier Wilkinson (reivilibre)5-3/+17
2022-10-28Fix room creation being rate limited too aggressively since Synapse v1.69.0. ↵reivilibre4-9/+70
(#14314) * Introduce a test for the old behaviour which we want to restore * Reintroduce the old behaviour in a simpler way * Newsfile Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org> * Use 1 credit instead of 2 for creating a room: be more lenient than before Notably, the UI in Element Web was still broken after restoring to prior behaviour. After discussion, we agreed that it would be sensible to increase the limit. Signed-off-by: Olivier Wilkinson (reivilibre) <oliverw@matrix.org>
2022-10-27Check appservice user interest against the local users instead of all users ↵Eric Eastwood7-14/+214
(`get_users_in_room` mis-use) (#13958)
2022-10-27Fix tests for change in PostgreSQL 14 behavior change. (#14310)Patrick Cloke3-7/+15
PostgreSQL 14 changed the behavior of `websearch_to_tsquery` to improve some behaviour. The tests were hitting those edge-cases about handling of hanging double quotes. This fixes the tests to take into account the PostgreSQL version.
2022-10-27Add workers settings to configuration manual (#14086)Dirk Klimpel5-82/+291
* Add workers settings to configuration manual * Update `pusher_instances` * update url to python logger * update headlines * update links after headline change * remove link from `daemon process` There is no docs in Synapse for this * extend example for `federation_sender_instances` and `pusher_instances` * more infos about stream writers * add link to DAG * update `pusher_instances` * update `worker_listeners` * update `stream_writers` * Update `worker_name` Co-authored-by: David Robertson <davidr@element.io>
2022-10-27Fix presence bug introduced in 1.64 by #13313 (#14243)Mathieu Velten2-2/+2
* Fix presence bug introduced in 1.64 by #13313 Signed-off-by: Mathieu Velten <mathieuv@matrix.org> * Add changelog * Add DISTINCT * Apply suggestions from code review Signed-off-by: Mathieu Velten <mathieuv@matrix.org>
2022-10-27Reject history insertion during partial joins (#14291)David Robertson2-0/+8
2022-10-26Refactor MSC3030 `/timestamp_to_event` to move away from our snowflake pull ↵Eric Eastwood7-126/+191
from `destination` pattern (#14096) 1. `federation_client.timestamp_to_event(...)` now handles all `destination` looping and uses our generic `_try_destination_list(...)` helper. 2. Consistently handling `NotRetryingDestination` and `FederationDeniedError` across `get_pdu` , backfill, and the generic `_try_destination_list` which is used for many places we use this pattern. 3. `get_pdu(...)` now returns `PulledPduInfo` so we know which `destination` we ended up pulling the PDU from
2022-10-26Use poetry 1.2 for complement in latest deps (#14305)David Robertson2-2/+2
2022-10-26fix broken avatar checks when server_name contains a port (#13927)Ashish Kumar3-1/+55
Fixes check_avatar_size_and_mime_type() to successfully update avatars on homeservers running on non-default ports which it would mistakenly treat as remote homeserver while validating the avatar's size and mime type. Signed-off-by: Ashish Kumar ashfame@users.noreply.github.com
2022-10-26Fix incorrectly sending authentication tokens to application service as ↵David Robertson3-8/+13
headers (#14301)
2022-10-26Save login tokens in database (#13844)Quentin Gliech11-227/+337
* Save login tokens in database Signed-off-by: Quentin Gliech <quenting@element.io> * Add upgrade notes * Track login token reuse in a Prometheus metric Signed-off-by: Quentin Gliech <quenting@element.io>
2022-10-261.70.0 v1.70.0Olivier Wilkinson (reivilibre)3-1/+13
2022-10-25Unified search query syntax using the full-text search capabilities of the ↵James Salter5-35/+454
underlying DB. (#11635) Support a unified search query syntax which leverages more of the full-text search of each database supported by Synapse. Supports, with the same syntax across Postgresql 11+ and Sqlite: - quoted "search terms" - `AND`, `OR`, `-` (negation) operators - Matching words based on their stem, e.g. searches for "dog" matches documents containing "dogs". This is achieved by - If on postgresql 11+, pass the user input to `websearch_to_tsquery` - If on sqlite, manually parse the query and transform it into the sqlite-specific query syntax. Note that postgresql 10, which is close to end-of-life, falls back to using `phraseto_tsquery`, which only supports a subset of the features. Multiple terms separated by a space are implicitly ANDed. Note that: 1. There is no escaping of full-text syntax that might be supported by the database; e.g. `NOT`, `NEAR`, `*` in sqlite. This runs the risk that people might discover this as accidental functionality and depend on something we don't guarantee. 2. English text is assumed for stemming. To support other languages, either the target language needs to be known at the time of indexing the message (via room metadata, or otherwise), or a separate index for each language supported could be created. Sqlite docs: https://www.sqlite.org/fts3.html#full_text_index_queries Postgres docs: https://www.postgresql.org/docs/11/textsearch-controls.html
2022-10-25Refactor OIDC tests to better mimic an actual OIDC provider. (#13910)Quentin Gliech10-460/+747
This implements a fake OIDC server, which intercepts calls to the HTTP client. Improves accuracy of tests by covering more internal methods. One particular example was the ID token validation, which previously mocked. This uncovered an incorrect dependency: Synapse actually requires at least authlib 0.15.1, not 0.14.0.
2022-10-25Implementation for MSC3664: Pushrules for relations (#11804)DeepBlueV7.X10-17/+454
2022-10-25Tweak changelog v1.70.0rc2Olivier Wilkinson (reivilibre)1-1/+1
2022-10-25Remove unused `@lru_cache` decorator (#13595)Nick Mills-Barrett3-140/+5
* Remove unused `@lru_cache` decorator Spotted this working on something else. Co-authored-by: David Robertson <davidr@element.io>
2022-10-25Cache rust build deps in trial CI (#14287)Erik Johnston2-0/+9
2022-10-251.70.0rc2Olivier Wilkinson (reivilibre)8-6/+25
2022-10-25Enable WAL for SQLite (#13897)asymmetric2-0/+5
Signed-off-by: Lorenzo Manacorda <lorenzo@mailbox.org>
2022-10-24Revert behavior change for bundling edits of non-message events (#14283)Patrick Cloke2-4/+8
2022-10-24Return NOT_JSON if decode fails and defer set_timeline_upper_limit ca… ↵Ryan Miguel2-4/+5
(#14262) * Return NOT_JSON if decode fails and defer set_timeline_upper_limit call until after check_valid_filter. Fixes #13661. Signed-off-by: Ryan Miguel <miguel.ryanj@gmail.com>. * Reword changelog
2022-10-24Bump serde_json from 1.0.86 to 1.0.87 (#14279)dependabot[bot]3-3/+4
2022-10-24Fix typo in cibuildwheel conf introduced in #14253David Robertson1-1/+1
2022-10-24Fix `TypeError: 'dict_keys' object is not reversible` (#14280)Erik Johnston2-2/+2
2022-10-24Bump peaceiris/actions-gh-pages from 3.8.0 to 3.9.0 (#14276)dependabot[bot]2-1/+2
2022-10-24Bump peaceiris/actions-mdbook from 1.1.14 to 1.2.0 (#14275)dependabot[bot]2-1/+2
2022-10-24Add debugging to help diagnose lost device-list-update (#14268)Richard van der Hoff2-17/+38
2022-10-24Bump pysaml2 from 7.1.2 to 7.2.1 (#14270)dependabot[bot]2-4/+5
2022-10-24Bump jinja2 from 3.0.3 to 3.1.2 (#14271)dependabot[bot]2-4/+5
2022-10-24Bump types-requests from 2.28.11 to 2.28.11.2 (#14272)dependabot[bot]2-3/+4
2022-10-24Bump setuptools-rust from 1.5.1 to 1.5.2 (#14273)dependabot[bot]2-3/+4
2022-10-24Bump prometheus-client from 0.14.0 to 0.15.0 (#14274)dependabot[bot]2-3/+4
2022-10-24Bump anyhow from 1.0.65 to 1.0.66 (#14278)dependabot[bot]3-3/+4
2022-10-24Bump serde from 1.0.145 to 1.0.147 (#14277)dependabot[bot]3-5/+6
2022-10-21Add initial power level event to batch of bulk persisted events when ↵Shay8-58/+82
creating a new room. (#14228)
2022-10-21Improve aesthetics and reusability of HTML templates. (#13652)Germain31-740/+691
Use a base template to create a cohesive feel across the HTML templates provided by Synapse. Adds basic styling to the base template for a more user-friendly look and feel.
2022-10-21Fix logging error on SIGHUP (#14258)Richard van der Hoff2-1/+3
2022-10-21Only build aarch64 wheels for cpython manylinux (#14259)Erik Johnston2-1/+2
2022-10-21Try building ABI3 wheels for cpython (#14253)Erik Johnston3-0/+142
2022-10-21Properly update the threads table when thread events are redacted. (#14248)Patrick Cloke3-43/+129
When the last event in a thread is redacted we need to update the threads table: * Find the new latest event in the thread and store it into the table; or * Remove the thread from the table if it is no longer a thread (i.e. all events in the thread were redacted).
2022-10-21Show erasure status when listing users in the Admin API (#14205)Tadeusz Sośnierz5-3/+51
* Show erasure status when listing users in the Admin API * Use USING when joining erased_users * Add changelog entry * Revert "Use USING when joining erased_users" This reverts commit 30bd2bf106415caadcfdbdd1b234ef2b106cc394. * Make the erased check work on postgres * Add a testcase for showing erased user status * Appease the style linter * Explicitly convert `erased` to bool to make SQLite consistent with Postgres This also adds us an easy way in to fix the other accidentally integered columns. * Move erasure status test to UsersListTestCase * Include user erased status when fetching user info via the admin API * Document the erase status in user_admin_api * Appease the linter and mypy * Signpost comments in tests Co-authored-by: Tadeusz Sośnierz <tadeusz@sosnierz.com> Co-authored-by: David Robertson <david.m.robertson1@gmail.com>
2022-10-21Fix event size checks (#13710)DeepBlueV7.X2-5/+6
2022-10-20Build wheels on macos 11, not 10.15 (#14249)David Robertson2-3/+4
2022-10-20Update changelog entry for #10015.David Robertson1-1/+1
Per https://github.com/matrix-org/synapse/pull/10015#issuecomment-1282773048
2022-10-20Use servlets for /key/ endpoints. (#14229)Patrick Cloke9-83/+86
To fix the response for unknown endpoints under that prefix. See MSC3743.
2022-10-20Stop returning `unsigned.invite_room_state` in `PUT ↵Andrew Morgan2-0/+6
/_matrix/federation/v2/invite/{roomId}/{eventId}` responses (#14064) Co-authored-by: David Robertson <davidr@element.io>
2022-10-19Explain `SynapseError` and `FederationError` better (#14191)Eric Eastwood3-3/+30
Explain `SynapseError` and `FederationError` better Spawning from https://github.com/matrix-org/synapse/pull/13816#discussion_r993262622
2022-10-19Bump types-opentracing from 2.4.7 to 2.4.10 (#14133)dependabot[bot]2-3/+4
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com> Co-authored-by: reivilibre <oliverw@matrix.org>
2022-10-19Bump flake8-bugbear from 21.3.2 to 22.9.23 (#14042)dependabot[bot]8-15/+22
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Erik Johnston <erik@matrix.org> Co-authored-by: David Robertson <davidr@element.io>
2022-10-19Document encryption_enabled_by_default_for_room_type under the right name ↵Matthew Hodgson2-1/+2
(#14110) * document encryption_enabled_by_default_for_room_type under the right name * add changelog * Update changelog.d/14110.doc
2022-10-19let update_synapse_database run on a multi-database configurations (#13422)Finn2-8/+1
* Allow sharded database in db migrate script Signed-off-by: Finn Herzfeld <finn@beeper.com> * Update changelog.d/13422.bugfix Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com> * Remove check entirely * remove unused import Signed-off-by: Finn Herzfeld <finn@beeper.com> Co-authored-by: finn <finn@beeper.com> Co-authored-by: Patrick Cloke <clokep@users.noreply.github.com>
2022-10-19Remove poetry.lock updates v1.70.0rc1Erik Johnston1-22/+0
2022-10-19Update lockfileErik Johnston1-9/+8
2022-10-191.70.0rc1Erik Johnston105-104/+126
2022-10-19Use backend-meta edition of issue triage workflow (#14230)Will Hunt2-21/+9
2022-10-18Fix MSC3030 `/timestamp_to_event` returning `outliers` that it has no idea ↵Eric Eastwood3-21/+104
whether are near a gap or not (#14215) Fix MSC3030 `/timestamp_to_event` endpoint returning `outliers` that it has no idea whether are near a gap or not (and therefore unable to determine whether it's actually the closest event). The reason Synapse doesn't know whether an `outlier` is next to a gap is because our gap checks rely on entries in the `event_edges`, `event_forward_extremeties`, and `event_backward_extremities` tables which is [not the case for `outliers`](https://github.com/matrix-org/synapse/blob/2c63cdcc3f1aa4625e947de3c23e0a8133c61286/docs/development/room-dag-concepts.md#outliers). Also fixes MSC3030 Complement `can_paginate_after_getting_remote_event_from_timestamp_to_event_endpoint` test flake. Although this acted flakey in Complement, if `sync_partial_state` raced and beat us before `/timestamp_to_event`, then even if we retried the failing `/context` request it wouldn't work until we made this Synapse change. With this PR, Synapse will never return an `outlier` event so that test will always go and ask over federation. Fix https://github.com/matrix-org/synapse/issues/13944 ### Why did this fail before? Why was it flakey? Sleuthing the server logs on the [CI failure](https://github.com/matrix-org/synapse/actions/runs/3149623842/jobs/5121449357#step:5:5805), it looks like `hs2:/timestamp_to_event` found `$NP6-oU7mIFVyhtKfGvfrEQX949hQX-T-gvuauG6eurU` as an `outlier` event locally. Then when we went and asked for it via `/context`, since it's an `outlier`, it was filtered out of the results -> `You don't have permission to access that event.` This is reproducible when `sync_partial_state` races and persists `$NP6-oU7mIFVyhtKfGvfrEQX949hQX-T-gvuauG6eurU` as an `outlier` before we evaluate `get_event_for_timestamp(...)`. To consistently reproduce locally, just add a delay at the [start of `get_event_for_timestamp(...)`](https://github.com/matrix-org/synapse/blob/cb20b885cb4bd1648581dd043a184d86fc8c7a00/synapse/handlers/room.py#L1470-L1496) so it always runs after `sync_partial_state` completes. ```py from twisted.internet import task as twisted_task d = twisted_task.deferLater(self.hs.get_reactor(), 3.5) await d ``` In a run where it passes, on `hs2`, `get_event_for_timestamp(...)` finds a different event locally which is next to a gap and we request from a closer one from `hs1` which gets backfilled. And since the backfilled event is not an `outlier`, it's returned as expected during `/context`. With this PR, Synapse will never return an `outlier` event so that test will always go and ask over federation.
2022-10-18Fix hiding devices names over federation (#10015)Aaron Raimist2-2/+9
And don't include blank opentracing stuff in device list updates. Signed-off-by: Aaron Raimist <aaron@raim.ist>
2022-10-18Fix docstring in EventContext (#14145)Shay2-1/+4
2022-10-18Add aarch64 wheels to CI (#14212)MichaIng2-5/+26
Co-authored-by: David Robertson <david.m.robertson1@gmail.com>
2022-10-18Bump twisted from 22.4.0 to 22.8.0 (#14207)dependabot[bot]2-13/+15
* Bump twisted from 22.4.0 to 22.8.0 Bumps [twisted](https://github.com/twisted/twisted) from 22.4.0 to 22.8.0. - [Release notes](https://github.com/twisted/twisted/releases) - [Changelog](https://github.com/twisted/twisted/blob/trunk/NEWS.rst) - [Commits](https://github.com/twisted/twisted/compare/twisted-22.4.0...twisted-22.8.0) --- updated-dependencies: - dependency-name: twisted dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-18Prepatory work for adding power level event to batched events (#14214)Shay6-17/+47
2022-10-18Bump pygithub from 1.55 to 1.56 (#14206)dependabot[bot]2-4/+5
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-18Bump types-setuptools from 65.4.0.0 to 65.5.0.1 (#14208)dependabot[bot]2-3/+4
* Bump types-setuptools from 65.4.0.0 to 65.5.0.1 Bumps [types-setuptools](https://github.com/python/typeshed) from 65.4.0.0 to 65.5.0.1. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-setuptools dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-18Implementation of HTTP 307 response for MSC3886 POST endpoint (#14018)Hugh Nimmo-Smith16-45/+257
Co-authored-by: reivilibre <olivier@librepush.net> Co-authored-by: Andrew Morgan <andrewm@element.io>
2022-10-18Don't pin dev-deps in pyproject; use lower bounds (#14227)David Robertson3-7/+8
* Don't pin dev-deps in pyproject; use lower bounds This makes it slightly less tedious to update these things via successive dependabot updates, by reducing the likelihood of a merge conflict. * Changelog * Changelog
2022-10-18Fixes to release-artifacts warnings (#14224)David Robertson2-0/+5
2022-10-18Update the thread_id right before use (in case the bg update hasn't ↵Patrick Cloke5-134/+112
finished) (#14222) This avoids running a forced-update of a null thread_id rows. An index is added (in the background) to hopefully make this easier in the future.
2022-10-18Enable URL previews in complement homeserver config. (#14198)Jonathan de Jong2-0/+3
2022-10-18Fix `track_memory_usage` on poetry-core 1.3.x installations (#14221)David Robertson3-3/+4
* Fix `track_memory_usage` on poetry-core 1.3.x installations The same kind of problem as discussed in #14085: 1. we defined an extra with an underscore 2. we look it up at runtime with an underscore 3. but poetry-core 1.3.x. installs it with a dash, causing (2) to fail. Fix by using a dash everywhere. * Changelog
2022-10-18Deal with some GHA deprecation warnings (#14216)David Robertson4-4/+12
2022-10-18Flush stdout/err in Dockerfile-workers before replacing the current process ↵realtyem3-17/+22
(#14195) Also update `subprocess.check_output` to the slightly newer `subprocess.run`. Signed-off-by: Jason Little <realtyem@gmail.com>
2022-10-18When restarting a partial join resync, prioritise the server which actioned ↵David Robertson6-31/+95
a partial join (#14126)
2022-10-18Allow poetry-core 1.3.2 (#14217)Ivan Shapovalov2-1/+2
Signed-off-by: Ivan Shapovalov <intelfx@intelfx.name>
2022-10-18Avoid checking the event cache when backfilling events (#14164)Andrew Morgan4-15/+140
2022-10-18Remove `_get_events_cache` check optimisation from `_have_seen_events_dict` ↵Andrew Morgan3-30/+14
(#14161)
2022-10-17Add debug logs to figure out why an event was filtered (#14095)Eric Eastwood2-1/+32
Spawned while investigating https://github.com/matrix-org/synapse/issues/13944 This way we might get some more context whenever an `403 Forbidden - body: {"errcode":"M_FORBIDDEN","error":"You don't have permission to access that event."}` error is produced. `log_config.yaml` ```yaml loggers: synapse: level: INFO synapse.visibility: level: DEBUG ```
2022-10-17Cache Rust build cache when building docker images (#14130)Erik Johnston3-1/+5
2022-10-17Bump click from 8.1.1 to 8.1.3 (#14201)dependabot[bot]3-5/+6
2022-10-17Support filtering the /messages API by relation type (MSC3874). (#14148)Patrick Cloke9-177/+212
Gated behind an experimental configuration flag.
2022-10-17Bump psycopg2 from 2.9.3 to 2.9.4 (#14200)dependabot[bot]2-12/+13
2022-10-17Bump bcrypt from 3.2.0 to 4.0.1 (#14186)dependabot[bot]2-15/+23
2022-10-17Use Pydantic when PUTting room aliases (#14179)David Robertson3-31/+47
2022-10-17Invalidate rooms for user caches when receiving membership events (#14155)Nick Mills-Barrett2-0/+5
This should fix a race where the event notification comes in over replication before the state replication, leaving a window during which a sync may get an incorrect list of rooms for the user.
2022-10-17Fix dead link to admin registration API (#14189)David Robertson2-1/+2
* Fix dead link to admin registration API * Changelog
2022-10-17Remove not needed `replication` listener in docker compose example (#14107)Dirk Klimpel4-25/+2
2022-10-171.69.0 v1.69.0Erik Johnston3-3/+15
2022-10-15Stop getting missing `prev_events` after we already know their signature is ↵Eric Eastwood7-2/+386
invalid (#13816) While https://github.com/matrix-org/synapse/pull/13635 stops us from doing the slow thing after we've already done it once, this PR stops us from doing one of the slow things in the first place. Related to - https://github.com/matrix-org/synapse/issues/13622 - https://github.com/matrix-org/synapse/pull/13635 - https://github.com/matrix-org/synapse/issues/13676 Part of https://github.com/matrix-org/synapse/issues/13356 Follow-up to https://github.com/matrix-org/synapse/pull/13815 which tracks event signature failures. With this PR, we avoid the call to the costly `_get_state_ids_after_missing_prev_event` because the signature failure will count as an attempt before and we filter events based on the backoff before calling `_get_state_ids_after_missing_prev_event` now. For example, this will save us 156s out of the 185s total that this `matrix.org` `/messages` request. If you want to see the full Jaeger trace of this, you can drag and drop this `trace.json` into your own Jaeger, https://gist.github.com/MadLittleMods/4b12d0d0afe88c2f65ffcc907306b761 To explain this exact scenario around `/messages` -> backfill, we call `/backfill` and first check the signatures of the 100 events. We see bad signature for `$luA4l7QHhf_jadH3mI-AyFqho0U2Q-IXXUbGSMq6h6M` and `$zuOn2Rd2vsC7SUia3Hp3r6JSkSFKcc5j3QTTqW_0jDw` (both member events). Then we process the 98 events remaining that have valid signatures but one of the events references `$luA4l7QHhf_jadH3mI-AyFqho0U2Q-IXXUbGSMq6h6M` as a `prev_event`. So we have to do the whole `_get_state_ids_after_missing_prev_event` rigmarole which pulls in those same events which fail again because the signatures are still invalid. - `backfill` - `outgoing-federation-request` `/backfill` - `_check_sigs_and_hash_and_fetch` - `_check_sigs_and_hash_and_fetch_one` for each event received over backfill - ❗ `$luA4l7QHhf_jadH3mI-AyFqho0U2Q-IXXUbGSMq6h6M` fails with `Signature on retrieved event was invalid.`: `unable to verify signature for sender domain xxx: 401: Failed to find any key to satisfy: _FetchKeyRequest(...)` - ❗ `$zuOn2Rd2vsC7SUia3Hp3r6JSkSFKcc5j3QTTqW_0jDw` fails with `Signature on retrieved event was invalid.`: `unable to verify signature for sender domain xxx: 401: Failed to find any key to satisfy: _FetchKeyRequest(...)` - `_process_pulled_events` - `_process_pulled_event` for each validated event - ❗ Event `$Q0iMdqtz3IJYfZQU2Xk2WjB5NDF8Gg8cFSYYyKQgKJ0` references `$luA4l7QHhf_jadH3mI-AyFqho0U2Q-IXXUbGSMq6h6M` as a `prev_event` which is missing so we try to get it - `_get_state_ids_after_missing_prev_event` - `outgoing-federation-request` `/state_ids` - ❗ `get_pdu` for `$luA4l7QHhf_jadH3mI-AyFqho0U2Q-IXXUbGSMq6h6M` which fails the signature check again - ❗ `get_pdu` for `$zuOn2Rd2vsC7SUia3Hp3r6JSkSFKcc5j3QTTqW_0jDw` which fails the signature check
2022-10-14Bump types-bleach from 4.1.4 to 5.0.3 (#14188)dependabot[bot]2-3/+4
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-15Bump types-pillow from 9.2.2 to 9.2.2.1 (#14187)dependabot[bot]2-20/+21
* Bump types-pillow from 9.2.2 to 9.2.2.1 Bumps [types-pillow](https://github.com/python/typeshed) from 9.2.2 to 9.2.2.1. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-pillow dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-14Strip whitespace from worker types in Dockerfile-workers (#14165)realtyem2-4/+3
2022-10-14Accept threaded receipts for events related to the root event. (#14174)Patrick Cloke5-8/+247
The root node of a thread (and events related to it) are considered "part of a thread" when validating receipts. This allows clients which show the root node in both the main timeline and the threaded timeline to easily send receipts in either. Note that threaded notifications are not created for these events, these events created notifications on the main timeline.
2022-10-141.69.0rc4 v1.69.0rc4Erik Johnston6-5/+23
2022-10-14Fix background update to use an index (#14181)Erik Johnston2-11/+52
2022-10-14Advertise support for Matrix 1.4. (#14184)Patrick Cloke3-1/+3
All features / changes in Matrix 1.4 are now supported in Synapse.
2022-10-14Fix changelog for #14171 to match #13394/#14175.Patrick Cloke1-1/+1
2022-10-14Don't require optional `invite_room_state` field on fed v2 invite (#14083)Andrew Morgan2-1/+2
2022-10-14Do not allow a None-limit on PaginationConfig. (#14146)Patrick Cloke16-50/+29
The callers either set a default limit or manually handle a None-limit later on (by setting a default value). Update the callers to always instantiate PaginationConfig with a default limit and then assume the limit is non-None.
2022-10-14Set LD_PRELOAD to load jemalloc in Dockerfile-workers. (#14182)realtyem2-1/+12
2022-10-14Stabilize the threads API. (#14175)Patrick Cloke7-29/+35
Stabilize the threads API (MSC3856) by supporting (only) the v1 path for the endpoint. This also marks the API as safe for workers since it is a read-only API.
2022-10-14Properly invalidate get_thread_id cache. (#14163)Patrick Cloke2-0/+2
This was missed in 2b6d41ebd685fb546e52acdbcb0024dfcf5a5db1 (#13824).
2022-10-14Revert "Disable push of docker images"Erik Johnston1-1/+1
This reverts commit f3f303aa22b9681c21468fb0bdce1b21d1bdbd92.
2022-10-14Fix docker workflowErik Johnston1-3/+5
2022-10-14Disable push of docker imagesErik Johnston1-1/+1
2022-10-13Fix docker build OOMing in CI for arm64 builds (#14173)Erik Johnston3-1/+11
Co-authored-by: David Robertson <davidr@element.io>
2022-10-13Optimise the event_push_backfill_thread_id bg job (#14172)David Robertson2-2/+9
Co-authored-by: Erik Johnston <erik@matrix.org>
2022-10-13Fix sqlite syntax for upserts. (#14171)Patrick Cloke2-1/+2
2022-10-13Properly return the thread ID down sync. (#14159)Patrick Cloke1-2/+2
Fix a broken conflict in e6e876b9b158f47811b6dfedd8783f658ce960a4, by not stomping over a field right after creating it.
2022-10-13Add an API for listing threads in a room. (#13394)Patrick Cloke10-6/+522
Implement the /threads endpoint from MSC3856. This is currently unstable and behind an experimental configuration flag. It includes a background update to backfill data, results from the /threads endpoint will be partial until that finishes.
2022-10-12Fix a bug where the joined hosts for a given event were not being properly ↵Shay3-45/+51
cached (#14125)
2022-10-12Return the thread ID properly down sync. (#14159)Patrick Cloke2-0/+3
A receipt's thread ID, if one exists, should be added to the body of a receipt.
2022-10-12Return the main timeline for events which are not part of a thread. (#14140)Patrick Cloke3-6/+9
Fixes a bug where threaded receipts could not be sent for the main timeline.
2022-10-12Bump typing-extensions from 4.1.1 to 4.4.0 (#14134)dependabot[bot]2-5/+6
2022-10-12Correct field name for stripped state events when knocking. ↵Andrew Morgan4-6/+26
`knock_state_events` -> `knock_room_state` (#14102)
2022-10-12Bump bleach from 4.1.0 to 5.0.1 (#14116)dependabot[bot]2-5/+9
2022-10-12Bump idna from 3.3 to 3.4 (#14115)dependabot[bot]2-3/+4
2022-10-12Fixup changelog v1.69.0rc3Erik Johnston1-6/+6
2022-10-121.69.0rc3Erik Johnston7-5/+24
2022-10-12Mark /relations endpoint as usable on workers. (#14028)Patrick Cloke6-2/+37
Co-authored-by: Eric Eastwood <erice@element.io>
2022-10-12Batch up calls to `get_rooms_for_users` (#14109)Nick Mills-Barrett2-1/+17
2022-10-12Remove the experimental implementation of MSC3772. (#14094)Patrick Cloke12-365/+22
MSC3772 has been abandoned.
2022-10-12Use minimal Rust installation in docker images and CI (#14141)David Robertson5-3/+5
2022-10-11Fix a bug where redactions were not being sent over federation if we did not ↵Shay6-38/+62
have the original event. (#13813)
2022-10-11Handle `gottestfmt` repository move (#14144)David Robertson3-2/+3
2022-10-11Remove the groups config code. (#14142)Patrick Cloke2-27/+1
This has been unused for a long time, but missed removal in #11584.
2022-10-11Fix rotating existing notifications in push summary (#14138)Erik Johnston2-5/+16
Broke by #14045. Fixes #14120. Introduced in v1.69.0rc2.
2022-10-11Making parse_server_name more consistent (#14007)Abdullah Osama3-2/+6
Fixes #12122
2022-10-11Fallback if 'approved' isn't included in a registration replication request ↵Brendan Abolivier2-1/+18
(#14135)
2022-10-11Enable dependabot for Rust dependencies (#14132)Erik Johnston3-28/+34
2022-10-11Fix pinning Rust deps in docker images (#14129)Erik Johnston3-1/+3
2022-10-10Fix name of "alias_creation_rules" option in config manual (#14124)Andrew Morgan2-2/+3
2022-10-10Bump types-psycopg2 from 2.9.9 to 2.9.21.1 (#14114)dependabot[bot]2-3/+4
* Bump types-psycopg2 from 2.9.9 to 2.9.21.1 Bumps [types-psycopg2](https://github.com/python/typeshed) from 2.9.9 to 2.9.21.1. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-psycopg2 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-10Bump types-pillow from 9.0.15 to 9.2.2 (#14113)dependabot[bot]2-5/+6
* Bump types-pillow from 9.0.15 to 9.2.2 Bumps [types-pillow](https://github.com/python/typeshed) from 9.0.15 to 9.2.2. - [Release notes](https://github.com/python/typeshed/releases) - [Commits](https://github.com/python/typeshed/commits) --- updated-dependencies: - dependency-name: types-pillow dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Changelog Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-07Indicate what endpoint came back with a JSON response we were unable to ↵Eric Eastwood3-2/+12
parse (#14097) **Before:** ``` WARNING - POST-11 - Unable to parse JSON: Expecting value: line 1 column 1 (char 0) (b'') ``` **After:** ``` WARNING - POST-11 - Unable to parse JSON from POST /_matrix/client/v3/join/%21ZlmJtelqFroDRJYZaq:hs1?server_name=hs1 response: Expecting value: line 1 column 1 (char 0) (b'') ``` --- It's possible to figure out which endpoint these warnings were coming from before but you had to follow the request ID `POST-11` to the log line that says `Completed request [...]`. Including this key information next to the JSON parsing error makes it much easier to reason whether it matters or not. ``` 2022-09-29T08:23:25.7875506Z synapse_main | 2022-09-29 08:21:10,336 - synapse.http.matrixfederationclient - 299 - INFO - POST-11 - {GET-O-13} [hs1] Completed request: 200 OK in 0.53 secs, got 450 bytes - GET matrix://hs1/_matrix/federation/v1/make_join/%21ohtKoQiXlPePSycXwp%3Ahs1/%40charlie%3Ahs2?ver=1&ver=2&ver=3&ver=4&ver=5&ver=6&ver=org.matrix.msc2176&ver=7&ver=8&ver=9&ver=org.matrix.msc3787&ver=10&ver=org.matrix.msc2716v4 ``` --- As a note, having no `body` is normal for the `/join` endpoint and it can handle it. https://github.com/matrix-org/synapse/blob/0c853e09709d52783efd37060ed9e8f55a4fc704/synapse/rest/client/room.py#L398-L403 Alternatively we could remove these extra logs but they are probably more usually helpful to figure out what went wrong.
2022-10-07Remove support for the unstable dir flag on relations. (#14106)Patrick Cloke5-57/+31
From MSC3715, this was unused by clients (and there was no way for clients to know it was supported). Matrix 1.4 defines the stable field.
2022-10-07Apply & bundle edits for non-message events. (#14034)Patrick Cloke2-7/+5
Fixes two related bugs: * No edit information was bundled for events which aren't `m.room.message`. * `m.new_content` was not applied for those events.
2022-10-07Document Google OpenID Connect email attribute (#14081)Paul Tötterman2-1/+3
2022-10-07Parse SYNAPSE_ASYNC_IO_REACTOR env variable & log the reactor on startup ↵Quentin Gliech3-14/+16
(#14092)
2022-10-07Bump phonenumbers from 8.12.44 to 8.12.56 (#14043)dependabot[bot]2-3/+4
* Bump phonenumbers from 8.12.44 to 8.12.56 Bumps [phonenumbers](https://github.com/daviddrysdale/python-phonenumbers) from 8.12.44 to 8.12.56. - [Release notes](https://github.com/daviddrysdale/python-phonenumbers/releases) - [Commits](https://github.com/daviddrysdale/python-phonenumbers/compare/v8.12.44...v8.12.56) --- updated-dependencies: - dependency-name: phonenumbers dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2022-10-07Unpin build-system requirements, but impose an upper-bound (#14085)David Robertson3-4/+10
* Revert to prior build-system requirements This reverts #14080. * Use normalised extra name, which poetry-core 1.3 will generate anyway * Changelog * Upper bound build-system requirements * Remove upgrade note; expand changelog entry a little. * Fix typo in build-system comment Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com> Co-authored-by: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>
2022-10-07Bump pydantic from 1.9.1 to 1.10.2 (#14044)dependabot[bot]2-38/+40
* Bump pydantic from 1.9.1 to 1.10.2 Bumps [pydantic](https://github.com/pydantic/pydantic) from 1.9.1 to 1.10.2. - [Release notes](https://github.com/pydantic/pydantic/releases) - [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md) - [Commits](https://github.com/pydantic/pydantic/compare/v1.9.1...v1.10.2) --- updated-dependencies: - dependency-name: pydantic dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2022-10-07Bump msgpack from 1.0.3 to 1.0.4 (#14040)dependabot[bot]2-36/+55
* Bump msgpack from 1.0.3 to 1.0.4 Bumps [msgpack](https://github.com/msgpack/msgpack-python) from 1.0.3 to 1.0.4. - [Release notes](https://github.com/msgpack/msgpack-python/releases) - [Changelog](https://github.com/msgpack/msgpack-python/blob/main/ChangeLog.rst) - [Commits](https://github.com/msgpack/msgpack-python/compare/v1.0.3...v1.0.4) --- updated-dependencies: - dependency-name: msgpack dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2022-10-07Improve the listener example on the metrics documentation (#14078)Dirk Klimpel2-12/+30
Signed-off-by: Dirk Klimpel <dirk@klimpel.org>
2022-10-07Be more lenient in the oEmbed response parsing. (#14089)Patrick Cloke3-51/+160
Attempt to parse any valid information from an oEmbed response (instead of bailing at the first unexpected data). This should allow for more partial oEmbed data to be returned, resulting in better / more URL previews, even if those URL previews are only partial.
2022-10-07Use stable identifiers for MSC3771 & MSC3773. (#14050)Patrick Cloke12-52/+49
These are both part of Matrix 1.4 which has now been released. For now, support both the unstable and stable identifiers.
2022-10-07Add sample worker files for `pusher` and `federation_sender` (#14077)Dirk Klimpel4-0/+29
Signed-off-by: Dirk Klimpel <dirk@klimpel.org>
2022-10-07Use Pydantic to validate /devices endpoints (#14054)David Robertson2-46/+53
2022-10-07Catch BrokenPipeError from metrics server, and log as a warning (#14072)David Robertson2-6/+13
2022-10-07Update frozendict 2.3.3 -> 2.3.4 (#13955)David Robertson2-18/+19
* Update frozendict 2.3.3 -> 2.3.4 This claims to fix more memory leaks. Could have automated this upgrade with #11828 if we wanted. * Changelog
2022-10-06Fix broken links to README (#14093)David Robertson3-2/+3
2022-10-06Always close _all_ `ijson` coroutines, even if doing so raises Exceptions ↵David Robertson4-5/+76
(#14065)
2022-10-06The changelog entry ending in a `.` or `!` is not optional (#14087)Andre Klärner2-1/+2
2022-10-06Update 1.69.0rc2 changelog v1.69.0rc2Sean Quah1-2/+2
2022-10-06Replace incorrect 1.69.0rc3 version with 1.69.0rc2Sean Quah1-1/+1
2022-10-061.69.0rc3Sean Quah5-5/+10
2022-10-06Fix sending events into rooms with non-integer power levels (#14073)David Robertson4-1/+86
2022-10-06Pin build-system requirements (#14080)David Robertson2-1/+2
* Pin build-system requirements * Changelog
2022-10-06Deprecate the `generate_short_term_login_token` method in favor of an async ↵Quentin Gliech3-0/+76
`create_login_token` method in the Module API. (#13842) Signed-off-by: Quentin Gliech <quenting@element.io> Co-authored-by: Brendan Abolivier <babolivier@matrix.org>
2022-10-061.69.0rc2Sean Quah4-4/+17
2022-10-06openid.md: fix a typo in the facebook exampleRichard van der Hoff1-1/+1
2022-10-05Batch up notifications after event persistence (#14033)Shay5-58/+66
2022-10-05Complement test image: capture logs from nginx (#14063)Richard van der Hoff2-1/+6
Have nginx send its logs to stderr/out, so that we can debug https://github.com/matrix-org/synapse/issues/13334.
2022-10-05Fix handling of public rooms filter with a network tuple. (#14053)Patrick Cloke3-27/+58
Fixes two related bugs: * The handling of `[null]` for a `room_types` filter was incorrect. * The ordering of arguments when providing both a network tuple and room type field was incorrect.
2022-10-05Fix backwards compatibility with upcoming threads schema changes. (#14045)Patrick Cloke2-11/+24
Ensure that the upsert will work properly by first updating any existing rows (in the same way that the background update to backfill data works).
2022-10-04Use threaded receipts when fetching events for push. (#13878)Patrick Cloke3-41/+97
Update the HTTP and email pushers to consider threaded read receipts when fetching unread events.
2022-10-04Bump types-pyyaml from 6.0.4 to 6.0.12 (#14041)dependabot[bot]2-5/+6
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
2022-10-04Remove get rooms for user with stream ordering (#13991)Nick Mills-Barrett2-80/+70
By getting the joined rooms before the current token we avoid any reading history to confirm a user *was* in a room. We can then use any membership change events, which we already fetch during sync, to determine the final list of joined room IDs.
2022-10-04Recursively fetch the thread for receipts & notifications. (#13824)Patrick Cloke5-2/+162
Consider an event to be part of a thread if you can follow a chain of relations up to a thread root. Part of MSC3773 & MSC3771.
2022-10-04update authlib from 0.15.5 to 1.1.0 (#14006)ffaex2-10/+8
Signed-off-by: Fyodor Fomichev <fyodor.fomichev@gmail.com>
2022-10-04Mark events as read using threaded read receipts from MSC3771. (#13877)Patrick Cloke5-62/+504
Applies the proper logic for unthreaded and threaded receipts to either apply to all events in the room or only events in the same thread, respectively.
2022-10-04Advertise supporting version 1.3 of the Matrix spec. (#14032)Patrick Cloke2-0/+2
Now that all features / changes in 1.3 are supported in Synapse.
generated by cgit-pink 1.4.1 (git 2.36.1) at 2024-12-18 20:33:53 +0000