summary refs log tree commit diff
path: root/synapse/rest/media/v1/preview_url_resource.py (follow)
Commit message (Expand)AuthorAgeFilesLines
* Do not wait for background updates to complete do expire URL cache. (#13657)Patrick Cloke2022-08-301-4/+0
* Inline URL preview documentation. (#13261)Patrick Cloke2022-07-121-4/+58
* Do not break URL previews if an image is unreachable. (#12950)Patrick Cloke2022-06-061-6/+17
* URL preview cache expiry logs: INFO -> DEBUG, text clarifications (#12720)Andrew Morgan2022-05-121-9/+21
* Ensure the type of URL attributes is always str when matching against preview...Brendan Abolivier2022-03-311-2/+7
* Clean-up logic for rebasing URLs during URL preview. (#12219)Patrick Cloke2022-03-161-11/+12
* Remove `HomeServer.get_datastore()` (#12031)Richard van der Hoff2022-02-231-1/+1
* Fetch images when previewing Twitter URLs. (#11985)AndrewRyanChama2022-02-221-1/+9
* Implement a content type allow list for URL previews (#11936)Denis Kasak2022-02-101-0/+8
* Support rendering previews with data: URLs in them (#11767)Patrick Cloke2022-01-241-58/+166
* Fix preview of imgur and Tenor URLs. (#11669)Philippe Daouadi2022-01-181-10/+25
* Move HTML parsing to a separate file for URL previews. (#11566)Patrick Cloke2021-12-131-375/+8
* Add type hints to media repository storage module (#11311)Patrick Cloke2021-11-121-4/+4
* Fix URL preview errors when previewing XML documents. (#11196)Patrick Cloke2021-10-271-3/+6
* Ensure each charset is attempted only once during media preview. (#11089)Patrick Cloke2021-10-141-6/+28
* Attempt different character encodings when previewing a URL. (#11077)Patrick Cloke2021-10-141-41/+39
* Be more lenient when parsing the version for oEmbed responses. (#11065)Patrick Cloke2021-10-131-1/+1
* Autodiscover oEmbed endpoint from returned HTML (#10822)Patrick Cloke2021-10-081-38/+74
* Fix empty `url_cache_thumbnails/yyyy-mm-dd/` directories being left behind (#...Sean Quah2021-09-291-31/+43
* Avoid storing URL cache files in storage providers (#10911)Sean Quah2021-09-271-1/+0
* Use direct references for configuration variables (part 5). (#10897)Patrick Cloke2021-09-241-5/+5
* Add reactor to `SynapseRequest` and fix up types. (#10868)Erik Johnston2021-09-241-2/+1
* Include more information in oEmbed previews. (#10819)Patrick Cloke2021-09-221-1/+1
* Refactor oEmbed previews (#10814)Patrick Cloke2021-09-211-142/+184
* Add missing type hints to non-client REST servlets. (#10817)Patrick Cloke2021-09-151-2/+3
* Use attrs internally for the URL preview code & add documentation. (#10753)Patrick Cloke2021-09-071-42/+79
* Allow configuration of the oEmbed URLs. (#10714)Patrick Cloke2021-08-311-142/+5
* Support underscores (in addition to hyphens) for charset detection. (#10410)sri-vidyut2021-07-271-2/+4
* Add a return type to parse_string. (#10438)Patrick Cloke2021-07-211-7/+3
* Use inline type hints in `handlers/` and `rest/`. (#10382)Jonathan de Jong2021-07-161-4/+4
* Remove redundant "coding: utf-8" lines (#9786)Jonathan de Jong2021-04-141-1/+0
* Add type hints to expiring cache. (#9730)Patrick Cloke2021-04-061-1/+1
* Make it possible to use dmypy (#9692)Erik Johnston2021-03-261-0/+2
* Import HomeServer from the proper module. (#9665)Patrick Cloke2021-03-231-1/+1
* Fix additional type hints from Twisted 21.2.0. (#9591)Patrick Cloke2021-03-121-1/+2
* Use the proper Request in type hints. (#9515)Patrick Cloke2021-03-011-1/+1
* Add support for no_proxy and case insensitive env variables (#9372)Tim Leung2021-02-261-2/+1
* Update black, and run auto formatting over the codebase (#9381)Eric Eastwood2021-02-161-2/+1
* Handle additional errors when previewing URLs. (#9333)Patrick Cloke2021-02-081-19/+52
* Try to recover from unknown encodings when previewing media. (#9164)Patrick Cloke2021-01-261-10/+34
* Add type hints to media rest resources. (#9093)Patrick Cloke2021-01-151-29/+48
* Do not raise a 500 exception when previewing empty media. (#8883)Patrick Cloke2020-12-071-1/+5
* Add type annotations to SimpleHttpClient (#8372)Richard van der Hoff2020-09-241-4/+10
* Use slots in attrs classes where possible (#8296)Patrick Cloke2020-09-141-1/+1
* Remove unnecessary maybeDeferred calls (#8044)Patrick Cloke2020-08-071-2/+1
* Reduce unnecessary whitespace in JSON. (#7372)David Vo2020-08-071-2/+2
* Rename database classes to make some sense (#8033)Erik Johnston2020-08-051-1/+1
* Convert the remaining media repo code to async / await. (#7947)Patrick Cloke2020-07-271-5/+5
* Support oEmbed for media previews. (#7920)Patrick Cloke2020-07-271-45/+220
* Merge different Resource implementation classes (#7732)Erik Johnston2020-07-031-6/+4
* Support running multiple media repos. (#7706)Erik Johnston2020-06-171-3/+15
* Replace all remaining six usage with native Python 3 equivalents (#7704)Dagfinn Ilmari Mannsåker2020-06-161-6/+3
* Reduce logging verbosity of URL cache cleanup. (#7295)Michael Kaye2020-04-221-2/+7
* Allow specifying the value of Accept-Language header for URL previews (#7265)Andrew Morgan2020-04-151-2/+6
* Convert some of the media REST code to async/await (#7110)Patrick Cloke2020-03-201-20/+17
* Fixup synapse.rest to pass mypy (#6732)Erik Johnston2020-01-201-3/+4
* Move background update handling out of storeErik Johnston2019-12-051-1/+1
* Fix startup error when http proxy is defined. (#6421)Richard van der Hoff2019-11-261-2/+2
* Clean up newline quote marks around the codebase (#6362)Andrew Morgan2019-11-211-1/+1
* Merge pull request #6334 from matrix-org/rav/url_preview_limit_title_2Richard van der Hoff2019-11-051-1/+2
|\
| * Fix exception when OpenGraph tag values are intsRichard van der Hoff2019-11-051-1/+2
* | Merge branch 'develop' into rav/url_preview_limit_titleRichard van der Hoff2019-11-051-13/+17
|\ \ | |/ |/|
| * Support for routing outbound HTTP requests via a proxy (#6239)Richard van der Hoff2019-11-011-0/+2
| * Remove usage of deprecated logger.warn method from codebase (#6271)Andrew Morgan2019-10-311-8/+8
| * Address codestyle concernsMichael Kaye2019-10-241-1/+3
| * Delay printf until logging is required.Michael Kaye2019-10-241-6/+6
* | Apply suggestions from code reviewRichard van der Hoff2019-11-051-1/+1
* | Strip overlong OpenGraph data from url previewRichard van der Hoff2019-11-051-1/+19
|/
* Fix store_url_cache using bytesErik Johnston2019-10-101-2/+2
* Remove double return statements (#5962)Andrew Morgan2019-09-031-1/+0
* Replace returnValue with return (#5736)Amber Brown2019-07-231-18/+16
* Move logging utilities out of the side drawer of util/ and into logging/ (#5606)Amber Brown2019-07-041-1/+1
* Fix media repo breaking (#5593)Amber Brown2019-07-021-0/+1
* Make the http server handle coroutine-making REST servlets (#5475)Amber Brown2019-06-291-12/+6
* Run Black. (#5482)Amber Brown2019-06-201-113/+102
* URL preview blacklisting fixes (#5155)Andrew Morgan2019-05-101-0/+10
* Fix IP URL previews on Python 3 (#4215)Amber Brown2018-12-221-2/+12
* Fix Content-Disposition in media repository (#4176)Amber Brown2018-11-151-27/+3
* Use <meta> tags to discover the per-page encoding of html previews (#4183)Amber Brown2018-11-151-9/+22
* Fix URL preview bugs (type error when loading cache from db, content-type inc...Amber Brown2018-11-081-6/+16
* Fix a number of flake8 errorsRichard van der Hoff2018-10-241-1/+1
* Fix bug where we raised StopIteration in a generatorErik Johnston2018-10-171-2/+5
* Fix some instances of ExpiringCache not expiring cache itemsErik Johnston2018-09-211-1/+0
* Port rest/ to Python 3 (#3823)Amber Brown2018-09-121-5/+5
* Rename async to async_helpers because `async` is a keyword on Python 3.7 (#3678)Amber Brown2018-08-101-1/+1
* Fix some looping_call calls which were broken in #3604Richard van der Hoff2018-07-261-1/+1
* Wrap a number of things that run in the backgroundRichard van der Hoff2018-07-251-1/+7
* Use parse_{int,str} and assert from http.servletKrombel2018-07-131-2/+3
* run isortAmber Brown2018-07-091-14/+11
* Attempt to be more performant on PyPy (#3462)Amber Brown2018-06-281-1/+2
* py3-ize url previewAdrian Tschira2018-05-191-3/+5
* Set Server header in SynapseRequestRichard van der Hoff2018-05-101-1/+0
* Remove redundant request_handler decoratorRichard van der Hoff2018-05-101-2/+3
* Use run_in_background in preference to preserve_fnRichard van der Hoff2018-04-271-2/+3
* Merge branch 'master' of github.com:matrix-org/synapse into developErik Johnston2018-03-191-1/+1
|\
| * Replace ujson with simplejsonErik Johnston2018-03-151-1/+1
* | Handle url_previews with no content-typeRichard van der Hoff2018-02-021-21/+34
* | Change _generate_thumbnails to take media_typeErik Johnston2018-01-161-2/+4
* | Move setting of file_id up to callerErik Johnston2018-01-161-2/+4
* | Make PreviewUrlResource use MediaStorageErik Johnston2018-01-091-7/+11
|/
* Merge pull request #2697 from matrix-org/rav/fix_urlcache_index_errorRichard van der Hoff2017-11-271-3/+7
|\
| * Check database in has_completed_background_updatesRichard van der Hoff2017-11-221-1/+1
| * Fix error on sqlite 3.7Richard van der Hoff2017-11-211-3/+7
* | Fix OPTIONS on preview_urlRichard van der Hoff2017-11-231-1/+5
|/
* Bit more loggingRichard van der Hoff2017-11-101-0/+2
* Cache failures in url_preview handlerRichard van der Hoff2017-11-101-41/+45
* Ignore noscript tags when generating URL previewsMaxime Vaillancourt2017-10-251-1/+8
* replace 'except:' with 'except Exception:'Richard van der Hoff2017-10-231-3/+3
* Don't reuse source but instead copy from primary media store to backupErik Johnston2017-10-131-2/+1
* Fix up thumbnailing functionErik Johnston2017-10-131-4/+4
* Fix commentsErik Johnston2017-10-121-0/+3
* Don't close file prematurelyErik Johnston2017-10-121-2/+2
* Copy everything to backupErik Johnston2017-10-121-1/+6
* Only log if we've removed mediaErik Johnston2017-09-281-2/+4
* Clear up expired url cache every 10sErik Johnston2017-09-281-1/+1
* Actually assign result to variableErik Johnston2017-09-281-1/+1
* Fix typo in url cache expiry timerErik Johnston2017-09-281-1/+1
* Change expires column to expires_tsErik Johnston2017-09-281-2/+2
* Delete expired url cache dataErik Johnston2017-09-281-2/+88
* Store URL cache preview downloads seperatelyErik Johnston2017-06-231-3/+4
* actually trim oversize og:description metaMatthew Hodgson2017-05-221-0/+2
* Fix crash in url preview when html tag has no textMarcin Bachry2016-12-141-1/+4
* preview_url_resource: Ellipsis must be in unicode stringJohannes Löthberg2016-12-011-1/+1
* Add None check to _iterate_over_textErik Johnston2016-08-171-1/+1
* Flake8Erik Johnston2016-08-161-4/+1
* Fix up preview URL API. Add tests.Erik Johnston2016-08-161-157/+196
* Don't include html comments in descriptionErik Johnston2016-08-051-1/+2
* TypoErik Johnston2016-08-041-1/+1
* Test summarizationErik Johnston2016-08-041-52/+54
* Don't infer paragrahs from newlinesErik Johnston2016-08-021-2/+1
* Comment on why we cloneErik Johnston2016-08-021-0/+1
* Spelling.Erik Johnston2016-08-021-3/+3
* Make it actually compileErik Johnston2016-08-021-1/+1
* Change the way we summarize URLsErik Johnston2016-08-021-11/+67
* Line lengthsErik Johnston2016-06-151-3/+3
* Handle floats as img widthsErik Johnston2016-06-151-1/+1
* Handle og props with not contentErik Johnston2016-06-151-1/+2
* Clean up the blacklist/whitelist handling.Mark Haines2016-05-161-33/+30
* Report per request metrics for all of the things using request_handlerMark Haines2016-04-281-1/+1
* Add self.media_repo to PreviewUrlResourceErik Johnston2016-04-191-0/+1
* _make_dirs was moved to MediaRepositoryErik Johnston2016-04-191-1/+1
* Add store to PreviewUrlResourceErik Johnston2016-04-191-0/+1
* Reorder importsErik Johnston2016-04-191-7/+8
* Split out BaseMediaResource into MediaRepositoryErik Johnston2016-04-191-7/+13
* explicitly pass in the charset from Content-Type to lxml to fix cyrillic woes...Matthew Hodgson2016-04-151-6/+18
* fix cyrillic URL previews by hardcoding all page decoding to UTF-8 for now, r...Matthew Hodgson2016-04-151-16/+8
* fix urlparse import thinko breaking tiny URLsMatthew Hodgson2016-04-141-5/+5
* Sanitize the optional dependencies for spider APIErik Johnston2016-04-131-22/+2
* PEP8Erik Johnston2016-04-111-1/+0
* fix typos and needless try/except from PR reviewMatthew Hodgson2016-04-111-143/+140
* actually throw meaningful errorsMatthew Hodgson2016-04-081-9/+24
* Fix pep8 warningMark Haines2016-04-081-3/+4
* more PR feedbackMatthew Hodgson2016-04-081-4/+8
* Add url_preview_enabled config option to turn on/off preview_url endpoint. de...Matthew Hodgson2016-04-081-17/+58
* report image size (bytewise) in OG metaMatthew Hodgson2016-04-031-0/+2
* char encodingMatthew Hodgson2016-04-031-0/+1
* pep8Matthew Hodgson2016-04-031-54/+73
* fix etag typing error. fix timestamp typing errorMatthew Hodgson2016-04-031-2/+2
* rebase all image URLsMatthew Hodgson2016-04-031-4/+4
* remove stale todoMatthew Hodgson2016-04-031-3/+0
* Ensure only one download for a given URL is active at a timeMatthew Hodgson2016-04-031-1/+18
* add a persistent cache of URL lookups, and fix up the in-memory one to workMatthew Hodgson2016-04-031-10/+54
* support gzip compression, and don't pass through error msgsMatthew Hodgson2016-04-021-2/+3
* handle missing dimensions without crashingMatthew Hodgson2016-04-021-4/+13
* make meta comparisons case insensitiveMatthew Hodgson2016-04-021-2/+2
* refactor calc_og; spider image URLs; fix xpath; add a (broken) expiringcache;...Matthew Hodgson2016-04-021-81/+121
* fix assorted redirect, unicode and screenscraping bugsMatthew Hodgson2016-04-011-78/+96
* handle spidered relative images correctlyMatthew Hodgson2016-03-311-2/+12
* prevent choking on invalid utf-8, and handle image thumbnailing smarterMatthew Hodgson2016-03-311-5/+18
* synthesise basig OG metadata from pages lacking itMatthew Hodgson2016-03-311-0/+47
* handle requests with missing content-length headers (e.g. YouTube)Matthew Hodgson2016-03-311-2/+2
* fix bugsMatthew Hodgson2016-03-291-5/+6
* debugMatthew Hodgson2016-03-291-3/+2
* make it workMatthew Hodgson2016-03-291-55/+76
* make it buildMatthew Hodgson2016-03-291-8/+9
* initial WIP of a tentative preview_url endpoint - incomplete, untested, exper...Matthew Hodgson2016-01-241-0/+164
generated by cgit-pink 1.4.1 (git 2.36.1) at 2024-12-16 01:40:35 +0000