Log Message:
matrix-synapse: update to 1.37.0.

Synapse 1.37.0 (2021-06-29)
===========================

This release deprecates the current spam checker interface. See the [upgrade \ 
notes](https://matrix-org.github.io/synapse/develop/upgrade#deprecation-of-the-current-spam-checker-interface) \ 
for more information on how to update to the new generic module interface.

This release also removes support for fetching and renewing TLS certificates \ 
using the ACME v1 protocol, which has been fully decommissioned by Let's Encrypt \ 
on June 1st 2021. Admins previously using this feature should use a [reverse \ 
proxy](https://matrix-org.github.io/synapse/develop/reverse_proxy.html) to \ 
handle TLS termination, or use an external ACME client (such as \ 
[certbot](https://certbot.eff.org/)) to retrieve a certificate and key and \ 
provide them to Synapse using the `tls_certificate_path` and \ 
`tls_private_key_path` configuration settings.

Synapse 1.37.0rc1 (2021-06-24)
==============================

Features
--------

- Implement "room knocking" as per \ 
[MSC2403](https://github.com/matrix-org/matrix-doc/pull/2403). Contributed by \ 
@Sorunome and anoa. \ 
([\#6739](https://github.com/matrix-org/synapse/issues/6739), \ 
[\#9359](https://github.com/matrix-org/synapse/issues/9359), \ 
[\#10167](https://github.com/matrix-org/synapse/issues/10167), \ 
[\#10212](https://github.com/matrix-org/synapse/issues/10212), \ 
[\#10227](https://github.com/matrix-org/synapse/issues/10227))
- Add experimental support for backfilling history into rooms \ 
([MSC2716](https://github.com/matrix-org/matrix-doc/pull/2716)). \ 
([\#9247](https://github.com/matrix-org/synapse/issues/9247))
- Implement a generic interface for third-party plugin modules. \ 
([\#10062](https://github.com/matrix-org/synapse/issues/10062), \ 
[\#10206](https://github.com/matrix-org/synapse/issues/10206))
- Implement config option `sso.update_profile_information` to sync SSO users' \ 
profile information with the identity provider each time they login. Currently \ 
only displayname is supported. \ 
([\#10108](https://github.com/matrix-org/synapse/issues/10108))
- Ensure that errors during startup are written to the logs and the console. \ 
([\#10191](https://github.com/matrix-org/synapse/issues/10191))

Bugfixes
--------

- Fix a bug introduced in Synapse v1.25.0 that prevented the \ 
`ip_range_whitelist` configuration option from working for federation and \ 
identity servers. Contributed by @mikure. \ 
([\#10115](https://github.com/matrix-org/synapse/issues/10115))
- Remove a broken import line in Synapse's `admin_cmd` worker. Broke in Synapse \ 
v1.33.0. ([\#10154](https://github.com/matrix-org/synapse/issues/10154))
- Fix a bug introduced in Synapse v1.21.0 which could cause `/sync` to return \ 
immediately with an empty response. \ 
([\#10157](https://github.com/matrix-org/synapse/issues/10157), \ 
[\#10158](https://github.com/matrix-org/synapse/issues/10158))
- Fix a minor bug in the response to \ 
`/_matrix/client/r0/user/{user}/openid/request_token` causing `expires_in` to be \ 
a float instead of an integer. Contributed by @lukaslihotzki. \ 
([\#10175](https://github.com/matrix-org/synapse/issues/10175))
- Always require users to re-authenticate for dangerous operations: deactivating \ 
an account, modifying an account password, and adding 3PIDs. \ 
([\#10184](https://github.com/matrix-org/synapse/issues/10184))
- Fix a bug introduced in Synpase v1.7.2 where remote server count metrics \ 
collection would be incorrectly delayed on startup. Found by @heftig. \ 
([\#10195](https://github.com/matrix-org/synapse/issues/10195))
- Fix a bug introduced in Synapse v1.35.1 where an `allow` key of a \ 
`m.room.join_rules` event could be applied for incorrect room versions and \ 
configurations. ([\#10208](https://github.com/matrix-org/synapse/issues/10208))
- Fix performance regression in responding to user key requests over federation. \ 
Introduced in Synapse v1.34.0rc1. \ 
([\#10221](https://github.com/matrix-org/synapse/issues/10221))

Improved Documentation
----------------------

- Add a new guide to decoding request logs. \ 
([\#8436](https://github.com/matrix-org/synapse/issues/8436))
- Mention in the sample homeserver config that you may need to configure max \ 
upload size in your reverse proxy. Contributed by @aaronraimist. \ 
([\#10122](https://github.com/matrix-org/synapse/issues/10122))
- Fix broken links in documentation. \ 
([\#10180](https://github.com/matrix-org/synapse/issues/10180))
- Deploy a snapshot of the documentation website upon each new Synapse release. \ 
([\#10198](https://github.com/matrix-org/synapse/issues/10198))

Deprecations and Removals
-------------------------

- The current spam checker interface is deprecated in favour of a new generic \ 
modules system. See the [upgrade \ 
notes](https://matrix-org.github.io/synapse/develop/upgrade#deprecation-of-the-current-spam-checker-interface) \ 
for more information on how to update to the new system. \ 
([\#10062](https://github.com/matrix-org/synapse/issues/10062), \ 
[\#10210](https://github.com/matrix-org/synapse/issues/10210), \ 
[\#10238](https://github.com/matrix-org/synapse/issues/10238))
- Stop supporting the unstable spaces prefixes from MSC1772. \ 
([\#10161](https://github.com/matrix-org/synapse/issues/10161))
- Remove Synapse's support for automatically fetching and renewing certificates \ 
using the ACME v1 protocol. This protocol has been fully turned off by Let's \ 
Encrypt for existing installations on June 1st 2021. Admins previously using \ 
this feature should use a [reverse \ 
proxy](https://matrix-org.github.io/synapse/develop/reverse_proxy.html) to \ 
handle TLS termination, or use an external ACME client (such as \ 
[certbot](https://certbot.eff.org/)) to retrieve a certificate and key and \ 
provide them to Synapse using the `tls_certificate_path` and \ 
`tls_private_key_path` configuration settings. \ 
([\#10194](https://github.com/matrix-org/synapse/issues/10194))

Internal Changes
----------------

- Update the database schema versioning to support gradual migration away from \ 
legacy tables. ([\#9933](https://github.com/matrix-org/synapse/issues/9933))
- Add type hints to the federation servlets. \ 
([\#10080](https://github.com/matrix-org/synapse/issues/10080))
- Improve OpenTracing for event persistence. \ 
([\#10134](https://github.com/matrix-org/synapse/issues/10134), \ 
[\#10193](https://github.com/matrix-org/synapse/issues/10193))
- Clean up the interface for injecting OpenTracing over HTTP. \ 
([\#10143](https://github.com/matrix-org/synapse/issues/10143))
- Limit the number of in-flight `/keys/query` requests from a single device. \ 
([\#10144](https://github.com/matrix-org/synapse/issues/10144))
- Refactor EventPersistenceQueue. \ 
([\#10145](https://github.com/matrix-org/synapse/issues/10145))
- Document `SYNAPSE_TEST_LOG_LEVEL` to see the logger output when running tests. \ 
([\#10148](https://github.com/matrix-org/synapse/issues/10148))
- Update the Complement build tags in GitHub Actions to test currently \ 
experimental features. \ 
([\#10155](https://github.com/matrix-org/synapse/issues/10155))
- Add a `synapse_federation_soft_failed_events_total` metric to track how often \ 
events are soft failed. \ 
([\#10156](https://github.com/matrix-org/synapse/issues/10156))
- Fetch the corresponding complement branch when performing CI. \ 
([\#10160](https://github.com/matrix-org/synapse/issues/10160))
- Add some developer documentation about boolean columns in database schemas. \ 
([\#10164](https://github.com/matrix-org/synapse/issues/10164))
- Add extra logging fields to better debug where events are being soft failed. \ 
([\#10168](https://github.com/matrix-org/synapse/issues/10168))
- Add debug logging for when we enter and exit `Measure` blocks. \ 
([\#10183](https://github.com/matrix-org/synapse/issues/10183))
- Improve comments in structured logging code. \ 
([\#10188](https://github.com/matrix-org/synapse/issues/10188))
- Update [MSC3083](https://github.com/matrix-org/matrix-doc/pull/3083) support \ 
with modifications from the MSC. \ 
([\#10189](https://github.com/matrix-org/synapse/issues/10189))
- Remove redundant DNS lookup limiter. \ 
([\#10190](https://github.com/matrix-org/synapse/issues/10190))
- Upgrade `black` linting tool to 21.6b0. \ 
([\#10197](https://github.com/matrix-org/synapse/issues/10197))
- Expose OpenTracing trace id in response headers. \ 
([\#10199](https://github.com/matrix-org/synapse/issues/10199))

Synapse 1.36.0 (2021-06-15)
===========================

No significant changes.

Synapse 1.36.0rc2 (2021-06-11)
==============================

Bugfixes
--------

- Fix a bug which caused  presence updates to stop working some time after a \ 
restart, when using a presence writer worker. Broke in v1.33.0. \ 
([\#10149](https://github.com/matrix-org/synapse/issues/10149))
- Fix a bug when using federation sender worker where it would send out more \ 
presence updates than necessary, leading to high resource usage. Broke in \ 
v1.33.0. ([\#10163](https://github.com/matrix-org/synapse/issues/10163))
- Fix a bug where Synapse could send the same presence update to a remote twice. \ 
([\#10165](https://github.com/matrix-org/synapse/issues/10165))

Synapse 1.36.0rc1 (2021-06-08)
==============================

Features
--------

- Add new endpoint `/_matrix/client/r0/rooms/{roomId}/aliases` from \ 
Client-Server API r0.6.1 (previously \ 
[MSC2432](https://github.com/matrix-org/matrix-doc/pull/2432)). \ 
([\#9224](https://github.com/matrix-org/synapse/issues/9224))
- Improve performance of incoming federation transactions in large rooms. \ 
([\#9953](https://github.com/matrix-org/synapse/issues/9953), \ 
[\#9973](https://github.com/matrix-org/synapse/issues/9973))
- Rewrite logic around verifying JSON object and fetching server keys to be more \ 
performant and use less memory. \ 
([\#10035](https://github.com/matrix-org/synapse/issues/10035))
- Add new admin APIs for unprotecting local media from quarantine. Contributed \ 
by @dklimpel. ([\#10040](https://github.com/matrix-org/synapse/issues/10040))
- Add new admin APIs to remove media by media ID from quarantine. Contributed by \ 
@dklimpel. ([\#10044](https://github.com/matrix-org/synapse/issues/10044))
- Make reason and score parameters optional for reporting content. Implements \ 
[MSC2414](https://github.com/matrix-org/matrix-doc/pull/2414). Contributed by \ 
Callum Brown. ([\#10077](https://github.com/matrix-org/synapse/issues/10077))
- Add support for routing more requests to workers. \ 
([\#10084](https://github.com/matrix-org/synapse/issues/10084))
- Report OpenTracing spans for database activity. \ 
([\#10113](https://github.com/matrix-org/synapse/issues/10113), \ 
[\#10136](https://github.com/matrix-org/synapse/issues/10136), \ 
[\#10141](https://github.com/matrix-org/synapse/issues/10141))
- Significantly reduce memory usage of joining large remote rooms. \ 
([\#10117](https://github.com/matrix-org/synapse/issues/10117))

Bugfixes
--------

- Fixed a bug causing replication requests to fail when receiving a lot of \ 
events via federation. \ 
([\#10082](https://github.com/matrix-org/synapse/issues/10082))
- Fix a bug in the `force_tracing_for_users` option introduced in Synapse v1.35 \ 
which meant that the OpenTracing spans produced were missing most tags. \ 
([\#10092](https://github.com/matrix-org/synapse/issues/10092))
- Fixed a bug that could cause Synapse to stop notifying application services. \ 
Contributed by Willem Mulder. \ 
([\#10107](https://github.com/matrix-org/synapse/issues/10107))
- Fix bug where the server would attempt to fetch the same history in the room \ 
from a remote server multiple times in parallel. \ 
([\#10116](https://github.com/matrix-org/synapse/issues/10116))
- Fix a bug introduced in Synapse 1.33.0 which caused replication requests to \ 
fail when receiving a lot of very large events via federation. \ 
([\#10118](https://github.com/matrix-org/synapse/issues/10118))
- Fix bug when using workers where pagination requests failed if a remote server \ 
returned zero events from `/backfill`. Introduced in 1.35.0. \ 
([\#10133](https://github.com/matrix-org/synapse/issues/10133))

Improved Documentation
----------------------

- Clarify security note regarding hosting Synapse on the same domain as other \ 
web applications. ([\#9221](https://github.com/matrix-org/synapse/issues/9221))
- Update CAPTCHA documentation to mention turning off the verify origin feature. \ 
Contributed by @aaronraimist. \ 
([\#10046](https://github.com/matrix-org/synapse/issues/10046))
- Tweak wording of database recommendation in `INSTALL.md`. Contributed by \ 
@aaronraimist. ([\#10057](https://github.com/matrix-org/synapse/issues/10057))
- Add initial infrastructure for rendering Synapse documentation with mdbook. \ 
([\#10086](https://github.com/matrix-org/synapse/issues/10086))
- Convert the remaining Admin API documentation files to markdown. \ 
([\#10089](https://github.com/matrix-org/synapse/issues/10089))
- Make a link in docs use HTTPS. Contributed by @RhnSharma. \ 
([\#10130](https://github.com/matrix-org/synapse/issues/10130))
- Fix broken link in Docker docs. \ 
([\#10132](https://github.com/matrix-org/synapse/issues/10132))

Deprecations and Removals
-------------------------

- Remove the experimental `spaces_enabled` flag. The spaces features are always \ 
available now. ([\#10063](https://github.com/matrix-org/synapse/issues/10063))

Internal Changes
----------------

- Tell CircleCI to build Docker images from `main` branch. \ 
([\#9906](https://github.com/matrix-org/synapse/issues/9906))
- Simplify naming convention for release branches to only include the major and \ 
minor version numbers. \ 
([\#10013](https://github.com/matrix-org/synapse/issues/10013))
- Add `parse_strings_from_args` for parsing an array from query parameters. \ 
([\#10048](https://github.com/matrix-org/synapse/issues/10048), \ 
[\#10137](https://github.com/matrix-org/synapse/issues/10137))
- Remove some dead code regarding TLS certificate handling. \ 
([\#10054](https://github.com/matrix-org/synapse/issues/10054))
- Remove redundant, unmaintained `convert_server_keys` script. \ 
([\#10055](https://github.com/matrix-org/synapse/issues/10055))
- Improve the error message printed by synctl when synapse fails to start. \ 
([\#10059](https://github.com/matrix-org/synapse/issues/10059))
- Fix GitHub Actions lint for newsfragments. \ 
([\#10069](https://github.com/matrix-org/synapse/issues/10069))
- Update opentracing to inject the right context into the carrier. \ 
([\#10074](https://github.com/matrix-org/synapse/issues/10074))
- Fix up `BatchingQueue` implementation. \ 
([\#10078](https://github.com/matrix-org/synapse/issues/10078))
- Log method and path when dropping request due to size limit. \ 
([\#10091](https://github.com/matrix-org/synapse/issues/10091))
- In Github Actions workflows, summarize the Sytest results in an easy-to-read \ 
format. ([\#10094](https://github.com/matrix-org/synapse/issues/10094))
- Make `/sync` do fewer state resolutions. \ 
([\#10102](https://github.com/matrix-org/synapse/issues/10102))
- Add missing type hints to the admin API servlets. \ 
([\#10105](https://github.com/matrix-org/synapse/issues/10105))
- Improve opentracing annotations for `Notifier`. \ 
([\#10111](https://github.com/matrix-org/synapse/issues/10111))
- Enable Prometheus metrics for the jaeger client library. \ 
([\#10112](https://github.com/matrix-org/synapse/issues/10112))
- Work to improve the responsiveness of `/sync` requests. \ 
([\#10124](https://github.com/matrix-org/synapse/issues/10124))
- OpenTracing: use a consistent name for background processes. \ 
([\#10135](https://github.com/matrix-org/synapse/issues/10135))