forked from postgres/postgres
-
Notifications
You must be signed in to change notification settings - Fork 11
Add WAL content for 2.0 release #499
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
23 commits
Select commit
Hold shift + click to select a range
265799a
Add WAL content for 2.0 release
Andriciuc c150be4
improve functions.md with small text fix and reword introductory para…
Andriciuc 9e0a879
Merge branch 'TDE_REL_17_STABLE' into wal-2.0-update
Andriciuc 3dd51c1
Merge branch 'TDE_REL_17_STABLE' into wal-2.0-update
Andriciuc 662f178
Merge branch 'TDE_REL_17_STABLE' into wal-2.0-update
Andriciuc 1c12c70
add WAL tool support to limitations, improve flow, add button to setup
Andriciuc 5d4fe68
Update contrib/pg_tde/documentation/docs/index/tde-limitations.md
Andriciuc 8769d25
update limitations with feedback
Andriciuc 9ce0f6a
Merge branch 'wal-2.0-update' of https://github.com/percona/postgres …
Andriciuc 79b5c28
Merge branch 'TDE_REL_17_STABLE' into wal-2.0-update
Andriciuc 3dc94d3
add limitation regarding WAL shipping standy not supported with WAL e…
Andriciuc 09b38f4
remove confusing text from how tde works, link in note to KMS config …
Andriciuc aa604d0
add mention of open source and enterprise ed being supported for pg_tde
Andriciuc b3b7e89
Update the Features topic buttons for better clarity (#508)
Andriciuc c1c9b63
Merge branch 'TDE_REL_17_STABLE' into wal-2.0-update
Andriciuc 86d8d0d
modify limitations and global key config with feedback
Andriciuc e6bf5a9
add none method to basebackup and link to topic
Andriciuc a551004
rename WAL tool support to compatibility
Andriciuc 37fa8b2
add Example Patroni configuration for Patroni tool
Andriciuc 58e53e8
add a new paragraph for unsupported tools under WAL tool compat and r…
Andriciuc b84c6c4
improve supported vs unsupported tools section
Andriciuc ab32dbb
Merge branch 'release-17.5.3' into wal-2.0-update
Andriciuc 0f00d2a
Merge branch 'release-17.5.3' into wal-2.0-update
Andriciuc File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2 changes: 1 addition & 1 deletion
2
contrib/pg_tde/documentation/docs/global-key-provider-configuration/vault.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
97 changes: 94 additions & 3 deletions
97
contrib/pg_tde/documentation/docs/index/tde-limitations.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,8 +1,99 @@ | ||
# Limitations of pg_tde | ||
|
||
The following are current limitations of `pg_tde`: | ||
Limitations of `pg_tde` {{release}}: | ||
|
||
* System tables, which include statistics data and database statistics, are currently **not encrypted**. | ||
* The WAL encryption feature is currently in beta and is not effective unless explicitly enabled. It is not yet production ready. **Do not enable this feature in production environments**. | ||
* PostgreSQL’s internal system tables, which include statistics and metadata, are not encrypted. | ||
* Temporary files created when queries exceed `work_mem` are not encrypted. These files may persist during long-running queries or after a server crash which can expose sensitive data in plaintext on disk. | ||
|
||
Andriciuc marked this conversation as resolved.
Show resolved
Hide resolved
|
||
## Currently unsupported WAL tools | ||
|
||
The following tools are currently unsupported with `pg_tde` WAL encryption: | ||
|
||
* `pg_createsubscriber` | ||
* `pg_verifybackup` (checksum mismatch with encrypted WAL) | ||
|
||
The following tools and extensions in Percona Distribution for PostgreSQL have been tested and verified to work with `pg_tde` WAL encryption: | ||
|
||
## Supported WAL tools | ||
|
||
The following tools have been tested and verified by Percona to work with `pg_tde` WAL encryption: | ||
|
||
* Patroni, for an example configuration see the following [Patroni configuration file](#example-patroni-configuration) | ||
* `pg_basebackup` (with `--wal-method=stream` or `--wal-method=none`), for details on using `pg_basebackup` with WAL encryption, see [Backup with WAL encryption enabled](../how-to/backup-wal-enabled.md) | ||
* `pg_resetwal` | ||
* `pg_rewind` | ||
* `pg_upgrade` | ||
* `pg_waldump` | ||
* pgBackRest | ||
|
||
## Example Patroni configuration | ||
|
||
The following is a Percona-tested example configuration. | ||
|
||
??? example "Click to expand the Percona-tested Patroni configuration" | ||
```yaml | ||
# Example Patroni configuration file maintained by Percona | ||
# Source: https://github.com/jobinau/pgscripts/blob/main/patroni/patroni.yml | ||
scope: postgres | ||
namespace: /db/ | ||
name: postgresql0 | ||
|
||
restapi: | ||
listen: 0.0.0.0:8008 | ||
connect_address: 127.0.0.1:8008 | ||
|
||
etcd: | ||
host: 127.0.0.1:2379 | ||
|
||
bootstrap: | ||
dcs: | ||
ttl: 30 | ||
loop_wait: 10 | ||
retry_timeout: 10 | ||
maximum_lag_on_failover: 1048576 | ||
postgresql: | ||
use_pg_rewind: true | ||
use_slots: true | ||
parameters: | ||
max_connections: 100 | ||
shared_buffers: 1GB | ||
wal_level: replica | ||
hot_standby: "on" | ||
wal_keep_size: 256MB | ||
max_wal_senders: 10 | ||
max_replication_slots: 10 | ||
|
||
initdb: | ||
- encoding: UTF8 | ||
- data-checksums | ||
|
||
pg_hba: | ||
- host replication replicator 127.0.0.1/32 md5 | ||
- host all all 0.0.0.0/0 md5 | ||
|
||
postgresql: | ||
listen: 0.0.0.0:5432 | ||
connect_address: 127.0.0.1:5432 | ||
data_dir: /var/lib/postgresql/data | ||
bin_dir: /usr/lib/postgresql/14/bin | ||
authentication: | ||
replication: | ||
username: replicator | ||
password: rep-pass | ||
superuser: | ||
username: postgres | ||
password: secretpassword | ||
``` | ||
|
||
!!! warning | ||
The above example is Percona-tested, but Patroni versions differ, especially with discovery backends such as `etcd`. Ensure you adjust the configuration to match your environment, version, and security requirements. | ||
|
||
## Next steps | ||
|
||
Check which PostgreSQL versions and deployment types are compatible with `pg_tde` before planning your installation. | ||
|
||
[View the versions and supported deployments :material-arrow-right:](supported-versions.md){.md-button} | ||
|
||
Begin the installation process when you're ready to set up encryption. | ||
|
||
[Start installing `pg_tde`](../install.md){.md-button} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.