Show hint for overloaded shards

[galnat]

Show hints on page on for the following cases :

• overloaded shard on a table that can't split - advice, need to put the correct table name in query.
• overloaded shard of a secondary index table - advice, need to put the correct table name and index name in query.
• overloaded shard and shard limit is reached - advice, need to put the correct table name in query and new limit?

Design - #1835
Backend - ydb-platform/ydb#13615

[galnat]

Overloaded shard and shard limit is reached.

Popup message:

Problem
The data shard is overloaded because the table was created with the AUTO_PARTITIONING_MAX_PARTITIONS_COUNT setting and has already reached its partition limit.

Recommendation
Increase the partition limit by executing query
ALTER TABLE <table_name> SET (AUTO_PARTITIONING_MAX_PARTITIONS_COUNT = <new_count>);

See documentation for more information.

[galnat]

Overloaded shard of a secondary index table.

Popup message:

Problem
The data shard is overloaded because the index is created without the AUTO_PARTITIONING_BY_LOAD clause.

Recommendation
Enable partitioning by load by executing query
ALTER TABLE <table_name> ALTER INDEX <index_name> SET (AUTO_PARTITIONING_BY_LOAD = ENABLED);

See documentation for more information.

[artemmufazalov]

Create advisor API in open-source version and pass hints functionality internally

[adameat]

@artemmufazalov
to get hints you should make a normal health check call, but with return_hints=1 parameter:

/viewer/healthcheck?database=/dev02/home/xenoxeno/db1&return_hints=1

it will return all healthcheck data too.

[artemmufazalov]

Design: https://www.figma.com/design/bNbecZuPFDDrJ7ghaXZ2Fe/Tickets?node-id=5009-567632&p=f&t=DmMEwYGVtoyc0MuT-0

[artemmufazalov]

HC with hints response example:

{
  "self_check_result": "GOOD",
  "issue_log": [
    {
      "id": "34a8-24c2a85b",
      "message": "Split by load is disabled on the table",
      "location": {
        "compute": {
          "tablet": {"id": ["72075186224106215"]},
          "schema": {"type": "table", "path": "/dev02/home/xenoxeno/db1/kv_test"}
        }
      },
      "type": "HINT-OVERLOADED-SHARD",
      "level": 3
    }
  ],
  "location": {"id": 50004, "host": "ydb-vla-dev02-001.search.yandex.net", "port": 31003}
}

Hint for this issue: #1875 (comment)

[artemmufazalov]

ydb-platform/ydb#14416

[artemmufazalov]

Internal PR:
https://nda.ya.ru/t/dkXN0dVl7CTTS2

PR that adds ShardsTable to componentsRegistry:
#1993

PRs with refactoring and related fixes:
#1998
#2000
#2001
#2002
#2003
#2004

[adameat]

HC with hints response example:

{
"self_check_result": "GOOD",
"issue_log": [
{
"id": "34a8-24c2a85b",
"message": "Split by load is disabled on the table",
"location": {
"compute": {
"tablet": {"id": ["72075186224106215"]},
"schema": {"type": "table", "path": "/dev02/home/xenoxeno/db1/kv_test"}
}
},
"type": "HINT-OVERLOADED-SHARD",
"level": 3
}
],
"location": {"id": 50004, "host": "ydb-vla-dev02-001.search.yandex.net", "port": 31003}
}
Hint for this issue: #1875 (comment)

@artemmufazalov the first part of id field (34a8 in this example) is crc16 of the issue message. so it won't change without changing the message itself. and it's unique for every message (hint).

[artemmufazalov]

Overloaded shards without partitioning advice was added here: https://nda.ya.ru/t/9N9rx5uT7Cenuv

[adameat]

@adameat

[artemmufazalov]

Overloaded shard when shards limit is reached advice was added here: https://nda.ya.ru/t/W7LHZxk27CpXTS

[artemmufazalov]

Now UI has all hints, that are currently returned by backend.

There is no hint for overloaded shard of index table neither in UI, nor in backend, I created a separate issue for this: #2020