* Fix docs about reset cursor
Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com>

* fix comments
Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com>
(cherry picked from commit 80e4b5f6)

### Motivation

- The connectorsManager is initialized twice in WorkerService, it seems to be a misoperation when merging codes. 

### Modifications

- Delete the redundant codes.

(cherry picked from commit 7275d53a)

* Add subscribe position param for consumer of sink
Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com>

(cherry picked from commit 39af4777)

* fix: Functions unnecessarily restart during FunctionRuntimeManager init phase

(cherry picked from commit dd58baf8)

* Fix list non-persistent topics shows the persistent topics
---

Fixes #5414

*Motivation*

When using the REST API to request to list all the non-persistent
topics, it will show the persistent topics.

*Modifications*

- Add a filter when before sending the response

(cherry picked from commit 79f47106)

### Motivation

While this doesn't appear to affect the correctness, we should just return empty after we trigger the callback.

(cherry picked from commit 734e7484)

There is a race condition when replaying messages on the `PersistentDispatcherMultipleConsumers`. This is apparently only happening in the context of delivering messages after a scheduled delay. 

The `Dispatcher.readMoreEntries()` can get invoked in multiple occasions: 
 * Piggybacking on the completion of the previous read operation
 * When the delaye tracker gets triggered

If there is already a replay read operation pending, we're currently ignoring the message ids returned by the delay tracker. These messages will not be retried on any other occasion, leading to backlog building up (until a consumer disconnects/reconnects).

(cherry picked from commit 01ca24b3)

* Trim deleted entries after recover cursor.

* Fix errors

* Add managed cursor unit tests.

* Fix tests and handle cursor reset.

* fix unit tests

* Fix tests

* Fix check style

(cherry picked from commit dc7d01ef)

Efficiency improvements for delay delivery tracker

(cherry picked from commit 467ffab1)

There are some link issues on Pulsar website, check and fix them.

(cherry picked from commit f538c522)

### Motivation

The code snippets in functions documentation are wrong: `Function` class of java native is from package `java.util.function` instead of `java.util`.

### Modifications

in 2 markdown file, corrected 2 java source snippets.

(cherry picked from commit bdfefc72)

* add thread/process modes

* update the differences between thread and process modes

* update

* update

(cherry picked from commit 8c163eb2)

Fixes #5484

(cherry picked from commit 6df7cec6)

Fixes #5365

(cherry picked from commit 49a8658c)

* [Issue 5309][docs] Clarify wording around retention policies

Fixes #5309

Docs are confusing.

Replaced retention wording to make distinction between acked and
non-acked messages clearer.

* [Issue 5309][docs] Remove TODO

(cherry picked from commit 418362e1)

- Make sure terminology is precise
- Clarify that each subscription has a backlog
- Clarify how retention interacts with readers

(cherry picked from commit a4c14cdf)

related issue #5349

(cherry picked from commit 09360682)

Some of the ManagedLedger methods, such as hasMoreEntries/getPreviousPosition/getNextValidPosition, are protected. This change try to make them public.
These methods are useful when user want to do some advanced operation in Data Processing.

(cherry picked from commit 89e3f30d)

Fix broken custom auth-provider that uses authenticationData

(cherry picked from commit ebaf97cc)

(cherry picked from commit ddf5429e)

(cherry picked from commit 0c7319fc)

* [pulsar-client] Fix message corruption on OOM for batch messages

* remove comments

* Address comments: index in local-var + remove lastSerializedMessageIndex var

(cherry picked from commit bf9a9019)

(cherry picked from commit b466b085)

* [pulsar-perf] record message failure and avoid exiting from process on publish failure

* add flag to exit on publish failure (default: disable and continue)

(cherry picked from commit c59a37b2)

*Motivation*

Allow spinning up multiple threads for running the perf-producer.

*Modifications*

- Introduce a new option for configuring multiple threads
- Each thread has one separate pulsar client

(cherry picked from commit 0b1e3b37)

Add support for partitioned topic consumer seek by time.

Call each partition consumer seekAsync() while call partitioned consumer seekAsync()

Update unit tests for consumer.seek().

(cherry picked from commit a95bea60)

(cherry picked from commit 8a022064)

This reverts commit d49e61e0.

(cherry picked from commit c4035d3d)

* Fix bug that namespace policies does not take effect due to NPE

* Prevent NPE if Dispatcher and DispatchRateLimiter return to null

(cherry picked from commit 84a519fa)

* [pulsar-broker] Fix: race condition : Failed to read-more entries on dispatcher

* clean up non-used method

(cherry picked from commit 13ea25a3)

* Trim messages which less than mark delete position for message redelivery.


(cherry picked from commit b11211f4)

(cherry picked from commit 3a9854e9)

* fix potential deadlock that can occur in addConsumer

* add fix to PersistentDispatcherSingleActiveConsumer

* fixing tests

(cherry picked from commit 590b0684)

Fixes #5360

This adds a small cache of the request body to ensure that it can be
re-sent.

TODO: still needs tested
(cherry picked from commit 978efaf1)

* Set default ensemble size to 2 in service conf, to match broker.conf

* Fixed test

(cherry picked from commit be5a7cf9)

Fixes #5350

### Motivation

When using the `--output-serde-classname` option, `functionClassLoader` is not set correctly.

(cherry picked from commit 18712eb9)

There's a bug in how user metadata is attached to a block that if the
user doesn't specify both the region and the endpoint, offloading will
throw an exception, as you can't add a null value to an immutable
map.

This change elides null to the empty string in these cases, so that
offloading can continue.

(cherry picked from commit 3e70d365)

### Motivation

If cursor is not durable, the subscription is closed and removed from the topic when all consumers are removed. 
https://github.com/apache/pulsar/blob/413ba03050036a620fa346456ef6c3ff6071e9ab/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/persistent/PersistentSubscription.java#L237-L254

As mentioned in #5288, the dispatcher also needs to be closed at this time. Otherwise, `RateLimiter` instances will not be garbage collected, causing a memory leak.

(cherry picked from commit 136048c0)

* fix instability with tumbling window test

* cleaning up

* cleaning up

(cherry picked from commit 094ebf7a)

* Bug in Message Deduplication that may cause incorrect behavior

* add tests

* fix error message

* fix client backoff

* fix tests

* cleaning up

* Fix handling of BK write failures for message dedup

* tests and clean up

* refactoring code

* fixing bugs

* addressing comments

* add missing license header

* Improve error handling of BK write failures

* fixing tests

* fixing bugs

* cleaning up

* addressing comments

* fixing tests

(cherry picked from commit 60abcaa9)