- 09 12月, 2019 4 次提交
-
-
由 Sijie Guo 提交于
-
由 Rajan Dhabalia 提交于
### Motivation As we discussed at #5797, adding broker level relative dispatch-throttling-config.
-
由 Sijie Guo 提交于
-
由 Gil Yehuda 提交于
### Motivation The current docs pointed to yahoo.github.io, which we decommissioned a while ago. I propose pointing this to the new webpage at opensource.yahoo.com.
-
- 08 12月, 2019 5 次提交
-
-
由 Sijie Guo 提交于
* [website] Mitigate "Invalid code tab markdown" issue on translated docs *Motivation* Docusaurus code tabs are removed when crowdin generated the translated docs. It causes website failed to build. See details: #5816 *Modifications* Use the original file for the translated files when building the website. Note: this is a work around. it doesn't address the root cause of #5816. * revert unneeded changes
-
由 Rajan Dhabalia 提交于
### Motivation With [PIP-3](https://github.com/apache/pulsar/wiki/PIP-3:-Message-dispatch-throttling) , Pulsar broker already supports to configure dispatch rate-limiting for a given topic. Dispatch-throttling feature allows user to configure absolute dispatch rate based on current publish-rate for a given topic or subscriber, and broker will make sure to dispatch only configured number of messages to the consumers regardless current publish-rate or backlog on that topic. Current dispatch-rate limiting doesn't consider change in publish-rate so, increasing publish-rate on the topic might be larger than configured dispatch-rate which will cause backlog on the topic and consumers will never be able to catch up the backlog unless user again reconfigured the dispatch-rate based on current publish-rate. Reconfiguring dispatch-rate based on publish-rate requires human interaction and monitoring. Therefore, we need a mechanism to configure dispatch rate relative to the current publish-rate on the topic. ### Modification `set-dispatch-rate` cli have a flag `--relative-to-publish-rate` to enable relative dispatch throttling. ``` pulsar-admin namespaces <property/cluster/namespace> set-dispatch-rate --msg-dispatch-rate 1000 --relative-to-publish-rate ``` ### Note: I will add broker-level configuration and documentation into separate PR.
-
由 冉小龙 提交于
Signed-off-by: Nxiaolong.ran <rxl@apache.org> ### Modifications - Add [pulsar-manager](https://github.com/apache/pulsar-manager) to helm chart - Replace pulsar-dashboard with pulsar-manager - Currently, we can deprecate pulsar-dashboard, In later versions, we can use `pulsar-manager` replace `pulsar-dashboard`.
-
由 Fernando Rejon Barrera 提交于
Fixes #5811 ### Modifications Added redelivery count method to message class ### Verifying this change This change added tests and can be verified as follows: - Added python test for redelivery count
-
由 lipenghui 提交于
-
- 07 12月, 2019 5 次提交
-
-
由 lipenghui 提交于
-
由 Yijie Shen 提交于
[pulsar-java-client] Decouple partition switch frequency with maxPublishDelay in producer configuration (#5788)
-
由 lipenghui 提交于
Fixes #5760 ### Motivation We use `org.HdrHistogram.Recorder` to record write latency and `highestTrackableValue` is `TimeUnit.SECONDS.toMicros(120000)`, but we record the value in micros, the error happens when the latency in micros is a very large number, so this PR change the `highestTrackableValue` of Recorder to `TimeUnit.SECONDS.toMicros(120000)`
-
由 冉小龙 提交于
* [release][website] Add release notes for Release 2.4.2 Signed-off-by: Nxiaolong.ran <rxl@apache.org> * add links for pull requests Signed-off-by: Nxiaolong.ran <rxl@apache.org> * fix comments Signed-off-by: Nxiaolong.ran <rxl@apache.org> * fix comments Signed-off-by: Nxiaolong.ran <rxl@apache.org>
-
由 congbo 提交于
Modify the logical in producer carry a schema to connect broker with isAllowAutoUpdateSchema. (#5782) ### Motivation Now, the logical is if isAllowAutoUpdateSchema = false, producer can't connect broker. So modify the logical, when isAllowAutoUpdateSchema = false, the first to check the schema whether is registered. ### Verifying this change Add the tests for it
-
- 06 12月, 2019 5 次提交
-
-
由 冉小龙 提交于
Signed-off-by: Nxiaolong.ran <rxl@apache.org>
-
由 冉小龙 提交于
* Update website for 2.4.2 release Signed-off-by: Nxiaolong.ran <rxl@apache.org> * update website docs for release 2.4.2 Signed-off-by: Nxiaolong.ran <rxl@apache.org>
-
由 ntysdd 提交于
### Motivation fix potential NPE and repeated conditional test ### Modifications local changes
-
由 冉小龙 提交于
Signed-off-by: Nxiaolong.ran <rxl@apache.org> Fixes #5687 ### Motivation When the user wants to add new keys for Env, adding fails if no prefix is added. Currently, add new keys for Env use the script of [apply-config-from-env.py](https://github.com/apache/pulsar/commits/master/docker/pulsar/scripts/apply-config-from-env.py), to ensure that the env set by the user can take effect, add the prefix(**PULSAR_PREFIX_**) for all keys. ### Modifications - Add prefix for new keys from Env
-
由 冉小龙 提交于
Signed-off-by: Nxiaolong.ran <rxl@apache.org> Signed-off-by: Nxiaolong.ran <rxl@apache.org> Fixes #5787 ### Motivation When we creating a K8S cluster on Minikube, due to the different versions of Minikube in the local environment, the installation fails on `--kubernetes-version=v1.10.5`. ### Modifications - Remove the `--kubernetes-version=v1.10.5` in docs.
-
- 04 12月, 2019 4 次提交
-
-
由 congbo 提交于
Fixes #5562 Update the schema compatibility check documentation to follow the latest changes from #5227
-
由 Masahiro Sakamoto 提交于
Updated jackson libraries to the latest version. There is a security vulnerability in `jackson-databind` currently used by Pulsar. https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-17531
-
由 congbo 提交于
### Motivation Modify the logical for getting schema compatibility strategy, if schemaCompatibilityStrategy = SchemaCompatibilityStrategy.UNDEFINED return the SchemaAutoUpdateCompatibilityStrategy. ### Verifying this change Add the tests for it
-
由 Sunkwan Kwon 提交于
StrEntry variable should be cleared after finish addLogTopicHandler() function regardless the log messages are appended to logger or not. If it is not cleared, it causes memory leak because StrEntry has grown indefinitely. Moreover, if the function set --log-topic, then the topic could get accumulated huge messages that cause ProducerQueueIsFull error.
-
- 03 12月, 2019 2 次提交
-
-
由 belinda-wong 提交于
* Update security-authorization.md Fix the link issue #34 see ["Enabling TLS Authentication on Proxies"](security-tls-authentication.md#on-proxies) * Fixes #5753 Fixes the link for "Enabling TLS Authentication on Proxies". * Update security-authorization.md
-
由 冉小龙 提交于
* [Issue 5597][pulsar-client-java]retry when getPartitionedTopicMetadata failed Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> * remove unuse code Signed-off-by: Nxiaolong.ran <ranxiaolong716@gmail.com> * fix ci error
-
- 02 12月, 2019 5 次提交
-
-
由 congbo 提交于
-
由 Sunkwan Kwon 提交于
If `killAfterIdleMs` is 0, time.After() function call makes memory leak. Refer to https://golang.org/pkg/time/#After. According to the document, the underlying Timer object is not recovered by the garbage collector if the timer is not fired. And It seems that if the duration is 0, it will not be released. Therefore, use one Timer object for idle time checking explicitly instead of the time.After() function.
-
由 Reugn 提交于
-
由 Masahiro Sakamoto 提交于
-
由 belinda-wong 提交于
* Fixes the dead link changed to: see ["Enabling TLS Authentication on Proxies"](security-tls-authentication.md#enable-tls-authentication-on-proxies)
-
- 30 11月, 2019 3 次提交
-
-
由 tuteng 提交于
-
由 Pierre Zemb 提交于
Fixes #5772 ### Motivation I would like to be able to build Pulsar with at least JDK12. ### Modifications Bumping lombok dep. ### Verifying this change This change is a trivial rework / code cleanup without any test coverage.
-
由 Sijie Guo 提交于
*Motivation* Add a tool to collect load report on a specific broker. This is used for troubleshooting problems in a production cluster. *Modifications* Add a broker tool for operations of a specific broker.
-
- 29 11月, 2019 6 次提交
-
-
由 tuteng 提交于
### Motivation As a sub-project of the pulsar, pulsar-manager should update relevant content on the website after the first release is completed, so as to facilitate users' use. ### Modifications * Add pulsar-manager release notes page * Add pulsar-manager download page * Add a document in sidebar ### Verifying this change yarn build pass
-
由 lipenghui 提交于
*Motivation* ManagedLedgerFactoryChangeLedgerPathTest sets the zk session timeout to 10 ms. 10ms is too low for a zookeeper client to connect to the zookeeper server. *Modifications* Remove zkSessionTimeout and use the default
-
由 Sijie Guo 提交于
*Motivation* ManagedLedgerFactoryChangeLedgerPathTest sets the zk session timeout to 10 ms. 10ms is too low for a zookeeper client to connect to the zookeeper server. *Modifications* Remove zkSessionTimeout and use the default
-
由 lipenghui 提交于
Fix NPE when send a large message and don't release batchedMessageMetadataAndPayload when discard in batch message container. (#5748) Fixes #5746 #5747 ### Motivation Fix NPE and release an already released ByteBuf when publish an oversize message. Here is error log: ``` io.netty.util.IllegalReferenceCountException: refCnt: 0, decrement: 1 at io.netty.util.internal.ReferenceCountUpdater.toLiveRealRefCnt(ReferenceCountUpdater.java:74) ~[netty-common-4.1.43.Final.jar:4.1.43.Final] at io.netty.util.internal.ReferenceCountUpdater.release(ReferenceCountUpdater.java:138) ~[netty-common-4.1.43.Final.jar:4.1.43.Final] at io.netty.buffer.AbstractReferenceCountedByteBuf.release(AbstractReferenceCountedByteBuf.java:100) ~[netty-buffer-4.1.43.Final.jar:4.1.43.Final] at io.netty.util.ReferenceCountUtil.release(ReferenceCountUtil.java:88) ~[netty-common-4.1.43.Final.jar:4.1.43.Final] at io.netty.util.ReferenceCountUtil.safeRelease(ReferenceCountUtil.java:113) [netty-common-4.1.43.Final.jar:4.1.43.Final] at org.apache.pulsar.client.impl.BatchMessageKeyBasedContainer$KeyedBatch.discard(BatchMessageKeyBasedContainer.java:244) [classes/:?] at org.apache.pulsar.client.impl.BatchMessageKeyBasedContainer.createOpSendMsg(BatchMessageKeyBasedContainer.java:125) [classes/:?] at org.apache.pulsar.client.impl.BatchMessageKeyBasedContainer.createOpSendMsgs(BatchMessageKeyBasedContainer.java:145) [classes/:?] at org.apache.pulsar.client.impl.ProducerImpl.batchMessageAndSend(ProducerImpl.java:1426) [classes/:?] at org.apache.pulsar.client.impl.ProducerImpl.triggerFlush(ProducerImpl.java:1411) [classes/:?] at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:112) [classes/:?] at org.apache.pulsar.client.impl.TypedMessageBuilderImpl.send(TypedMessageBuilderImpl.java:89) [classes/:?] at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:63) [classes/:?] at org.apache.pulsar.broker.service.BatchMessageTest.testSendOverSizeMessage(BatchMessageTest.java:875) [test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_201] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201] at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124) [testng-6.14.3.jar:?] at org.testng.internal.Invoker.invokeMethod(Invoker.java:583) [testng-6.14.3.jar:?] at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719) [testng-6.14.3.jar:?] at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989) [testng-6.14.3.jar:?] at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125) [testng-6.14.3.jar:?] at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109) [testng-6.14.3.jar:?] at org.testng.TestRunner.privateRun(TestRunner.java:648) [testng-6.14.3.jar:?] at org.testng.TestRunner.run(TestRunner.java:505) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.runTest(SuiteRunner.java:455) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.run(SuiteRunner.java:364) [testng-6.14.3.jar:?] at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.14.3.jar:?] at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84) [testng-6.14.3.jar:?] at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208) [testng-6.14.3.jar:?] at org.testng.TestNG.runSuitesLocally(TestNG.java:1137) [testng-6.14.3.jar:?] at org.testng.TestNG.runSuites(TestNG.java:1049) [testng-6.14.3.jar:?] at org.testng.TestNG.run(TestNG.java:1017) [testng-6.14.3.jar:?] at org.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:73) [testng-plugin.jar:?] at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:123) [testng-plugin.jar:?] 16:19:13.850 [main:org.apache.pulsar.client.impl.ProducerImpl@1439] WARN org.apache.pulsar.client.impl.ProducerImpl - [persistent://prop/ns-abc/testSendOverSizeMessage-623833fc-d9f7-4b28-aead-27955928fae9] [test-0-0] error while create opSendMsg by batch message container java.lang.NullPointerException: null at org.apache.pulsar.client.impl.ProducerImpl.releaseSemaphoreForSendOp(ProducerImpl.java:858) ~[classes/:?] at org.apache.pulsar.client.impl.ProducerImpl.processOpSendMsg(ProducerImpl.java:1477) ~[classes/:?] at org.apache.pulsar.client.impl.ProducerImpl.batchMessageAndSend(ProducerImpl.java:1432) [classes/:?] at org.apache.pulsar.client.impl.ProducerImpl.triggerFlush(ProducerImpl.java:1411) [classes/:?] at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:112) [classes/:?] at org.apache.pulsar.client.impl.TypedMessageBuilderImpl.send(TypedMessageBuilderImpl.java:89) [classes/:?] at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:63) [classes/:?] at org.apache.pulsar.broker.service.BatchMessageTest.testSendOverSizeMessage(BatchMessageTest.java:875) [test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_201] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201] at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124) [testng-6.14.3.jar:?] at org.testng.internal.Invoker.invokeMethod(Invoker.java:583) [testng-6.14.3.jar:?] at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719) [testng-6.14.3.jar:?] at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989) [testng-6.14.3.jar:?] at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125) [testng-6.14.3.jar:?] at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109) [testng-6.14.3.jar:?] at org.testng.TestRunner.privateRun(TestRunner.java:648) [testng-6.14.3.jar:?] at org.testng.TestRunner.run(TestRunner.java:505) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.runTest(SuiteRunner.java:455) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415) [testng-6.14.3.jar:?] at org.testng.SuiteRunner.run(SuiteRunner.java:364) [testng-6.14.3.jar:?] at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.14.3.jar:?] at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84) [testng-6.14.3.jar:?] at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208) [testng-6.14.3.jar:?] at org.testng.TestNG.runSuitesLocally(TestNG.java:1137) [testng-6.14.3.jar:?] at org.testng.TestNG.runSuites(TestNG.java:1049) [testng-6.14.3.jar:?] at org.testng.TestNG.run(TestNG.java:1017) [testng-6.14.3.jar:?] at org.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:73) [testng-plugin.jar:?] at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:123) [testng-plugin.jar:?] ``` ### Modifications Add check for processOpSendMsg, if the op is null, just return. Don't release the batchedMessageMetadataAndPayload since it is already released in getCompressedBatchMetadataAndPayload() method.
-
由 lipenghui 提交于
### Motivation Remove cursor from cursors of managed ledger while remove non-durable subscription. The data deletion is depends the mark delete position of all cursors, if left a unused cursor in the cursors of managed ledger, data can't be delete as expected. ### Modifications Remove cursor while remove non-durable subscription
-
由 Yong Zhang 提交于
Fixes #3009 *Motivation* There are no REST APIs usage docs for the presto SQL.
-
- 28 11月, 2019 1 次提交
-
-
由 lsy180829 提交于
* Fix Issue 5614, Deprecate brokerServicePurgeInactiveFrequencyInSeconds * [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds
-