1. 09 12月, 2019 4 次提交
  2. 08 12月, 2019 5 次提交
    • S
      [website] Mitigate "Invalid code tab markdown" issue on translated docs (#5817) · 5d5f58fb
      Sijie Guo 提交于
      * [website] Mitigate "Invalid code tab markdown" issue on translated docs
      
      *Motivation*
      
      Docusaurus code tabs are removed when crowdin generated the translated docs.
      It causes website failed to build.
      
      See details: #5816
      
      *Modifications*
      
      Use the original file for the translated files when building the website.
      
      Note: this is a work around. it doesn't address the root cause of #5816.
      
      * revert unneeded changes
      5d5f58fb
    • R
      PIP-52: [pulsar-sever] Add support of dispatch throttling relative to publish-rate (#5797) · 02bf9a0b
      Rajan Dhabalia 提交于
      ### Motivation
      With [PIP-3](https://github.com/apache/pulsar/wiki/PIP-3:-Message-dispatch-throttling) , Pulsar broker already supports to configure dispatch rate-limiting for a given topic. Dispatch-throttling feature allows user to configure absolute dispatch rate based on current publish-rate for a given topic or subscriber, and broker will make sure to dispatch only configured number of messages to the consumers regardless current publish-rate or backlog on that topic.
      
      Current dispatch-rate limiting doesn't consider change in publish-rate so, increasing publish-rate on the topic might be larger than configured dispatch-rate which will cause backlog on the topic and consumers will never be able to catch up the backlog unless user again reconfigured the dispatch-rate based on current publish-rate. Reconfiguring dispatch-rate based on publish-rate requires human interaction and monitoring. Therefore, we need a mechanism to configure dispatch rate relative to the current publish-rate on the topic.
      
      ### Modification
      `set-dispatch-rate` cli have a flag `--relative-to-publish-rate` to enable relative dispatch throttling.
      
      ```
      pulsar-admin namespaces <property/cluster/namespace> set-dispatch-rate --msg-dispatch-rate 1000 --relative-to-publish-rate
      ```
      
      ### Note:
      I will add broker-level configuration and documentation into separate PR.
      02bf9a0b
    • Add pulsar-manager to helm chart (#5810) · 5b1ad001
      冉小龙 提交于
      Signed-off-by: Nxiaolong.ran <rxl@apache.org>
      
      ### Modifications
      
      - Add [pulsar-manager](https://github.com/apache/pulsar-manager) to helm chart
      - Replace pulsar-dashboard with pulsar-manager
        - Currently, we can deprecate pulsar-dashboard, In later versions, we can use `pulsar-manager` replace `pulsar-dashboard`.
      5b1ad001
    • F
      [Issue 5811][pulsar-client-python]Expose redelivery count of message in python client (#5812) · e8db9919
      Fernando Rejon Barrera 提交于
      Fixes #5811 
      
      ### Modifications
      
      Added redelivery count method to message class
      
      ### Verifying this change
      
      This change added tests and can be verified as follows:
        - Added python test for redelivery count
      e8db9919
    • L
      Add Yu to team list. (#5796) · 90944f1b
      lipenghui 提交于
      90944f1b
  3. 07 12月, 2019 5 次提交
  4. 06 12月, 2019 5 次提交
  5. 04 12月, 2019 4 次提交
  6. 03 12月, 2019 2 次提交
  7. 02 12月, 2019 5 次提交
  8. 30 11月, 2019 3 次提交
  9. 29 11月, 2019 6 次提交
    • T
      [website]Add content of pulsar-manager in website(include release notes, download link) (#5741) · e4fc6098
      tuteng 提交于
      ### Motivation
      
      As a sub-project of the pulsar, pulsar-manager should update relevant content on the website after the first release is completed, so as to facilitate users' use.
      
      ### Modifications
      
      * Add pulsar-manager release notes page
      * Add pulsar-manager download page
      * Add a document in sidebar
      
      ### Verifying this change
      
      yarn build pass
      e4fc6098
    • L
      Add document for sticky consumer (#5745) · d9c2b8b6
      lipenghui 提交于
      *Motivation*
      
      ManagedLedgerFactoryChangeLedgerPathTest sets the zk session timeout to 10 ms.
      
      10ms is too low for a zookeeper client to connect to the zookeeper server.
      
      *Modifications*
      
      Remove zkSessionTimeout and use the default
      d9c2b8b6
    • S
      [tests] ManagedLedgerFactoryChangeLedgerPathTest is flaky (#5766) · ae59d558
      Sijie Guo 提交于
      *Motivation*
      
      ManagedLedgerFactoryChangeLedgerPathTest sets the zk session timeout to 10 ms.
      
      10ms is too low for a zookeeper client to connect to the zookeeper server.
      
      *Modifications*
      
      Remove zkSessionTimeout and use the default
      ae59d558
    • L
      Fix NPE when send a large message and don't release... · ecf77921
      lipenghui 提交于
      Fix NPE when send a large message and don't release batchedMessageMetadataAndPayload when discard in batch message container. (#5748)
      
      Fixes #5746 #5747
      
      ### Motivation
      
      Fix NPE and release an already released ByteBuf when publish an oversize message.
      
      Here is error log:
      ```
      io.netty.util.IllegalReferenceCountException: refCnt: 0, decrement: 1
      	at io.netty.util.internal.ReferenceCountUpdater.toLiveRealRefCnt(ReferenceCountUpdater.java:74) ~[netty-common-4.1.43.Final.jar:4.1.43.Final]
      	at io.netty.util.internal.ReferenceCountUpdater.release(ReferenceCountUpdater.java:138) ~[netty-common-4.1.43.Final.jar:4.1.43.Final]
      	at io.netty.buffer.AbstractReferenceCountedByteBuf.release(AbstractReferenceCountedByteBuf.java:100) ~[netty-buffer-4.1.43.Final.jar:4.1.43.Final]
      	at io.netty.util.ReferenceCountUtil.release(ReferenceCountUtil.java:88) ~[netty-common-4.1.43.Final.jar:4.1.43.Final]
      	at io.netty.util.ReferenceCountUtil.safeRelease(ReferenceCountUtil.java:113) [netty-common-4.1.43.Final.jar:4.1.43.Final]
      	at org.apache.pulsar.client.impl.BatchMessageKeyBasedContainer$KeyedBatch.discard(BatchMessageKeyBasedContainer.java:244) [classes/:?]
      	at org.apache.pulsar.client.impl.BatchMessageKeyBasedContainer.createOpSendMsg(BatchMessageKeyBasedContainer.java:125) [classes/:?]
      	at org.apache.pulsar.client.impl.BatchMessageKeyBasedContainer.createOpSendMsgs(BatchMessageKeyBasedContainer.java:145) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerImpl.batchMessageAndSend(ProducerImpl.java:1426) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerImpl.triggerFlush(ProducerImpl.java:1411) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:112) [classes/:?]
      	at org.apache.pulsar.client.impl.TypedMessageBuilderImpl.send(TypedMessageBuilderImpl.java:89) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:63) [classes/:?]
      	at org.apache.pulsar.broker.service.BatchMessageTest.testSendOverSizeMessage(BatchMessageTest.java:875) [test-classes/:?]
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_201]
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_201]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_201]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201]
      	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124) [testng-6.14.3.jar:?]
      	at org.testng.internal.Invoker.invokeMethod(Invoker.java:583) [testng-6.14.3.jar:?]
      	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719) [testng-6.14.3.jar:?]
      	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989) [testng-6.14.3.jar:?]
      	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125) [testng-6.14.3.jar:?]
      	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109) [testng-6.14.3.jar:?]
      	at org.testng.TestRunner.privateRun(TestRunner.java:648) [testng-6.14.3.jar:?]
      	at org.testng.TestRunner.run(TestRunner.java:505) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.runTest(SuiteRunner.java:455) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.run(SuiteRunner.java:364) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.runSuitesLocally(TestNG.java:1137) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.runSuites(TestNG.java:1049) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.run(TestNG.java:1017) [testng-6.14.3.jar:?]
      	at org.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:73) [testng-plugin.jar:?]
      	at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:123) [testng-plugin.jar:?]
      
      
      
      16:19:13.850 [main:org.apache.pulsar.client.impl.ProducerImpl@1439] WARN  org.apache.pulsar.client.impl.ProducerImpl - [persistent://prop/ns-abc/testSendOverSizeMessage-623833fc-d9f7-4b28-aead-27955928fae9] [test-0-0] error while create opSendMsg by batch message container
      java.lang.NullPointerException: null
      	at org.apache.pulsar.client.impl.ProducerImpl.releaseSemaphoreForSendOp(ProducerImpl.java:858) ~[classes/:?]
      	at org.apache.pulsar.client.impl.ProducerImpl.processOpSendMsg(ProducerImpl.java:1477) ~[classes/:?]
      	at org.apache.pulsar.client.impl.ProducerImpl.batchMessageAndSend(ProducerImpl.java:1432) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerImpl.triggerFlush(ProducerImpl.java:1411) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:112) [classes/:?]
      	at org.apache.pulsar.client.impl.TypedMessageBuilderImpl.send(TypedMessageBuilderImpl.java:89) [classes/:?]
      	at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:63) [classes/:?]
      	at org.apache.pulsar.broker.service.BatchMessageTest.testSendOverSizeMessage(BatchMessageTest.java:875) [test-classes/:?]
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_201]
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_201]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_201]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201]
      	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124) [testng-6.14.3.jar:?]
      	at org.testng.internal.Invoker.invokeMethod(Invoker.java:583) [testng-6.14.3.jar:?]
      	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719) [testng-6.14.3.jar:?]
      	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989) [testng-6.14.3.jar:?]
      	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125) [testng-6.14.3.jar:?]
      	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109) [testng-6.14.3.jar:?]
      	at org.testng.TestRunner.privateRun(TestRunner.java:648) [testng-6.14.3.jar:?]
      	at org.testng.TestRunner.run(TestRunner.java:505) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.runTest(SuiteRunner.java:455) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunner.run(SuiteRunner.java:364) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.14.3.jar:?]
      	at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.runSuitesLocally(TestNG.java:1137) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.runSuites(TestNG.java:1049) [testng-6.14.3.jar:?]
      	at org.testng.TestNG.run(TestNG.java:1017) [testng-6.14.3.jar:?]
      	at org.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:73) [testng-plugin.jar:?]
      	at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:123) [testng-plugin.jar:?]
      ```
      
      ### Modifications
      
      Add check for processOpSendMsg, if the op is null, just return.
      Don't release the batchedMessageMetadataAndPayload since it is already released in getCompressedBatchMetadataAndPayload() method.
      ecf77921
    • L
      Remove cursor while remove non-durable subscription (#5719) · 2e30c086
      lipenghui 提交于
      ### Motivation
      
      Remove cursor from cursors of managed ledger while remove non-durable subscription.  The data deletion is depends the mark delete position of all cursors, if left a unused cursor in the cursors of managed ledger, data can't be delete as expected.
      
      ### Modifications
      
      Remove cursor while remove non-durable subscription
      2e30c086
    • Y
      [Issue 3009][docs] Add presto sql REST APIs doc (#5376) · b23c7320
      Yong Zhang 提交于
      Fixes #3009
      
      *Motivation*
      
      There are no REST APIs usage docs for the presto SQL.
      b23c7320
  10. 28 11月, 2019 1 次提交