1. 08 9月, 2020 3 次提交
    • F
      [DOCS] Small improvements and clarifications around AuthN / AuthZ (#7976) · 18a54c41
      Frank J Kelly 提交于
      * Small documentation improvements and clarifications around AuthN / AuthZ
      
      * PR feedback and added some clarifications
      18a54c41
    • H
      Remove stateful functions note (#7956) · 37a1d87e
      HuanliMeng 提交于
      Motivation
      The state is not production-ready.
      
      Modifications
      Remove the note about stateful function from the Deploy a cluster on bare metal document.
      
      updated docs for releases: master ~ 2.1.0
      37a1d87e
    • M
      Report compacted topic ledger info when calling get internal stats. (#7988) · 97ba09e6
      Marvin Cai 提交于
      Fixes #7895
      
      ### Motivation
      For get-internal-stats of persistent topic admin cli: https://pulsar.apache.org/docs/en/2.6.0/admin-api-persistent-topics/#get-internal-stats, we can also return the compacted topic ledger id if compaction is enabled. So we'll able to read from ledger without creating additional subscription, it can benefit like querying compacted topic from Pulsar SQL.
      
      ### Modifications
      Expose CompactedTopicContext from CompactedTopicImpl, try to get ledger information of compacted topic ledger if exist in PersistentTopic.
      
      ### Verifying this change
      
      This change added tests and can be verified as follows:
      - Added unit test to verify correct compacted ledger info is returned after compaction.
      
      
      * Report compacted topic ledger info when calling get internal stats.
      
      * Update documentation to add information about returning compacted topic ledger when get-internal-stats.
      97ba09e6
  2. 07 9月, 2020 1 次提交
    • M
      Add bookkeeperClientMinNumRacksPerWriteQuorum,... · 7b5301d9
      Michal Koziorowski 提交于
      Add bookkeeperClientMinNumRacksPerWriteQuorum, bookkeeperClientEnforceMinNumRacksPerWriteQuorum conf options (#7977)
      
      Added bookkeeperClientMinNumRacksPerWriteQuorum and bookkeeperClientEnforceMinNumRacksPerWriteQuorum to be able to configure rack and region aware bookie selection policy more precisely.
      
      Motivation
      We have Apache Pulsar setup running on Azure in 3 different Availability Zones (2 bookkeepers per zone). We wanted to store copy of each pulsar message in all that AZs. After configuring rack aware bookie selection policy, we found that messages are usually stored only in 2 AZs. After digging, we've found that it's caused by default bookeeper client minNumRacksPerWriteQuorum=2 setting. We've added bookkeeperClientMinNumRacksPerWriteQuorum and also bookkeeperClientEnforceMinNumRacksPerWriteQuorum to be able to configure this behaviour.
      
      Modifications
      Added bookkeeperClientMinNumRacksPerWriteQuorum and bookkeeperClientEnforceMinNumRacksPerWriteQuorum configuration option, modified tests, config files and documentation.
      
      Verifying this change
      We've updated existing unit tests, deployed modified pulsar docker image on AKS kubernetes cluster using helm charts and checked that stored messages were written always to bookkeepers in all AZs.
      
      
      * Added `bookkeeperClientMinNumRacksPerWriteQuorum` and `bookkeeperClientEnforceMinNumRacksPerWriteQuorum` broker configuration options to be able set `minNumRacksPerWriteQuorum` and `enforceMinNumRacksPerWriteQuorum` bookkeeper client options.
      
      * Reverted accidental change in ServiceConfigurationTest.
      Co-authored-by: NMichal Koziorowski <Michal.Koziorowski@tomtom.com>
      7b5301d9
  3. 04 9月, 2020 1 次提交
  4. 03 9月, 2020 3 次提交
  5. 02 9月, 2020 5 次提交
  6. 01 9月, 2020 1 次提交
    • H
      [Doc]--Update BookKeeper config (#7834) · 9994d6dc
      HuanliMeng 提交于
      Fixes #7481
      
      Motivation
      Default bookkeeper conf that ships with apache pulsar indicates that the unit of openLedgerRereplicationGracePeriod is in seconds, but official bookkeeper doc(and code) mentions that the unit is in milliseconds.
      
      Pulsar should configure default as 30000 instead of 30 and bookkeeper.conf should mention that the unit of this period is milliseconds instead of seconds.
      
      Modifications
      Update the bookkeep.config file
      Update the following Pulsar docs for releases 2.5.2, 2.6.0, 2.6.1, and master
      Reference > Pulsar Config > BookKeeper
      9994d6dc
  7. 29 8月, 2020 2 次提交
  8. 28 8月, 2020 2 次提交
  9. 26 8月, 2020 1 次提交
  10. 24 8月, 2020 2 次提交
  11. 21 8月, 2020 3 次提交
  12. 19 8月, 2020 2 次提交
    • Update release.json and versions.json (#7847) · 6cae4afa
      冉小龙 提交于
      Signed-off-by: Nxiaolong.ran <rxl@apache.org>
      
      ### Motivation
      
      Currently, when the official website 2.6.1 document is released, we should first let 2.6.0 continue as the default version, wait for version 2.6.1 to appear in the historical version, and then try to use version 2.6.1 as the default version. If we directly publish the 2.6.1 version of the document, the search function will be unavailable.
      
      ### Modifications
      
      - Update versions.json
      6cae4afa
    • Add 2.6.2 docs (#7835) · 04afe234
      冉小龙 提交于
      Signed-off-by: Nxiaolong.ran <rxl@apache.org>
      
      ### Motivation
      
      Currently, the 2.6.2 docs are a complete copy based on 2.6.1. In the next pull request, if there is a fix for the 2.6.2 document, we can modify it based on the current 2.6.2, so A release manager can directly reuse the contents of the 2.6.2 document when releasing 2.6.2
      
      
      ### Modifications
      
      - Add docs of 2.6.2
      - Add sidebars of 2.6.2
      04afe234
  13. 18 8月, 2020 1 次提交
  14. 14 8月, 2020 2 次提交
  15. 13 8月, 2020 3 次提交
  16. 12 8月, 2020 1 次提交
    • Y
      [pulsar-io-hdfs2] Add config to create subdirectory from current time (#7771) · 569b8f9f
      Yunze Xu 提交于
      ### Motivation
      
      Adding a subdirectory associated with current time willmake it easier to process HDFS files in batch.
      
      For example, user can create multiple running sink instances with `yyyy-MM-dd-hh` pattern. Then stop all instances at next hour. Eventually, files of the subdirectory will contain all messages consumed during this hour.
      
      ### Modifications
      
      - Add a `subdirectoryPattern` field to `HdfsSinkConfig`
      - Update some simple tests for `HdfsSinkConfig`
      - Update the doc of HDFS2 sink
      
      ### Documentation
      
        - Does this pull request introduce a new feature? (yes)
        - If yes, how is the feature documented? (docs)
      569b8f9f
  17. 11 8月, 2020 1 次提交
  18. 10 8月, 2020 2 次提交
  19. 07 8月, 2020 1 次提交
    • K
      update aws deployment for 2.6.0 (#7668) · 3e13b9b3
      Kristi 提交于
      ### Motivation
      I tried to follow the Aws deployment guide at https://pulsar.apache.org/docs/en/deploy-aws/ but found it was pretty outdated - It was trying to install pulsar 2.1.0-incubating. This PR updates it to install 2.6.0.
      
      ### Modifications
      
      * Updated the pulsar version to 2.6.0
        * Fixed download location for 2.6.0
        * Updated config files for 2.6.0
        * Fixed connector installation for 2.6.0
        * Fixed Ansible's yum warning about installing multiple packages
      3e13b9b3
  20. 06 8月, 2020 1 次提交
    • H
      [Doc] Add a note about sink-type and source-type value of the built-in connector. (#7699) · 894e0789
      HuanliMeng 提交于
      Fixes #6109
      
      ### Motivation
      Tell user the available values of "--sink-type" "--source-type" parameter of the Cassandra built-in connector.
      
      ### Modifications
      Update the following docs:
      
      - Pulsar IO > get started
      - Connector Admin CLI
      
      Currently, only docs in master is updated. After the PR is approved, versioned docs will be updated also. So, do not immediately merge the PR when it is approved.
      894e0789
  21. 05 8月, 2020 2 次提交