I have setup a periodic task in openlab env for gpdb.
It runs installcheck-world per UTC12:00 every day.

We can check the status with link

https://status.openlabtesting.org/builds/builds?project=greenplum-db%2Fgpdb&job_name=gpdb-installcheck-world-tests-on-arm64

And get the necessary log in each build.
Also that build definition could be changed anytime. You guys can tell me
the changes you want. Thanks

Previously, we used "DEBUG" (in all caps) in our CI/scripts, which isn't
canonical (https://cmake.org/cmake/help/v3.0/variable/CMAKE_BUILD_TYPE.html).
Authored-by: NChris Hajas <chajas@pivotal.io>

Remove the gpperfmon since we have the alternative metrics collector.

1, remove all gpperfmon codes, including gpmon, gpsmon, gpmmon,
gpperfmon and alert_log.
2, remove all gpperfmon GUCs, `gp_enable_gpperfmon`, `gp_perfmon_segment_interval`,
`gp_perfmon_print_packet_info`, `gpperfmon_port` and `gpperfmon_log_alert_level`.
3, remove the `perfmon` and `stats sender` processes/bgworkers.
4, remove the `apu` and `libsigar` dependencies.

Previously, three different environment variables were required to
modify ports to be used by demo cluster. I think that's unnecessary
and such flexibility comes at greater cost for developers, instead
better to have only one environment variable to help provide the
flexibility. Hence, removing MASTER_PORT and STANDBY_PORT
variables. Now, only PORT_BASE is used. This becomes the starting port
number and master port number. All other required port numbers for
demo cluster are sequential to it, including standby port, followed by
primaries and mirrors.

Also, very often need to create demo cluster across different GPDB
versions. So, would be helpful to have PORT_BASE default set to not
conflict across different GPDB versions. Hence, using 7000 as this is
GPDB7 branch. For GPDB6 we can have it start at 6000 and GPDB5 at
5000. I think that makes it easy to remember as well and shorter to
type as well compared to 5 digits previously used :-)
Signed-off-by: NAshwin Agrawal <aagrawal@pivotal.io>

Fix remnant PXF paths that were pointing to the old repository path.

gpAux/extensions/pxf -> gpcontrib/pxf

ORCA Explain plans will now contain:
`Optimizer: Pivotal Optimizer (GPORCA) version 3.35.0`

instead of:
`Optimizer: PQO version 3.35.0`

Authored-by: Chris Hajas chajas@pivotal.io

As we merge with upstream and by that keep refining the Postgres
planner, legacy planner is no longer a suitable name. This changes
all variations of the spelling (legacy planner, legacy optimizer,
legacy query optimizer etc) to say "Postgres" rather than "legacy".
Reviewed-by: NVenkatesh Raghavan <vraghavan@pivotal.io>
Reviewed-by: NDavid Yozie <dyozie@pivotal.io>
Reviewed-by: NGeorgios Kokolatos <gkokolatos@pivotal.io>

We do welcome draft PRs, especially now that Github has enabled it
as a feature when creating PRs. Add a note on this in the main README
and also fix the text regarding which branch to PR against, as we now
have a supported back-branch.

Also fix a long line in the same section to make reading of the source
markdown easier.
Reviewed-by: NAdam Berlin <aberlin@pivotal.io>
Reviewed-by: NGeorgios Kokolatos <gkokolatos@pivotal.io>

This polishes the wording in the README a bit where it seemed either
convoluted or strange to me. On top of wording it updates the directory
structure to reference gpcontrib, and removes mention of TINC with the
rationale that anyone reading this file is a new contributor and there
is little value in bringing up a framework which is its deathbed. It
also fixes the links to the website to actually work, since they site
redesign broke the old links without redirects. The ORCA naming is
discussed with all mentions changed to GPORCA, since that's the name
used in the documentation.
Reviewed-by: NHeikki Linnakangas <hlinnakangas@pivotal.io>
Discussion: https://github.com/greenplum-db/gpdb/pull/6648

This Greenplum logo png is used in the top level README of the
repository. Instead of having the image live a few layers deep in the
gpAux/releng directory (which we will eventually be removing), have the
image be placed in close proximity to the README.md itself.
Authored-by: NKris Macoskey <kmacoskey@pivotal.io>

This moves the HyperLogLog license from THIRDPARTY into the correct
NOTICE file and lso fixes a few related typos and minor differences
with upstream license files.

Reviewed-by: Heikki Linnakangas

Commit 17f9b7f070dbe17b2844a8b4dd428 in the pgweb repository removed
the /static/ portion on all doc URLs, leaving a redirect in place. To
avoid incurring a needless redirect, remove the /static/ part in the
links to the PostgreSQL documentation.

The /static/ URLs stem from a time when there were interactive docs
that had comment functionality. These docs were removed a very long
time ago, but the static differentiator was left in place until now.

Reviewed-by: Mel Kiyama

PXF client in gpdb uses pxf libraries from apache hawq repo. These pxf libraries will continue being developed in a new PXF repo greenplum-db/pxf and is in the process of getting open sourced in the next few days. The PXF extension and gpdb-pxf client code will continue to remain in gpdb repo.

The following changes are included in this PR:

Transition from the old PXF namespace org.apache.hawq.pxf to org.greenplum.pxf
(there is a separate PR in the PXF repo to address the package namespace refactor
greenplum-db/pxf#5)

Doc updates to reflect the new PXF repo and the new package namespace

Follow src/pl/plpython/README.md to see how to build
 and use plpython3u on GPDB.
Co-authored-by: NYandong Yao <yyao@pivotal.io>

* Update readme instructions for using docker for building GPDB

Add a hint to rebuild the shared library cache if the user follows the suggestion to add the
usr/local/lib path to /etc/ld.so.conf file.

[ci skip]

Adding support to create cluster for tinc testing. This also create
gptest database. Here is an example script to run tinc tests:

```
cd ~/workspace/gpdb
source .../greenplum_path.sh
make create-tinc-test-cluster
source gpAux/gpdemo/gpdemo-env.sh
make -C src/test/tinc walrep_2 # to run walrep_2 tinc tests
```

Author: Xin Zhang <xzhang@pivotal.io>
Author: Ashwin Agrawal <aagrawal@pivotal.io>

This patch removes codegen wholesale from Greenplum.

In addition to reverting the commits involving codegen, we also removed
miscellaneous references to the feature and GUC.

The following commits from 5.0.0 were reverted (topologically ordered):

f38c9064 Support avg aggregate function in codegen
87dcae4c Capture and print error messages from llvm::verifyFunction
65137540 libgpcodegen assert() overrides use GPDB Assert()
81d378b4 GenerateExecVariableList calls regular slot_getattr when the code generation of the latter fails
05a28211 Update Google Test source path used by codegen
22a35fcc Call ereport when code generating float operators
79517271 Support overflow checks for doubles.
b5373a1e Fix codegen unittest link problem
7a1a98c9 Print filename and lineno in codegened CreateElog
58eda293 Fix wrong virtual tuple check in codegened slot_getattr
bc6faa08 Set llvm_isNull_ptr to false when the result of codegened expression evaluation is not null
8bbbd63f Enhance codegened advance_aggregates with support for null attributes
e1fd6072 Abort code generation of expression evaluation trees with unsupported ExprState types
509460ee Support null attributes in codegen expression evaluation framework
739d978d Move enrollment of codegened ExecVariableList to ExecInitNode
c05528d1 Fix CHECK_SYMBOL_DEFINED macro in CMakeLists.txt
12cfd7bd Support offset calculation when there is null in the tuple and codegen is enabled
40a2631e Use slot_getattr wrapper function for regular version.(#1194)
613e9fbb Revert "Fix codegen issue by moving slot_getattr to heaptuple.c similar to"
ee03f799 Fix cpplint error on advance aggregate
2a65b0aa Fix slot function nullptr issue in expr eval.
3107fc0e Fix for !(expr1 & expr2) and hasnull logic in slot_getatrr codegen.
c940c7f6 Fix codegen issue by moving slot_getattr to heaptuple.c similar to Postgres.
c8125736 Introduce guc to enable/disable all generator.
a4f39507 Ensure that codegen unittests pass with GCC 6.2.0 (#1177)
682d0b28 Allow overriding assert() functionality in libgpcodegen in DEBUG mode
3209258a Organize codegen source files and unit tests
d2ba88a9 Fix codegen unittests using DatumCastGenerator
020b71a5 Generate code for COUNT aggregate function
0eeec886 Fixing codegen related bugs in InitializeSupportedFunction
41055352 Rewrite PGGenericFuncGenerator to support variable number of types
e5318b6b Add AdvanceAggregatesCodegenEnroll mock function
87521715 Codegen advance_aggregates for SUM transition function
2043d95b Use string messages in codegened slot_getattr fallback block
f160fa5a Add new GUC to control Codegen Optimization level.
697ffc1a Fix cpplint errors
c5e3aed4 Support Virtual Tuples and Memtuples in SlotGetAttrCodegen
5996aaa7 Keep a reference to the CodegenManager in code generators
6833b3c2 Remove unused header and just include what you use in codegen
ab1eda87 Allow setting codegen guc to ON only if code generation is supported by the build
dcd40712 Use PGFuncGeneratorInfo to codegen pg functions
83869d1c Replace dynamic_cast with dyn_cast for llvm objects
23007017 Decide what to generate for ExecEvalExpr based on PlanState
387d8ce8 Add EXPLAIN CODEGEN to print generated IR to the client
c4a9bd27 Introduce Datum to cpp cast, cpp type to Datum cast  and normal cast.(#944)
66158dfd Record external function names for useful debugging
adab9120 Support variable length attributes in SlotGetAttrCodegen.
335e09aa Proclaim that the codegen'ed version of generated functions are called in debug build
50fd9140 Fix cpplint errors
88a04412 Use ExprTreeGeneratorInfo for expression tree generation.
3b4af3bb Split code generation of ExecVariableList from slot_getattr
8cd9ed9f Support <= operator for date/timestamp data types and some minor refactors.
e4dccf46 Implement InlineFunction to force inline at call site
71170942 Mock postmaster.o for codegen_framework_unittest.t
09f00581 Codegen expressions that contain plus, minus and mul operators on float8 data types
d7fb2f6d Fix codegen unittests on Linux and various compiler warnings while building codegen.
45f2aa96 Fix test and update coding style This closes #874
1b26fbfc Enrolled targetlist for scan and aggregate
ebd1d014 Enhance codegen framework to support arbitrary expr tree
ec626ce6 Generate and enroll naive ExecEvalExpr in Scan's quals
1186001e Revert "Create naive code-generated version of ExecQual"
6f928a65 Replace RegisterExternalFunction with GetOrRegisterExternalFunction using an unordered_map in codegen_utils
6ae0085b Move ElogWrapper to GpCodegenUtils.
d3f80b45 Add verifyfunction for generated llvm function.
7bcf094a Fix codegen compiler error with 8.3 merge
aae0ad3d Create naive code-generated version of ExecQual
dce266ad Minor code quality fixes in src/backend/codegen
d281f340 Support null attributes in code generated ExecVariableList
82fd418e Address a number of cpplint errors in codegen_utils_unittest.cc
887aa48d Add check for CodegenUtils::GetType for bool arrays
bb9b92c6 Enhance Base Codegen to do clean up when generation fails
b9ef5e3f Fix build error for Annotated types
a5cfefd9 Add support for array types in codegen_utils.
2b883384 Fix static_assert call
7b75d9ea This commit  generates code for code path: ExecVariableList > slot_getattr > _slot_getsomeattrs > slot_deform_tuple. This code path is executed during scan in simple select queries that do not have a where clause (e.g., select bar from foo;).
6d0a06e8 Fix CodeGen typos and CodeGeneratorManagerCreate function signature in gpcodegen_mock.c
4916a606 Add support for registering vararg external functions with codegen utils.
ae4a7754 Integrate codegen framework and make simple external call to slot deform tuple. This closes #649
ee5fb851 Renaming code_generator to codegen_utils and CodeGenerator to CodegenUtils. This closes #648
88e9baba Adding GPDB code generation utils
Signed-off-by: NJesse Zhang <sbjesse@gmail.com>
Signed-off-by: NMelanie Plageman <mplageman@pivotal.io>
Signed-off-by: NSambitesh Dash <sdash@pivotal.io>

A GPDB developer who uses CentOS 6 recently requested we add a tip to our README about adding /usr/local/lib to the list of directories in which the program loader looks.

Signed-off-by: NLarry Hamel <lhamel@pivotal.io>

- README.ubuntu.bash and README.centos.bash are created
for different dev-setup environments
Signed-off-by: NLarry Hamel <lhamel@pivotal.io>

Cleans up README and simplifies build steps

1. Remove leftover mentions of `make` in the context of building ORCA
1. Because ninja is parallel by default, remove mentions of how to
   parallelize the build

* Simplify build steps in README

Noticeably, we no longer require the two most hated steps:
cd-after-mkdir-build. Instead `cmake` will directly mkdir the build
directly if it doesn't exist.

* [ci skip]
This fixes #248

    commit b0328d5631088cca5f80acc8dd85b859f062ebb0
    Author: mcdevc <a@b>
    Date:   Fri Mar 6 16:28:45 2009 -0800

        Separate our internal libpq front end from the client libpq library
        upgrade libpq to the latest to pick up bug fixes and support for more
        client authentication types (GSSAPI, KRB5, etc)
        Upgrade all files dependent on libpq to handle new version.

Above is the initial commit of gp_libpq_fe, seems no good reasons still
having it.

Key things this PR do:

1, remove the gp_libpq_fe directory.
2, build libpq source codes into two versions, for frontend and backend,
check the macro FRONTEND.
3, libpq for backend still bypasses local authentication, SSL and some
environment variables, and these are the whole differences.
Signed-off-by: NAdam Lee <ali@pivotal.io>

This guide is based on the centos-gpdb-dev docker images that Concourse uses, thus there are less things we need to add on top.
Signed-off-by: NAmil Khanzada <akhanzada@pivotal.io>

Signed-off-by: NEkta Khanna <ekhanna@pivotal.io>

The installcheck-world target requires gssapi, so add it to default configuration
Signed-off-by: NGoutam Tadi <gtadi@pivotal.io>

- Open Source GPDB compile
- No ORCA yet -- getting there soon

[#151180202]
Signed-off-by: NGoutam Tadi <gtadi@pivotal.io>

* Enable PXF by default for GPDB builds

* Disable pxf wherever libcurl is disabled

- instead of trying to keep GPDB readme in sync with GPORCA readme, just refer to it