After using namespaced kubernetes client, we will not need to always set the namespace when creating kubernetes resources(e.g. deployment, pods, configmap, watch, etc.).

Address comments: Update the unit test to verify the configmap watch is created in appropriate namespace

This closes #14570.

This closes #14486

[FLINK-20650][k8s] Remove "native-k8s" command and add bash wrapper for JobManager and TaskManager container args

The "native-k8s" command has been deprecated. Flink should use the pass-through mode. Note that Flink needs to add a "bash -c" wrapper so that the environment variables could be expanded when executing in the "docker-entrypoint.sh".

The corresponding PR in flink-docker is https://github.com/apache/flink-docker/pull/49.

This closes #14419

This closes #14132.

This closes #13871.

This closes #13864.

[FLINK-19542][k8s] Implement LeaderElectionService and LeaderRetrievalService based on Kubernetes API

This closes #13644.

[FLINK-19662][runtime][kubernetes][yarn][dist] Added dynamic parameters to BashJavaUtils' JobManager argument extraction. Additionally, the Kubernetes and Yarn deployment were extended accordingly.

The parameters are returned using the newly introduced global environment variable DYNAMIC_PARAMETERS.

[FLINK-19662][runtime][core] Moved assembleDynamicConfigsStr into ConfigurationUtils to be used by both TaskExecutorProcessUtils and JobManagerProcessUtils.

This changed the way how the parameter list is generated for the TaskExecutor removing the final space. This made it necessary to update the JavaCmdTaskManagerDecoratorTest.

This closes #13755.

[FLINK-18971][kubernetes] Support to mount kerberos conf as ConfigMap and Keytab as Secrete in Kubernetes

This closes #13448.

This closes #13263.

This closes #13186.

This closes #12899.

This closes #12054.

The JVM Direct Memory leak is unlikely in JM. Therefore, we could
disable its limit by default. This way it could span into e.g. JVM
Overhead w/o failure to improve the user experience as before FLIP-116.
If user needs the limit, e.g. to investigate container OOMs, the limit can be enabled by
setting the 'jobmanager.memory.enable-jvm-direct-memory-limit' option.

This closes #12745.

[FLINK-18226][runtime] Fix ActiveResourceManager request extra workers on termination of existing workers.

ActiveResourceManager decides whether and how many new wokers to request based on the following equation.

	workersToRequest = workersRequiredBySlotManager - workersRequestedByResourceManagerNotRegistered

where previsoutly 'workersRequestedByResourceManagerNotRegistered' was 'workersRequestedByResourceManagerNotAllocated'.

This closes #12620.

DeploymentOptionsInternal#CONF_DIR is an internal option and stores the client config path. It should not be added to config map and used by JobManager pod. Instead, KubernetesConfigOptions#FLINK_CONF_DIR will be used.

This closes #12501.

This closes #12455.

Revert "[FLINK-17935] Move set yarn.log-config-file to YarnClusterClientFactory.createClusterDescriptor()"

This reverts commit 2eb73771

This closes #12455.

This closes #12215 .

This closes #12277 .

[hotfix] Add setupFlinkConfig to KubernetesTestBase to make sure flinkConfig is always setup before used