Issues Fixed in CDH 5.13.x

The following topics describe issues fixed in CDH 5.13.x, from newest to oldest release. You can also review What's New in CDH 5.13.x or Known Issues in CDH 5.

Issues Fixed in CDH 5.13.3

Missing results in Hive, Spark, Pig, Custom MapReduce jobs, and other Java applications when filtering Parquet data written by Impala

This issue, which was also reported in TSB-2018-300, is fixed in CDH 5.13.3 and higher. For further details, see the original Known Issue for Hive, Known Issue for Spark, Known Issue for Pig, or the Known Issue for MapReduce.

Slow or stalled queries under highly concurrent write workloads when Sentry + Hive are used, caused by a Hive metastore deadlock

This issue, which was also reported in TSB-2018-294, is fixed in CDH 5.13.3. For further details, see the original Known Issue.

Crash due to CHECK failure during compactions: pv_delete_redo != nullptr

This issue, which was also reported in TSB-2018-298, is fixed in CDH 5.13.3 and 5.14.2. For further details, see the original Known Issue.

Upstream Issues Fixed

The following upstream issues are fixed in CDH 5.13.3:

  • HADOOP-6852 - apparent bug in concatenated-bzip2 support (decoding)
  • HADOOP-12886 - Exclude weak ciphers in SSLFactory through ssl-server.xml
  • HDFS-6054 - MiniQJMHACluster should not use static port to avoid binding failure in unit test.
  • HDFS-10903 - Replace config key literal strings with config key names II: hadoop hdfs
  • HDFS-12386 - Add fsserver defaults call to WebhdfsFileSystem.
  • HDFS-13040 - Kerberized inotify client fails despite kinit properly
  • HDFS-13115 - In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted
  • HDFS-13170 - Port webhdfs unmaskedpermission parameter to HTTPFS
  • MAPREDUCE-7048 - Uber AM can crash due to unknown task in statusUpdate
  • MAPREDUCE-7053 - Timed out tasks can fail to produce thread dump
  • YARN-2416 - InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time
  • HBASE-15714 - We are calling checkRow() twice in doMiniBatchMutation()
  • HBASE-15866 - Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
  • HBASE-17319 - Truncate table with preserve after split may cause truncation to fail
  • HBASE-17924 - Consider sorting the row order when processing multi() ops before taking rowlocks
  • HBASE-18233 - We shouldn't wait for readlock in
  • HBASE-19163 - "Maximum lock count exceeded" from region server's batch processing
  • HBASE-19188 - Build fails on branch-1 using maven-3.5.2
  • HBASE-19364 - Truncate_preserve fails with table when replica region > 1
  • HBASE-19391 - Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory
  • HBASE-19553 - Old replica regions should be cleared from AM memory after primary region split or merge
  • HBASE-19728 - Add lock to filesCompacting in all place.
  • HBASE-19934 - HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting
  • HBASE-20052 - TestRegionOpen#testNonExistentRegionReplica fails due to NPE
  • HBASE-20061 - HStore synchronized member variable filesCompacting should be private
  • HIVE-14792 - AvroSerde reads the remote schema-file at least once per mapper, per table reference.
  • HIVE-16886 - HMS log notifications may have duplicated event IDs if multiple HMSs are running concurrently
  • HIVE-18671 - Lock not released after Hive on Spark query was cancelled
  • HIVE-18917 - Add spark.home to hive.conf.restricted.list
  • HUE-7431 - [core] When idle session timeout is enabled it causes issues with IDP initiated SAML
  • HUE-7920 - [frontend] The stacked graph shouldn't have empty areas in the stacks
  • HUE-7932 - [oozie] Clicking on workflow with several decision nodes hangs Hue
  • HUE-7992 - [oozie] Big workflows show horizontally scroll in Hue 4
  • HUE-7997 - [backend] Python LDAP library exposes password
  • HUE-8009 - [useradmin] Fix login page error for invalid local user when LDAP also enabled
  • HUE-8024 - [indexer] Use old collection API to avoid grant Update privilege
  • HUE-8032 - [core] XSS in Hue Admin Interface
  • HUE-8053 - [useradmin] LDAP authentication with sync_groups_on_login=true fails with KeyError exception
  • HUE-8055 - [desktop] Support multiple LDAP servers in LDAP Test command
  • HUE-8063 - [fb] Better error message when HTTPFS is not working
  • HUE-8069 - [core] Pyformance reporter thread stops on exceptions in guage callbacks
  • HUE-8069 - [core] Fix code format and exception logging
  • IMPALA-6353 - Fixed the crash in snappy decompressor.
  • IMPALA-6473 - Error in analytic sort with same expr in 'partition by' and 'order by'.
  • IMPALA-6500 - Impala crashes randomly on different queries with GROUP BY.
  • KUDU-2238 - Fixed a bug where large updates were not flushed to disk, even when the server is under memory pressure..
  • KUDU-2274 - Fixed a very rare bug where a tombstone being copied over could produce a tablet replica in an inconsistent state.
  • KUDU-2343 - Java client doesn't properly reconnect to leader master when old leader is online.
  • OOZIE-3132 - Instrument SLACalculatorMemory
  • PARQUET-1133 - Add int96 support by returning bytearray, Skip originalType comparison for map types when originalType is null
  • PARQUET-1217 - Incorrect handling of missing values in Statistics
  • SENTRY-1459 - Alter view with HMS Client fails with "java.lang.IllegalArgumentException: Can not create a Path from a null string"
  • SENTRY-2124 - LeaderStatusMonitor.toString() throws IllegalFormatConversionException with AtomicLong
  • SOLR-11873 - ofand SOLR-7391: Use time based expiration cache in all necessary places in HdfsDirectoryFactory.
  • SPARK-19982 - Disable flaky java bean encoder tests ().
  • SPARK-23438 - [DSTREAMS] Fix DStreams data loss with WAL when driver crashes
  • SQOOP-2976 - avro padding

Issues Fixed in CDH 5.13.2

Hive Replications Can Fail Intermittently

This issue, which was also reported in TSB-2018-276, is fixed in CDH 5.13.2. For further details, see the original Known Issue.

Secure Impala-Kudu clusters need to be restarted frequently

Due to Kudu-2264, secure, long-running Impala clusters on CDH 5.13.x and later will be unable to interact with Kudu tables after some time because the Kudu client used by Impala will no longer be able to authenticate with Kudu. The problem starts after the client's ticket can no longer be renewed, which is typically after 7 days. Restarting the Impala service will allow Impala to work with Kudu again.

Impala will begin failing to read or write Kudu tables with errors in the Impala daemon logs resembling:
W1121 22:47:47.231425 50416 ConnectToCluster.java:302] Error receiving response from
cdh-master-4db933ef.cdh-cluster.internal:7051
Java exception follows:
org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not
authenticated (kinit)

at org.apache.kudu.client.Negotiator.evaluateChallenge(Negotiator.java:705)
at org.apache.kudu.client.Negotiator.sendSaslInitiate(Negotiator.java:581)
at org.apache.kudu.client.Negotiator.startAuthentication(Negotiator.java:545)
at org.apache.kudu.client.Negotiator.handleTlsMessage(Negotiator.java:499)
at org.apache.kudu.client.Negotiator.handleResponse(Negotiator.java:264)
at org.apache.kudu.client.Negotiator.messageReceived(Negotiator.java:231)
at ...
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]

at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
at org.apache.kudu.client.Negotiator$1.run(Negotiator.java:691)
at org.apache.kudu.client.Negotiator$1.run(Negotiator.java:688)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.kudu.client.Negotiator.evaluateChallenge(Negotiator.java:687)
... 35 more

Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any
Kerberos tgt)

at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147)
at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122)
at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187)
at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179)
at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192)
... 40 more
Alternatively, errors may be seen like the following:
I0102 11:58:36.688992 3587 jni-util.cc:196] 
org.apache.impala.common.ImpalaRuntimeException: Unable to initialize the Kudu scan node

at org.apache.impala.planner.KuduScanNode.init(KuduScanNode.java:133)
at org.apache.impala.planner.SingleNodePlanner.createScanNode(SingleNodePlanner.java:1312)
at org.apache.impala.planner.SingleNodePlanner.createTableRefNode(SingleNodePlanner.java:1519)
at org.apache.impala.planner.SingleNodePlanner.createTableRefsPlan(SingleNodePlanner.java:779)
at org.apache.impala.planner.SingleNodePlanner.createSelectPlan(SingleNodePlanner.java:617)
at org.apache.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:260)
at org.apache.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:150
at org.apache.impala.planner.Planner.createPlan(Planner.java:98)
at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1004)
at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1100)
at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:156)

Caused by: org.apache.kudu.client.NonRecoverableException: cannot re-acquire authentication
token after 5 attempts

at org.apache.kudu.client.AuthnTokenReacquirer$1NewAuthnTokenErrB.failQueuedRpcs(AuthnTokenReacquirer.java:167)
at org.apache.kudu.client.AuthnTokenReacquirer$1NewAuthnTokenErrB.call(AuthnTokenReacquirer.java:159)
at org.apache.kudu.client.AuthnTokenReacquirer$1NewAuthnTokenErrB.call(AuthnTokenReacquirer.java:142)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1262)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1241)
at com.stumbleupon.async.Deferred.callback(Deferred.java:989)
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:223)
at org.apache.kudu.client.ConnectToCluster.access$000(ConnectToCluster.java:48)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:304)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:293)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1262)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1241)
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1297)

Products Affected: Impala

Releases Affected: CDH 5.13.0, CDH 5.13.1, and CDH 5.14.0

Users Affected: Users running a secure cluster with Impala and Kudu.

Severity: Medium

Impact: Impala will not be able to query or write to Kudu tables until the service is restarted. The Impala service will need to be restarted periodically in order to continue being able to work with Kudu tables.

Immediate action required: To work around the issue, users can restart the Impala service at least once per ticket renewal period. This period is typically 7 days.

Addressed in release: CDH 5.13.2, CDH 5.13.3, and CDH 5.14.2

Apache Hadoop MapReduce Job History Server (JHS) vulnerability

A vulnerability in Hadoop’s Job History Server allows a cluster user to expose private files owned by the user running the MapReduce Job History Server (JHS) process. See http://seclists.org/oss-sec/2018/q1/79 for reference.

Products affected: Apache Hadoop MapReduce

Releases affected: All releases prior to CDH 5.12.0. CDH 5.12.0, CDH 5.12.1, CDH 5.12.2, CDH 5.13.0, CDH 5.13.1, CDH 5.14.0

Users affected: Users running the MapReduce Job History Server (JHS) daemon

Date/time of detection: November 8, 2017

Detected by: Man Yue Mo of lgtm.com

Severity (Low/Medium/High): High

Impact: The vulnerability allows a cluster user to expose private files owned by the user running the MapReduce Job History Server (JHS) process. The malicious user can construct a configuration file containing XML directives that reference sensitive files on the MapReduce Job History Server (JHS) host.

CVE: CVE-2017-15713

Immediate action required: Upgrade to a release where the issue is fixed.

Addressed in release/refresh/patch: CDH 5.13.2, 5.14.2, 5.15.0

HUE

Group sync fails when a non-standard (not uid) user_name_attr is used

Group sync fails when a non-standard (not uid) user_name_attr is used. For example, if a customer user "LDAP User Attribute" is used sync fails for users where the users uid value does not match the user_name_attr defined in the configuration. There is also a "... is not JSON serializable" error when running "Sync LDAP Users/Groups"

Bug: CDH-61984

Apache Oozie Server Vulnerability

A vulnerability in the Oozie Server allows a cluster user to read private files owned by the user running the Oozie Server process.

Products affected: Oozie

Releases affected: All releases prior to CDH 5.12.0, CDH 5.12.0, CDH 5.12.1, CDH 5.12.2, CDH 5.13.0, CDH 5.13.1, CDH 5.14.0

Users affected: Users running the Oozie Server

Date/time of detection: November 13, 2017

Detected by: Daryn Sharp and Jason Lowe of Oath (formerly Yahoo! Inc)

Severity: (Low/Medium/High) High

Impact: The vulnerability allows a cluster user to read private files owned by the user running the Oozie Server process. The malicious user can construct a workflow XML file containing XML directives and configuration that reference sensitive files on the Oozie server host.

CVE: CVE-2017-15712

Immediate action required: Upgrade to release where the issue is fixed.

Addressed in release/refresh/patch: CDH 5.13.2, 5.14.2

Upstream Issues Fixed

The following upstream issues are fixed in CDH 5.13.2:

  • FLUME-3046 - Kafka Sink and Source Configuration Improvements
  • FLUME-3100 - Support arbitrary header substitution for topic of Kafka Sink
  • FLUME-3158 - Upgrade surefire version and config
  • FLUME-3195 - Split the KafkaChannelTest to avoid timeouts
  • FLUME-3201 - Fix SyslogUtil to handle RFC3164 format in December correctly
  • HADOOP-14687 - AuthenticatedURL will reuse bad/expired session cookies
  • HADOOP-14814 - Fix incompatible API change on FsServerDefaults to HADOOP-14104
  • HADOOP-15143 - NPE due to Invalid KerberosTicket in UGI
  • HDFS-11799 - Introduce a config to allow setting up write pipeline with fewer nodes than replication factor
  • HDFS-12052 - Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS
  • HDFS-12485 - expunge may fail to remove trash from encryption zone
  • HDFS-12985 - NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted.
  • MAPREDUCE-5124 - AM lacks flow control for task events
  • MAPREDUCE-7015 - Possible race condition in JHS if the job is not loaded
  • MAPREDUCE-7020 - Task timeout in uber mode can crash AM
  • MAPREDUCE-7028 - Concurrent task progress updates causing NPE in Application Master
  • YARN-4813 - TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently
  • YARN-7363 - ContainerLocalizer don't have a valid log4j config in case of Linux container executor.
  • YARN-7590 - Improve container-executor validation check
  • YARN-7622 - Allow fair-scheduler configuration on HDFS
  • YARN-7705 - Create the container log directory with correct sticky bit in C code
  • YARN-7758 - Add an additional check to the validity of container and application ids passed to container-executor
  • HBASE-14252 - RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0
  • HBASE-15354 - Use same criteria for clearing meta cache for all operations
  • HBASE-16980 - TestRowProcessorEndpoint failing consistently
  • HBASE-18625 - Splitting of region with replica, doesn't update region list in serverHolding. A server crash leads to overlap.
  • HBASE-19215 - Incorrect exception handling on the client causes incorrect call timeouts and byte buffer allocations on the server
  • HIVE-9447 - Metastore: inefficient Oracle query for removing unused column descriptors when adding or dropping a table or partition
  • HIVE-11569 - Use PreOrderOnceWalker where feasible
  • HIVE-11609 - Capability to add a filter to hbase scan via composite key doesn't work
  • HIVE-14303 - CommonJoinOperator.checkAndGenObject should return directly to avoid NPE if ExecReducer.close is called twice
  • HIVE-15519 - BitSet not computed properly for ColumnBuffer subset
  • HIVE-15859 - HoS: Write RPC messages in event loop
  • HIVE-16708 - Exception while renewing a Delegation Token
  • HIVE-17022 - Add mode in lock debug statements
  • HIVE-17624 - MapredLocalTask running in separate JVM could throw ClassNotFoundException
  • HIVE-17969 - Metastore to alter table in batches of partitions when renaming table
  • HIVE-18009 - Multiple lateral view query is slow on Hive on Spark
  • HIVE-18127 - Do not strip '--' comments from shell commands issued from CliDriver
  • HUE-7353 - [search] Timeline chart shouldn't degrade the page performance
  • HUE-7564 - Remove one of the get_connection(ldap_config) function in ldap_access.py.
  • HUE-7567 - [all] Fix test desktop.lib.rest.test_clear_cookies
  • HUE-7583 - [editor] Export result to table throws already exists error
  • HUE-7592 - [jb] Hide older browser if the new ones is enabled
  • HUE-7622 - [jb] Reruning a wokflow redirects to a json result
  • HUE-7624 - [core] Support multi-authentication with AllowFirstUserDjangoBackend and LdapBackend
  • HUE-7646 - [sentry] Changing role privileges removes HDFS ACLs
  • HUE-7647 - [core] Group sync fails when a non-standard (not uid) user_name_attr is used
  • HUE-7666 - [editor] Presentation mode with variables shouldn't break the editor
  • HUE-7667 - [core] Fix http client pool by correctly mounting Transport Adapter to a prefix.
  • HUE-7676 - [core] skip_trash for hue_config_validation
  • HUE-7692 - [editor] Upgrade failure from from CDH <= 5.4
  • HUE-7697 - [core] Allow Kerberos Renewer to retry kinit multiple times
  • HUE-7739 - [metastore] Fix column context popover in the table browser
  • HUE-7755 - [oozie] Adding Distcp arguments and properties
  • HUE-7790 - [assist] Silence all API errors in the right assistant
  • HUE-7794 - [fb] Modify/upload file failed if S3 bucket encryption is SSE-KMS
  • HUE-7802 - [dashboard] Protect against missing function in old dashboards
  • HUE-7806 - [core] Show all the users "Switch to Hue 4" option
  • HUE-7822 - [core] Unable to clone oozie workflow in Hue 4.0
  • HUE-7830 - [core] Non supported feature use_default_configuration doesn't work in Hue 4
  • HUE-7874 - [oozie] SSH action missing configuration for retry-max and retry-interval
  • HUE-7909 - [editor] Hide options in session settings
  • HUE-7916 - [frontend] Avoid breaking of scatterplot chart for some grouping values
  • IMPALA-2810 - Remove column stats restoration when altering table.
  • IMPALA-4664 - Unexpected string conversion in Shell.
  • IMPALA-5167 - Revert "Reduce the number of Kudu clients created (FE)".
  • IMPALA-5664 - Unix time to timestamp conversions may crash Impala
  • IMPALA-5926 - Avoid printing expensive stack when closing a session.
  • IMPALA-5936 - Operator '%' overflows on large decimals.
  • IMPALA-5940 - Avoid log spew by using Status::Expected.
  • IMPALA-5951 - Remove flaky test_catalogd_timeout.
  • IMPALA-5987 - LZ4 Codec silently produces bogus compressed data for large inputs.
  • IMPALA-6004 - Fix the test_row_filters failure on ASAN.
  • IMPALA-6053 - Fix the exception when storadeIds don't match hosts.
  • IMPALA-6060 - Check the return value of JNI exception handling functions.
  • IMPALA-6067 - Enable S3 access via IAM roles for EC2 VMs.
  • IMPALA-6069 - Fix CodegenAnyVal's handling of 'nan'.
  • IMPALA-6100 - Increase test_exchange_delays timeout on slow builds.
  • IMPALA-6106 - Handle comments before set in test parser.
  • IMPALA-6114 - Require type equality for NumericLiteral::localEquals().
  • IMPALA-6137 - Fix text scanner split delim mem mgmt.
  • IMPALA-6183 - Fix Decimal to Double conversion.
  • IMPALA-6184 - Clean up after ScalarExprEvaluator::Clone() fails.
  • IMPALA-6280 - Materialize TupleIsNullPredicate for insert sorts.
  • IMPALA-6284 - Mark the intermediate decimal avg struct as packed.
  • IMPALA-6286 - Remove invalid runtime filter targets.
  • IMPALA-6291 - Disable AVX512 codegen in LLVM.
  • IMPALA-6295 - Fix mix/max handling of 'nan' and 'inf'.
  • IMPALA-6307 - CTAS statement fails with duplicate column exception.
  • IMPALA-6308 - Fix bad Status() usage in data-stream-sender.cc.
  • IMPALA-6348 - Redact only sensitive fields in runtime profiles.
  • IMPALA-6364 - Bypass file handle cache for ineligible files.
  • IMPALA-6381 - Increase test_exchange_delays timeout for isilon.
  • IMPALA-6384 - RequestPoolService should honor custom group mapping config.
  • IMPALA-6388 - Fix the Union node number of hosts estimation.
  • IMPALA-6418 - Find a reliable way to detect supported TLS versions.
  • IMPALA-6435 - Disable codegen for CHAR literals.
  • KUDU-2147 - Consensus: Unknown leader should not be treated as valid UUID
  • KUDU-2231 - Sparse column predicate can cause excessive data-block reads.
  • KUDU-2251 - rowset size can overflow int in RowSetInfo.
  • rpc: Allow setting --rpc_tls_min_protocol on older RHEL versions.
  • OOZIE-1401 - amend PurgeCommand should purge the workflow jobs w/o end_time
  • OOZIE-2045 - Symlink support for sharelib
  • OOZIE-3078 - PasswordMasker throws NPE with null arguments
  • OOZIE-3103 - Improve log message regarding max concurrency for coordinators
  • OOZIE-3112 - SparkConfigrationService overwrites properties provided via --properties-file option in SparkAction
  • PIG-5325 - Schema disambiguation can't be turned off for nested schemas
  • SENTRY-1712 - Add trigger mechanism for Sentry to push full path snapshot to Name Node.
  • SENTRY-1951 - Old SentryStore.retrieveFullPathsImage() should be removed
  • SENTRY-2019 - Improve logging in SentryPlugin
  • SENTRY-2031 - Add trigger mechanism for Sentry to pull full path snapshot from HMS
  • SENTRY-2032 - Leading Slashes need to removed when creating HMS path entries
  • SENTRY-2040 - When getting Snapshots from HMS we need more logging around cases when a snapshot is not being received
  • SENTRY-2046 - Create a full snapshot if AUTHZ_PATHS_SNAPSHOT_ID is empty, even if HMS and Sentry Notifications are in sync
  • SENTRY-2047 - isTableEmptyCore method in SentryStore has references to MAuthzPathsMapping when it should be generic
  • SENTRY-2066 - DB name is not set for AlterTable
  • SENTRY-2078 - Have sentry server print an obvious INFO level log message when it becomes the writer
  • SENTRY-2120 - Escape input string for error response message in LogLevelServlet
  • SPARK-16845 - [SQL][BRANCH-1.6] GeneratedClass$SpecificOrdering` grows beyond 64 KB
  • SPARK-21551 - [PYTHON] Increase timeout for PythonRDD.serveIterator
  • SQOOP-3196 - Modify MySQLAuthTest to use configurable test database parameters
  • SQOOP-3197 - Database credentials cannot be configured in PostgreSQL third party tests
  • SQOOP-3229 - Document how to run third party tests manually with databases running in docker
  • SQOOP-3233 - SqoopHCatImportHelper.convertNumberTypes check for Varchar instead of Char
  • SQOOP-3241 - ImportAllTablesTool uses the same SqoopOptions object for every table import
  • ZOOKEEPER-2249 - CRC check failed when preAllocSize smaller than node data

Issues Fixed in CDH 5.13.1

CDH 5.13.1 fixes the following issues.

HDFS

Cannot re-encrypt an encryption zone if a previous re-encryption on it was canceled

When canceling a re-encryption on an encryption zone, the status of the re-encryption would continue to show "Processing". When this occurred, future re-encrypt commands for this encryption zone failed inside the NameNode, and the re-encryption never completed.


Bug: HDFS-12518, CDH-59073

Upstream Issues Fixed in 5.13.1

The following upstream issues are fixed in CDH 5.13.1:

  • FLUME-3186 - Make asyncHbaseClient config parameters available from Flume config
  • HADOOP-13017 - Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0
  • HDFS-6763 - Initialize file system-wide quota once on transitioning to active
  • HDFS-7582 - Enforce maximum number of ACL entries separately per access and default.
  • HDFS-8540 - Mover should exit with NO_MOVE_BLOCK if no block can be moved
  • HDFS-8541 - Mover should exit with NO_MOVE_PROGRESS if there is no move progress
  • HDFS-8865 - Improve quota initialization performance
  • HDFS-9003 - ForkJoin thread pool leaks
  • HDFS-9396 - Total files and directories on jmx and web UI on standby is uninitialized
  • HDFS-11384 - Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation
  • HDFS-11742 - Improve balancer usability after HDFS-8818
  • HDFS-11755 - Underconstruction blocks can be considered missing
  • HDFS-12424 - Datatable sorting on the Datanode Information page in the Namenode UI is broken
  • HDFS-12494 - libhdfs SIGSEGV in setTLSExceptionStrings
  • HDFS-12518 - Re-encryption should handle task cancellation and progress better.
  • HDFS-12642 - Log block and datanode details in BlockRecoveryWorker.
  • YARN-6757 - Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path.
  • YARN-7099 - ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.
  • YARN-7207 - Cache the RM proxy server address.
  • YARN-7261 - Add debug message for better download latency monitoring.
  • HBASE-18665 - ReversedScannerCallable invokes getRegionLocations incorrectly
  • HBASE-18675 - Making {max,min}SessionTimeout configurable for MiniZooKeeperCluster
  • HBASE-18924 - Backport HBASE-18568 (Correct metric of numRegions) to branch-1.2 and branch-1.3
  • HIVE-12742 - NULL table comparison within CASE does not work as it did in previous Hive versions.
  • HIVE-16758 - Better Select Number of Replications
  • HIVE-16784 - Missing lineage information when hive.blobstore.optimizations.enabled is true
  • HIVE-17218 - Canonical-ize hostnames for Hive metastore, and HS2 servers.
  • HIVE-17274 - RowContainer spills for timestamp column throws exception
  • HIVE-17640 - Comparison of date return null if time part is provided in string.
  • HIVE-17659 - get_token thrift call fails for DBTokenStore in remote HMS mode
  • HIVE-17805 - SchemaTool validate locations should not return exit 1
  • HUE-6835 - [autocomplete] Update the Impala autocompleter to match the latest Impala version
  • HUE-6851 - [metastore] Loading a table is missing loading feedback
  • HUE-7088 - [core] Display a warning when users access a Hue 3 page while on Hue 4
  • HUE-7124 - [frontend] The global search should highlight the match for Hue documents
  • HUE-7182 - [editor] Accented characters not inserted correctly
  • HUE-7222 - [desktop] Document filtering on home page always return an empty list
  • HUE-7229 - [editor] Expanding a result row a second time does not reset the scroll of the modal to the top
  • HUE-7230 - [editor] In full screen the left column filtering is too high and not shown when scrolling down
  • HUE-7237 - [jb] Doc link in Oozie workflow has a mini scrollbar
  • HUE-7246 - [importer] Input file input styling can be too short sometimes
  • HUE-7249 - [indexer] Index sample data tab can be empty when the collection is small
  • HUE-7259 - [autocomplete] Suggest REGEXP instead of REGEX
  • HUE-7260 - [assist] Disable "Open in importer" option for folders in HDFS
  • HUE-7264 - [core] Fix cx_Oracle removed numbersAsStrings in 6.0
  • HUE-7270 - [core] Do not display warning in Hue 3 on login page
  • HUE-7276 - [autocomplete] Support variable references in limit clause for Hive
  • HUE-7277 - [autocomplete] Fix issue where columns are marked as tables in the select list when qualified table references are used
  • HUE-7279 - [autocomplete] Mark column alias locations
  • HUE-7283 - [editor] Fix issue where analytic functions aren't found in the context popover
  • HUE-7285 - [oozie] Coordinator last modification date is always empty
  • HUE-7288 - [editor] Don't check for risks for incomplete statements
  • HUE-7324 - [autocomplete] Prevent js error on column alias selection in the autocomplete dropdown
  • HUE-7325 - [assist] Gracefully handle missing tables or backend errors in the assistant panel
  • HUE-7326 - [assist] Include table names in the right assistant filter
  • HUE-7328 - [assist] Don't reload assistant tables on every change
  • HUE-7331 - [assist] Make the assistant panel aware of snippet database changes
  • HUE-7335 - [editor] Make it possible to close the editor sessions panel form within the panel
  • HUE-7390 - [autocomplete] Fall back to only autocomplete the active statement in case there are surrounding errors
  • HUE-7398 - [dashboard] Do not 500 on Dashboard opening when the first collection is not queryable
  • HUE-7402 - [core] Truncate SEARCH Column in Document2 for Oracle database
  • HUE-7412 - [editor] Fix indexes for chart limit array slice
  • HUE-7427 - [editor] Keep the selected database after execution of a statement that refreshes the assist panel
  • HUE-7428 - [core] Opening a view directly from top search lands on a 404
  • HUE-7430 - [core] Update translations files
  • HUE-7438 - [editor] Query execution time is not updated on short queries
  • HUE-7439 - [editor] Move optimizer call to after check status
  • HUE-7446 - [core] RM HA gets called by mistake on each navopt call
  • HUE-7456 - [core] Do not retry Thrift call on read operation timed out from ssl.SSLError
  • HUE-7457 - [assist] Don't fetch top columns for tables in the right assistant
  • HUE-7465 - [assist] Fetch right assistant columns synchronously to reduce backend load
  • HUE-7470 - [editor] Only check for risks when a snippet has focus
  • HUE-7476 - [core] Add Hue shell command to set CM environment
  • HUE-7477 - [frontend] Close the left nav on click
  • HUE-7489 - [editor] CloseOperation when GetOperationStatus is in an ERROR_STATE
  • HUE-7519 - [assist] Fix JS error when the sample tab can't load samples
  • HUE-7520 - [editor] Prevent JS error from being thrown when closing the session
  • HUE-7521 - [security] Prevent JS error on printAcl not defined
  • HUE-7522 - [frontend] Link to the latest editor from the oldest editor alert
  • HUE-7525 - [home] Prevent js error when dragging to select documents
  • HUE-7526 - [frontend] Avoid XSS in the wysiwyg5 editor and fix the binding in Hue 4
  • HUE-7527 - [assist] Prevent scroll on drag in the foreachVisible binding
  • HUE-7530 - [editor] Avoid red error popup on close of expired query
  • HUE-7531 - [frontend] Allow double click to see detail on old dataTables too
  • HUE-7533 - [fb] Wrong error message in UI with 500 error when user tries to edit read_only file in File browser
  • HUE-7534 - [editor] Fix IE js error on missing endsWith in the syntax checker
  • HUE-7535 - [editor] Fix issue where the syntax checker marks incomplete statements as complete
  • HUE-7536 - [frontend] Avoid XSS in the table row display modal, HueDatatable and TableExtender2
  • HUE-7537 - [editor] Make SqlFunctions optional for the parsers
  • HUE-7538 - [frontend] Override default knockout html binding to prevent XSS
  • HUE-7543 - [editor] Prevent the risk icon from moving the editor down
  • HUE-7552 - [fb] Copy Folder Into Itself Causes Endless Loop
  • HUE-7567 - [all] Add default timeout to REST calls
  • IMPALA-4682 - Remove Preconditions check from analyzeAggregation().
  • IMPALA-4951 - Fix database visibility for user with only column privilege
  • IMPALA-5597 - Try casting targetExpr when building runtime filter plan
  • IMPALA-5856 - Fix outer join predicate assignment.
  • IMPALA-5923 - Print binary ID as hex in ChildQuery::Cancel()
  • IMPALA-5954 - Set DO_NOT_UPDATE_STATS in alterTable() RPCs to HMS.
  • IMPALA-5955 - Use totalSize tblproperty instead of rawDataSize.
  • IMPALA-5983 - Fix crash in to/from_utc_timestamp
  • KUDU-1788 - Increase Raft RPC timeout to 30sec to avoid fruitless retries.
  • KUDU-2130 - (part 2): more fixes for ITClientStress
  • KUDU-2130 - java client: handle termination during negotiation edge case
  • KUDU-2167 - fix C++ client crash due to bad assumption regarding scan data
  • KUDU-2170 - Masters can start with duplicates specified
  • KUDU-2173 - Partitions are incorrectly pruned when range-partitioned on a PK prefix
  • KUDU-2188 - restore Java 7 compatibility to artifacts built with JDK8
  • KUDU-2209 - HybridClock doesn't handle changes in STA_NANO flag
  • SENTRY-1906 - Sentry clients to retry connections to server with delay to avoid failing fast
  • SENTRY-1966 - Improve logging of HMS sync data (paths and permissions) flowing from Sentry to NameNode
  • SENTRY-1993 - StringIndexOutOfBoundsException in HMSPathsDumper.java
  • SENTRY-2027 - backportCreate mechanism of delivering commands via WebUI
  • SPARK-17460 - [SQL] Make sure sizeInBytes in Statistics will not overflow
  • SPARK-17511 - Yarn Dynamic Allocation: Avoid marking released container as Failed
  • SPARK-17531 - Fix the "hive.metastore.uris" value that was changed by the backport ofto 1.6 branches.
  • SQOOP-3014 - Sqoop with HCatalog import loose precision for large numbers that does not fit into double
  • SQOOP-3243 - Importing BLOB data causes 'Stream closed' error on encrypted HDFS
  • ZOOKEEPER-2347 - Deadlock shutting down zookeeper
  • ZOOKEEPER-2726 - backportPatch for ZOOKEEPER-2693 introduces potential race condition

Issues Fixed in CDH 5.13.0

CDH 5.13.0 fixes the following issues.

Sqoop 1

Sqoop does not support Hive metastore HA for Parquet format

If the Hive metastore (HMS) is configured for high availability (HA), the value of the hive.metastore.uris property in /etc/hive/conf.cloudera.HIVE-1/hive-site.xml contains a list of URIs instead of one URI. For example:

<value>thrift://hive-1.example.com:9083,thrift://hive-2.example.com:9083,thrift://hive-3.example.com:9083</value>

Sqoop uses Kite for Parquet file handling and Kite does not support HMS HA. Using Kite, Sqoop takes the first URI from the hive.metastore.uris list and uses that to connect to the HMS. If that address is not available, the Sqoop command fails.

This issue occurs when you use the following Sqoop arguments with the sqoop-import command: --hive-import and --as-parquetfile.

Bug: CDH-57895

Upstream Issues Fixed in 5.13.0

The following upstream issues are fixed in CDH 5.13.0:

  • AVRO-1985 - DataFileWriter.appendTo(SeekableInput, OutputStream) does not close the input anymore
  • FLUME-2752 - Fix AvroSource startup resource leaks
  • FLUME-2905 - Fix NetcatSource file descriptor leak if startup fails
  • FLUME-3093 - Groundwork for version changes in root pom
  • FLUME-3144 - Improve Log4jAppender's performance by allowing logging collection of messages
  • FLUME-3152 - Add Flume Metric for Backup Checkpoint Errors
  • HADOOP-9137 - Support connection limiting in IPC server
  • HADOOP-11572 - s3a delete() operation fails during a concurrent delete of child entries
  • HADOOP-13414 - Hide Jetty Server version header in HTTP responses
  • HADOOP-13588 - ConfServlet should respect Accept request header
  • HADOOP-13628 - Support to retrieve specific property from configuration via REST API
  • HADOOP-13700 - Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
  • HADOOP-13827 - Add reencryptEncryptedKey interface to KMS.
  • HADOOP-13867 - FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations
  • HADOOP-14024 - KMS JMX endpoint throws ClassNotFoundException
  • HADOOP-14038 - Rename ADLS credential properties
  • HADOOP-14174 - Set default ADLS access token provider type to ClientCredential
  • HADOOP-14251 - Credential provider should handle property key deprecation
  • HADOOP-14260 - Configuration.dumpConfiguration should redact sensitive information
  • HADOOP-14324 - Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics
  • HADOOP-14349 - Rename ADLS CONTRACT_ENABLE_KEY
  • HADOOP-14376 - Memory leak when reading a compressed file using the native library
  • HADOOP-14401 - maven-project-info-reports-plugin can be removed
  • HADOOP-14407 - DistCp - Introduce a configurable copy buffer size.
  • HADOOP-14440 - Add metrics for connections dropped
  • HADOOP-14464 - hadoop-aws doc header warning #5 line wrapped
  • HADOOP-14504 - ProvidedFileStatusIterator#next() may throw IndexOutOfBoundsException
  • HADOOP-14511 - WritableRpcEngine.Invocation#toString NPE on null parameters
  • HADOOP-14515 - Addendum. Specifically configure zookeeper-related log levels in KMS log4j.
  • HADOOP-14515 - Specifically configure zookeeper-related log levels in KMS log4j.
  • HADOOP-14521 - Revert "KMS client needs retry logic
  • HADOOP-14521 - KMS client needs retry logic
  • HADOOP-14523 - OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memory
  • HADOOP-14524 - Make CryptoCodec Closeable so it can be cleaned up proactively.
  • HADOOP-14533 - Size of args cannot be less than zero in TraceAdmin#run as its linkedlist
  • HADOOP-14540 - Replace MRv1 specific terms in HostsFileReader
  • HADOOP-14542 - Add IOUtils.cleanupWithLogger that accepts slf4j logger API
  • HADOOP-14563 - LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException
  • HADOOP-14586 - StringIndexOutOfBoundsException breaks org.apache.hadoop.util.Shell on 2.7.x with Java 9
  • HADOOP-14627 - Support MSI and DeviceCode token provider in ADLS
  • HADOOP-14678 - AdlFilesystem#initialize swallows exception when getting user name
  • HADOOP-14688 - Intern strings in KeyVersion and EncryptedKeyVersion
  • HADOOP-14705 - Add batched interface reencryptEncryptedKeys to KMS.
  • HADOOP-14760 - Add missing override to LoadBalancingKMSClientProvider.
  • HADOOP-14824 - Update ADLS SDK to 2.2.2 for MSI fix
  • HADOOP-14844 - Remove requirement to specify TenantGuid for MSI Token Provider
  • HDFS-7847 - Modify NNThroughputBenchmark to be able to operate on a remote NameNode
  • HDFS-8312 - Added permission check for moving file to Trash.
  • HDFS-8586 - Dead Datanode is allocated for write when client is from deadnode
  • HDFS-8674 - Improve performance of postponed block scans
  • HDFS-8818 - Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable.
  • HDFS-8856 - Make LeaseManager#countPath O(1).
  • HDFS-8870 - Lease is leaked on write failure
  • HDFS-9503 - Use generic option -fs for NNThroughputBenchmark instead of -namenode
  • HDFS-10468 - HDFS read ends up ignoring an interrupt
  • HDFS-10480 - Add an admin command to list currently open files
  • HDFS-10506 - OIV's ReverseXML processor cannot reconstruct some snapshot details
  • HDFS-10899 - Add functionality to re-encrypt EDEKs.
  • HDFS-11210 - Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled.
  • HDFS-11303 - Hedged read might hang infinitely if read data from all DN failed
  • HDFS-11345 - Document the configuration key for FSNamesystem lock fairness
  • HDFS-11352 - Potential deadlock in NN when failing over
  • HDFS-11377 - Balancer hung due to no available mover threads
  • HDFS-11472 - Fix inconsistent replica size after a data pipeline failure
  • HDFS-11674 - reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered
  • HDFS-11708 - Positional read will fail if replicas moved to different DNs after stream is opened
  • HDFS-11711 - DN should not delete the block On "Too many open files" Exception
  • HDFS-11738 - Hedged pread takes more time when block moved from initial locations
  • HDFS-11741 - Long running balancer may fail due to expired DataEncryptionKey
  • HDFS-11833 - HDFS architecture documentation descibes outdated placement policy
  • HDFS-11849 - JournalNode startup failure exception should be logged in log file
  • HDFS-11851 - getGlobalJNIEnv() may deadlock if exception is thrown
  • HDFS-11861 - ipc.Client.Connection#sendRpcRequest should log request name
  • HDFS-11881 - NameNode consumes a lot of memory for snapshot diff report generation
  • HDFS-11891 - DU#refresh should print the path of the directory when an exception is caught
  • HDFS-11932 - BPServiceActor thread name is not correctly set
  • HDFS-11945 - Internal lease recovery may not be retried for a long time
  • HDFS-11960 - Successfully closed files can stay under-replicated
  • HDFS-12042 - Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption
  • HDFS-12078 - Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml
  • HDFS-12089 - Fix ambiguous NN retry log message in WebHDFS
  • HDFS-12117 - HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface
  • HDFS-12139 - HTTPFS liststatus returns incorrect pathSuffix for path of file
  • HDFS-12140 - Remove BPOfferService lock contention to get block pool id
  • HDFS-12157 - Do fsyncDirectory(..) outside of FSDataset lock
  • HDFS-12191 - Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file
  • HDFS-12217 - HDFS snapshots doesn't capture all open files when one of the open files is deleted.
  • HDFS-12278 - LeaseManager operations are inefficient in 2.8
  • HDFS-12336 - Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory
  • HDFS-12357 - Let NameNode to bypass external attribute provider for configured users
  • HDFS-12359 - Re-encryption should operate with minimum KMS ACL requirements.
  • HDFS-12363 - Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages
  • HDFS-12369 - Edit log corruption due to hard lease recovery of not-closed file which has snapshots.
  • HDFS-12383 - Re-encryption updater should handle canceled tasks better.
  • HDFS-12400 - Provide a way for NN to drain the local key cache before re-encryption.
  • YARN-2780 - Log aggregated resource allocation in rm-appsummary.log
  • YARN-3006 - Improve the error message when attempting manual failover with auto-failover enabled.
  • YARN-4995 - FairScheduler: Display per-queue demand on the scheduler page.
  • YARN-6432 - Revert "FairScheduler: Reserve preempted resources for corresponding applications.
  • YARN-6751 - Display reserved resources in web UI per queue
  • YARN-6752 - Display reserved resources in web UI per application
  • YARN-6802 - Add max AM resource and AM resource usage to leaf queue view in FairScheduler WebUI.
  • YARN-7099 - ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.
  • HBASE-9393 - Hbase does not close a dead connection with the datanode.
  • HBASE-12770 - Don't transfer all the queued hlogs of a dead server to the same alive server
  • HBASE-15548 - SyncTable: sourceHashDir is supposed to be optional but doesn't work without it
  • HBASE-15691 - ConcurrentModificationException in BucketAllocator
  • HBASE-15720 - Print row locks at the debug dump page
  • HBASE-16033 - Add more details in logging of responseTooSlow/TooLarge
  • HBASE-16045 - endtime argument for VerifyReplication was incorrectly specified in usage
  • HBASE-16090 - ResultScanner is not closed in SyncTable#finishRemainingHashRanges()
  • HBASE-16351 - Improve error reporting for license failures
  • HBASE-16409 - Row key for bad row should be properly delimited in VerifyReplication
  • HBASE-16423 - Add re-compare option to VerifyReplication to avoid occasional inconsistent rows
  • HBASE-16638 - Reduce the number of Connection's created in classes of hbase-spark module
  • HBASE-16772 - Add verbose option to VerifyReplication for logging good rows
  • HBASE-17047 - Add an API to get HBase connection cache statistics
  • HBASE-17131 - Avoid livelock caused by HRegion#processRowsWithLocks
  • HBASE-17287 - Master becomes a zombie if filesystem object closes
  • HBASE-17341 - Add a timeout during replication endpoint termination
  • HBASE-17352 - Fix hbase-assembly build with bash 4
  • HBASE-17534 - Avoid re-wrapping IOExceptions as IOExceptions
  • HBASE-17587 - Do not Rethrow DoNotRetryIOException as UnknownScannerException
  • HBASE-17648 - HBase Table-level synchronization fails between two secured(kerberized) cluster
  • HBASE-17698 - ReplicationEndpoint choosing sinks
  • HBASE-17773 - VerifyReplication tool wrongly emits Invalid arguments error
  • HBASE-17904 - GET runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl
  • HBASE-18005 - read replica: handle the case that region server hosting both primary replica and meta region is down
  • HBASE-18021 - Add more info in timed out RetriesExhaustedException for read replica client get processing
  • HBASE-18024 - HRegion#initializeRegionInternals should not re-create .hregioninfo file when the region directory no longer exists
  • HBASE-18025 - CatalogJanitor should collect outdated RegionStates from the AM
  • HBASE-18030 - Per Cell TTL tags may get duplicated with increments/Append causing tags length overflow.
  • HBASE-18035 - Meta replica does not give any primaryOperationTimeout to primary meta region
  • HBASE-18036 - Data locality is not maintained after cluster restart or SSH
  • HBASE-18066 - Get with closest_row_before on hbase:meta can return empty Cell during region merge/split
  • HBASE-18077 - Update JUnit licensing to use EPL
  • HBASE-18081 - The way we process connection preamble in SimpleRpcServer is broken
  • HBASE-18122 - Scanner id should include ServerName of region server
  • HBASE-18137 - Replication gets stuck for empty WALs
  • HBASE-18192 - Replication drops recovered queues on region server shutdown
  • HBASE-18212 - reduce log level for unbuffer warning.
  • HBASE-18230 - Remove Velocity vars from LICENSE
  • HBASE-18247 - Hbck to fix the case that replica region shows as key in the meta table
  • HBASE-18255 - Set JVM code cache size in provided configuration
  • HBASE-18358 - Backport HBASE-18099 'FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish'
  • HBASE-18362 - hbck should not report split replica parent region from meta as errors
  • HBASE-18390 - Sleep too long when finding region location failed
  • HBASE-18479 - should apply HBASE-18255 to HBASE_MASTER_OPTS too
  • HBASE-18487 - Minor fixes in row lock implementation
  • HIVE-6727 - Table level stats for external tables are set incorrectly
  • HIVE-8838 - Support Parquet through HCatalog
  • HIVE-9152 - Dynamic Partition Pruning support added
  • HIVE-9567 - JSON SerDe not escaping special chars when writing char/varchar data
  • HIVE-10209 - FetchTask with VC may fail because ExecMapper.done is true
  • HIVE-10616 - TypeInfoUtils doesn't handle DECIMAL with just precision specified
  • HIVE-11193 - ConstantPropagateProcCtx should use a Set instead of a List to hold operators to be deleted
  • HIVE-11240 - Change value type from int to long for HiveConf.ConfVars.METASTORESERVERMAXMESSAGESIZE
  • HIVE-11462 - GenericUDFStruct should constant fold at compile time
  • HIVE-11592 - ORC metadata section can sometimes exceed protobuf message size limit
  • HIVE-12270 - Add DBTokenStore support to HS2 delegation token
  • HIVE-12274 - Increase width of columns used for general configuration in the metastore
  • HIVE-12551 - Fix several kryo exceptions in branch-1
  • HIVE-12667 - DPP: UDFs on the partition column side does not evaluate correctly
  • HIVE-12762 - Common join on parquet tables returns incorrect result when hive.optimize.index.filter set to true
  • HIVE-13330 - ORC vectorized string dictionary reader does not differentiate null vs empty string dictionary
  • HIVE-13588 - NPE is thrown from MapredLocalTask.executeInChildVM.
  • HIVE-13947 - HoS prints wrong number for hash table size in map join scenario
  • HIVE-14178 - Hive::needsToCopy should reuse FileUtils::equalsFileSystem
  • HIVE-15068 - Run ClearDanglingScratchDir periodically inside HS2
  • HIVE-15122 - Hive: Upcasting types should not obscure stats
  • HIVE-15208 - Query string should be HTML encoded for Web UI
  • HIVE-15233 - UDF UUID() should be non-deterministic
  • HIVE-15428 - HoS DPP doesn't remove cyclic dependency
  • HIVE-15792 - Hive should raise SemanticException when LPAD/RPAD pad character's length is 0
  • HIVE-16183 - Fix potential thread safety issues with static variables
  • HIVE-16291 - Hive fails when unions a parquet table with itself
  • HIVE-16450 - Some metastore operations are not retried even with desired underlining exceptions
  • HIVE-16559 - Parquet schema evolution for partitioned tables may break if table and partition serdes differ
  • HIVE-16613 - SaslClientHandler.sendHello fails with SASL timeout instead of real cause
  • HIVE-16675 - Fix ConcurrentModificationException in SparkClientImpl#startDriver
  • HIVE-16729 - Improve location validator to check for blank paths
  • HIVE-16845 - INSERT OVERWRITE a table with dynamic partitions on S3 fails with NPE
  • HIVE-16869 - Hive returns wrong result when predicates on non-existing columns are pushed down to Parquet reader
  • HIVE-16875 - Query against view with partitioned child on HoS fails with privilege exception.
  • HIVE-16930 - HoS should verify the value of Kerberos principal and keytab file before adding them to spark-submit command parameters
  • HIVE-16935 - Hive should strip comments from input before choosing which CommandProcessor to run.
  • HIVE-16949 - Leak of threads from Get-Input-Paths and Get-Input-Summary thread pool
  • HIVE-16960 - Hive throws an ugly error exception when HDFS sticky bit is set
  • HIVE-16961 - Hive on Spark leaks spark application in case user cancels query and closes session
  • HIVE-16974 - Change the sort key for the schema tool validator to be ID column
  • HIVE-16978 - HoS: add current thread ID to the log redirector for the RemoteDriver
  • HIVE-16982 - WebUI "Show Query" tab prints "UNKNOWN" instead of explaining configuration option
  • HIVE-16998 - Add config to enable HoS DPP only for map-joins
  • HIVE-17008 - Fix boolean flag switchup in DropTableEvent
  • HIVE-17050 - Multiline queries that have comment in middle fail when executed via "beeline -e"
  • HIVE-17052 - Remove logging of predicate filters
  • HIVE-17087 - Remove unnecessary HoS DPP trees during map-join conversion
  • HIVE-17131 - Add InterfaceAudience and InterfaceStability annotations for SerDe APIs
  • HIVE-17132 - Add InterfaceAudience and InterfaceStability annotations for UDF APIs
  • HIVE-17149 - Hdfs directory is not cleared if partition creation failed on HMS
  • HIVE-17150 - CREATE INDEX execute HMS out-of-transaction listener calls inside a transaction
  • HIVE-17191 - Add InterfaceAudience and InterfaceStability annotations for StorageHandler APIs
  • HIVE-17225 - HoS DPP pruning sink ops can target parallel work objects
  • HIVE-17237 - HMS wastes 26.4% of memory due to dup strings in metastore.api.Partition.parameters
  • HIVE-17247 - HoS DPP: UDFs on the partition column side does not evaluate correctly
  • HIVE-17268 - WebUI / QueryPlan: query plan is sometimes null when explain output conf is on
  • HIVE-17405 - HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT
  • HUE-1199 - [metastore] Wrong time stamp for all export query result to directory or new table
  • HUE-2961 - [indexer] Turn on the new interface by default
  • HUE-3228 - [editor] SQL Dashboard enhancements
  • HUE-3797 - [editor] Open submitted schedule in mini job browser
  • HUE-4031 - [editor] Smart syntax error highlighting
  • HUE-4907 - [editor] Provide a default value to parameters
  • HUE-5116 - [indexes] Remove unfinished create collection from a file
  • HUE-5217 - [backend] Resolve LGPL copyleft issue - Paramiko in boto 2.46.1
  • HUE-5304 - [search] List all the Solr cloud collections
  • HUE-5396 - [spark] Hide extra add property dropdown
  • HUE-5463 - [autocomplete] Add autocomplete support for partitions in Hive describe table statements
  • HUE-5504 - [oozie] Only use JDBC URL from hive2 action when hardcoded
  • HUE-5736 - [autocomplete] Cancel any running API requests when closing the autocompleter
  • HUE-5991 - [metastore] New table with Date time works with Hive but not with Impala
  • HUE-6045 - [Pig] Update LOG_END_PATTERN to identify completed jobs
  • HUE-6063 - [frontend] Remove double class attribute from element
  • HUE-6149 - [search] Smarter catching of Solr error message
  • HUE-6256 - [presentation] Result grid not displaying the cells when scrolling
  • HUE-6347 - [presentation] Convert player mode to presentation
  • HUE-6364 - [importer] Dock the bottom bar to the bottom
  • HUE-6370 - Revert "[jobsub] Save jobsub doesn't redirect to list-designs page."
  • HUE-6377 - [importer] Submit doesn't give a feedback if the call takes a long time
  • HUE-6380 - [editor] Move clipboard option above Save menu
  • HUE-6486 - Move Hue Krb ticket cache out of /tmp
  • HUE-6575 - [home] Convert all links to use the hueLink binding
  • HUE-6595 - [fb] Opening a job might throw a 500 error if its tasks are None
  • HUE-6659 - [import] Support RDMBs as input via Sqoop
  • HUE-6684 - [editor] Horizontal scrollbar of the ace editor isn't updated when the right assist is resized
  • HUE-6701 - [editor] The right panel resize bar gets hidden in Hue 3 on window resize
  • HUE-6702 - [about] About page is accessible without authentication
  • HUE-6704 - [fb] Handle empty page error on filebrowser filter requests
  • HUE-6705 - [fb] Opening directory after opening editor does not load at first click
  • HUE-6707 - [search] Do not send search call when the collection name is null
  • HUE-6709 - [editor] Column list can jump back and forth depending on its size
  • HUE-6710 - [notebook] Application reachable directly by users without granted access
  • HUE-6711 - [frontend] Render 403 page properly on Hue 4
  • HUE-6714 - [jb] No tasks found for job when refreshing MapReduce job page
  • HUE-6719 - [assist] Add a close button to the assist function panel
  • HUE-6722 - [jb] Task progress shows as 1 and not 100%
  • HUE-6723 - [jb] Provide duration time of running Yarn jobs
  • HUE-6724 - [jb] Job progress can have too many decimals
  • HUE-6727 - [jb] 0/1 map progress percent gets listed as 100%
  • HUE-6728 - [assist] Fix truncated input in the assist filter
  • HUE-6730 - [fb] Use SkipFile instead of StopUpload in case of exception during file upload
  • HUE-6732 - [jb] Add clearable to job filters
  • HUE-6735 - [jb] A suspended workflow should also be killable
  • HUE-6737 - [fb] Submit workflow.xml sends to Hue 3
  • HUE-6738 - [jb] Kill button of workflow enabled when clicking on re-run
  • HUE-6740 - [assist] Enable text filter for document type in the assist
  • HUE-6742 - [editor] Incorrect Sorting With TIMESTAMP Column Type
  • HUE-6745 - [frontend] The title of the browser is Filebrowser even if I’m in editor
  • HUE-6746 - [autocomplete] Add USER and TIMESTAMP to non-reserved keywords list
  • HUE-6748 - [editor] Select and copy the query from the query history
  • HUE-6749 - [editor] From metastore to editor with past query ran and scrolled can garble grid
  • HUE-6754 - [assist] Add open in dashboard to collections
  • HUE-6755 - [assist] Add link to create a collection
  • HUE-6756 - [home] The text filter should honor the active type
  • HUE-6757 - [fb] Used to have a fixed action menu when scrolling down
  • HUE-6758 - [jb] Open a workflow workspace breaks the history
  • HUE-6759 - [jb] Variable section of workflow is shown even if empty
  • HUE-6760 - [jb] Filtering running jobs and batch killing them do not update their status
  • HUE-6762 - [assist] Offer right click to open table in editor
  • HUE-6763 - [search] Add global default if in cloud mode
  • HUE-6767 - [jb] Submit a workflow sometimes generates a JS error
  • HUE-6768 - [frontend] Remove shown tooltips on app change in Hue 4
  • HUE-6770 - [metastore] Remove unused partitions mako page
  • HUE-6771 - [metastore] The table description should have a fixed height in the table page
  • HUE-6772 - [metadata] Cache Navigator password reads from scripts
  • HUE-6773 - [core] Clicks on Logs, Dump config with middle click are not supported
  • HUE-6776 - [search] Js error when clicking on the first two layout of a new dashboard
  • HUE-6777 - [fb] Drag & drop upload not enabled if editor was loaded before
  • HUE-6778 - [frontend] Visual hint on click or d'n'd to import in Hue 4
  • HUE-6779 - [jb] Disable click around checkbox in list of jobs
  • HUE-6780 - [s3] Correctly infer and display region when connected to S3 by endpoint
  • HUE-6781 - [jb] Workflow duration time is not humanized
  • HUE-6783 - [home] Don't close the modals until all files marked for deletion are actually deleted
  • HUE-6785 - [doc2] Return more useful error message when users try to create a directory within a read-only shared directory
  • HUE-6786 - [metastore] DB configuration list shouldn't overflow into table list
  • HUE-6787 - [oozie] Hide calendar on modal close for any submit action
  • HUE-6789 - [beeswax] Fix alignment of the assist headers
  • HUE-6790 - [assist] Improve the assist functions filter
  • HUE-6791 - [search] Protect against pivot facets conflicting with nested facets
  • HUE-6792 - [core] Middle/right click is not working as a link on main blue action button
  • HUE-6794 - [assist] Show columns in the right assistant
  • HUE-6795 - [fb] Fix minor logic error in trash directory creation
  • HUE-6796 - [indexer] Faster installations of the examples
  • HUE-6797 - [dashboard] Grid widget operation icons are not grayed much
  • HUE-6798 - [frontend] Rename main action button depending on the selected app
  • HUE-6800 - [frontend] Re-word the welcome tour
  • HUE-6801 - [frontend] Set a minimum height to the log resizer binding
  • HUE-6802 - [editor] Don't check for column existence in the location handler when a column is prefixed with a table name or alias
  • HUE-6803 - [assist] Only refresh the assist cache for DDL statements that affect the assist structure
  • HUE-6806 - [frontend] Avoid double init of Nicescroll on the context popover
  • HUE-6807 - [search] The rolling time picker should consider the user's timezone
  • HUE-6808 - [frontend] Replace external links with _blank target to open the sample popup instead
  • HUE-6809 - [home] Set a min width for the name column in the document list
  • HUE-6810 - [assist] Improve positioning and visibility of side panel toggles
  • HUE-6811 - [editor] Prevent displaying small black lines in the upper left corner on editor load
  • HUE-6812 - [frontend] Swap sortable column style from top to bottom blue border
  • HUE-6813 - [metastore] Fix database comment last character truncation
  • HUE-6814 - [search] Only return distinct usernames in security impersonate dropdown
  • HUE-6815 - [frontend] Improve the user experience for the top search bar
  • HUE-6816 - [frontend] Fix flexbox sizing of the popover sample tab on Safari
  • HUE-6817 - [editor] Do a better column name match for the scroll to column functionality
  • HUE-6819 - [oozie] Set generic widget for generic actions in oozie graph
  • HUE-6820 - [frontend] Catch all the JS errors and send them to the backend
  • HUE-6821 - [home] Add star to favorite on Hue 4
  • HUE-6823 - [frontend] Sending JS errors to the backend should be transparent and still show the stacktrace on the console
  • HUE-6824 - [fb] Fix possible JS error after permanently deleting files
  • HUE-6825 - [autocomplete] Prevent exception when there's no identifierChain given for a table
  • HUE-6826 - [oozie] Better slicing of action commands property
  • HUE-6827 - [editor] Fix padding on download modal body
  • HUE-6828 - [editor] Fix vertical alignment of save query result file chooser button
  • HUE-6829 - [editor] Set download dialog overwrite default value to false to improve UX
  • HUE-6830 - [editor] Introduce copy to clipboard for results
  • HUE-6831 - [metastore] Editing view comments should use ALTER VIEW instead of TABLE
  • HUE-6833 - [editor] Disable query builder tab for non-sql editors
  • HUE-6835 - [autocomplete] Update the Impala auto-completer to match the latest Impala version
  • HUE-6836 - [jb] Reset select all checkboxes on interface change
  • HUE-6837 - [frontend] Fix alignment of hueCheckbox and hueCheckAll icons
  • HUE-6839 - [home] Avoid action icons to be shown unstyled at page load
  • HUE-6840 - [notebook] Workaround lack of status flag in Impala profile page
  • HUE-6841 - [oozie] Copy examples to HDFS as the hue user
  • HUE-6842 - [core] Correctly append the list of custom apps
  • HUE-6843 - [metastore] Show partition icon on table browser sends to Hue 3
  • HUE-6844 - [frontend] Make all custom apps embeddable
  • HUE-6845 - [frontend] Fix custom app mako generation
  • HUE-6846 - [frontend] Make all proxy apps embeddable
  • HUE-6847 - [metastore] Do not display if table is compressed as Hive information is incorrect
  • HUE-6848 - [jb] Add doAs impersonation when fetching job logs
  • HUE-6850 - [metastore] Rely on default SQL editor type for querying data
  • HUE-6852 - [editor] Scroll left does not disappear when going to metastore from editor
  • HUE-6853 - [jb] On mini jb clicking on breadcrumbs shouldn't close the popup
  • HUE-6854 - [home] Clicking on a folder should open it
  • HUE-6855 - [frontend] Set a default application tooltip sometimes doesn't disappear
  • HUE-6856 - [search] Protect against reflected XSS in search query parameters
  • HUE-6857 - [metadata] Add skeleton of troubleshooting API
  • HUE-6858 - [indexer] Add load data action
  • HUE-6859 - [index] Support creating collection aliases without page refresh
  • HUE-6861 - [search] Do not 500 when Search is not enabled
  • HUE-6862 - [jb] Workflow filtering on username does not happen
  • HUE-6863 - [jb] Kill buttons are enabled even when the user is not allowed
  • HUE-6864 - [jb] Check for permission before killing a job
  • HUE-6866 - [core] Js error popup does not re-appear if same as previous one which was closed
  • HUE-6868 - [search] Field analysis popup shows up too high if down scrolling
  • HUE-6870 - [jb] Improve end user experience with bubbling up of common actions and properties
  • HUE-6874 - [search] Stabilize some nested facets
  • HUE-6877 - [rdbms] Server error label misspelling
  • HUE-6880 - [fb] Missing bottom gray border table header styling
  • HUE-6881 - [editor] Display table type in the SQL context popover
  • HUE-6882 - [metastore] Fix issues with the description overflow toggle
  • HUE-6883 - [metastore] Allow deletion of table comments
  • HUE-6884 - [core] Allow to blacklist the Hive
  • HUE-6885 - [frontend] Catch all http 502 and show an HTML stripped version of the message
  • HUE-6886 - [oozie] SLA variable in workflow action are not getting retrieved
  • HUE-6888 - [oozie] SLA page is broken in Hue 4
  • HUE-6889 - [oozie] Force wrap oozie IDs on the detail page
  • HUE-6890 - [autocomplete] Add support for database prefixed UDFs
  • HUE-6891 - [importer] Incorrect Warning for tables starting with #
  • HUE-6894 - [core] Remove cluster config call on login page
  • HUE-6895 - [frontend] Disable errorcatcher when in Django debug mode
  • HUE-6896 - [frontend] Errorcatcher should not log jQuery triggered events
  • HUE-6897 - [oozie] Ensure that examples_dir exists before installing examples
  • HUE-6898 - [oozie] Editor doesn't update job status to "finished" for finished Pig jobs
  • HUE-6899 - [core] Allow 403 to be accessed by regular users
  • HUE-6900 - [useradmin] Do not link app title to list of users if user is not a super user
  • HUE-6901 - [oozie] Editor is missing certain regular actions
  • HUE-6903 - [dataeng] Backport several useful Jiras
  • HUE-6905 - [frontend] Minor user interface bugs in old Pig Editor and Job Designer
  • HUE-6906 - [frontend] 'Add more' should open in a new tab and not throw a 404 in Hue 4
  • HUE-6907 - [search] The dashboard header is bigger than the other headers
  • HUE-6908 - [jb] Add optional Spark session list
  • HUE-6909 - [libsentry] Use the new sentry config property sentry.service.client.server.rpc-addresses
  • HUE-6910 - [indexes] Display dynamic and copy fields
  • HUE-6911 - [indexes] Display sample data of schemaless collections
  • HUE-6912 - [sqoop] Securing Database password in oozie
  • HUE-6922 - [fb] When typing in the search box, last 1 or few characters get deleted when the list is refreshed
  • HUE-6923 - [fb] Fix table header borders
  • HUE-6925 - [indexes] Enable column filtering
  • HUE-6926 - [indexes] Refresh out-of-sync collections
  • HUE-6928 - [assist] Add filter to right assistant
  • HUE-6930 - [importer] Libs filechooser input should be shorter
  • HUE-6931 - [indexes] Hide table headers when tables are empty
  • HUE-6932 - [indexes] Add field sample popover
  • HUE-6933 - [indexes] Show a message when there's no sample data
  • HUE-6934 - [importer] Taking the Sqoop jar paths from UI parameters/asking from end-user
  • HUE-6936 - [indexer] Move SQL indexing into its own flag
  • HUE-6937 - [importer] Improve UX by not hiding the pre-filled wizard destination
  • HUE-6938 - [importer] Restyle section headers
  • HUE-6939 - [editor] Improve interactions with the risk indicator
  • HUE-6940 - [editor] Cancel risk requests if editing while risk check is running
  • HUE-6941 - [editor] Don't show a pointer cursor for the risk check spinner
  • HUE-6942 - [indexer] 404 error when creating an index from a file that has a _version_ field
  • HUE-6943 - [indexer] Error when input file does not have any headers
  • HUE-6944 - [indexer] Support manual creation of collection
  • HUE-6945 - [search] Aliases cannot be retrieved with Solr 4
  • HUE-6948 - [indexer] Warn when indexer name is invalid
  • HUE-6949 - [indexer] Cleaner error message when coming from Solr
  • HUE-6950 - [saml] Create home directory for new user login
  • HUE-6951 - [indexes] Index with no data has an empty field section
  • HUE-6952 - [doc] Remove warning description
  • HUE-6953 - [indexer] Support skipping field in non task mode
  • HUE-6954 - [indexer] Support different number of shards, replication at index creation
  • HUE-6955 - [metadata] Extend query suggest caching to 1 week
  • HUE-6957 - [importer] Primary Key dropdown opens on selecting Default field dropdown
  • HUE-6959 - [assist] Fix collection opening from left assist
  • HUE-6960 - [frontend] Only suggest facet values and no results when autocompleting facets in the top search
  • HUE-6961 - [frontend] Filechooser inputs sometimes have rounder corners on the right side of the input
  • HUE-6962 - [importer] Index field operations overlap with the submit button
  • HUE-6965 - [importer] Supporting import in different file types with different delimeters
  • HUE-6968 - [metadata] Gather table stats via Impala
  • HUE-6969 - [jb] Start time, Finish time, Elapsed time of tasks of MR jobs are not formatted
  • HUE-6971 - [jb] Schedule list is filtered by default on 7 days which hides most of them
  • HUE-6972 - [metadata] Sometimes the DB owner is shown as ()
  • HUE-6973 - [indexer] Open up the index page after creating a new index
  • HUE-6974 - [importer] Refresh Assist collection list after create table wizard success
  • HUE-6975 - [core] 500 in configuration on /hue/desktop/dump_config
  • HUE-6976 - [editor] Suggest fix for missing filters risk
  • HUE-6977 - [editor] Fix issue where the autocomplete dropdown doesn't show for column completion
  • HUE-6979 - [editor] Sometimes editor title/summary are truncated too much
  • HUE-6981 - [oozie] Configuration text filter spacing is a bit off
  • HUE-6984 - [editor] Use TeraGen instead of TeraSort
  • HUE-6988 - [jb] After killing the MR job, the interface hangs
  • HUE-6989 - [jb] Clicking on the jobs button doesn’t allow me to go back to the editor with the back button of the browser
  • HUE-6990 - [editor] The syntax checker should be aware of table aliases
  • HUE-6992 - [editor] Unable to paste via right click menu
  • HUE-6993 - [sqoop] Support for configurable number of mappers
  • HUE-6995 - [oozie] Set minimum width of a workflow node
  • HUE-6996 - [frontend] Clicking on home doesn't allow to go back in history
  • HUE-6997 - [core] Leaflet_tile_layer should allow case sensitive URIs
  • HUE-6999 - [core] Deleting admin user message yes button keeps circling
  • HUE-7000 - [assist] HBase assist does not load the table the second time
  • HUE-7001 - [assist] Remember the last selected HBase cluster
  • HUE-7002 - [core] Welcome to Hue 4 tour could be also skipped by clicking on the white background
  • HUE-7004 - [notebook] Loading query with empty session param shows several JS errors
  • HUE-7005 - [oozie] sharing coordinator or bundle immediately after creating fails
  • HUE-7006 - [core] Ability in HUE to change Cookie name from default "sessionid"
  • HUE-7008 - [autocomplete] Minify the generated parsers
  • HUE-7009 - [metadata] Automatic upload of table stats if missing
  • HUE-7010 - [sqoop] Take configured databases from librdms instead of hardcoding the list of drivers
  • HUE-7011 - [jb] JS error on workflow with taks without a startTime
  • HUE-7012 - [jb] Wrong spelling of Job has not tasks
  • HUE-7013 - [backend] Provide Kerberos Mutual Authentication disable switch in "hue.ini"
  • HUE-7015 - [frontend] Set default background color to white
  • HUE-7016 - [libsentry] HA retry on SOLR component does not set the component value
  • HUE-7017 - [importer] Add JDBC option in both custom and config modes
  • HUE-7018 - [jb] disable_killing_jobs option is not supported in the new job browser
  • HUE-7019 - [fb] show_download_button is not integrated in the backend
  • HUE-7020 - [indexer] Provide the real lib_path at the Morphline config generation
  • HUE-7022 - [assist] Enable listing the Solr collection fields
  • HUE-7023 - [assist] Add a create button to the HDFS panel
  • HUE-7024 - [assist] The current selected item should have an 'open' action too
  • HUE-7025 - [editor] Move copy to clipboard outside the download dropdown
  • HUE-7026 - [editor] Add an HBase connector
  • HUE-7027 - [fb] Opening a file directly via editing path lands on Hue 3
  • HUE-7028 - [editor] Don't mark where and limit clauses on hover
  • HUE-7029 - [jb] Switching between log types should reset the log content before loading the new one
  • HUE-7030 - [jb] Style Oozie SLA not available page
  • HUE-7031 - [oozie] Promote tabs to the usual Documents icon for browsing documents
  • HUE-7033 - [jb] Switching from Hue 3 to Hue 4 should remap the old URL to the new one
  • HUE-7035 - [frontend] Close editor sessions panel on app switch
  • HUE-7036 - [fb] Disable full page refresh on folder open
  • HUE-7039 - [oozie] Remove JS auto center of the workflow actions
  • HUE-7040 - [oozie] Pressing Esc on share popup throws JS error in Hue4
  • HUE-7041 - [fb] Items in menu come and go when doing a right clicking on a file
  • HUE-7043 - [frontend] Switch fa-tags with fa-list for list of files links in the apps
  • HUE-7044 - [oozie] Be consistent with the Schedule name in Hue 4
  • HUE-7045 - [hive] Avoid use database call for SET queries
  • HUE-7046 - [frontend] Fix open.link on Hue 3
  • HUE-7048 - [oozie] User prompting doesn't work in share document popup in hue4
  • HUE-7049 - [assist] Extract a generic context popover component
  • HUE-7050 - [assist] Add a feature flag for the new generic context popover
  • HUE-7051 - [importer] Add SQL editor to the importer for RDBMS
  • HUE-7052 - [desktop] Retain last_modified when sharing sample docs in sync_documents
  • HUE-7053 - [search] Indexer requires options to avoid jar classes conflicts
  • HUE-7055 - [importer] Option to add column other than primary key to split-by
  • HUE-7056 - [importer] Minimal arrow linking step 1 to 2
  • HUE-7057 - [search] Make widget dimensions draggable
  • HUE-7060 - [search] Merge initial layout choices to one single widget and two columns grid
  • HUE-7061 - [search] Add the possibility of add/remove the left layout column
  • HUE-7064 - [editor] Integrate sharing button into the Editor
  • HUE-7065 - [dashboard] Integrate sharing button into the Dashboard
  • HUE-7066 - [frontend] Missing grunt uglify dependency on packages.json
  • HUE-7067 - [dashboard] Refresh facet result when reordering sub-facets
  • HUE-7068 - [frontend] Update knockout sortable binding to the latest version
  • HUE-7069 - [editor] Remove the spinner for risk checking
  • HUE-7070 - [importer] Prefill the destination name for the database importer
  • HUE-7071 - [frontend] The left nav should always be on top
  • HUE-7072 - [importer] Disable fields that are not marked as keep
  • HUE-7073 - [backend] When user is logged in using LdapBackEnd, restrict certain characters from the Hue login name.
  • HUE-7074 - [frontend] Extend hueDebug to accept the id of the element as well
  • HUE-7075 - [assist] Allow to refresh other types than Hive and Impala
  • HUE-7079 - [editor] Keep the last 50 risk responses and clear the risks on statement change
  • HUE-7080 - [oozie] Oozie HiveServer2 action is prompting for and 'Impalad hostname'
  • HUE-7082 - [aws] Create bucket fails with error "Failed to create S3 bucket 'xxxx':Bad Request"
  • HUE-7084 - [useradmin] Remove @domain part of username when creating home directory for LDAP user
  • HUE-7085 - [useradmin] Remove unused view_user view
  • HUE-7086 - [core] Clicking on a task item to select it closes the task popup
  • HUE-7087 - [frontend] Skip showing assist.db.refresh output links on the history panel
  • HUE-7090 - [security] Protect from missing groupName in the list_sentry_roles_by_group API
  • HUE-7091 - [assist] The assistant should suggest adding a filter for missing partition columns in filter
  • HUE-7092 - [autocomplete] Adjust the parser to also report location of select lists
  • HUE-7093 - [frontend] Unify table headers and sorters styles across the various apps
  • HUE-7094 - [frontend] Filechooser should never navigate by default to an empty path
  • HUE-7095 - Table import not working
  • HUE-7096 - [editor] Presentation mode revamp
  • HUE-7097 - [notebook] Remove export to Jupyter
  • HUE-7098 - [presentation] Toggle hiding/showing the code snippets
  • HUE-7099 - [notebook] Display variables on top
  • HUE-7100 - [editor] Switch ko model betweeb editor and notebook presentation mode
  • HUE-7104 - [core] Hue and Isilon issue "UnsupportedOperationException: Unknown op 'GETTRASHROOT'"
  • HUE-7105 - [importer] Column list is not aligned on large screens
  • HUE-7106 - [oozie] New oozie doc url doesn't update after saving the page
  • HUE-7107 - [core] Hue 4 group access doesn't reflect on Interface
  • HUE-7108 - [desktop] Add config check to see if the migration history table is up to date
  • HUE-7109 - [useradmin] Add/Sync LDAP Group should refresh the group list and show a sync message
  • HUE-7110 - [editor] Focus on the SQL editor when opening Hue
  • HUE-7112 - [oozie] Do not escape characters in decision node condition
  • HUE-7114 - [filebrowser] Edit File could be in a fixed width font
  • HUE-7115 - [autocomplete] Show popular joins above popular filters
  • HUE-7116 - [editor] Fix syntax checker js error when table ref is missing
  • HUE-7117 - [frontend] Harmonize all the monospace occurrences and move to Roboto Mono
  • HUE-7118 - [editor] Take statement location into account when marking query compatibility warnings
  • HUE-7120 - [presentation] Set a minimum height for the editors
  • HUE-7122 - [autocomplete] Don't add db prefix in popular join conditions for Hive
  • HUE-7123 - [autocomplete] Include the join type if given when suggesting popular joins
  • HUE-7124 - [frontend] Use the orignalName attribute for inline autocomplete in the global search
  • HUE-7125 - [importer] Dropdown shrinks in the 'external database' section
  • HUE-7127 - [backend] Fix for Python requests Kerberos/GSSAPI authentication library fails to authenticate kerberos requests to the same destination host.
  • HUE-7128 - [core] Create an ENABLE_DOWNLOAD property in 'desktop' conf and use it for the editor and search dashboards
  • HUE-7131 - [importer] Revert HUE-7051
  • HUE-7132 - [frontend] Fix Selectize default placeholder i18n
  • HUE-7133 - [oozie] Bulk add parameters parsed from XML
  • HUE-7134 - [oozie] Allow vertical resize of Sqoop arguments
  • HUE-7135 - [presentation] Add SQL comment as snippet title or text widgets
  • HUE-7136 - [frontend] Remove references to download.js
  • HUE-7137 - [editor] Move copy to clipboard inside the download dropdown
  • HUE-7138 - [editor] Open notebook should work also when the editor has not been loaded before
  • HUE-7139 - [conf] Remove non-standard double quotes from the configuration files
  • HUE-7141 - [dashboard] Menu shows an incomplete dropdown
  • HUE-7144 - [core] Switch document list icon in editors to the document one
  • HUE-7148 - [frontend] Set a default size for SVG icons inside buttons
  • HUE-7149 - [presentation] Missing common share import in Hue 3
  • HUE-7150 - [presentation] Skip storing the left and right assist status when toggling presentation mode
  • HUE-7151 - [editor] Refactor previousChartOptions to avoid duplication
  • HUE-7152 - [editor] Enable execute query shortcut inside a variable input
  • HUE-7153 - [core] Analytics call to add logging in the backend
  • HUE-7154 - [hive] Replace NoSuchObjectException by QueryServerException
  • HUE-7155 - [backend] Hue needs to support TLSv1_1 and TLSv1_2 via Thrift connections
  • HUE-7157 - [presentation] Align the top variables better
  • HUE-7158 - [editor] Remove border to the grid results column list
  • HUE-7159 - [fb] Remove history dropdown
  • HUE-7160 - [importer] Make arrow in between steps bigger
  • HUE-7162 - [assist] Make the document type selection scrollable
  • HUE-7165 - [aws] hue s3 browser should provide accessibility for all buckets in v2 regions
  • HUE-7166 - [aws] deleting s3 bucket throws console error
  • HUE-7167 - [search] Enable swapping dashboard columns
  • HUE-7168 - [editor] Add keyboard shortcut for presentation mode and make esc work all the time
  • HUE-7169 - [editor] Force re-render when swapping between chart and grid mode
  • HUE-7170 - [indexes] Analysis popup hidden a bit on non refreshed collection page
  • HUE-7172 - [indexes] Analysis popup should disappear when navigating to the list of indexes
  • HUE-7173 - [indexes] Add name label to the create alias modal
  • HUE-7175 - [fb] Right click on file, click on a disable action actually clicks on the background
  • HUE-7176 - [metastore] Open in metastore from Assist does not select the first tab in Hue 3
  • HUE-7177 - [assist] Right click "Open in Importer"
  • HUE-7179 - [core] Avoid issue with searching documents on assist or global search box
  • HUE-7180 - [search] Hide horizontal column swap when there is only one
  • HUE-7181 - [assist] Collection field list does not get refreshed
  • HUE-7183 - [indexer] Properly bubble up errors when index creation fails
  • HUE-7184 - [search] Protect against nested facets with empty buckets
  • HUE-7185 - [indexer] Go back to the index list after deleting one index
  • HUE-7187 - [editor] Save button should be enabled once table name being filled
  • HUE-7188 - [editor] The save dropdown should be under the horizontal scrollbar
  • HUE-7189 - [editor] Query result modal is shown only once
  • HUE-7192 - [desktop] Hue Search is failing with DatabaseError field_cast_sql deprecated after Django 1.8
  • HUE-7193 - [core] /desktop/debug/is_alive should allow GET requests
  • HUE-7194 - [assist] Fix broken documents panel refresh
  • HUE-7196 - [assist] Fix JS error for missing Object.values in IE 11
  • HUE-7197 - [editor] Fix IE 11 JS errors in syntax checker
  • HUE-7198 - [editor] Remove unused onBlur code to improve IE 11 debug performance
  • HUE-7200 - [metastore] Refresh table and database js errors
  • HUE-7201 - [importer] 'Config' object has no attribute 'get' when Solr is not installed
  • HUE-7205 - [editor] Fix leaking interval in logScroller
  • HUE-7206 - [editor] Fix stack overflow from fileChooser binding in IE 11
  • HUE-7207 - [frontend] Fix fileChooser search for IE 11
  • HUE-7209 - [editor] Make sure pubsub subscribes continue to work when switching between editor types
  • HUE-7210 - [metastore] Fix the metastore refresh button
  • HUE-7211 - [metastore] Invalidate the Impala cache when pressing refresh in the metastore
  • HUE-7212 - [editor] Properly scroll to the executing query when selected queries are executed
  • HUE-7213 - [editor] Mark the correct statement when executing selection after the first line
  • HUE-7216 - [presentation] Close the editor mode when leaving by other links than the exit button
  • HUE-7218 - [editor] Offer links if row values are pure http links in the record popup
  • HUE-7219 - [dashboard] New columns are one slot too small when adding a new one
  • HUE-7223 - [autocomplete] Fix issue where the old autocompleter inserts extra characters on exception
  • HUE-7225 - [autocomplete] Prevent new line on enter when a suggestion equals the typed text
  • HUE-7226 - [frontend] Add navigation logging
  • HUE-7227 - [frontend] Log usage of popular values in the autocomplete
  • HUE-7231 - [assist] Keep track of the last opened documents folder
  • HUE-7234 - [editor] New variable should be empty
  • HUE-7240 - [impala] Workaround non support of partition_spec in DESCRIBE FORMATTED
  • HUE-7241 - [assist] Only refresh the docs assist when saving new documents in the editor
  • HUE-7242 - [frontend] Properly dispose the context popover contents for the global search results
  • HUE-7243 - [assist] Make sure the SQL assist panel is opened from the context popover show in assist action
  • IMPALA-992 - Rerun past queries from history in shell
  • IMPALA-1470 - Fix error message with catalog down
  • IMPALA-1478 - Improve error message when subquery is used in the ON clause
  • IMPALA-1882 - Remove ORDER BY restriction from first_value()/last_value()
  • IMPALA-1891 - Statestore won't send deletions in initial non-delta topic
  • IMPALA-2373 - Extrapolate row counts for HDFS tables.
  • IMPALA-2525 - Treat parquet ENUMs as STRINGs when creating impala tables.
  • IMPALA-2615 - support [[nodiscard]] on Status
  • IMPALA-3040 - addendum: use specific_build_type_timeout for slow builds
  • IMPALA-3208 - max_row_size option
  • IMPALA-3504 - UDF for current timestamp in UTC
  • IMPALA-3894 - Change the behavior parsing date "YY"
  • IMPALA-3905 - HdfsScanner::GetNext() for Avro, RC, and Seq scans.
  • IMPALA-3931 - arbitrary fixed-size uda intermediate types
  • IMPALA-3937 - Deprecate --be_service_threads
  • IMPALA-4039 - Increase width of Operator column in runtime profile
  • IMPALA-4086 - Add benchmark for simple scheduler
  • IMPALA-4164 - Avoid overly aggressive inlining in LLVM IR
  • IMPALA-4192 - Disentangle Expr and ExprContext
  • IMPALA-4276 - Profile displays non-default query options set by planner
  • IMPALA-4418 - Fixes extra blank lines in query result
  • IMPALA-4622 - Add ALTER COLUMN statement.
  • IMPALA-4623 - Enable file handle cache
  • IMPALA-4669 - Add Kudu's RPC, util, and security libraries
  • IMPALA-4674 - Port spilling ExecNodes to new buffer pool
  • IMPALA-4687 - Get Impala working against HBase 2.0
  • IMPALA-4703 - reservation denial debug action
  • IMPALA-4737 - Prevent SIGUSR1 from killing daemons when minidumps are disabled
  • IMPALA-4794 - Grouping distinct agg plan robust to data skew
  • IMPALA-4795 - Allow fetching function obj from catalog using signature
  • IMPALA-4826 - Fix error during a scan on repeated root schema in Parquet.
  • IMPALA-4833 - Use scheduling information to make per-node memory reservation tight
  • IMPALA-4861 - READ_WRITE warning on CREATE TABLE LIKE PARQUET.
  • IMPALA-4862 - make resource profile consistent with backend behaviour
  • IMPALA-4866 - Hash join node does not apply limits correctly
  • IMPALA-4905 - Don't send empty insert status to coordinator
  • IMPALA-4925 - Cancel finstance if query has finished
  • IMPALA-5016 - Simplify COALESCE() in SimplifyConditionalsRule.
  • IMPALA-5031 - UBSAN clean and method for testing UBSAN cleanliness
  • IMPALA-5036 - Parquet count star optimization
  • IMPALA-5061 - Populate null_count in parquet::statistics
  • IMPALA-5085 - large rows in BufferedTupleStreamV2
  • IMPALA-5104 - Admit queries with mem equal to proc mem_limit
  • IMPALA-5108 - idle_session_timeout kicks in later than expected
  • IMPALA-5109 - Increase range of backend latency histogram
  • IMPALA-5116 - Remove deprecated hash_* types in gutil
  • IMPALA-5158 - Account for difference between process memory consumption and memory used by queries
  • IMPALA-5160 - adjust spill buffer size based on planner estimates
  • IMPALA-5167 - Reduce the number of Kudu clients created
  • IMPALA-5240 - Allow config of number of disk I/O threads per disk type
  • IMPALA-5275 - Avoid printing status stack trace on hot paths
  • IMPALA-5280 - Coalesce chains of OR conditions to an IN predicate
  • IMPALA-5286 - Query with Kudu col name w/ different casing from 'order by' fails
  • IMPALA-5316 - Adds last_day() function
  • IMPALA-5327 - Handle return of JNI GetStringUTFChar
  • IMPALA-5336 - Fix partition pruning when column is cast
  • IMPALA-5347 - reduce codegen overhead of timestamp trunc()
  • IMPALA-5350 - Tidy up thread groups for finst exec threads
  • IMPALA-5352 - Age out unused file handles from the cache
  • IMPALA-5354 - INSERT hints for Kudu tables
  • IMPALA-5376 - Loads all TPC-DS tables
  • IMPALA-5386 - Fix ReopenCachedHdfsFileHandle failure case
  • IMPALA-5389 - simplify BufferDescriptor lifetime
  • IMPALA-5407 - Fix crash in HdfsSequenceTableWriter
  • IMPALA-5412 - Fix scan result with partitions on same file
  • IMPALA-5420 - Skip ACL fetch if the acl bit is not set.
  • IMPALA-5427 - Fix race between CRS::UpdateQueryStatus() and beeswax RPCs
  • IMPALA-5431 - Remove redundant path exists checks during table load
  • IMPALA-5433 - Mark single-argument Status c'tors as explicit
  • IMPALA-5446 - dropped Sorter::Reset() status
  • IMPALA-5477 - Fix minidump-2-core tool
  • IMPALA-5479 - Propagate the argument type in RawValue::Compare()
  • IMPALA-5480 - Improve missing filters message
  • IMPALA-5481 - Clarify RowDescriptor ownership
  • IMPALA-5482 - fix git checkout when workloads are modified
  • IMPALA-5483 - Automatically disable codegen for small queries
  • IMPALA-5484 - Fix LICENSE issues discovered by IPMC in 2.9 vote
  • IMPALA-5488 - Fix handling of exclusive HDFS file handles
  • IMPALA-5489 - Improve Sentry authorization for Kudu tables
  • IMPALA-5492 - Fix incorrect newline character in the LDAP message
  • IMPALA-5494 - Fixes the selectivity of NOT IN predicates
  • IMPALA-5495 - Improve error message if no impalad role is configured
  • IMPALA-5497 - spilling hash joins that output build rows hit OOM
  • IMPALA-5498 - Support for partial sorts in Kudu INSERTs
  • IMPALA-5499 - avoid ephemeral port conflicts
  • IMPALA-5500 - Reduce catalog update topic size
  • IMPALA-5504 - Fix TupleIsNullPredicate evaluation.
  • IMPALA-5506 - Add stdin description to help information of query_file option
  • IMPALA-5507 - Add clear description to help information of KEYVAL option
  • IMPALA-5511 - Add process start time to debug web page
  • IMPALA-5513 - Fix display message exception when using invalid KEYVAL
  • IMPALA-5514 - Throw an error when --ldap_password_cmd is used without LDAP auth
  • IMPALA-5517 - Allow IMPALA_LOGS_DIR to be overridden
  • IMPALA-5520 - TopN node periodically reclaims old allocations
  • IMPALA-5524 - Fixes NPE during planning with DISABLE_UNSAFE_SPILLS=1
  • IMPALA-5529 - Add additional function signatures for TRUNC()
  • IMPALA-5531 - Fix correctness issue in correlated aggregate subqueries
  • IMPALA-5532 - Stack-allocate compressors in RowBatch (de)serialization
  • IMPALA-5536 - Fix TCLIService thrift compilation on Hive 2
  • IMPALA-5539 - Fix Kudu timestamp with -use_local_tz_for_unix_ts
  • IMPALA-5540 - Revert Sentry version back to 5.13
  • IMPALA-5546 - Allow creating unpartitioned Kudu tables
  • IMPALA-5547 - Rework FK/PK join detection.
  • IMPALA-5548 - Fix some minor nits with HDFS parquet column readers
  • IMPALA-5549 - Remove deprecated fields from CatalogService API
  • IMPALA-5551 - Fix AggregationNode::Close() when Prepare() fails
  • IMPALA-5554 - sorter DCHECK on null column
  • IMPALA-5560 - always store CHAR(N) inline in tuple
  • IMPALA-5567 - race in fragment instance teardown
  • IMPALA-5570 - fix spilling null-aware anti join
  • IMPALA-5572 - Timestamp codegen for text scanner
  • IMPALA-5573 - Add decimal codegen in text scanner
  • IMPALA-5579 - Fix IndexOutOfBoundsException in GetTables metadata request
  • IMPALA-5580 - fix Java UDFs that return NULL strings
  • IMPALA-5582 - Store sentry privileges in lower case
  • IMPALA-5586 - Null-aware anti-join can take a long time to cancel
  • IMPALA-5588 - Reduce the frequency of fault injection
  • IMPALA-5591 - set should handle negative values
  • IMPALA-5594 - don't import shaded classes
  • IMPALA-5595 - Only set KuduScanner timestamp feature flag if necessary
  • IMPALA-5598 - Fix excessive dumping in MemLimitExceeded
  • IMPALA-5602 - Fix query optimization for kudu and datasource tables
  • IMPALA-5611 - KuduPartitionExpr holds onto memory unnecessarily
  • IMPALA-5612 - join inversion should factor in parallelism
  • IMPALA-5615 - Fix compute incremental stats for general partition exprs
  • IMPALA-5616 - Add --enable_minidumps startup flag
  • IMPALA-5617 - Include full workload name in tpch_nested query filenames
  • IMPALA-5618 - buffered-tuple-stream-v2 fixes
  • IMPALA-5623 - Fix lag() on STRING cols to release UDF mem
  • IMPALA-5627 - fix dropped statuses in HDFS writers
  • IMPALA-5629 - avoid expensive list::size() call
  • IMPALA-5630 - Add Kudu client version as a common metric
  • IMPALA-5636 - Change the metadata in parquet
  • IMPALA-5638 - Fix Kudu table set tblproperties inconsistencies
  • IMPALA-5641 - mem-estimate should never be less than mem-reservation
  • IMPALA-5643 - Add total number of threads created per group to /threadz
  • IMPALA-5644 - Fail queries early when their minimum reservation is too high to execute within the given mem_limit
  • IMPALA-5648 - fix count(*) mem estimate regression
  • IMPALA-5650 - Make sum_init_zero a SUM function
  • IMPALA-5652 - deprecate unlimited process mem_limit
  • IMPALA-5657 - FunctionCallExpr.toSql() and clone() ignore 'IGNORE NULLS' case
  • IMPALA-5658 - addtl. process/system-wide memory metrics
  • IMPALA-5659 - Begin standardizing treatment of thirdparty libraries
  • IMPALA-5659 - glog/gflags should be dynamically linked
  • IMPALA-5661 - buffer pool limit
  • IMPALA-5666 - ASAN poisoning for MemPool and BufferPool
  • IMPALA-5670 - Misc. tidying of ExecEnv
  • IMPALA-5676 - avoid expensive consistency checks in BTSv2
  • IMPALA-5677 - limit clean page memory consumption
  • IMPALA-5679 - Fix Parquet count(*) with group by string
  • IMPALA-5681 - release reservation from blocking operators
  • IMPALA-5686 - Update a mini cluster Sentry property
  • IMPALA-5689 - Avoid inverting non-equi left joins
  • IMPALA-5691 - recalibrate mem limit for Q18
  • IMPALA-5696 - Enable cipher configuration when using TLS / Thrift
  • IMPALA-5709 - Remove mini-impala-cluster
  • IMPALA-5713 - always reserve memory for preaggs
  • IMPALA-5714 - Add OpenSSL to bootstrap_toolchain.py
  • IMPALA-5715 - (mitigation only) defer destruction of MemTrackers
  • IMPALA-5716 - Don't delete cmake_modules/* when enabling distcc
  • IMPALA-5722 - Fix string to decimal cast
  • IMPALA-5725 - coalesce() with outer join incorrectly rewritten
  • IMPALA-5739 - Correctly handle sles12 SP2
  • IMPALA-5742 - De-allocate buffer in parquet-reader on exit
  • IMPALA-5743 - Support TLS version configuration for Thrift servers
  • IMPALA-5744 - Add 'use_krpc' flag and create DataStream interface
  • IMPALA-5745 - Bump Breakpad version
  • IMPALA-5749 - coordinator race hits DCHECK 'num_remaining_backends_ > 0'
  • IMPALA-5750 - Catch exceptions from boost thread creation
  • IMPALA-5756 - start memory maintenance thread after metric creation
  • IMPALA-5757 - Make tbl property toSql deterministic
  • IMPALA-5769 - Add periodic minidump cleanup
  • IMPALA-5773 - Correctly account for memory used in data stream receiver queue
  • IMPALA-5774 - Prevent FindInSet() from reading off end of string
  • IMPALA-5775 - Allow shell to support TLSv1, v1.1 and v1.2
  • IMPALA-5776 - HdfsTextScanner::WritePartialTuple() writes the varlen data to an incorrect memory pool
  • IMPALA-5778 - Clarify logging around and usage of read_size startup option
  • IMPALA-5784 - Separate planner and user set query options in profile
  • IMPALA-5787 - Dropped status in KuduTableSink::Send()
  • IMPALA-5788 - Fix agg node crash when grouping by nondeterministic exprs
  • IMPALA-5791 - Make bootstrap_development.sh survive apt-get failure
  • IMPALA-5796 - CTAS for Kudu fails with expr rewrite
  • IMPALA-5798 - ASAN use-after-poison in Parquet decoder
  • IMPALA-5799 - Kudu DML can crash if schema has changed
  • IMPALA-5800 - Configure Squeasel's cipher suite and TLS version
  • IMPALA-5811 - Add 'backends' tab to query details pages
  • IMPALA-5812 - Fix NPE when joining on empty const select
  • IMPALA-5815 - right outer join returns invalid memory
  • IMPALA-5819 - DCHECK in HdfsTextScanner::Close()
  • IMPALA-5823 - fix SET_DENY_RESERVATION_PROBABILITY
  • IMPALA-5825 - Catch exceptions thrown by TSSLSocketFactory c'tor
  • IMPALA-5838 - Improve errors on AC buffer mem rejection
  • IMPALA-5840 - Don't write page-level statistics in Parquet files.
  • IMPALA-5849 - Remove compile-time checks for OpenSSL > 1.0.0
  • IMPALA-5850 - Cast sender partition exprs under unions.
  • IMPALA-5852 - improve MINIMUM_RESERVATION_UNAVAILABLE error
  • IMPALA-5853 - fix GetResultSetMetadata() error message for invalid query id
  • IMPALA-5855 - Preaggregation crashes - unable to initialize hash table
  • IMPALA-5857 - avoid invalid free of hedged read metrics
  • IMPALA-5867 - Fix bugs parsing 2-digit year
  • IMPALA-5871 - KuduPartitionExpr incorrectly handles its child types
  • IMPALA-5885 - free runtime filter allocations in Parquet
  • IMPALA-5888 - free other local allocations in Parquet
  • IMPALA-5890 - Abort queries if scanner hits IO errors
  • IMPALA-5891 - fix PeriodicCounterUpdater initialization
  • IMPALA-5892 - Allow reporting status independent of fragment instance
  • IMPALA-2615 - annotate Status with [[nodiscard]]
  • IMPALA-5412 - Fix scan result with partitions on same file
  • KITE-762 - HiveAbstractDatasetRepository now uses the first URI from hive.metastore.uris property
  • KITE-1155 - Deleting an already deleted empty path should not fail the job
  • KUDU-871 - Allow tombstoned tablets to vote
  • KUDU-1125 - (part 1) catalog_manager: try to avoid unnecessarily rewriting tablet info
  • KUDU-1407 - reassign failed tablets
  • KUDU-1442 - log number of open log block containers
  • KUDU-1544 - Race in Java client's AsyncKuduSession.apply()
  • KUDU-1726 - Avoid fsync-per-block in tablet copy
  • KUDU-1755 - Part 1: Improve tablet on disk size metric
  • KUDU-1811 - C++ client: use larger batches when fetching scan tokens
  • KUDU-1863 - improve overall safety of graceful server shutdown
  • KUDU-1865 - Avoid heap allocation for payload slices
  • KUDU-1894 - fixed deadlock in client.Connection
  • KUDU-1911 - improve missing required arg message
  • KUDU-1929 - [rpc] Allow using encrypted private keys for TLS
  • KUDU-1942 - Kerberos fails to log in on hostnames with capital letters
  • KUDU-1943 - Add BlockTransaction to Block Manager
  • KUDU-1952 - Remove round-robin for block placement
  • KUDU-1955 - refuse to use world-readable keytabs
  • KUDU-2004 - Undefined behavior in TlsSocket::Writev()
  • KUDU-2013 - Support for long lived auth tokens in Java client
  • KUDU-2032 - Kerberos authentication fails with rdns disabled in krb5.conf
  • KUDU-2039 - Fix the table count in the /tables page of master webUI
  • KUDU-2041 - Fix negotiation deadlock
  • KUDU-2049 - Fix too-strict CHECK in RleIntBlockDecoder::SeekToPositionInBlock
  • KUDU-2053 - Fix race in Java RequestTracker
  • KUDU-2058 - Fix LocatedTablet string comparisons
  • KUDU-2060 - Show primary keys in the master's table web UI page
  • KUDU-2066 - Add experimental Gradle build support
  • KUDU-2067 - Enable cfile checksumming by default
  • KUDU-2072 - upgrade to cmake 3.9.0 breaks sles12sp0 cmake patch
  • KUDU-2078 - Sink failure if batch size > session's flush buffer size
  • KUDU-2083 - Decrement running maintenance ops on failed prepare
  • KUDU-2085 - Fix crash when seeking past end of prefix-encoded blocks
  • KUDU-2087 - Fix failure to map Kerberos principal to username with FreeIPA
  • KUDU-2088 - Synchronizer may not go out of scope with outstanding references
  • KUDU-2091 - Certificates with intermediate CA's do not work with Kudu
  • KUDU-2101 - Include a table summary at the bottom
  • KUDU-2102 - fix PosixRWFile::Sync to guarantee durability when used concurrently
  • KUDU-2103 - [java]Canonicalize hostnames in client
  • KUDU-2104 - Upgrade to Spark 2.2.0
  • KUDU-2114 - Don't re-delete tombstoned replicas
  • KUDU-2118 - Fully shut down TabletReplica on delete
  • KUDU-2123 - Auto-vivify cmeta on tombstoned replicas if doesn't exist at startup
  • KUDU-2131 - switch to LIFO log container retrieval
  • KUDU-2138 - delete failed replicas in tablet report
  • KUDU-2141 - master: Remove DCHECK when tablet report has no opid_index
  • OOZIE-2488 - Upgrade to latest OpenJPA version
  • OOZIE-2796 - oozie.action.keep.action.dir not getting notice
  • OOZIE-2816 - Strip out the first command word from Sqoop action if its "sqoop"
  • OOZIE-2854 - Oozie should handle transient database problems
  • OOZIE-2984 - Parse spark-defaults.conf values with spaces without needing the quotes
  • PARQUET-825 - Static analyzer findings (NPEs, resource leaks)
  • PIG-3567 - LogicalPlanPrinter throws OOM for large scripts
  • PIG-3655 - BinStorage and InterStorage approach to record markers is broken
  • SENTRY-1546 - Generic Policy provides bad error messages for Sentry exceptions
  • SENTRY-1580 - Provide pooled client connection model with HA
  • SENTRY-1646 - Unable to truncate table <database>.<tablename>; from "default" databases
  • SENTRY-1665 - cross-site scripting vulnerability in ConfServlet
  • SENTRY-1696 - Expose time spent creating the initial snapshot as a metric
  • SENTRY-1724 - Remove old PoolClientInvocationHandler
  • SENTRY-1744 - Simplify creation of DelegateSentryStore
  • SENTRY-1801 - Sentry Namenode Plugin should handle unknown permissions
  • SENTRY-1820 - Add JSON file reporter for Sentry metrics
  • SENTRY-1822 - Allow multiple Sentry reporters
  • SENTRY-1827 - Minimize TPathsDump thrift message used in HDFS sync
  • SENTRY-1853 - Add the log level access mechanism
  • SENTRY-1881 - PrivilegeOperatePersistence throws wrong type of exceptions
  • SENTRY-1892 - Reduce memory consumption of HMSPath$Entry and TPathEntry
  • SENTRY-1903 - TransactionManager shows retried transactions starting from 0
  • SENTRY-1932 - Improve logging for HMSPath
  • SENTRY-1937 - Optimize performance for listing sentry roles by group name
  • SENTRY-1938 - Sentry logs to provide more relevant information
  • SOLR-10889 - Stale zookeeper information is used during failover check
  • SPARK-13278 - Launcher fails to start with JDK 9 EA
  • SPARK-13669 - Job always fails in the external shuffle service unavilable situation
  • SPARK-15067 - YARN executors are launched with fixed perm gen size
  • SPARK-19688 - Spark on YARN credentials file set to different application directory
  • SPARK-20393 - Strengthen Spark to prevent XSS vulnerabilities
  • SPARK-20904 - Task failures during shutdown cause problems with pre-empted executors
  • SQOOP-3139 - sqoop tries to re execute select query during import in case of a connection reset error and this is causing lots of duplicate records from source
  • ZOOKEEPER-1653 - zookeeper fails to start because of inconsistent epoch
  • ZOOKEEPER-2678 - Large databases take a long time to regain a quorum