Hadoop Change Log
Release 2.7.6 - 2018-04-16
INCOMPATIBLE CHANGES
NEW FEATURES
IMPROVEMENTS
HADOOP-14246. Authentication Tokens should use SecureRandom instead of
Random and 256 bit secrets (Conttributed by Robert Kanter via
Daniel Templeton)
HADOOP-15177. Update the release year to 2018.
(Bharat Viswanadham via aajisaka)
HADOOP-13263. Reload cached groups in background after expiry.
(Stephen O'Donnell via Arpit Agarwal)
HADOOP-15212. Add independent secret manager method for logging expired
tokens. (Daryn Sharp via kihwal)
HADOOP-9477. Add posixGroups support for LDAP groups mapping service.
(Dapeng Sun via Yongjun Zhang)
HADOOP-12568. Update core-default.xml to describe posixGroups support.
(Wei-Chiu Chuang via aajisaka)
HADOOP-15283. Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2
to fix docker image build. (aajisaka)
HADOOP-15279. Increase maven heap size recommendations.
(Allen Wittenauer via aajisaka)
HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust.
(Steve Loughran via jing9)
HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping.
(Mingliang Liu via shv)
HADOOP-15345. Backport HADOOP-12185 to branch-2.7: NetworkTopology is not
efficient adding/getting/removing nodes. (He Xiaoqiao via Inigo Goiri)
OPTIMIZATIONS
BUG FIXES
HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider.
(Masatake Iwasaki via wheat9)
HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail.
(ebadger via rkanter)
HADOOP-14842. Hadoop 2.8.2 release build process get stuck due to java
issue. Contributed by Junping Du.
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with
'@' to be non-simple. (Bolke de Bruin via stevel).
HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters
seems flaky. (Weiwei Yang via Mingliang Liu, shv)
HADOOP-13508. FsPermission string constructor does not recognize
sticky bit. (Atul Sikaria via Wei-Chiu Chuang, shv)
HADOOP-15143. NPE due to Invalid KerberosTicket in UGI.
(Mukul Kumar Singh via Wei-Chiu Chuang)
HADOOP-15206. BZip2 drops and duplicates records when input split size
is small. (Aki Tanaka via jlowe)
HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and
GID attributes during the search. (Patrick White via vinodkv)
Revert HADOOP-13119. Add ability to secure log servlet using proxy users.
(Contribute by Yuanbo Liu via Eric Yang)
HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store.
(Wei-Chiu Chuang and Konstantin Shvachko)
Release 2.7.5 - 2017-12-14
INCOMPATIBLE CHANGES
NEW FEATURES
IMPROVEMENTS
HADOOP-13442. Optimize UGI group lookups. (Daryn Sharp via kihwal, shv)
HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests.
(Erik Krogen via jlowe)
HADOOP-14867. Update HDFS Federation setup document, for incorrect
property name for secondary name node http address.
(Bharat Viswanadham via Arpit Agarwal)
OPTIMIZATIONS
BUG FIXES
HADOOP-14702. Fix formatting issue and regression caused by conversion from
APT to Markdown. (Doris Gu via iwasakims)
HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure
durations. (Bharat Viswanadham via jlowe)
HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly
calculated. (Hanisha Koneru via jlowe)
HADOOP-14919. BZip2 drops records when reading data in splits. (Jason Lowe)
Release 2.7.4 - 2017-08-04
INCOMPATIBLE CHANGES
HADOOP-13812. Upgrade Tomcat to 6.0.48. (John Zhuge via aajisaka)
NEW FEATURES
IMPROVEMENTS
HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter)
HADOOP-10597. RPC Server signals backoff to clients when all request
queues are full. (Ming Ma via Arpit Agarwal)
HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs.
(Anu Engineer via xyao)
HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via
yliu)
HADOOP-13782. Make MutableRates metrics thread-local write,
aggregate-on-read. (Erik Krogen via zhz)
HADOOP-13655. document object store use with fs shell and distcp.
(Steve Loughran via Mingliang Liu)
HADOOP-13742. Expose "NumOpenConnectionsPerUser" as a metric.
(Brahma Reddy Battula via kihwal)
HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer.
(Erik Krogen via zhz)
HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread
(Elliott Clark via Colin P. McCabe).
HADOOP-14408. Backport contributed by Erik Krogen.
HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab
via aw)
HADOOP-14440. Add metrics for connections dropped. (Eric Badger via kihwal)
HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust.
(Steve Loughran via jing9)
OPTIMIZATIONS
HADOOP-14138. Remove S3A ref from META-INF service discovery, rely on
existing core-default entry (Steve Loughran via jlowe)
HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs.
(Erik Krogen via shv)
BUG FIXES
HADOOP-13362. DefaultMetricsSystem leaks the source name when a source
unregisters (Junping Du via jlowe)
HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache.
(Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula via ozawa)
HADOOP-13202. Avoid possible overflow in
org.apache.hadoop.util.bloom.BloomFilter#getNBytes.
(Kai Sasaki via aajisaka)
HADOOP-12991. Conflicting default ports in DelegateToFileSystem.
(Kai Sasaki via aajisaka)
HADOOP-11149. Increase the timeout of TestZKFailoverController.
(Steve Loughran via wheat9)
HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk
(Eric Badger via jlowe)
HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently.
(kihwal)
HADOOP-13579. Fix source-level compatibility after HADOOP-11252.
(Tsuyoshi Ozawa via aajisaka)
HADOOP-13494. ReconfigurableBase can log sensitive information.
(Sean Mackrory via Andrew Wang)
HADOOP-13512. ReloadingX509TrustManager should keep reloading in
case of exception. (Mingliang Liu)
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through
ssl-server.conf. (Vijay Singh via Zhe Zhang)
HADOOP-12765. HttpServer2 should switch to using the non-blocking
SslSelectChannelConnector to prevent performance degradation when
handling SSL connections.
(Min Shen,Wei-Chiu Chuang via Zhe Zhang)
HADOOP-13558. UserGroupInformation created from a Subject incorrectly
triesto renew the Kerberos ticket. (Xiao Chen).
HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager
. (Mehran Hassani via Mingliang Liu).
HADOOP-11780. Prevent IPC reader thread death.
(Daryn Sharp via kihwal).
HADOOP-12597. In kms-site.xml configuration
"hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with
new name. (Contributed by Surendra Singh Lilhore via Brahma Reddy Battula)
HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7.
(Brahma Reddy Battula)
HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2.
(Min Shen).
HADOOP-13236. truncate will fail when we use viewfilesystem.
(Brahma Reddy Battula)
HADOOP-13201. Print the directory paths when ViewFs denies the rename
operation on internal dirs.
(Contributed by Tianyin Xiu via Brahma Reddy Battula)
HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses.
(Daryn Sharp via yliu)
HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used.
(Erik Krogen via zhz)
HADOOP-1185