hadoop2.7.7

Hadoop Change Log Release 2.7.7 - 2018-07-06 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar. OPTIMIZATIONS BUG FIXES HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota. Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka. Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen Release 2.7.6 - 2018-04-16 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets (Conttributed by Robert Kanter via Daniel Templeton) HADOOP-15177. Update the release year to 2018. (Bharat Viswanadham via aajisaka) HADOOP-13263. Reload cached groups in background after expiry. (Stephen O'Donnell via Arpit Agarwal) HADOOP-15212. Add independent secret manager method for logging expired tokens. (Daryn Sharp via kihwal) HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang) HADOOP-12568. Update core-default.xml to describe posixGroups support. (Wei-Chiu Chuang via aajisaka) HADOOP-15283. Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2 to fix docker image build. (aajisaka) HADOOP-15279. Increase maven heap size recommendations. (Allen Wittenauer via aajisaka) HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. (Steve Loughran via jing9) HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. (Mingliang Liu via shv) HADOOP-15345. Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes. (He Xiaoqiao via Inigo Goiri) OPTIMIZATIONS BUG FIXES HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. (Masatake Iwasaki via wheat9) HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail. (ebadger via rkanter) HADOOP-14842. Hadoop 2.8.2 release build process get stuck due to java issue. Contributed by Junping Du. HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Weiwei Yang via Mingliang Liu, shv) HADOOP-13508. FsPermission string constructor does not recognize sticky bit. (Atul Sikaria via Wei-Chiu Chuang, shv) HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. (Mukul Kumar Singh via Wei-Chiu Chuang) HADOOP-15206. BZip2 drops and duplicates records when input split size is small. (Aki Tanaka via jlowe) HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. (Patrick White via vinodkv) Revert HADOOP-13119. Add ability to secure log servlet using proxy users. (Contribute by Yuanbo Liu via Eric Yang) HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. (Wei-Chiu Chuang and Konstantin Shvachko) Release 2.7.5 - 2017-12-14 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS HADOOP-13442. Optimize UGI group lookups. (Daryn Sharp via kihwal, shv) HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. (Erik Krogen via jlowe) HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. (Bharat Viswanadham via Arpit Agarwal) OPTIMIZATIONS BUG FIXES HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. (Doris Gu via iwasakims) HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. (Bharat Viswanadham via jlowe) HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. (Hanisha Koneru via jlowe) HADOOP-14919. BZip2 drops records when reading data in splits. (Jason Lowe) Release 2.7.4 - 2017-08-04 INCOMPATIBLE CHANGES HADOOP-13812. Upgrade Tomcat to 6.0.48. (John Zhuge via aajisaka) NEW FEATURES IMPROVEMENTS HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Ming Ma via Arpit Agarwal) HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. (Anu Engineer via xyao) HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. (Erik Krogen via zhz) HADOOP-13655. document object store use with fs shell and distcp. (Steve Loughran via Mingliang Liu) HADOOP-13742. Expose "NumOpenConnectionsPerUser" as a metric. (Brahma Reddy Battula via kihwal) HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. (Erik Krogen via zhz) HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe). HADOOP-14408. Backport contributed by Erik Krogen. HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw) HADOOP-14440. Add metrics for connections dropped. (Eric Badger via kihwal) HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. (Steve Loughran via jing9) OPTIMIZATIONS HADOOP-14138. Remove S3A ref from META-INF service discovery, rely on existing core-default entry (Steve Loughran via jlowe) HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. (Erik Krogen via shv) BUG FIXES HADOOP-13362. DefaultMetricsSystem leaks the source name when a source unregisters (Junping Du via jlowe) HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. (Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula via ozawa) HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. (Kai Sasaki via aajisaka) HADOOP-12991. Conflicting default ports in DelegateToFileSystem. (Kai Sasaki via aajisaka) HADOOP-11149. Increase the timeout of TestZKFailoverController. (Steve Loughran via wheat9) HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk (Eric Badger via jlowe) HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. (kihwal) HADOOP-13579. Fix source-level compatibility after HADOOP-11252. (Tsuyoshi Ozawa via aajisaka) HADOOP-13494. ReconfigurableBase can log sensitive information. (Sean Mackrory via Andrew Wang) HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Mingliang Liu) HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. (Vijay Singh via Zhe Zhang) HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. (Min Shen,Wei-Chiu Chuang via Zhe Zhang) HADOOP-13558. UserGroupInformation created from a Subject incorrectly triesto renew the Kerberos ticket. (Xiao Chen). HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager . (Mehran Hassani via Mingliang Liu). HADOOP-11780. Prevent IPC reader thread death. (Daryn Sharp via kihwal). HADOOP-12597. In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name. (Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) HADOOP-13670. Upd