Hadoop-2.6.4

Hadoop Change Log Release 2.6.4 - 2016-02-11 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS OPTIMIZATIONS BUG FIXES HADOOP-11252. RPC client does not time out by default. (Wilfred Spiegelenburg and Masatake Iwasaki via aajisaka) HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. (kanaka kumar avvaru via wheat9) HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally (Sangjin Lee and Colin Patrick McCabe via jlowe) HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. (Xiao Chen via aajisaka) Release 2.6.3 - 2015-12-17 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. (Zhihai Xu via cnauroth) OPTIMIZATIONS BUG FIXES HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. (Rakesh R via aajisaka) HADOOP-9242. Duplicate surefire plugin config in hadoop-common. (Andrey Klochkov via suresh) HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. (Ming Ma via cnauroth) HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. (Stephen Chu via wheat9) HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. (apurtell via stevel) HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. (Wei-Chiu Chuang via vinodkv) Release 2.6.2 - 2015-10-28 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS OPTIMIZATIONS BUG FIXES Release 2.6.1 - 2015-09-23 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS HADOOP-7139. Allow appending to existing SequenceFiles (kanaka kumar avvaru via vinayakumarb) HADOOP-12280. Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe) OPTIMIZATIONS HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe) HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) BUG FIXES HADOOP-11466: FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. (Stephen Chu via wheat9) HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. (Jerry Chen via wang) HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. (Arun Suresh via wang) HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. (Benoy Antony via wheat9) HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh. HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. (Ming Ma via kihwal) HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. (cnauroth) HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. (Sean Busbey via yliu) HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu) HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) HADOOP-11802: DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. (Matt Foley via harsh) HADOOP-11932. MetricsSinkAdapter may hang when being stopped. (Brahma Reddy Battula via jianhe) HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. (Larry McCay via cnauroth) Release 2.6.0 - 2014-11-18 INCOMPATIBLE CHANGES NEW FEATURES HADOOP-10433. Key Management Server based on KeyProvider API. (tucu) HADOOP-10893. isolated classloader on the client side (Sangjin Lee via jlowe) HADOOP-10400. Incorporate new S3A FileSystem implementation. (Jordan Mendelson and Dave Wang via atm) IMPROVEMENTS HADOOP-10808. Remove unused native code for munlock. (cnauroth) HADOOP-10815. Implement Windows equivalent of mlock. (cnauroth) HADOOP-7664. Remove warmings when overriding final parameter configuration if the override value is same as the final parameter value. (Ravi Prakash via suresh) HADOOP-10673. Update rpc metrics when the call throws an exception. (Ming Ma via jing9) HADOOP-10845. Add common tests for ACLs in combination with viewfs. (Stephen Chu via cnauroth) HADOOP-10839. Add unregisterSource() to MetricsSystem API. (Shanyu Zhao via cnauroth) HADOOP-10607. Create an API to separate credentials/password storage from applications (Larry McCay via omalley) HADOOP-10732. Fix locking in credential update. (Ted Yu via omalley) HADOOP-10733. Fix potential null dereference in CredShell. (Ted Yu via omalley) HADOOP-10610. Upgrade S3n s3.fs.buffer.dir to support multi directories. (Ted Malaska via atm) HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu) HADOOP-10755. Support negative caching of user-group mapping. (Lei Xu via wang) HADOOP-10855. Allow Text to be read with a known Length. (todd) HADOOP-10887. Add XAttrs to ViewFs and make XAttrs + ViewFileSystem internal dir behavior consistent. (Stephen Chu via wang) HADOOP-10882. Move DirectBufferPool into common util. (todd) HADOOP-8069. Enable TCP_NODELAY by default for IPC. (Todd Lipcon via Arpit Agarwal) HADOOP-10902. Deletion of directories with snapshots will not output reason for trash move failure. (Stephen Chu via wang) HADOOP-10900. CredentialShell args should use single-dash style. (wang) HADOOP-10903. Enhance hadoop classpath command to expand wildcards or write classpath into jar manifest. (cnauroth) HADOOP-10791. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) HADOOP-10771. Refactor HTTP delegation support out of httpfs to common. (tucu) HADOOP-10835. Implement HTTP proxyuser support in HTTP authentication client/server libraries. (tucu) HADOOP-10820. Throw an exception in GenericOptionsParser when passed an empty Path. (Alex Holmes and Zhihai Xu via wang) HADOOP-10281. Create a scheduler, which assigns schedulables a priority level. (Chris Li via Arpit Agarwal) HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw) HADOOP-10231. Add some components in Native Libraries document (Akira AJISAKA via aw) HADOOP-10650. Add ability to specify a reverse ACL (black list) of users and groups. (Benoy Antony via Arpit Agarwal) HADOOP-10335. An ip whilelist based implementation to resolve Sasl properties per connection. (Benoy Antony via Arpit Agarwal) HADOOP-10975. org.apache.hadoo