hadoop-2.7.1.tar.gz

Hadoop Change Log Release 2.7.2 - UNRELEASED INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS OPTIMIZATIONS BUG FIXES Release 2.7.1 - 2015-06-28 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. (Yongjun Zhang) OPTIMIZATIONS BUG FIXES HADOOP-11868. Invalid user logins trigger large backtraces in server log (Chang Li via jlowe) HADOOP-11872. "hadoop dfs" command prints message about using "yarn jar" on Windows(branch-2 only) (Varun Vasudev via cnauroth) HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. (Zhijie Shen via ozawa) HADOOP-11663. Remove description about Java 6 from docs. (Masatake Iwasaki via aajisaka) HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. (cnauroth) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. (Larry McCay via cnauroth) HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. (Kazuho Fujii via aajisaka) HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Arpit Agarwal) HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A Chundatt via Colin P. McCabe) Release 2.7.0 - 2015-04-20 INCOMPATIBLE CHANGES HADOOP-10530 Make hadoop build on Java7+ only (stevel) NEW FEATURES HADOOP-10987. Provide an iterator-based listing API for FileSystem (kihwal) HADOOP-7984. Add hadoop --loglevel option to change log level. (Akira AJISAKA via cnauroth) HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. (Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei via cnauroth) HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. (Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovich, Brian Swan, and Min Wei via cnauroth) HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) HADOOP-11490. Expose truncate API via FileSystem and shell command. (Milan Desai via shv) HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing job. (Yongjun Zhang and Todd Lipcon via ozawa) HADOOP-11510. Expose truncate API via FileContext. (yliu) HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. (Vinayakumar B via ozawa) IMPROVEMENTS HADOOP-11483. HardLink.java should use the jdk7 createLink method (aajisaka) HADOOP-11156. DelegateToFileSystem should implement getFsStatus(final Path f). (Zhihai Xu via wang) HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) HADOOP-10748. HttpServer2 should not load JspServlet. (wheat9) HADOOP-6857. FsShell should report raw disk usage including replication factor. (Byron Wong via shv) HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. (Pascal Oliva via wheat9) HADOOP-10563. Remove the dependency of jsp in trunk. (wheat9) HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. (Stephen Chu via wheat9) HADOOP-11291. Log the cause of SASL connection failures. (Stephen Chu via cnauroth) HADOOP-11173. Improve error messages for some KeyShell commands. (wang) HADOOP-11257: Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) HADOOP-11341. KMS support for whitelist key ACLs. (Arun Suresh via wang) HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) HADOOP-11313. Adding a document about NativeLibraryChecker. (Tsuyoshi OZAWA via cnauroth) HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. (Li Lu via wheat9) HADOOP-10476) Bumping the findbugs version to 3.0.0. (wheat9) HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe) HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. (Shanyu Zhao via cnauroth) HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. (Shanyu Zhao via cnauroth) HADOOP-11421. Add IOUtils#listDirectory (cmccabe) HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe) HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe) HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe) HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha) HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Chris Nauroth via Arpit Agarwal) HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. (wheat9) HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter) HADOOP-11455. KMS and Credential CLI should request confirmation for deletion by default. (Charles Lamb via yliu) HADOOP-11390 Metrics 2 ganglia provider to include hostname in unresolved address problems. (Varun Saxena via stevel) HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch (ozawa) HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. (cnauroth) HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job (Akshay Radia via brandonli) HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Varun Saxena via Arpit Agarwal) HADOOP-11481. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) HADOOP-11171 Enable using a proxy server to connect to S3a. (Thomas Demoor via stevel) HADOOP-11489 Dropping dependency on io.netty from hadoop-nfs' pom.xml (Ted Yu via ozawa) HADOOP-11419 Improve hadoop-maven-plugins. (Herve Boutemy via stevel) HADOOP-11450. Cleanup DistCpV1 not to use deprecated methods and fix javadocs. (Varun Saxena via ozawa) HADOOP-4297. Enable Java assertions when running tests. (Tsz Wo Nicholas Sze via wheat9) HADOOP-10626. Limit Returning Attributes for LDAP search. (Jason Hubbard via atm) HADOOP-11317. Increment SLF4J version to 1.7.10. (Tim Robertson via ozawa) HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka) HADOOP-10574. Bump the maven plugin versions too -moving the numbers into properties. (aajisaka) HADOOP-11441. Hadoop-azure: Change few methods scope to public. (Shashank Khandelwal via cnauroth) HADOOP-9137. Support connection limiting in IPC server (kihwal) HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masa