hadoop-2.7.7 linux安装包

Hadoop MapReduce Change Log Release 2.7.7 - 2018-07-06 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS OPTIMIZATIONS BUG FIXES Release 2.7.6 - 2018-04-16 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS OPTIMIZATIONS BUG FIXES MAPREDUCE-5124. AM lacks flow control for task events. (Peter Bacsko via jlowe) MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. (Gergo Repas via jlowe) MAPREDUCE-7020. Task timeout in uber mode can crash AM. (Peter Bacsko via jlowe) MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. (Peter Bacsko via jlowe) MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is flaky. (Peter Bacsko via jlowe) Release 2.7.5 - 2017-12-14 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS MAPREDUCE-6937. Backport MAPREDUCE-6870 to branch-2 while preserving compatibility. (Peter Bacsko via Haibo Chen) MAPREDUCE-6975. Logging task counters. (Prabhu Joseph via Naganarasimha) OPTIMIZATIONS BUG FIXES MAPREDUCE-6931. Remove TestDFSIO "Total Throughput" calculation. (Dennis Huo via shv) MAPREDUCE-6750. Fix TestHSAdminServer#testRefreshSuperUserGroups (Kihwal Lee via Varun Saxena) MAPREDUCE-6957. shuffle hangs after a node manager connection timeout. (Jooseong Kim via jlowe) MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA. Release 2.7.4 - 2017-08-04 INCOMPATIBLE CHANGES NEW FEATURES MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R. Backport by Inigo Goiri) IMPROVEMENTS MAPREDUCE-6741. Add MR support to redact job conf properties. (Haibo Chen via jlowe) OPTIMIZATIONS BUG FIXES MAPREDUCE-6744. Increase timeout on TestDFSIO tests (Eric Badger via jlowe) MAPREDUCE-6768. TestRecovery.testSpeculative failed with NPE (Haibo Chen via jlowe) MAPREDUCE-4784. TestRecovery occasionally fails (Haibo Chen via jlowe) MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event (Haibo Chen via jlowe) MAPREDUCE-6763. Shuffle server listen queue is too small. (Jason Lowe via Varun Saxena) MAPREDUCE-6724. Single shuffle to memory must not exceed Integer#MAX_VALUE. (Haibo Chen via jlowe) MAPREDUCE-6873. MR Job Submission Fails if MR framework application path not on defaultFS. (xkrogen via zhz) MAPREDUCE-6433. launchTime may be negative. (zxu) backported by Chris Douglas. MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. (Nathan Roberts via shv). MAPREDUCE-6711. JobImpl fails to handle preemption events on state COMMITTING. (Prabhu Joseph via Junping Du) Release 2.7.3 - 2016-08-25 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS MAPREDUCE-6436. JobHistory cache issue. (Kai Sasaki via zxu) MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. (Brahma Reddy Battula via wang) MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) OPTIMIZATIONS BUG FIXES MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors (Rushabh Shah via epayne) MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter) MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. (Junping Du via jianhe) MAPREDUCE-6377. JHS sorting on state column not working in webUi. (zhihai xu via devaraj) MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading (Nathan Roberts via jlowe) MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. (Kai Sasaki via aajisaka) MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory (Bibin A Chundatt via jlowe) MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. (Junping Du via jianhe) MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. (Xuan Gong via jlowe) MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal() (Xuan Gong via jlowe) MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host (zhihai xu via jlowe) MAPREDUCE-6191. Improve clearing stale state of Java serialization testcase. (Sam Liu via Eric Yang) MAPREDUCE-6460. TestRMContainerAllocator. testAttemptNotFoundCausesRMCommunicatorException fails. (Zhihai Xu) MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. (Junping Du via vvasudev) MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. (Gabor Liptak via aajisaka) MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. (Eric Badger via aajisaka) MAPREDUCE-6302. Preempt reducers after a configurable timeout irrespective of headroom. (kasha via wangda) MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. (Gergely Novák via junping_du) MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests (Wangda Tan via jlowe) MAPREDUCE-6513. Job got hanged forever when one NM unstable for some time. Contributed by Varun Saxena & Wangda Tan MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records (Wilfred Spiegelenburg via jlowe) MAPREDUCE-6514. Job hangs as ask is not updated after ramping down of all reducers. (Varun Saxena and Wangda Tan via vinodkv) MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.) (Junping Du via jianhe) Release 2.7.2 - 2016-01-25 INCOMPATIBLE CHANGES NEW FEATURES IMPROVEMENTS OPTIMIZATIONS BUG FIXES MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to getMapOutputInfo if mapId is not in the cache. (zhihai xu via devaraj) MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing. (zhihai xu via devaraj) MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor (Chang Li via ozawa) MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors (Kuhu Shukla via jlowe) MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks (Naganarasimha G R via jlowe) MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well (Vinayakumar B, Rushabh Shah, and Akira AJISAKA via jlowe) MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. (Zhihai Xu via jlowe) MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear (Chang Li via jlowe) MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask (Bibin A Chundatt via jlowe) MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections (Chang Li via jlowe) MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state. (zhihai xu via devaraj) MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary() (Junping Du via jlowe) MAPREDUCE-6