*******************************************************************************
CloverETL Engine - HISTORY of RELEASES
*******************************************************************************
REL-3-4-3
---------
- FIXES:
- Component status and number of records on the edge are not shown after joiner
that has input edges in different phases
- Insufficient error message while reading CSV files with header across two rows
- Insufficient and unclear error message while reading CSV files with incorrect encoding
- HTTPConnector changes EOL delimiters in response content
- Null value being saved into db table field of time type
REL-3-4-2
---------
* improved performance of TreeWriter caches (in-memory caching)
* upgraded JSch library to 0.1.50
* upgraded slf4j-api to 1.7.2
- FIXES:
- CLO-1216 Hadoop is missing in opensource engine build
- CLO-1335 Problems with DBExecute component
REL-3-4-1
---------
- FIXES:
- Data_Intersection component drops data silently
- NPE occurs when data flows from JSONReader to ExtHashJoin and both components are in the same phase
- Checkconfig on DBOutputTable causes JNDI connection not released
- SORT_WITHIN_GROUPS output more records then records on input
- Lookup table can't read quoted data
- XmlReader: when port is not selected NPE is thrown
- A graph with DBLookupTable used in a CTL code is not restartable in batch mode
REL-3-4-0
---------
* documented that Cloudera 3 works only on Sun Java
* HTTPConnector should support PUT and DELETE methods
* HTTPConnector - content should allow byte/cbyte data types
* CTL2 wrapper for returning capturing groups from regex
* improved visualization of error messages
- FIXES:
- XMLWriter with underscore in key fails on server
- CharInputReader.skip skips bytes instead of characters
- UniversalDataReader - wildcard redading fails on server
- XMLExtract - extract element contents as text fails on databuffersize
- XmlExtract: parent field is not copied correctly
- Wildcard mapping does not check container type
- Improve Aggregate checkconfig
- MysqlDataWriter on MacOS
- UniversalDataReader: "Trim strings: not working when "quote strings" enabled
- XLSDataWriter: NPE when finishing writing into .xls file
- BACKWARDS INCOMPATIBILITY:
- DBInputTable does not support empty strings - empty strings are considered as null value
REL 3-4-0-M2
------------
* Cleanup of error reporting in graph log
* Allow DataGenerator to generate variable number of records
* Denormalizer should work also without key/group specification
* XSLTransformer - support XSLT v2.0
- Update JSch SFTP library
- HadoopReader and HadoopWriter for local files
- New CTL2 function sha256()
- FIXES:
- Sequence does not allow using numbers higher than integer limit.
- Graph with 2 simple gathers runs forever
- Implement connection pooling
- BACKWARDS INCOMPATIBILITY:
* Database connection refactoring
* Maximum number of processed records has long precision
REL 3-4-0-M1
------------
* Hadoop support
- Hadoop connection
- HDFS protocol for readers & writers
- HadoopReader & HadoopWriter
- Hive JDBC specific
* CTL2 wrapper for returning capturing groups from regex
* CTL function for writing into lookup table
* SystemExecute - new attribute “Ignore exit value”
* Write binary data without padding with 0
REL-3-3-1
---------
+ tracking reported in % (e.g. now it's "30%" vs previous "0.3")
- FIXES:
- XMLExtract: autofilling does not work
- SystemExecute: Do not delete temp file if component fails
- Recapacity of this CloverBuffer is not allowed.
- CTLUtils class cannot be used in transformations
- Incorrect last modification date on SFTP
- Remove org.jetel.license dependency from org.jetel.component plugin
REL 3-3-0
---------
- UniversalDataReader does not open as many connections to SFTP
- Partition correctly uses charset attribute
- escape values in defaultProperties
- input port reading in stream mode - process data progressibely without waiting for EOF
REL 3-3-0-M3
------------
* DBFDataWriter component
* USE_DIRECT_MEMORY in default properties – ability to turn off usage of direct memory and use heap instead (lower performance, better manageability)
* Tempspace Management - components were updated to use centralised tempspace management
- BACKWARDS INCOMPATIBILITY
- components cannot specify their own tmp paths (SortWithinGroups, ExtSort, HTTPConnector, XLSDataWriter, XMLWriter)
- components cannot prevent deletion of their temporary files (SystemExecute - Delete tmp batch file)
- XMLExtract - ability to read element/attribute names
- MD5Sum, SHA1Sum, SHA256Sum aggregation functions
- MSAccess specific/connection
- CTL functions to access environment variables, Java properties, graph parameters
- dateDiff() CTL function implementation fixed - provides correct results (BACKWARDS INCOMPATIBILITY)
- Upgraded bundled Oracle JDBC driver to version 11.2.0.3.0
REL 3-3-0-M2
------------
* Support for list and map fields in metadata (container types)
* CTL2 change in assignment operator '=' (now it assigns by value, not reference)
- Webservice client: added "Timeout" attribute + ability to print SOAP request/response in DEBUG mode
REL 3-3-0-M1
------------
+ Introducing MS Access and Generic ODBC
- Improved log messages in readers and Aggregate
- CTL2: fixed datediff() function to work with milliseconds
- FastSort: Fixed rare synchronization problem during long runs causing a deadlock
- UniversalDataReader: fixed buffer size problems when verbose mode is on with big records
- UniversalDataReader/Writer, ComplexDataReader and ParallelReader: Explicit Quoted string and Quote character have now higher priority than setting these values in metadata (i.e. can now be properly overridden in component setting)
- Analyzedb.bat: Paths to Clover-bundled JDBC drivers are now properly set
- UniversalDataWriter and partitioned output – locking of file pattern is now more fine grained so that multiple graphs can run at the same time
REL 3-2-1
---------
- WebServiceClient name space support fixed
- XMLExtract mapping dialog not handling recursive XSDs correctly fixed
REL 3-2-0
---------
* Introduction of dynamic edge buffers
+ Field Labels
REL 3-1-2
---------
REL 3-1-0
---------
* New component ComplexDataReader (commercial only)
- for reading structured and unstructured flat files
- similar to MultiLevelReader, yet more powerful and user-friendly
* Redesigned component XMLWriter (EXT_XML_WRITER)
- brand new mapping (incompatible)
- old XMLWriter still available as a deprecated component
- supports disk caching for large amounts of data
* XMLExtract improvements
- automatic data denormalization
- metadata creation out of XMLExtract dialog
- ability to add ports and assign metadata
- annotations
- improved error reporting
* AddressDoctor component (commercial only)
* Lotus Notes Domino Reader/Writer/metadata extract (commercial only)
* New component EmailReader (commercial only)
* New CTL2 functions - xml2json() and json2xml()
* Support for WebDAV and Amazon S3 protocols
* DBInputTable supports reading SQL queries from input port
+ Binary parsers for integer and long, double (little/big endian, packed decimal)
+ New component Pivot
+ New component MetaPivot
+ PervasiveDB support
+ Firebird is has now built-in support
+ Trash multiple input ports
+ Trash can simulate a writer (Performance/Validate records modes)
+ New component DataSampler
+ New attribute for Denormalizer - group size
+ Performance of CTL random* functions improved
+ Performance of CTL String.indexOf() improved
+ Fixed handling of paths with spaces
+ ParallelReader improvements
+ Performance of Concatenate improved
+ Truezip is now used for handling zip files (append, excel)
REL 3-0-2
---------
* CTL2: Lists and maps of records are now possible.
Now you can use list of records and maps of records in your code.
Example:
// lists
MyDataRecord[] myList;
MyDataRecor
评论0