Advanced Data Management (ADM) is a separately licensed component of Syncsort's DMExpress. ADM's powerful features include:
- High-performance aggregation
- High-performance join
- Advanced data transformation capabilities (including UNICODE (UTF-*) support, target layout mapping, external functions, arithmetic functions, date and time functions, string functions, user-defined values, data partitioning, and advanced aggregation functions)
DMExpress ADM shortens aggregation processing time for
major pharmaceutical company by an additional 60%.
ADM high-performance aggregations and joins exploit patented algorithms, state-of-the-art parallel processing technology, and dynamic optimization to speed applications and reduce computing resources. These time and resource savings increase dramatically as data volumes grow.
The DMExpress engine processes data far more efficiently than database functions. Through parallelization and other high-performance techniques, DMExpress automatically alerts you when performance would be improved by licensing ADM.
Data warehouse experts agree that aggregates are the best way to speed warehouse queries. A query answered from base-level data can take hours and involve millions of data records and millions of calculations. With precalculated aggregates, the same query can be answered in seconds with just a few records and calculations.
ADM high-performance aggregation simplifies the creation, administration, and execution of aggregation jobs. It summarizes data much faster than other aggregation methods, such as C programs, SQL statements, or third-party multi-purpose data warehouse packages. It provides the necessary flexibility to select the best aggregates for optimizing query performance. ADM high-performance aggregation enables you to:
- Employ advanced aggregation functions, including Min, Max, Avg, and date and time granularity
- Generate aggregates, including multi-level hierarchical aggregations, significantly faster than with other methods
- Set up aggregates by browsing database tables or flat files through an easy-to-use interface with complete online help
- Group data on a number of dimensions, such as time, geography, sales unit, and product type
ADM high-performance join significantly improves the efficiency of preprocessing, retrieval, and updating in a dimensional data warehouse. ADM high-performance join enables you to:
- Optimize data preparation
- Improve query performance
- Reduce the quantity of data that must be processed in response to a query
- Speed lookups and application matching
- Retrieve and summarize information more efficiently
- Minimize storage and throughput requirements
- Reduce elapsed time of changed data capture/delta processing
Additional data transformation capabilities allow you to easily design tasks, enabling powerful data transformations and complex processing.
- Support for international encodings includes database extract and load encoding for RDBMS national character set data types. Full character support yields higher speed and capability as a result of automatic text data extraction/loading optimization. File-level encoding includes support for UNICODE (UTF-*)/multi-byte data, metadata, file delimiters (field separators, record terminators), and file metadata (header layouts). UNICODE (UTF-*) support enables text encoding (encode function), comparisons across encodings, and function arguments.
- Target layout mapping allows a particular, externally defined format to be used for a DMExpress target file.
- Support for user-written external functions allows DMExpress expressions to call any existing or new functions, such as those in Java or C. Any transformation is now fully customizable.
- Arithmetic functions include +, -, *, /, Abs, Mod, Pow, Rand, Round, Sqrt, ToNumber, and Truncate.
- Date and time functions enable arithmetic, manipulation, and validation, including DateAdd, DateDiff, DateLastDay, DatePart, and IsValidDate.
- String functions allow for the manipulation of alphanumeric strings through operations such as concatenation, case conversions, and substring searches (||, CharacterLengthOf, LengthOf, SubString, ToLower, ToText, ToUpper, Translate, Trim).
- Support for user-defined values enables programmatic functions for storing variables in memory (like global variables). You can set and retrieve values in any number of user-defined variables. This gives you the ability to determine certain parts of your tasks at execution time rather than at design time. The logic can then be developed to use these variables in row, column, and programmatic (iterative, logical) operations (EvaluateExpressionList, GetUserDefinedValue, SetUserDefinedValue).
- Data partitioning allows data to be split by key break, by range or list of values, or by size (records, MBs, GBs, etc.).
Download the DMExpress Additional Components Data Sheet
Click here to download DMExpress white papers:
- It's Time for Your Data to Talk: A Look at Data Integration
- Joins and Aggregates Are Critical for Achieving Faster Data Retrieval in a Dimensional Data Warehouse
- Using DMExpress for Changed Data Capture Applications
- Mitigate Business Intelligence Project Risks with Rule-Based Audits and Proof-of-Concepts
- Speeding ETL Processing in Data Warehouses
- Solving the Challenges of Exponential Data Growth
- Optimizing ETL: The Key to Accelerating Data-Driven Business Decisions
|
 |
|
