Curium Enterprise Data Management
Curium Enterprise Data Management (EDM) is a leap forward for data management technology within financial services firms. It combines innovative and high performing business process tools for the validation, matching and mastering of key data sets combined with optional modules to monitor and control the gathering, temporal storage and distribution of those data sets.
CuriumEDM can be integrated seamlessly with CuriumDQM and CuriumBI components for even higher levels of data quality control and business intelligence to provide a powerful data layer suitable for any size and complexity of firm. Curium data models can handle all structured data types and will scale over any number of incoming data sources.
With its integrated data governance layer CuriumEDM combines best practice in data operations with the control and oversight that all firms need – from a single application!
Inside CuriumEDM
Data Gathering
Curium’s data gathering functions are designed to provide connectivity to all commonly encountered data storage and delivery mechanisms, from fixed width files to multiple database technologies to web services, with comprehensive error handling to allow complete control over the treatment of source formatting errors.
Key features include:
- Database connections to SQL Server, Oracle, Sybase, Teradata, Caché and any ODBC compliant source
- File connections to fixed width files, delimited files, XML files, JSON files and Excel spreadsheets
- Server connections to FTP Servers, REST APIs and Web Services
- Dedicated market data adapter with cost monitoring and alerts
- Data can be captured and stored or left in situ and used live on demand
- Comprehensive source format error handling provides auto-correction, auditing, exception raising and variable acceptable error limits
- Separate set up of source credentials and configuration details adds security and easier re use and promotion between environments
- Scheduling functions allow loads to be run at specific times, at intervals between two points in time or on detection of changes to the source data
Master Data Management
A highly sophisticated, rules based data matching and construction process tool for the creation of composite, ‘gold copy’ data records from multiple source versions. Easy to set up, maintain and highly performant – the master data management component of Curium is a major strength and differentiator of the CuriumEDM toolset.
Key features include:
- Advanced, cumulative points based algorithms to assemble matched data records from contributing sources prior to application of construction logic. Quick to set up, easy to maintain and highly performant even when matching multiple data sources
- Simple addition of new data sources without the need to code new matching or construction rules
- Easy set up of default and override rule hierarchies – write once, apply to any construction methodology
- Supports complex rule sets including calculation of derived values
- Capture of data provenance against each attribute to assist with advanced analytics and audit of master data
- Innovative ‘what-if’ data constructor to test out different MDM strategies, compare and analyse results
- One step navigation from MDM results to underlying construction logic
- Macro analysis of source contribution levels to understand coverage and value of each data source
- Integrates with CuriumDQM ticketing and workflow features for reporting, investigation and management of matching errors and proposed matches
Operational and Historic Data Storage
An operational data store for current, live data to support the firm’s daily data needs combined with a full history archive of previous days’ data over time. Reports, enquiries and extracts of data can be created at any point in time including the ability to view data ‘as it was then’ versus ‘as it is now’ in order to recreate prior extracts as they would have been even if the data has subsequently changed.
Key features include:
- ‘Out of the box‘ data store for capture and storage of constructed and maintained data sets over time
- Standard data models for key data including security, portfolio, holdings, prices, benchmarks, classifications etc
- Data models can be customised, extended or added to at any time
- Maintenance of both current and historic data with change approval controls and full audit trail built in
- Historic data store supports backdated and period based reporting and extracts
- Simple addition of new data sources without the need to code new matching or construction rules
- Supports temporal data on both snapshot and slowly changing dimension basis
- Supports effective and actual date to allow backdated changes and recreation of ‘as at date’ states
Data Distribution
Data distribution from Curium allows for scheduled, event driven or on demand transmission of data to consumers via an extensive choice of technologies, from web services to delimited files as well as via direct access to the Curium hub.
Key features include:
- Direct access to the Curium Hub or a dedicated companion database on SQL Server, Oracle, Sybase or Teradata
- Delivery via delimited or XML file to network or FTP sites
- Delivery via Curium’s Web Services or its REST API
- Delivery over IBM Websphere, MSMQ or Solace queues
- Delivery via email as attachment or in formatted body text
- Scheduling functions allow deliveries to be run at specific times, at intervals between two points in time or driven by Curium events such as completion of mastering processes or in response to user activity such as entry of an override
- Separate set up of target credentials and configuration details adds security and easier reuse and promotion between environments
Integrated Data Governance
A data governance and lineage module that is integrated with the EDM process. No need to separately document the data process as modelling, data transformation and processing logic are exposed directly from the EDM layer within Curium – Data Governance ‘out of the box’! Also includes set up, maintenance and reports over data glossary, owners/stewards, data provenance metrics and data quality metrics for all governed data sets.
Key features include:
- Central console for set up and access to data dictionary/glossary items. Local set up and storage of full business glossary information within Curium and/or access to additional information via URL links, diagrams and documents
- Framework to capture owners/stewards for all data items, sources and consumers
- Full range of standard quality metric indicators for any governed data set
- Visual analysis of current data provenance for all mastered data sets (dynamically generated from underlying MDM process)
- Capture and display of data lineage for any data attribute – follow lineage trail from data owner, through processing and validation logic to downstream consumption within applications and reports
- Visual exposure of all data models, validation, processing and mastering logic within Curium – no requirement for a separate documentation exercise