Author
Abstract
The rapid growth of enterprise data volumes and the increasing demand for timely, accurate, and auditable financial reporting have compelled large organizations to rethink traditional extract–transform–load (ETL) architectures supporting treasury deposit systems. Between 2018 and 2019, enterprises—particularly in banking and financial services—faced mounting limitations with legacy SAS, mainframe COBOL, Informatica, and Oracle PL/SQL-based batch processing platforms. These systems were costly, vertically scaled, and constrained by overnight batch windows that could no longer meet modern regulatory, operational, and analytical requirements. This paper presents a comprehensive architectural and methodological framework for building Authoritative Data Stores (ADS) for treasury deposits using Apache Spark as the core distributed processing engine. The framework addresses data sourcing, certification, governance, and standardized provisioning to downstream consumers such as regulatory reporting, risk analytics, finance, and real-time dashboards. It elaborates on enterprise migration drivers, architectural comparisons between legacy ETL systems and Spark-based ecosystems, and the key challenges encountered during large-scale modernization initiatives. A structured migration methodology is proposed, encompassing baseline legacy assessment, code translation, data quality reconciliation, performance optimization, orchestration redesign, and phased cutover strategies. The paper further illustrates best practices through representative case studies demonstrating significant performance gains, cost reduction, and improved scalability. The findings highlight Spark’s role as a unifying compute platform capable of supporting batch, streaming, and advanced analytics workloads while maintaining the integrity and auditability required for treasury deposit data. The study concludes that Spark-enabled Authoritative Data Stores provide a resilient foundation for enterprise financial data modernization, enabling near real-time insights, improved governance, and long-term adaptability in evolving regulatory and business environments.
Suggested Citation
Ravi Kumar Vallemoni, 2024.
"Authoritative Data Stores for Treasury Deposits: Sourcing, Certification, and Provisioning Standards for Enterprise Downstreams,"
Frontiers in Computer Science and Artificial Intelligence, Al-Kindi Center for Research and Development, vol. 3(2), pages 46-58, December.
Handle:
RePEc:alk:fcsai0:v:3:y:2024:i:2:id:11960
DOI: 10.32996/fcsai.2024.3.2.8
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:alk:fcsai0:v:3:y:2024:i:2:id:11960. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Al-Kindi Center for Research and Development (email available below). General contact details of provider: https://al-kindipublisher.com/index.php/fcsai .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.