Abstract
Data source connectors are core components of any data integration architecture. Typically, they are deployed as libraries of connectors. Such deployment exposes some significant pitfalls, e.g., poor maintainability, limited scalability, limited performance, and challenging security. To mitigate these drawbacks, we propose to organize connectors as the so-called a library of connectors used as a service (LCS). In this paper, we discuss design patterns of the LCS that allow to ease connectors maintenance, enhance data access security, and increase performance.
Paper Type
Full Paper
DOI
10.62036/ISD.2024.82
On Developing Data Connectivity Services for Industrial Applications
Data source connectors are core components of any data integration architecture. Typically, they are deployed as libraries of connectors. Such deployment exposes some significant pitfalls, e.g., poor maintainability, limited scalability, limited performance, and challenging security. To mitigate these drawbacks, we propose to organize connectors as the so-called a library of connectors used as a service (LCS). In this paper, we discuss design patterns of the LCS that allow to ease connectors maintenance, enhance data access security, and increase performance.
Recommended Citation
Bodziony, M. & Wrembel, R. (2024). On Developing Data Connectivity Services for Industrial Applications. In B. Marcinkowski, A. Przybylek, A. Jarzębowicz, N. Iivari, E. Insfran, M. Lang, H. Linger, & C. Schneider (Eds.), Harnessing Opportunities: Reshaping ISD in the post-COVID-19 and Generative AI Era (ISD2024 Proceedings). Gdańsk, Poland: University of Gdańsk. ISBN: 978-83-972632-0-8. https://doi.org/10.62036/ISD.2024.82