The state of the art technologies today have revolutionized the business processes of an organization by providing effective storage, retrieval and communication mechanisms. The most desirable feature of this technology is the secure data sharing among various business partners. Most of the organizations today rely on standard communication channels to share information among interacting partners. These standalone systems provide the intended benefits to some extent; but the communication between two heterogeneous work processes is a difficult task. To cope with the issue, developed countries like Germany, France, Sweden, Estonia and Denmark have developed centralized communication infrastructures for government and private/business organizations. Such infrastructure serves as a backbone for secure information exchange between G2G (Government to Government) and G2B (Government to Business). In developing countries like Pakistan, Bangladesh and Sri Lanka although the communication system is based on IT but segregated systems/processes are being used for information sharing among various organizations. The communication between governmental and private organizations is done in a traditional manner, which requires a cumbersome process of data formatting and information exchange. In this paper, we will explore and analyze the opportunities and constraints to develop/deploy the centralized communication infrastructure (CIPS: Centralized Information Processing System) in a developing country perspective. The paper presents the case study from Pakistan and analyzes the constraints and opportunities to develop such centralized infrastructure for information exchange.