The validation of information systems research instruments has not received the attention that it deserves. Based on data obtained from 174 Australian CIOs, we use component-based structural equation modelling (PLS/SEM) to investigate the psychometric properties and possible modeling of the highly regarded CIO role expectations instrument that Smaltz, Sambamurthy, and Agarwal (2006) have developed. Results show that the CIO role expectations instrument exhibits solid validity and reliability indices despite some minor weaknesses. The results also demonstrate the possibility to model the constructs of this instrument in different null and hierarchical models, and they provide further empirical support for the validity of this instrument to measure the CIO role in different countries and different types of industries beyond the U.S. healthcare sector in which Smaltz et al. developed it. The results provide support for CIO role theory on two central issues: CIOs are fulfilling a configuration of roles not just one specific role, and the CIO roles can be grouped into two major categories: supply (operational) side roles and demand (business) side roles.