The validation of IS instruments has not been given the attention that it deserves. This study uses component-based structural equation modelling (PLS/SEM) to investigate the psychometric properties and possible modelling of the CIO role expectations instrument based on data obtained from 174 Australian CIOs. Results show that the CIO role expectation instrument exhibit solid validity and reliability indices despite some minor weaknesses. The results also demonstrate the possibility to model the constructs of this instrument in different null and hierarchical models, and the validity of this instrument to measure the CIO role in different types of industries not just the healthcare sector in which it was developed. The results provide support for CIO role theory on two central issues: CIOs are fulfilling a configuration of roles not just one specific role; and the CIO roles can be grouped into two major categories: supply side roles and demand side roles.