This study questions a common practice of using item weights for construct validity tests in the application of formative measurement. The practice does not confirm to the theoretical formation of formative constructs. A Monte Carlo simulation analysis is conducted to examine the practice. The results clearly demonstrate that item weights do not reflect the true design of the focal formative construct; using item weights may mislead the development and the application of formative instruments in empirical research.