Developed a framework to guide the evaluation of the effectiveness of the 2017 changes to the Essential Skills Work visas and Skilled Migrant Category Residence visas. The framework specified a mixed method evaluation making use of information gathered from diverse sources over three years. The evaluation will ascertain the extent to which the policy changes achieved their goals and avoided unintended negative consequences.
Year: 2017
For MBIE
This work involved:
- consultation and working closely with MBIE staff to uncover the underlying logic of the policy changes and stakeholders’ information needs
- development of an intervention logic and theory of change
- articulation of the policy changes’ intended outcomes and risks of unintended negative outcomes.
- refinement of the evaluation’s purpose and scope
- development of key evaluation questions
- identification of indicators and data collection methods including quantitative and qualitative approaches and making use of new and existing data
- a description of how the evaluation will synthesise findings across multiple methods and how it will assess the counterfactual (that is, what would have happened without the policy changes?)
- development of a timeline and a draft costing for the evaluation.