Quantum Consulting Australia homeHome about usAbout Us the Quantum ElementThe Quantum Element Services SolutionsService Solutions newsNews project experienceProject Experience contact usContact Us
Evaluation and Advisory Services

Evaluation and Advisory Services

Below are examples of evaluation and review consultancies that have been undertaken by Quantum Consulting Australia.

i) Evaluation and Advisory Services:

Emerging practices in engaging Aboriginal students in their learning

QCA was appointed by the Department of Education (the Department) to undertake a research project to identify emerging practices and whole-school approaches that optimise the conditions for learning for vulnerable (disengaged and at-risk) Aboriginal students.

The purpose of the research was to provide an evidence-base of emerging practices to assist the Department to identify the support public schools in Western Australia need to optimise the learning environment they create for Aboriginal students.

The appointment included the following components:

  • Undertake a horizon scan of national and international emerging practices in optimising the learning environment for Aboriginal students;
  • Deliver focus group and individual interviews with 11 selected school communities
  • Design and facilitate a whole-day forum with the selected school principals; and
  • Design a professional learning module suitable for all public schools, based on the research outcomes.

  • Review of the At Risk Communities Program

    The At-Risk Communities Program aims to assist in educating and enabling health and community service agencies to better prepare for and respond to bushfire emergencies.

    QCA was appointed by DFES to undertake a review of the At Risk Communities Program in order to:

  • Determine the suitability of the program design for industry needs, considering the current changing environment of the sector and existing priorities
  • Measure the effectiveness and suitability of the promotional activities undertaken and awareness of the program by industry since its Launch.
  • Examine industry propensity to utilise the programs resources in assisting to develop emergency management plans for their organisation, staff and clients and
  • Explore the option of expanding the scope of the program in adopting an all hazards approach in emergency management planning for industry and at risk communities.

  • Literature Review – Causes of Suicide in the Construction Industry

    QCA conducted a literature review of all major research undertaken throughout Australia and in selected international countries on the causes of suicide in the building and construction industry.

    The Literature Review included the development of recommendations or potential interventions and/or strategies that the Construction Training Fund could consider adopting as a preventative strategy in regards to the rates of suicide of construction workers.

    Evaluation of the closure, assessment and relocation of Franciscan House residents

    QCA was appointed by the Mental Health Commission (MHC) to undertake an evaluation of the closure, assessment and relocation of Franciscan House residents (approximately 70 residents) and use the findings to inform the potential for future closure and divestment of facilities. The evaluation consists of three components:

    1. Policy review: Review the MHC’s Hostel Closure Strategy and any relevant WA Health policies in light of the processes and tasks completed as part of the hostel closure.
    2. Process review: Review and evaluation of the closure, assessment and relocation process followed. The evaluation methodology developed was tailored to reflect the unique cohort of stakeholders associated with the closure process.
    3. Data/outcomes review:
      • Psychosocial outcomes: Baseline and follow-up data from the Personal Care Support Assessment Questionnaire was analysed.
      • Clinical outcome data review: Mental Health National Outcomes and Casemix Collection (NOCC) data was reviewed. This data was de-identified and analysed and assessed for development of findings.

    Review of the Language, Literacy and Numeracy Practitioner Scholarships Program

    Quantum Consulting Australia were engaged to review the LLN Practitioner Scholarships Program, operated nationally and funded by the Department of Industry.

    The Review was to examine all aspects of the Program including the effectiveness and efficiency of the Program in connecting people to the LLN Practitioner field; the appropriateness of the existing funding model and administration process; the satisfaction of individuals, trainers and training providers with the delivery of the Program; the employment outcomes of the Scholarship recipients and suggest possible improvements and or enhancements to the delivery of the Program.

    Consultation with a number of stakeholder cohorts and analysis of the relationships between the Department and the administrating agency provided insight into the potential enhancements of the Program.

    Review of the Current Funding Distribution of the Social and Emotional Wellbeing Program

    Quantum Consulting Australia were engaged to provide an analysis and review of the current funding distribution under the Social and Emotional Wellbeing (SEWB) Program. In particular, the Review presented options on more appropriate funding levels for:

  • Link Up services taking into account current and future service demand, delivery requirements and rural and remoteness factors; and
  • Counselling services considering models identified in the counselling review, salary equity between and across services as appropriate and rural and remoteness factors.
  • The Review took into account a variety of issues, including:

  • a lack of national consistency in service delivery between services, and variable links between SEWB Counselling and Link Up Services;
  • rural and remoteness estimates of demand;
  • costing of service models for counselling;
  • direct and on costs of recruitment/retention, travel, administration, casework, group work and counselling activities;
  • an exploration of innovative models to provide SEWB services in a cost efficient manner in a diversity of locations and settings; and
  • limited geographical coverage of programs; and limited service promotion and outreach activity to promote awareness of, and access to, services.

  • Evaluation of the Remote Area Alcohol Interlock Demonstration Program

    Quantum Consulting Australia were engaged to develop the methodology and to implement the evaluation of the Remote Area Alcohol Interlock Demonstration (RAAID) project.

    The Project provided an opportunity to:

  • trial alcohol interlocks as an effective sanction in separating drinking and driving in a remote area
  • trial the impact of using alcohol interlocks on a voluntary basis
  • better understand issues arising when alcohol interlocks are used with Indigenous groups in remote locations
  • feed into the development of the Repeat Drink Driving Strategy (RDDS)

  • The program was based in Roebourne, Western Australia, which has a high percentage of Indigenous community members. The evaluation included consultation with Indigenous groups for reflection on the Programs performance and development of recommendations for improvement in a state-wide roll out.

    Evaluation of the Aboriginal Youth Health Project

    Quantum Consulting was approached by the Department of Health (South Metropolitan Area Health Service) to conduct a comprehensive qualitative and quantitative evaluation of the Aboriginal Youth Health (AYH) Project.

    A literature review was undertaken for which the key outcome was to develop measurement criteria against which to assess the AYH Project. In developing these measurement criteria the following variables were considered:

  • Aboriginal community
  • Aboriginal cultural
  • Public Health/ Health Promotion
  • Partnerships

  • In addition, a Performance Management Framework was developed to provide a process for performance review and management of the AYH Project. The Framework comprised of the following attributes:

  • Roles and responsibilities of the South Metropolitan Public Health Unit staff
  • Monitoring/Governance requirements to support the AYH Project and the process for establishing and maintaining the Youth Steering Group (E.g. Terms of Reference)
  • Performance measures/indicators

  • The outcome of this Evaluation was the assessment of the applicability and transferability of the model implemented for the AYH Project in the Fremantle Health District to other Health Districts in the South Metropolitan Area Health Service.

    Evaluation of the Aboriginal Tobacco Control Project

    Quantum Consulting was approached by the Department of Health (South Metropolitan Area Health Service) to provide an evaluation of the Aboriginal Tobacco Control (ATC) Project.

    The Project was focused on Aboriginal health and in particular, increasing knowledge regarding smoking.

    The Evaluation included assessment in the following key areas:

  • Operational structure within which the Project is implemented
  • Monitoring and reporting processes
  • Human and other resources required for developing and implementing the Project
  • The governance arrangements in respect to formal partnerships with key health stakeholders

  • The outcome of this Evaluation was the development of strategic recommendations and ‘good practice’ models for future implementation.

    Evaluation of the Early Intervention Pilot Program

    The Western Australia Police Alcohol and Drug Policy Unit appointed Quantum Consulting Australia to conduct an evaluation of the Early Intervention Pilot Program (EIPP).

    The EIPP is a Federal Government initiative designed to reduce the harm associated with binge drinking amongst young people from the ages of 12 to 17 years. The evaluation assessed the progress and effectiveness of the EIPP together with an assessment of the current reporting protocols and referrals.

    The evaluation included the following key activities:

  • A desktop review of programs that are framed with a harm minimisation strategy to develop indicators against which to assess the EIPP
  • A needs analysis of the EIPP practice model
  • Data profiling of referrals to the EIPP through quantitative data analysis
  • Administering survey instruments with key stakeholder cohorts as well as the parents of young people referred to the program

  • Tuition Assurance Scheme Review

    Quantum Consulting completed a consultancy to assess the approval, accountability and review process for Tuition Assurance Schemes (TASs) operating in Australia and established under the Education Services for Overseas Students Act 2000 (ESOS Act).

    The purpose of the TAS Review was to assess whether there would be benefit to the international education industry in Australia (to providers, international students and to government oversight and regulatory functions) in making incremental improvements to the approval, accountability and review processes for TASs established under the ESOS Act.

    The Review identified possible improvements to approval, accountability and review processes that could deliver benefit to the industry, while keeping to a minimum any additional reporting or administrative burdens on TAS operators.

    Implementation/Process Evaluation of the Road Aware Drivers Program

    The Keys for Life Program is the principal pre-driver education initiative implemented in Western Australian schools which aims at encouraging supervised driving practice, positive attitudes to driving and safer driving practices. On completion of the Program teachers are authorised to conduct the Learner's Permit Theory Test (road rules test) with students at school and issue certificates which can be redeemed for a discounted Learner's Permit at any licensing centre in the State.

    Quantum Consulting was appointed by the Office of Road Safety to evaluate whether there was merit in refining the Keys for Life program content, the Keys for Life professional development program and the way in which the Keys for Life program is promoted, taught and supported.

    The Evaluation provided recommendations to enhance the Program content and management of the Program. Strategies for enhancing the take-up of the Program by schools and enhancing the involvement of key agencies were also developed and provided to the Office of Road Safety and funding organisations.

    Review of the Joint Group Training Program

    The Joint Group Training Program (JGTP) is a key program operating in the VET Sector. JGTP funding assists eligible providers of group training services by supporting and rewarding growth, by funding targeted Australian Apprenticeship outcomes in one or more of the four nationally agreed priority areas. JGTP funding is administered by the state/territory governments on the basis of an annual funding plan.

    Quantum Consulting was engaged by the Department of Education, Science and Training to conduct a national review of the JGTP to examine its appropriateness, efficiency and effectiveness.

    The Review informed the Department on the effectiveness of JGTP funding in building a strong, sustainable and self-reliant group training sector and provided options and recommendations for future Australian and state/territory government group training program funding.

    Evaluation of the Outcomes of the Increasing Vocational Learning Opportunities for Indigenous Students (IVLOIS) Programme

    The IVLOIS Program is designed to provide vocational learning opportunities for Indigenous secondary school and secondary school-aged students, particularly those students who are at risk of disengaging from school.

    Quantum Consulting was engaged by the Department of Education, Science and Training to conduct a national evaluation of the Increasing Vocational Learning Opportunities for Indigenous Students (IVLOIS) Program.

    The evaluation report provided an overview of the effectiveness and appropriateness of the IVLOIS Programme in helping to achieve the goals of the National Aboriginal and Torres Strait Islander Education Policy, reported on lessons learnt from the implementation and operation of the IVLOIS Programme.

    The report also informed policy makers of the good practice approaches from IVLOIS in a concise way so as to assist policy makers to contribute to the development of future policies and influence the delivery of mainstream programmes.

    Evaluation and review of the development and implementation of the Regional Youth Justice Services

    Quantum Consulting was engaged by the Department of Corrective Services to evaluate and review the development and implementation of the Regional Youth Justice Services. The evaluation included:

  • outlining and assessing the processes undertaken to develop and implement the Services
  • examining and assessing the project management arrangements for the Services
  • identification of preliminary outcomes and the development of recommendations regarding future operations.
  • The associated report provided the key findings of the implementation of the RYJS and examined options and recommendations for enhancing the current service, and for enhancing future expansion of the service in Western Australia.

    Evaluation of the National Arts and Crafts Industry Support (NACIS) Programme

    The objectives of the NACIS programme were to support the development of strong arts centres in Australia and to build a more sustainable Indigenous arts industry by strengthening governance and business management practices in the industry, provide opportunities for artists to maintain, develop and extend their professional art practice and provide opportunities for arts workers to develop professional skills and experience.

    Quantum Consulting undertook the evaluation of the NACIS Programme, which focused on the impact of the NACIS programme on the sustainable functioning of art centres and the development of the Indigenous visual arts industry in the context of the programme’s objectives, the Indigenous Art Centres Strategy and Action Plan and current government policy and administration processes.

    Review of Community Resource Centres

    The Department of Regional Development and Lands engaged Quantum Consulting Australia to conduct a Review of the WA Telecentre Network Community Resource Centres to assess the level of operation and services provided by Community Resource Centres located in Western Australia. As part of the review, the Project Team travelled to over 100 Community Resource Centres throughout Western Australia to assess the level of operations, likely future demand and the future funding requirements for each Centre.

    Review of the Safer Country Training Program

    The Emergency Risk Management Capacity Building Training Program ‘Safer Country’ – A Community Centred Approach to Emergency Risk Management with Remote Indigenous Communities was delivered to communities within remote Western Australia by the Fire and Emergency Services Authority of Western Australia (FESA).

    Quantum Consulting was engaged by FESA to review and evaluate the Training Program, in particular to assess the Program against good practice models, the effectiveness of the Program, and how the Program could be enhanced to better address the priorities, needs and expectations of the various stakeholders.

    Evaluation of the What Works Project

    The What Works Project is a national flagship project which delivers professional development workshops to teachers in all States and Territories across Australia. Its aim is to help schools improve outcomes for Indigenous students.

    Quantum Consulting was engaged by the Department of Education, Science and Training to conduct a consultancy to evaluate and report on the What Works Project. Quantum Consulting examined the appropriateness, effectiveness and efficiency of the What Works Project in order to assess the extent to which it is meeting its stated objectives and made recommendations on opportunities for improving the performance of the What Works Project.

    Rolling Reviews of Indigenous Community Housing Organisations

    Quantum Consulting was appointed to undertake rolling reviews of identified organisations/communities to assess the performance of the existing grantee Housing Organisations and analyse the efficiency and effectiveness of the organisations in reducing the level of housing need either in their town or their communities.

    Whilst undertaking the reviews, Quantum Consulting made reference to the extent of housing needs (supported by demographic data) and assessed the level of funding both recurrent and/or capital which will be required for future years.

    Quantum Consulting also made recommendations on each organisation’s administration, operational and financial management and the development and application of organisational policy.

    Evaluation of the East Kimberley COAG Trial

    The Western Australian COAG trial site is situated in the East Kimberley region and encompasses the communities of Balgo, Billiluna, Mulan and Ringer Soak. The communities reside within the Tjurabalan-Kutjungka Region.

    Quantum Consulting and Nyaarla Projects undertook a formative evaluation of the East Kimberley Council of Australian Governments (COAG) Trial. The primary focus of this evaluation was on what’s working well and what could be improved. The scope of the evaluation included an overview of the regions, conditions and challenges at the start of the trial and significant event and outcomes that had occurred as a result of the coordination between and within Governments and the extent of partnership between the Government and community partners.

    The Evaluation also identified good practice models and approaches to improve the way communities and Government agencies work together, which may potentially be applicable to other sites around Australia

    Review of an Aboriginal Funeral Service

    As part of the Department of Health and Ageing commitment to funding sustained and coordinated services to achieve improved health outcomes for Aboriginal and Torres Strait Islander people, Quantum Consulting was appointed to conduct a thorough review of an Aboriginal Funeral Service to identify:

  • Whether value for money was being achieved
  • Whether the needs of Aboriginal and Torres Strait Islander community and individuals who have lost a family member were being met and will continue to be met into the future
  • Whether the organisation operated funeral services in a sustainable manner
  • Which related services, in addition to funeral services, were being provided to clients whose family member had died, to what extent, and if they were sustainable.

  • Review into the Use of Education Agents by CRICOS Registered Providers

    Quantum Consulting was appointed to identify and describe current practices by Commonwealth Register of Institutions and Courses for Overseas Students (CRICOS) registered providers in meeting their responsibilities under the National Code in relation to the use of education agents.

    The Review identified how providers who use education agents ensure that those agents act in compliance with the National Code in the areas of the provision of marketing, student information and student recruitment and placement. The Review also identified how providers deal with agents found to be acting in contravention of the National Code and good practice approaches for dissemination to all registered providers.

    Review of Group Training Arrangements in Western Australia

    Group training is an employment and training arrangement where an organisation employs apprentices and trainees, and then places them with 'host employers', usually from small to medium-sized enterprises. The group training organisation is responsible for the quality and continuity of the apprentices’ and trainees’ employment and training and also provides additional support.

    The Review of Group Training Arrangements in WA had a particular focus on the implications of expanding the group training network, managing a growing market within a limited budget, the provision of sustainable services and considering eligibility to access funding.

    Quantum Consulting developed recommendations and funding models designed to assist the Department of Education and Training in policy formulation and funding arrangements associated with group training in Western Australia.

    Review of Industry Training Advisory Arrangements in Western Australia

    The Department of Education and Training appointed Quantum Consulting to facilitate discussions between the Industry Training Advisory Bodies (ITABs) and to provide models to a Reference Group in regards to determining the most effective industry advisory arrangements for alternative industry advisory models and assess their applicability to Western Australia.

    Review of the Type I Child Car Restraint Fitting Service

    The Office of Road Safety (within Main Roads) engaged Quantum Consulting Australia (in conjunction with personnel from the Centre for Accident Research and Road Safety Queensland (CARRS-Q)) to undertake an evaluation of the implementation of the Type 1 Child Car Restraints Fitting Service. The Type 1 Child Car Restraints Fitting Service provides advice and assistance in installing child restraints and offers information on the appropriate restraints to use for children according to their weight and size. The Fitting Service may be an ongoing service offered through a business, organisation or Agency, or it may be a temporary “station” set up as part of a promotional event.

    The evaluation was divided into a process evaluation (to determine the extent to which the Project had been implemented) and an impact evaluation (to determine the likely impact the Project had on those involved or targeted by it).

    Evaluation of National Skills Week

    QCA was appointed to evaluate the Australian Government’s National Skills Week.

    The Evaluation involved qualitative research with VET stakeholders and the general public. Specifically, the Evaluation will determine the following:

    • Awareness level of National Skills Week among VET stakeholders and the general public
    • Identifying opportunities to improve the outcomes achieved by National Skills Week
    • Impact of National Skills Week on VET stakeholders and the general public.
    • Effectiveness of National Skills Week – did it impact the profile of skills in the wider community in the same way that other “National Weeks” has impacted the profile of the subject matter in the wider community.

    Evaluation of a Secure Care Facility

    QCA was appointed to undertake an evaluation of a secure care facility service model and facility.

    The purpose of the evaluation was to address the findings of a Statutory Review (recommendations) and consider the broader service system impacting on young people with extremely complex needs.

    The objectives and areas of focus of the Evaluation included the following:

    • The extent to which the Facility is operating as intended;
    • Evidence on the role and effectiveness of secure care as a protective intervention;
    • The appropriateness of the admission criteria and service model in identifying and responding to young people in care with extremely complex needs;
    • The availability of alternative options to secure care arrangement;
    • Intended and unintended outcomes for young people admitted to the Facility;
    • Was the infrastructure fit for purpose to manage operational performance requirements;
    • The appropriateness of oversight arrangements;
    • Identification of service gaps and the allocation of resources across government to meet the needs of, and improve outcomes for, children with complex needs; and

    The Evaluation also developed a Program Logic Model applicable to operations of the Facility together with an ongoing monitoring and evaluation framework.

    Evaluation of the Kids Health Link Service

    QCA conducted an evaluation of the service which represented a connected approach between government, public and private services and NGOs. Key aspects included:

    • Review of the original contract /grant agreements
    • Review of the Program Logic
    • On site observations, interviews and focus groups of all the key stakeholders
    • Assessment of whether the contractual arrangements represented value for money to Government.
    • Gathering of quantitative data and qualitative data as appropriate to inform the impacts of the service.

    Transitional Housing and Support Program Evaluation

    The Mental Health Commission (MHC) appointed QCA to evaluate the Transitional Housing and Support Program (THASP). The evaluation determined if clients engaged with THASP have improved outcomes. The Evaluation Report informed the development of a business case by the MHC for the consideration of the State Government.

    The evaluation assessed the effectiveness and efficiency of THASP through quantitative and qualitative measures.

    The scope of work associated with the Evaluation included:

    • Developing an evaluation methodology and consultation questions in line with the evaluation framework.
    • Conduct consultations (via a focus group) with the current program service providers.
    • Undertake service user interviews with current THASP clients.
    • Undertake five detailed case studies from current clients outlining their transition and experiences through THASP.

    Back to top