Hello and welcome to this video that addresses the professional competency area assessment evaluation and research in this video you will learn about five dimensions to the competency area and what constitutes proficiency in assessment evaluation and research across the foundational intermediate and advanced proficiency levels these competency proficiencies come directly from the professional competency rubrics developed by the a CPA.
Evaluation and research competency area focuses on the ability to design conduct critique and use various Aer methodologies and the results obtained from them to utilize Aer processes and the results to inform practice and to shape the political and ethical climate surrounding Aer processes and uses in higher education assessment evaluation and research encompasses five dimensions which.
Includes terms and concepts values ethics and politics a er design methodology.
Data collection and data analysis and interpreting reporting and using results the.
Terms and concepts embraces the knowledge and the ability to describe terms concepts and strategies associated with assessment program review evaluation planning and research it also includes dispositions to view.
A er as an essential element to improvement at the unit division institutional and professional.
Levels at the foundational level attributes that demonstrate competency in the terms and.
Concepts dimension of assessment evaluation and research include the ability to differentiate between assessment program review evaluation planning and research at the intermediate level this would include using a er terminology consistently when participating with colleagues and assessment program review evaluation planning and research and violently at the advanced level this would include the attributes of leading and teaching others assessment program review evaluation planning and research the.
Second dimension values ethics and politics embraces the knowledge of the value of assessment and the ethical principles associated with data collection management analysis and.
Reporting also would be the ability to use results.
Towards continuous improvement and to follow institutional policies and procedures demonstrated dispositions would be to navigate institutional politics effectively to adhere to standards and to sustain a cultural of assessment attributes that demonstrate competency in the values ethics.
And politics dimension of assessment evaluation and research at the foundational level include the ability to explain institutional and divisional Aer procedures and policies with regard to ethical assessment evaluation and other.
Research activities also the ability to identify political and educational sensitivity of raw and partially processed data and AER results and also the ability to handle data with appropriate confidentiality and deference to organizational hierarchies attributes that demonstrate competency at the intermediate level would include being able to contribute actively to the development of a culture of evidence at the department level by providing AER training advocating for funding and incorporating AER in practice being able to manage and/or here to the implementation of institutional and professional standards for ethical.
AER activities and being able to use culturally relevant and appropriate terms and methods to conduct and AEE our findings and finally at the advanced level proficiency would be demonstrated by the ability to create a culture of evidence in which a er is central to practice and that training happens across.
The organization being able to ensure institutional divisional or unit compliance with professional ethical.
Standards concerning a er activities and finally being able to anticipate and respond to challenges related to individual and institutional politics competing constituencies and.
Interest and divergent values the third dimension a er design embraces the knowledge of theoretical frameworks that align with organizational outcomes goals and values it also includes the ability to create learner centered outcomes that align with divisional and institutional priorities and the ability to design and lead a process oriented strategy to address the assessments.
Purpose or research questions also included is the disposition to think critically and systematically about questions and problems of practice attributes that demonstrate competency in the AER design dimension of assessment evaluation and research include.
Being able to design program and learning outcomes that are clear specific and measurable that are informed by theoretical frameworks and aligned with the organizational outcomes goals and values being able to utilize theoretical frameworks and organizational.
Outcomes goals and values to design program and learning outcomes and the ability to explain to students and colleagues a relationship of Aer processes to learning outcomes and goals attributes that demonstrate competency at the intermediate level would.
Include being able to prioritize programming and learning outcomes with organizations goals and values utilizing student learning and development theory scholarly research to inform content and design of learning outcomes and assessment tools the ability to educate stakeholders about the relationship of departmental Aer processes to learning outcomes and goals.
At the student department division and institutional level and being able to discern appropriate designs based on critical questions available data and intended audiences and then finally attributes.
That demonstrate competency at the advanced level include the ability to lead the conceptualization and design of ongoing systematic high quality database strategies at the institutional divisional and/or unit wide level to evaluate and assess learning programs services in personnel the ability to use assessment and evaluation results in determining institutional divisional or unit accomplishments toward missions and goals reallocation of resources and advocacy for more resources and finally leading a comprehensive.
Communication process to inform campus stakeholders about the.
Relationship of Aer processes to learning outcomes and goals at the student department division and institution level the fourth dimension methodology data collection and data analysis embraces the knowledge of strengths and limits of research methodologies it also includes the ability to match methodology with purpose of assessment and guiding questions.
To collect and analyze data dispositions are the ability to take a critical stance and collection and analysis of data being able to give rigorous attention to detail and engage in creative thinking attributes that demonstrate competency in the methodology data collection and data analysis dimension of assessment evaluation and research at the foundational level include the ability to differentiate among methods for assessment program.
Review evaluation and research the ability to facilitate data collection for system and/or department-wide assessment in evaluation efforts using current technology and.
Methods the ability to assess trustworthiness and/or validity of studies of various methods and designs and the ability to consider strengths and limitations of approaches when applying findings to practice in diverse institutional settings and would diverse student populations at the intermediate.
Level proficiency would be the ability to design data collection efforts that are ongoing sustainable rigorous unobtrusive and technologically current the ability to doesn’t demonstrate working knowledge.
Of alternative methodologies and Aer approaches and strategies for ensuring quality results the ability to participate in the design of qualitative and quantitative aar.
Projects determining appropriate methods and analyses for each and also the ability to articulate the limitations of findings imposed by differences in how quantitative and qualitative data are sampled analyzed and verified through validity reliability and/or trustworthiness techniques and.
Then finally at the advanced level proficiency would be the ability to design and integrate ongoing and periodic data collection efforts such that they are sustainable rigorous as unobtrusive as possible and technologically.
Current and also being able to lead supervised and/or collaborate with others to design and analyze assessment program review evaluation and research activities that span multiple approaches the fifth and final dimension under assessment evaluation in research is interpreting reporting and using results this embraces the knowledge of how to interpret data in practical.
Terms that are relevant to institutional context this also embraces the ability to present results concisely and reports that are useful to a variety of audiences and to use findings to make informed decisions and to align resources dispositions would be the ability to collaborate to represent findings accurately and fairly and the ability to share interpretations with stakeholders including students professional competency for interpreting reporting and using results at the foundational.
Level would be the ability to.
Articulate interpret and apply results of Aer reports and studies including professional literature and ensuring all communications of Aer results are accurate responsible and effective at the intermediate level proficiency would be the ability to manage a line.