Assessment & Evaluation Tools
There are several types of assessment and evaluation tools that can be used to help select what vocabulary to use within an AAC system. When deciding on assessment and evaluation tools, there are several factors that should be taken into consideration.
In no particular order, some of these include:
Individual preferences and interests
Age
Current skills and abilities
The environment
Functional needs
The type of AAC system used
Communication stage
Cultural considerations (language, customs/values/beliefs/practices)
The types of vocabulary that will be selected
Note: To meet the individual diverse needs of the AAC user it is recommended that multiple indirect and direct assessments are used. Research highlights that when indirect and direct assessments are used together they can become a powerful tool. Together, indirect and direct assessments can help select vocabulary for the AAC user that will increase their learning, autonomy, wellbeing and social interactions to communicate and participate in their environment. It is also recommended that communication partners (AAC user, parents/families, teachers) are involved throughout the whole assessment and evaluation process. This will help to create a respectful and collaborative environment (see collaboration).
Direct assessments:
Direct assessments can be used to select vocabulary within an AAC system.
Direct assessments can allow AAC users to demonstrate their own knowledge, skills and behaviour. They can also help to determine an AAC user’s current skills and abilities.
Examples of direct assessments for selecting vocabulary to use within an AAC system, include the following:
A just-in-time approach:
In this approach vocabulary is introduced that is relevant to the AAC user and meets their immediate needs based on their current environment and situation. This includes an AAC user’s preferences and interests, current skills and abilities and functional needs.
Studies have shown that a just-in-time approach can be easy to use for high tech AAC systems, such as speech generating devices (see types of AAC systems). They can also enhance an AAC user’s communication and social interactions.
Case study example:
A student named Orla uses a combined picture and word based AAC system to communicate. Orla is on a school trip to the zoo and takes an interest in the lion in the lion enclosure. The picture and word lion are not in Orla’s AAC system. Orla’s teacher aide Elsie is on the school trip with her. Elsie takes a quick photograph of the lion, uploads the photo onto Orla’s AAC system and inserts the word “lion.”
Dynamic assessments:
Dynamic assessments are approaches that look at an individual’s current learning skills and abilities and their learning potential. DA often involve support (e.g., models and gestures) from adults (teachers, professionals) and can help individuals demonstrate their learning potential.
DA can help select vocabulary to use within an AAC system that aligns with an AAC user’s individual preferences and interests, current skills and abilities, social communication and functional needs. DA can also ensure the vocabulary within an AAC system can be used in many environments. DA can help provide AAC users with support to help learn and use new vocabulary, increasing their language and communication skills. The assessment can also help to understand the vocabulary the AAC user is able to use on their own with minimal support and can help identify when vocabulary within the AAC system needs to be changed.
Various research has used DA within AAC systems.
One study that used DA found that grid and visual scene AAC displays on speech generating devices (SGD) (see types of AAC systems), helped AAC users increase their use of function words (see types of vocabulary and their usage). AAC users who used grid and visual scenes were skilled at requesting nouns and showed progress at requesting other types of vocabulary, such as verbs.
DA example for selecting vocabulary to use within an AAC system:
1. Collaborate with communication partners
Gather information from communication partners (AAC user, parents/families and teachers) to find out the AAC user’s current skills and abilities, individual preferences and interests and functional needs (see collaboration).
2. Preference assessments:
- Present the AAC user with their preferred items/objects. Observe which item/object the AAC user reached for and/or pointed to. Create 20 opportunities for the AAC user to request these items.
3. Graduated Prompting:
Use a least-to-most prompting hierarchy throughout the process. This involves a step by step guidance from the smallest to the highest level of support to correct non-responses and/or incorrect responses. This will determine the level of support that is needed.
For example:
Wait six seconds for the AAC user to respond
Give a spoken reminder
Model (show and speak)
Physical prompt (guide the AAC user’s hand to press the correct word/symbol)
4. Knowledge of vocabulary:
Show the AAC user pictures of words and ask them to identify the words, such as verbs. This will help show what words the AAC user knows already.
5. Identify new words:
Continue to show the AAC user pictures of words until enough new words (that the AAC user does not know) have been identified.
6. Dynamic assessment sessions:
Provide opportunities for the AAC user to practice using vocabulary, such as verbs in specific environments they will use them in.
Positive reinforcement of correct responses:
For every correct response, praise the AAC user with positive feedback.
7. Review support needs:
Look at how much support the AAC user needs to use the words/symbols correctly on their AAC system. This will help guide decision-making on what vocabulary is suitable for the AAC user within their AAC system.
The Verbal Behaviour Milestones Assessment and Placement Program (VB-MAPP):
The verbal Behaviour Milestones Assessment and Placement Program (VB-MAPP) is an assessment tool that is administered across a number of tasks. It is commonly used with individuals who have autism spectrum disorder (ASD). The VB-MAPP aims to determine an individual’s current language and social skills which can help guide intervention and individual support plans.
The VB-MAPP can be used to help select what vocabulary to use within an AAC system. This is because the VB-MAPP can determine an AAC user’s current language and communication abilities.
The VB-MAPP is divided into five components:
1. Milestones assessment:
The milestone assessment examines the individual’s current verbal skills and abilities.
It is made up of 170 language skills grouped by developmental age:
Level one: 0-18 months
Level two: 18-30 months
Level three: 30-48 months
The skills examined include asking for help, naming items/objects, repeating sounds and playing with others.
2. Barriers assessment:
The barriers assessment can help Identify challenges an individual may face in learning and communicating.
It examines 24 common issues, such as difficulty with social skills or trouble staying focused.
It helps communication partners (teachers, professionals, parents/families) come up with strategies that will be used to support the individual.
3. Transition assessment:
The transition assessment can help to determine whether an individual is ready for an independent learning environment.
It measures skills such as social interactions and classroom behaviour.
4. Task analysis (breaking down tasks) and supporting skills:
Breaks down tasks into smaller steps to make it easier for an individual to learn and reach their goals.
5. Placement and IEP (individual education plan) goals:
After completing the assessment, results guide the creation of individualised goals and further support.
The VB-MAPP reports can be created and shared with communication partners (AAC user, parents/families, teachers, professional). For accurate results, trained professionals should administer the assessment.
The VB-MAPP has been widely recognised in research. It has also been used in several studies presented at conferences.
Indirect Assessments:
Indirect assessments can be used to gather information, including opinions and behaviours to make a decision about an individual’s current skills and abilities. Examples of indirect assessments include interviews and questionnaires.
Indirect assessments are recommended for individuals who have early language communication abilities and individuals who use other types of communication other than verbal speech to communicate, such as AAC systems.
A challenge of indirect assessments are the lack of assessments for teenagers and adults with autism spectrum disorder (ASD). Personal experiences or influences from the assessor could also affect the results.
Examples of indirect assessments for selecting vocabulary to use within an AAC system, include the following:
Ages and stages questionnaire:
The ages and stages questionnaire (ASQ) is an assessment tool that can be used to help select what vocabulary to use within an AAC system.
The ASQ can identify an individual’s current skills and abilities and functional needs.
Research has shown that the ASQ is seen as an accurate, low cost tool for screening and monitoring. It is also easy to administer and a recommended tool for the early identification of autism spectrum disorder (ASD).
The ASQ can be completed by parents/families or by professionals who know the individual well.
Research highlights how ASQ has been examined across many different cultures and communities across the world. It has shown to be useful in many settings, including schools, homes and health settings.
Communication matrix:
The communication matrix is an online assessment tool that can be used to help select what vocabulary to use within an AAC system. The communication matrix is a free/low cost assessment tool. It was created to help communication partners (parents/families, teachers, professionals) easily understand the communication skills and abilities and needs of an individual who communicates at an early language level. The assessment is commonly used to assess children in home, school and community settings.
The assessment involves 24 questions mostly comprising “yes” or “no” questions and can be done off-line or online. The questions are based on the assessors observations and experiences with the individual. Assessors answer questions about the individual’s ability to use expressive communication (vocabulary to get functional needs met). These include refusing and obtaining objects, engaging socially and providing or obtaining information. An individual’s progress can be tracked using the communication matrix. The assessment includes many different types of communication with or without speech, including types of AAC systems, such as speech generating devices and picture exchange communication systems (see types of AAC systems). The results from the communication matrix can help to create individual goals.
The communication matrix was created based off several years of communication research. A wide range of research recommends the use of this tool.
One study highlighted how the communication matrix was the only assessment for communication skills that was recommended by parents and received the highest five star rating on all of the questions.
References
Barnes, C. S., Mellor, J. R., & Rehfeldt, R. A. (2014). Implementing the verbal behavior milestones assessment
and placement program (VB-MAPP): Teaching assessment techniques. The Analysis of Verbal Behavior, 30(1),
36–47. https://doi.org/10.1007/s40616-013-0004-5
Banajee, M., Dicarlo, C. & Stricklin, B. (2003). Core vocabulary determination for toddlers. Augmentative and
Alternative Communication, 19(2), 67-73. https://doi.org/10.1080/0743461031000112034
Brodhead, M. T., Higbee, T. S., Gerencser, K. R., & Akers, J. S. (2016). The use of a discrimination-training
procedure to teach mand variability to children with autism. Journal of Applied Behavior Analysis, 49(1), 34–48.
https://doi.org/10.1002/jaba.280
Byrne, B. L., Rehfeldt, R. A., & Aguirre, A. A. (2014). Evaluating the effectiveness of the stimulus pairing
observation procedure and multiple exemplar instruction on tact and listener responses in children with
autism. The Analysis of Verbal Behavior, 30(2), 160–169. https://doi.org/10.1007/s40616-014-0020-0
Carnett, A., & Ingvarsson, E. T. (2016). Teaching a child with autism to mand for answers to questions using a
speech-generating device. The Analysis of Verbal Behavior, 32(2), 233–241. https://doi.org/10.1007/s40616-016-0070-6
Crone, D. A., Hawken, L. S., & Horner, R. H. (2015). Building Positive Behavior Support Systems in Schools: Functional Behavioral Assessment (2nd ed.). Guilford Publications.
Fallon, K. A., Light, J. C., & Paige, T. K. (2001). Enhancing Vocabulary Selection for Preschoolers Who Require
Augmentative and Alternative Communication (AAC). American Journal of Speech-Language Pathology, 10(1),
81–94. https://doi.org/10.1044/1058-0360(2001/010)
Gevarter, C., Horan, K., & Sigafoos, J. (2020). Teaching preschoolers with autism to use different speech-
generating device display formats during play: Intervention and Secondary Factors. Language, Speech & Hearing
Services in Schools, 51(3), 821–838. https://doi.org/10.1044/2020_LSHSS-19-00092
Gevarter, C., Prieto, V., Binger, C., & Hartley, M. (2023). Dynamic assessment of AAC action verb symbols for
children with ASD. Advances in Neurodevelopmental Disorders, 7(3), 329–343. https://doi.org/10.1007/s41252-022-00312-3
Holyfield, C., Caron, J., & Light, J. (2019). Programing AAC just-in-time for beginning communicators: the
process. Augmentative and Alternative Communication, 35(4), 309–318.
https://doi.org/10.1080/07434618.2019.1686538
Lotfizadeh, A. D., Gard, B., Rico, C., Poling, A., & Choi, K. R. (2024). Convergent and discriminant validity of the
verbal behavior milestones assessment and placement program (VB-MAPP) and the vineland adaptive
behavior scales (VABS). Journal of Autism and Developmental Disorders. https://pubmed.ncbi.nlm.nih.gov/38717635/
Muthusamy, S., Wagh, D., Tan, J., Bulsara, M., & Rao, S. (2022). Utility of the ages and stages questionnaire to
identify developmental delay in children aged 12 to 60 months: A Systematic Review and Meta-analysis. JAMA
Pediatrics, 176(10), 980–989. https://doi.org/10.1001/jamapediatrics.2022.3079
Navarro, J.-J., Mourgues-Codern, C., Guzman, E., Rodriguez-Ortiz, I. R., Conejo, R., Sanchez-Gutierrez, C., de la
Fuente, J., Martella, D., & Saracostti, M. (2018). Integrating curriculum-based dynamic assessment in
computerized adaptive testing: Development and predictive validity of the EDPL-BAI battery on reading
competence. Frontiers in Psychology, 9, 1492–1492. https://doi.org/10.3389/fpsyg.2018.01492
Nulty, E. C., Groh, R. R. (2021). Verbal behavior milestones assessment and placement program (VB-MAPP). In
F. R. Volkmar (Ed.), Encyclopedia of Autism Spectrum Disorders (2nd ed., pp. 5025-5028). Springer International Publishing.
Orellana, C., Wada, R., & Gillam, R. B. (2019). The use of dynamic assessment for the diagnosis of language
disorders in bilingual children: A Meta-Analysis. American Journal of Speech-Language Pathology, 28(3), 1298-
1317. https://doi.org/10.1044/2019_AJSLP-18-0202
Quinn, E. D., Cook, A., Wiedrick, J., & Rowland, C. (2021). An initial investigation into the feasibility of the
communication matrix professional development program for educational professionals working with
students with complex communication needs. Language, Speech & Hearing Services in Schools, 52(4), 1080-
1094. https://doi.org/10.1044/2021_LSHSS-20-00154
Rensfeld Flink, A., Thunberg, G., Nyman, A., Broberg, M., & Åsberg Johnels, J. (2024). Augmentative and
alternative communication with children with severe/profound intellectual and multiple disabilities: speech
language pathologists’ clinical practices and reasoning. Disability and Rehabilitation: Assistive Technology, ahead-
of-print(ahead-of-print), 1–13. https://doi.org/10.1080/17483107.2022.2137252
Rhodes, T., & Bergeron, J. (2017). Direct assessment methods. In T. Cumming & D. Miller (Eds.), Enhancing
assessment in higher education: Putting psychometrics to work (pp. 49-77). Taylor & Francis.
Rowland, C. (2024). Communication matrix. https://www.communicationmatrix.org/
Singh, A., Squires, Yeh, C. J., Heo, K., & Bian, H. (2016). Validity and reliability of the developmental assessment
screening scale. Journal of Family Medicine and Primary Care, 5(1), 124–128.
https://doi.org/10.4103/2249-4863.184636
Singh, A., Yeh, C. J., & Blanchard, S. B. (2017). Ages and stages questionnaire: a global screening scale. Boletín
Médico Del Hospital Infantil de México, 74(1), 5–12. https://doi.org/10.1016/j.bmhimx.2016.07.008
Sundberg, M. L (2024). The VB-MAPP application. https://www.vbmappapp.com/
Symons, D. K. (2011). Dynamic assessment. In S. Goldstein & J. A. Naglieri (Eds.), Encyclopedia of Child Behavior
and Development (pp. 529-530). Springer, Boston, MA.
Trembath, D., Dark, L., & Balandin, S. (2006). Why any old words won’t do: The importance of vocabulary
selection. Acquiring Knowledge in Speech, Language and Hearing, 8(3), 117-119.
https://www.researchgate.net/publication/261659416
Trembath, D, & Iacano, T. (2016). Standardized assessment of prelinguistic communication. In D. Keen., H.
Meadan., N. C. Brady, & J. W. Halle (Eds.), Prelinguistic and Minimally Verbal Communicators on the Autism
Spectrum (pp. 89-115). Springer Singapore.