Assessment & Evaluation Tools

There are several types of assessment and evaluation tools that can be used to help select what vocabulary to use within an AAC system. When deciding on assessment and evaluation tools, there are several factors that should be taken into consideration.

 

In no particular order, some of these include:

 


Note: To meet the individual diverse needs of the AAC user it is recommended that multiple indirect and direct assessments are used. Research highlights that when indirect and direct assessments are used together they can become a powerful tool. Together, indirect and direct assessments can help select vocabulary for the AAC user that will increase their learning, autonomy, wellbeing and social interactions to communicate and participate in their environment. It is also recommended that communication partners (AAC user, parents/families, teachers) are involved throughout the whole assessment and evaluation process. This will help to create a respectful and collaborative environment (see collaboration).

Direct assessments:

Direct assessments can be used to select vocabulary within an AAC system.

Direct assessments can allow AAC users to demonstrate their own knowledge, skills and behaviour. They can also help to determine an AAC user’s current skills and abilities.


 Examples of direct assessments for selecting vocabulary to use within an AAC system, include the following:

A just-in-time approach: 

In this approach vocabulary is introduced that is relevant to the AAC user and meets their immediate needs based on their current environment and situation. This includes an AAC user’s preferences and interests, current skills and abilities and functional needs.


Studies have shown that a just-in-time approach can be easy to use for high tech AAC systems, such as speech generating devices (see types of AAC systems). They can also enhance an AAC user’s communication and social interactions.

Case study example:

A student named Orla uses a combined picture and word based AAC system to communicate. Orla is on a school trip to the zoo and takes an interest in the lion in the lion enclosure. The picture and word lion are not in Orla’s AAC system. Orla’s teacher aide Elsie is on the school trip with her. Elsie takes a quick photograph of the lion, uploads the photo onto Orla’s AAC system and inserts the word “lion.”

Dynamic assessments:

Dynamic assessments are approaches that look at an individual’s current learning skills and abilities and their learning potential. DA often involve support (e.g., models and gestures) from adults (teachers, professionals) and can help individuals demonstrate their learning potential.

 

DA can help select vocabulary to use within an AAC system that aligns with an AAC user’s individual preferences and interests, current skills and abilities, social communication and functional needs. DA can also ensure the vocabulary within an AAC system can be used in many environments. DA can help provide AAC users with support to help learn and use new vocabulary, increasing their language and communication skills. The assessment can also help to understand the vocabulary the AAC user is able to use on their own with minimal support and can help identify when vocabulary within the AAC system needs to be changed.

 

Various research has used DA within AAC systems.

One study that used DA found that grid and visual scene AAC displays on speech generating devices (SGD) (see types of AAC systems), helped AAC users increase their use of function words (see types of vocabulary and their usage). AAC users who used grid and visual scenes were skilled at requesting nouns and showed progress at requesting other types of vocabulary, such as verbs.


DA example for selecting vocabulary to use within an AAC system:


    1.    Collaborate with communication partners

Gather information from communication partners (AAC user, parents/families and teachers) to find out the AAC user’s current skills and abilities, individual preferences and interests and functional needs (see collaboration).


2.   Preference assessments:

-     Present the AAC user with their preferred items/objects. Observe which item/object the AAC user reached for and/or pointed to. Create 20 opportunities for the AAC user to request these items.


3.  Graduated Prompting:

Use a least-to-most prompting hierarchy throughout the process. This involves a step by step guidance from the smallest to the highest level of support to correct non-responses and/or incorrect responses. This will determine the level of support that is needed.














  For example:


4.  Knowledge of vocabulary:

Show the AAC user pictures of words and ask them to identify the words, such as verbs. This will help show what words the AAC user knows already.


5.  Identify new words:

Continue to show the AAC user pictures of words until enough new words (that the AAC user does not know) have been identified.


6.   Dynamic assessment sessions:

Provide opportunities for the AAC user to practice using vocabulary, such as verbs in specific environments they will use them in.


Positive reinforcement of correct responses:


7.  Review support needs:

Look at how much support the AAC user needs to use the words/symbols correctly on their AAC system. This will help guide decision-making on what vocabulary is suitable for the AAC user within their AAC system.

The Verbal Behaviour Milestones Assessment and Placement Program (VB-MAPP):

The verbal Behaviour Milestones Assessment and Placement Program (VB-MAPP) is an assessment tool that is administered across a number of tasks. It is commonly used with individuals who have autism spectrum disorder (ASD). The VB-MAPP aims to determine an individual’s current language and social skills which can help guide intervention and individual support plans.

 

The VB-MAPP can be used to help select what vocabulary to use within an AAC system. This is because the VB-MAPP can determine an AAC user’s current language and communication abilities.

 

The VB-MAPP is divided into five components:


1.    Milestones assessment:

Level one: 0-18 months

Level two: 18-30 months

Level three: 30-48 months


2.    Barriers assessment:


3.    Transition assessment:


4.    Task analysis (breaking down tasks) and supporting skills:

5. Placement and IEP (individual education plan) goals:

The VB-MAPP reports can be created and shared with communication partners (AAC user, parents/families, teachers, professional). For accurate results, trained professionals should administer the assessment.

 

The VB-MAPP has been widely recognised in research. It has also been used in several studies presented at conferences.

Indirect Assessments:

Indirect assessments can be used to gather information, including opinions and behaviours to make a decision about an individual’s current skills and abilities. Examples of indirect assessments include interviews and questionnaires.


Indirect assessments are recommended for individuals who have early language communication abilities and individuals who use other types of communication other than verbal speech to communicate, such as AAC systems.


A challenge of indirect assessments are the lack of assessments for teenagers and adults with autism spectrum disorder (ASD). Personal experiences or influences from the assessor could also affect the results.


Examples of indirect assessments for selecting vocabulary to use within an AAC system, include the following:

Ages and stages questionnaire:

The ages and stages questionnaire (ASQ) is an assessment tool that can be used to help select what vocabulary to use within an AAC system.

 

The ASQ can identify an individual’s current skills and abilities and functional needs.


Research has shown that the ASQ is seen as an accurate, low cost tool for screening and monitoring. It is also easy to administer and a recommended tool for the early identification of autism spectrum disorder (ASD).

 

The ASQ can be completed by parents/families or by professionals who know the individual well.

 

Research highlights how ASQ has been examined across many different cultures and communities across the world. It has shown to be useful in many settings, including schools, homes and health settings.

Communication matrix:

The communication matrix is an online assessment tool that can be used to help select what vocabulary to use within an AAC system. The communication matrix is a free/low cost assessment tool. It was created to help communication partners (parents/families, teachers, professionals) easily understand the communication skills and abilities and needs of an individual who communicates at an early language level. The assessment is commonly used to assess children in home, school and community settings.

 

The assessment involves 24 questions mostly comprising “yes” or “no” questions and can be done off-line or online. The questions are based on the assessors observations and experiences with the individual. Assessors answer questions about the individual’s ability to use expressive communication (vocabulary to get functional needs met). These include refusing and obtaining objects, engaging socially and providing or obtaining information. An individual’s progress can be tracked using the communication matrix. The assessment includes many different types of communication with or without speech, including types of AAC systems, such as speech generating devices and picture exchange communication systems (see types of AAC systems). The results from the communication matrix can help to create individual goals.

 

The communication matrix was created based off several years of communication research. A wide range of research recommends the use of this tool.


One study highlighted how the communication matrix was the only assessment for communication skills that was recommended by parents and received the highest five star rating on all of the questions.


References

Barnes, C. S., Mellor, J. R., & Rehfeldt, R. A. (2014). Implementing the verbal behavior milestones assessment

                   and placement program (VB-MAPP): Teaching assessment techniques. The Analysis of Verbal Behavior, 30(1),

                   36–47. https://doi.org/10.1007/s40616-013-0004-5


Banajee, M., Dicarlo, C. & Stricklin, B. (2003). Core vocabulary determination for toddlers. Augmentative and

                   Alternative Communication, 19(2), 67-73. https://doi.org/10.1080/0743461031000112034


Brodhead, M. T., Higbee, T. S., Gerencser, K. R., & Akers, J. S. (2016). The use of a discrimination-training 

                  procedure to teach mand variability to children with autism. Journal of Applied Behavior Analysis, 49(1), 34–48.

                  https://doi.org/10.1002/jaba.280


Byrne, B. L., Rehfeldt, R. A., & Aguirre, A. A. (2014). Evaluating the effectiveness of the stimulus pairing

                 observation procedure and multiple exemplar instruction on tact and listener responses in children with

                 autism. The Analysis of Verbal Behavior, 30(2), 160–169. https://doi.org/10.1007/s40616-014-0020-0


Carnett, A., & Ingvarsson, E. T. (2016). Teaching a child with autism to mand for answers to questions using a

                 speech-generating device. The Analysis of Verbal Behavior, 32(2), 233–241. https://doi.org/10.1007/s40616-016-0070-6


Crone, D. A., Hawken, L. S., & Horner, R. H. (2015). Building Positive Behavior Support Systems in Schools: Functional Behavioral Assessment (2nd ed.). Guilford Publications.


Fallon, K. A., Light, J. C., & Paige, T. K. (2001). Enhancing Vocabulary Selection for Preschoolers Who Require

                Augmentative and Alternative Communication (AAC). American Journal of Speech-Language Pathology, 10(1), 

                81–94. https://doi.org/10.1044/1058-0360(2001/010)


Gevarter, C., Horan, K., & Sigafoos, J. (2020). Teaching preschoolers with autism to use different speech-

               generating device display formats during play: Intervention and Secondary Factors. Language, Speech & Hearing

               Services in Schools, 51(3), 821–838. https://doi.org/10.1044/2020_LSHSS-19-00092


Gevarter, C., Prieto, V., Binger, C., & Hartley, M. (2023). Dynamic assessment of AAC action verb symbols for 

               children with ASD. Advances in Neurodevelopmental Disorders, 7(3), 329–343. https://doi.org/10.1007/s41252-022-00312-3


Holyfield, C., Caron, J., & Light, J. (2019). Programing AAC just-in-time for beginning communicators: the

               process. Augmentative and Alternative Communication, 35(4), 309–318.

               https://doi.org/10.1080/07434618.2019.1686538


Lotfizadeh, A. D., Gard, B., Rico, C., Poling, A., & Choi, K. R. (2024). Convergent and discriminant validity of the 

               verbal behavior milestones assessment and placement program (VB-MAPP) and the vineland adaptive

               behavior scales (VABS). Journal of Autism and Developmental Disorders. https://pubmed.ncbi.nlm.nih.gov/38717635/


Muthusamy, S., Wagh, D., Tan, J., Bulsara, M., & Rao, S. (2022). Utility of the ages and stages questionnaire to

               identify developmental delay in children aged 12 to 60 months: A Systematic Review and Meta-analysis. JAMA

               Pediatrics, 176(10), 980–989. https://doi.org/10.1001/jamapediatrics.2022.3079


Navarro, J.-J., Mourgues-Codern, C., Guzman, E., Rodriguez-Ortiz, I. R., Conejo, R., Sanchez-Gutierrez, C., de la

               Fuente, J., Martella, D., & Saracostti, M. (2018). Integrating curriculum-based dynamic assessment in 

               computerized adaptive testing: Development and predictive validity of the EDPL-BAI battery on reading

               competence. Frontiers in Psychology, 9, 1492–1492. https://doi.org/10.3389/fpsyg.2018.01492


Nulty, E. C., Groh, R. R. (2021). Verbal behavior milestones assessment and placement program (VB-MAPP). In 

F. R. Volkmar (Ed.), Encyclopedia of Autism Spectrum Disorders (2nd ed., pp. 5025-5028). Springer International Publishing.


Orellana, C., Wada, R., & Gillam, R. B. (2019). The use of dynamic assessment for the diagnosis of language 

               disorders in bilingual children: A Meta-Analysis. American Journal of Speech-Language Pathology, 28(3), 1298-

               1317. https://doi.org/10.1044/2019_AJSLP-18-0202


Quinn, E. D., Cook, A., Wiedrick, J., & Rowland, C. (2021). An initial investigation into the feasibility of the 

                communication matrix professional development program for educational professionals working with 

                students with complex communication needs. Language, Speech & Hearing Services in Schools, 52(4), 1080-

               1094. https://doi.org/10.1044/2021_LSHSS-20-00154


Rensfeld Flink, A., Thunberg, G., Nyman, A., Broberg, M., & Åsberg Johnels, J. (2024). Augmentative and 

                alternative communication with children with severe/profound intellectual and multiple disabilities: speech 

                language pathologists’ clinical practices and reasoning. Disability and Rehabilitation: Assistive Technology, ahead-

                of-print(ahead-of-print), 1–13. https://doi.org/10.1080/17483107.2022.2137252


Rhodes, T., & Bergeron, J. (2017). Direct assessment methods. In T. Cumming & D. Miller (Eds.), Enhancing 

                 assessment in higher education: Putting psychometrics to work (pp. 49-77). Taylor & Francis.


Rowland, C. (2024). Communication matrix. https://www.communicationmatrix.org/


Singh, A., Squires, Yeh, C. J., Heo, K., & Bian, H. (2016). Validity and reliability of the developmental assessment 

                 screening scale. Journal of Family Medicine and Primary Care, 5(1), 124–128. 

                   https://doi.org/10.4103/2249-4863.184636


Singh, A., Yeh, C. J., & Blanchard, S. B. (2017). Ages and stages questionnaire: a global screening scale. Boletín 

                  Médico Del Hospital Infantil de México, 74(1), 5–12. https://doi.org/10.1016/j.bmhimx.2016.07.008


Sundberg, M. L (2024). The VB-MAPP application. https://www.vbmappapp.com/


Symons, D. K. (2011). Dynamic assessment. In S. Goldstein & J. A. Naglieri (Eds.), Encyclopedia of Child Behavior

                 and Development (pp. 529-530). Springer, Boston, MA.


Trembath, D., Dark, L., & Balandin, S. (2006). Why any old words won’t do: The importance of vocabulary 

                 selection. Acquiring Knowledge in Speech, Language and Hearing, 8(3), 117-119.

                 https://www.researchgate.net/publication/261659416


Trembath, D, & Iacano, T. (2016). Standardized assessment of prelinguistic communication. In D. Keen., H.

                 Meadan., N. C. Brady, & J. W. Halle (Eds.), Prelinguistic and Minimally Verbal Communicators on the Autism

                 Spectrum (pp. 89-115). Springer Singapore.