Very in-depth and a good refresher. This reminds me of standardized tests and I could see where a lot of these play into things such as standardized tests. Good to be reminded of the differences between reliability and validity.
This video was a really great refresher of reliability and validity. I think we try to make sure we are always using reliable and valid assessment with our clients. However, as we all know, no assessment is completely reliable and valid, which makes you question if the whole process of diagnosing is worthwhile in the first place. I'm glad, however, that we have a lot of different formulas and tools to determine how valid and reliable certain instruments are.
I was introduced to these concepts as an undergraduate. I must say that this presentation was helpful because I did forget what some of the concepts meant. It was nice to have an opportunity to revisit these concepts; they were broken down in this video in an easy way for me to try to remember.
This was a nice overview of the concepts of reliability and validity. It was a good reminder what the concepts mean, what types of errors that could occur while using an instrument, as well as why it's important to be mindful of how reliable and valid an instrument you are using actually is.
The concepts of reliability and validity are well explained. This video gives a better understanding of different forms and methods of reliability and validity.
This video was a great refresher from statistics. The real-world examples helped me to better understand the differences between reliability and validity.
Reliability and validity seem like important concepts for everyone to understand. I think about these concepts every day while reading the paper, etc. This video is helpful in reinforcing what we learned in research.
Always good to go over the differences between reliability and validity as well as being reminded that an instrument can be reliable and not valid but a valid instrument has to also be reliable.
This video was useful in describing validity and reliability. Emphasizing that reliability doesn't have to be valid but that in order to be valid it has to be reliable and reliability has to come first was a crucial take away from this video. I appreciated the detailed explanation of the different types of methods used to determine reliability as well as the different types of validity. Face validity not being a true form of validity but is useful for clients and has value I think was an important component to understand.
I remember going over this stuff in my undergrad, this was a very good refresher video. I always find it hard to remember that an instrument can be reliable but not valid and a valid instrument needs to be reliable.
Great refresher to the reliability and validity video we watched last semester. I have a better understanding of the concepts watching this video matched with the textbook.
The level of detail about reliability and validity in this presentation helped bridge the gap between the definitions of reliability and validity and its significance when using it to evaluate scientific studies.
This video was very helpful in understanding reliability and validity. I've heard these terms so many times in the past. It wasn't until I watched this video and read the text that I truly understood the concepts in depth. Beyond learning their definitions, I learned how they are developed and maintained in the field.
I often find the different types of validity to be confusing. This video help to make the concept clearer for me. I think this was a good supplement to the information in our text.
This video was a good refresher on reliability and validity. I never knew there were so many different types of validity and consistency. This video will be good to look back on when making sure an instrument being used is reliable and valid to what we are measuring.
I didn't realize there were so many different types of consistency either! It really goes to show how you how nuanced the concept of reliability truly is.
This was video was helpful for me to remember the difference between validity and reliability. It was a great addition to the text and helped prepare me for the relate quiz. The examples to real life scenarios, were also helpful in being able to retain and remember this information.
This video was an excellent refresher. I remember during my undergrad Test and Measurements class being really confused about the difference between reliability and validity. Dr. Grande’s video has cleared up any remaining confusion I may have had.
This was a great review on validity and reliability. I easily confuse the two terms! I really appreciated how Dr. Grande broke down how reliability comes first, making valid instruments always reliable. I understand this much better having Dr. Grande explain that.
+Rachel Foster These seem like simple concepts, but there is a lot more too them. I really enjoyed Dr. Grande's video on how to make differentiating them simpler.
The video was a great way to bring chapters 5 and 6 together. It helped me understand reliability and validity better. It is always nice to have different perspectives on the subject. These videos would be a great learning tool in class.
This was a great video that explained concepts of reliability and validity used in appraisal techniques. I appreciated that everything was explained in a slow-paced and easy to understand way. I also was unaware of the three types of internal consistency.
Thank you for this wonderful video! This video is a really useful refresher for learning the difference between reliability and validity. It is important to remember that a test that is reliable isn't always useful or valid. Also, an instrument can't be valid without first being reliable.
I found this video very fascinating! i had to watch twice due to the plethora of information. i think construct validity was the easiest topic to follow in this video. but i will keep watching until it makes better sense! great resource!
I thought this was a good presentation about reliability and validity. I think it is easy to become confused regarding the difference between reliability and validity, and this serves as a good reminder.
Great refresher! Great to revisit validity vs. reliability. Nice to be reminded of a lot of the concepts we are already familiar with, makes appraisals a little less intimidating.
It certainly does make appraisal a little less intimidating! Its nice to know that the KR20 and KR21 formulas can be used as alternatives for the split half method.
I often get reliability and validity confused, and I think reliability is a lot more clear cut that validity, and I think this video clears up a lot of confusion about the two concepts.
This was a good overview of reliability and validity. It makes sense to me that some testing instruments may not be completely accurate, however, it can be useful or reliable, as it can offer up a general consensus. I think this is also why there are so many different testing instruments created and made available to help assure the validity or accuracy of the test.
So far the most resourceful video. I do understand reliability and validity but the video gave a more insight. Reliability deals with consistency and validity Great lesson in methods of determining reliability. I think as counselor, it's very important for us to understand these two concepts in order to effectively conceptualize, estimate, predict and determine our clients scores in order to make judgements about them as this can affect their lives. Great video.
Vida, I completely agree. It was as if I'd only been given the introductory lesson on these topics. This video and the text illuminated the intricacies and deeper details of each component respectively.
These two concepts have been somewhat plaguing me for distinction since my courses began in the summer. I could get them straight for a moment, and then have difficulty five minutes later so to speak. However, this helped to delineate the terms in a way that I feel I will be able to continue with. Thank you!
This video is useful since the terms reliability and validity are sometimes hard to differentiate. So a reliable instrument must be dependable and consistent and validity is accuracy and there are multiple types of validity. The example of the weight scale was helpful.
I don't know why I keep mixing these two terms up all the time because with hearing the definitions and explanations it is easy to tell the difference. This is a good video to really cement the information in.
This video is helpful in distinguishing between reliability and validity, and was a good reminder of the various forms of reliability and validity. I also found thought it was helpful in remembering that an instrument can be reliable and not valid, but to be valid it also has to be reliable.
+Jacklin Skibicki I agree Jackie. This video was a good reminder overall of the importance of the concepts since we haven't had research in a while! And how this is incorporated into the usage of instruments.
Although we learned this in Research it was a great opportunity to refresh what we previously learned. I feel like I understood it a little bit better this time and somethings that I thought I understood before have changed, for example the test-retest.
I had an understanding of valid and reliable, but this video gave a more in depth explanation of the two. I was unaware of face validity, I know I have heard it in class before but it never stuck.
I understand what reliability and validity are, but sometimes I confuse myself on which is which. I really enjoyed the scale example because it simplified it enough for me to understand. I also get confused on the "it can be reliable and not valid, but not the other way around". The scale metaphor helped me understand that as well. So, reliability means that the results will be consistent, and validity means that the instrument measures what it's suppose to measure.
I tend to find myself using the terms reliability and validity interchangeably even though I understand the difference and the video provided a great reminder on how to use the terms correctly and why. This video helped to clarify the interpretation of the statistical analysis. I'm not great at using the formulas and remembering which one to use. Any refresher on these terms is welcome at any time. This is a video that I will probably be going back to time and again.
The two terms reliability and validity has came up some many times since 2010 when I started taking classes. This was the fist time that it actually made sense to me. This was a very good video and should be presented the classroom. A very good video!
Oh yes please go over in class! true validity and not true validity within content! I understand when Dr, Grande presents in class so much better! I think you are saying the same thing Robert!
I get the two of these confused sometimes. I think this was a good overview and I think that I have a better understanding now. I makes a lot of sense that the test needs to be consistent- it has to be reliable so that when it is run, we can count on the results. It doesn't matter if the results are good- at least the test is reliable.
Reliability and validity are so necessary, and I think that I appreciate videos like this because as a counselor, we will use measures and tests and somewhat take for granted all of the work that was done for us to make sure that our results are "trustworthy." Aside from this, the "true score" construct was interesting; something that I had not been exposed to before.
Angelique Castro Interesting point! I think I was definitely guilty of taking this work for granted. I now have a greater respect and understanding of this field. Although my mind is not particularly built for research and stats, I now understand and respect the importance this has on our careers!
Most definitely. Some people take tests and have meltdowns over their scores but disregard that there's either no info on reliability or it's not valid for their group. These are two central concepts to understand when talking about assessment and experimentation.
ive never thought of it that way before and you're right, i think we take for granted all the work that was done for us and just trust that the measures we are using are reliable and valid. Which is why it is important to be able to know these concepts so we can read the research or do the research in order to pick useful instruments or develop them ourselves and test them
This was a good refresher on reliability and validity. I also remember learning about Test and Retest to determine reliability. It was a great reminder that reliability measures consistency. I liked the example of the scale being off by 10 lbs; the scale is consistent but not valid. Validity measures accuracy and it must be reliable to be valid.
Pretty good refresher video. I may have to revisit again to understand what measures of reliability are appropriate for what test types, but much of it is a refresher. Test-retest I always thought would be easily arguable against because memory of the questions would affect the scores, but in here you say that's not enough to prevent the method from being used so that is interesting.
There is a lot to take in on this video. I learned the straight forward method that the reliability coefficient is not squared, .8 is 80% not the square of 80%. I also learned the importance of raters working independently, which will reduce error.
This was a good refresher of reliability and validity. I liked how it discussed the different types of validity. I found it interesting that a instrument can be reliable but might not be valid.
Although I can recognized the difference between reliability and validity, I still tend to confuse the different types of validity with one another. This video and the examples provided throughout were rather helpful in clarifying this distinction!
I am the same way when it comes to the different types if validity. I find it hard to remember the differences without examples, and this video did provided some clarification.
Great video differentiating reliability and validity, and different forms of each. One of the biggest things I'm taking from this video is that an instrument can be reliable yet not valid. The scale/10 lbs. weight difference was a good example demonstrating reliability.
While reading the Chapters 5 and 6 in the D&J text, I found myself understanding reliability and validity however; the terminology and equations that accompany these terms can be confusing. There are so many ways to explore reliability and validity! I found the video to be a great help. When Dr. Grande explained that an instrument can be reliable but not valid BUT in order to be valid it must be reliable... for some reason, it clicked.
I agree, I think the video really simplifies things. Sometimes books can be too detailed and it is easy to get lost in all of the information. This video is clear and simple and that is what helps.
I thought it was interesting that with inter rater consistency that the raters should work independently so they don't know how the other rater rated. It was also interesting to know that in order for an instrument to be valid it has to be reliable but a instrument can be reliable without being valid
Although I had learned this information last semester, this was a greater refresher. I also find it interesting that in order for an instrument to be valid it must be reliable but it can be reliable without being valid.
I can tell we are back to the statistical measurement portion once we start talking reliability and validity. The example given for reliability was a great example of how a scale meant to measure weight can be off by 10 pounds but it is still reliable not a valid measurement but one that shows consistent reliability. I could easily relate to the example of face validity. If I am taking a test, questionnaire, or whatever and I do not think it is questions that pertain to what should be measurable I start to change my answers because I do not think the instrument has face validity.
This was a great video to outline these concepts and refresh my memory from research. They can seem like very simple concepts but they are so important when using assessments. Anyone can create an instrument to measure a concept but if we're going to use it with clients, we want to be able to ensure that it is reliable and valid.
I thought it was interesting too because the same instrument can be considered both valid and invalid, depending on the purpose it's being used. I think it's important for us to understand these concepts well so we can make confident decisions whenever we have to use an instrument. It's not about which instrument we like better, it's about identifying which one is appropriate for the specific purpose.
As I watched this video, I too was able to recall some terms from research. This is an area that is quite important when using assessments and interpreting results but for me, I would really need to see it first hand to really grasp a clearer understanding.
I can sometimes confuse these terms, so this video is a good reminder about the difference between the two concepts. It is important to remember that just because it is reliable doesn't mean it is valid. for some reason i have a harder time understanding the coefficient portion and needed to replay more than once to understand. Good refresher from research class. I truely struggle with statistical concepts and when to use them so while the video was helpful, i was still a bit confused.
I was more confused about the reliability cofefficient in the video.. I thought I understood it, or at least had some understanding of it, but this was confusing in the video.. The breakdown of construct validity was very helpful though. I was a little confused between the difference of convergent and discriminant validity. This wasn't defined as clearly in the text, but the video helped for these concepts.
Excellent video explaining the differences in reliability and validity. I understand the measurement concept a tad better but I still need to revisit calculations! I wish there was a tool to drill this information in my head!!!
Agreed Eva.I understand the concepts and the differences between the two terms. However, all of the formulas are a bit confusing. I think once we start using real world data with the formulas given, more of these concepts will make sense to us.
I feel like I really grasped the difference between the two and how they apply to assessments. I read the chapters in D&J and then watched the videos which helped really explain the info.
As other classmates have noted, reliability and validity, while easy to understand, they are also a necessary component when conducting and understanding research. Although these two terms are simple enough to understand, there are so many complex parts to them, and if researchers are not fully knowledgeable about those parts, could cause problems with the research.
this video is a great reminder and refresher on the difference between reliability and validity. The two terms tend to blend together for me at times which can be confusing.
+Melissa Clendaniel This was a simple break down of the two terms again. The examples give were easy to follow. When it comes to construct validity which seems to be the most important type since it can not be directly observed it makes things a little more difficult for me to understand. I get the big picture, but it is hard to grasp because the measure is of a hypothetical construct.
+Bethany Elstrom The examples were easy to follow but not so easy to completely grasp. Each time I learn and relearn about reliability and validity more sinks in. Something must be reliable before it can valid but it does not have to be valid in order to be reliable.
A good refresher for me with this video. Reliability and validity are often confused but this video helped me to re-establish the difference between the two. The coefficient and stat portion is what makes me nervous. Even though the video did help somewhat, I am still not confident in my knowledge of this. Hopefully the book will help clear it up more for me. Overall, useful video.
I agree, the stat portion of these concepts do make me nervous as well. The topics were touched on but not really talked about in depth. I think the book will help with that a little as well.
Yes, it was a good refresher on the terms. Appraisal class is like an advanced form of research class, but with more complex pieces, and application of those research terminologies. I am confuse about a whole of things with this video, because there are so many parts of reliability and validity, and each plays various roles, and some work better with measuring specific assessments, and do not work well with other assessments.
A Od Yes, it seems simple when the terms are explained. But when we talk about collecting evidence of validity and estimating reliability, things get more complex. So far, these two chapters were the easiest ones to follow.
I think that I learned a lot in this video. I did not know that there were so many other kinds of validity. I also never thought of the a instrument having to be relaiable to be vaild. I thought that was a good point to remember. It also makes a lot of sense that it doesnt work the other way around. An instrument can be reliable without being vaild.
+Mandy Moore When I read the chapters for this week, this video coincides very well with it. Reliability and validity are very important, and it is very important to know and to understand the differences between the two.
"Reliability-- Does the measure provide stable dependable results?" In addition, validity refers to if an assessment is sound or meaningful. These are both crucial for assessment and are used for clinical purposes about our client.
I thought. Dr. Grande made the distincition between reliablity and validity very clear. I also thought that it was a good refresher from research class. The scale example was really great!
It was a nice little reminder of the difference between a measure or scale's reliability and validity. Reliability is to consistency as validity is to accuracy. True score in addition to measurement error yields the observed score for a given measure and scale as well. Just as we cannot know the exact true score for a measure, we also estimate the reliability coefficient. Seems a little confusing, so I am hoping the text can clear up some of these statistical measures.
I used this video in combination with the chapters in the D&J textbook. I use to get them mixed up all the time. But I feel I have finally grasped the difference. Reliability is in reference to the test scores and validity is in reference to the test itself.
This video was a great refresher of reliability and validity. With reliability, does the measure provide stable, dependable and consistent results and with validity does the test measure what it is supposed to be measuring.
+Regina Ames Exactly! I just noticed that your response was pretty much the same as mine for this video! But yes reliability and validity do hold such truths!
+Regina Ames I agree, this was a great refresher as it has been awhile since we have discussed reliability and validity. Your breakdown of the video information did help me to better understand the difference among the two terms.
It is always interesting to me that an instrument can be reliable but not valid, yet it does not work the other way around. It cannot be valid if it is not also reliable. It makes sense that the measure has to be stable and consistent before you can even consider if it is measuring accurately.
The terms reliability and validity themselves are easy to understand. With reliability, to find the coefficients was a bit confusing. A couple of the formulas, I remember from my first stats class. Putting the numbers in the formulas are easy, I just don't know when to use what formula... this is so much! I truly hope I don't have to work with stats in my career as much as this class insinuates... lol The interpretation of the coefficients is simple too, I thought, such as .95 or . or .80 meaning that 95% and 80% respectively indicates that only 5% of variation in tests scores (in the first case) and 20% (in the second case) is attributed to error. Did I get that right? Some of the methods used to estimate reliability are easy, others are a bit more challenging, but I think Dr. Grande did a good job explaining them and their characteristics. The book also explained them pretty well, I thought. The formulas are not that hard to interpret. I just need to know which ones to use at each situation... that's the challenge for me. Validity is easier to understand overall. My favorite chapter so far! lol No formulas and no numbers! Just the way I like it! :) The different types of validity: face, content, criterion, predictive, construct, and convergent and discriminant are simple to understand.
I agree with both of you. I think that we will be seeing more of this, so hopefully it will seem less confusing to us as time goes on. I think this is something that I will need to hear again and again.
Right there with you on the dislike of stats... No matter how many times i learn these constructs, i feel like they go in one ear and out the other and don't fully sink in. Its almost like another language. I understand why its important, such as choosing which assessment to use and understanding the research on various measures... but its still frustrating to understand
Reliability and validity are so relevent for counselors when one conducts testing and interpreting results. This is an area that I am not confident but with practice and some one on one training, it can be mastered.
Laura, this was the first time reliability and validity was explained in this matter; it was easy to follow and understand. The big take away that I got which is very important is reliability has to come first before it can be valid.
Very in-depth and a good refresher. This reminds me of standardized tests and I could see where a lot of these play into things such as standardized tests. Good to be reminded of the differences between reliability and validity.
This video was a really great refresher of reliability and validity. I think we try to make sure we are always using reliable and valid assessment with our clients. However, as we all know, no assessment is completely reliable and valid, which makes you question if the whole process of diagnosing is worthwhile in the first place. I'm glad, however, that we have a lot of different formulas and tools to determine how valid and reliable certain instruments are.
I was introduced to these concepts as an undergraduate. I must say that this presentation was helpful because I did forget what some of the concepts meant. It was nice to have an opportunity to revisit these concepts; they were broken down in this video in an easy way for me to try to remember.
This was a nice overview of the concepts of reliability and validity. It was a good reminder what the concepts mean, what types of errors that could occur while using an instrument, as well as why it's important to be mindful of how reliable and valid an instrument you are using actually is.
The concepts of reliability and validity are well explained. This video gives a better understanding of different forms and methods of reliability and validity.
This video was a great refresher from statistics. The real-world examples helped me to better understand the differences between reliability and validity.
Reliability and validity seem like important concepts for everyone to understand. I think about these concepts every day while reading the paper, etc. This video is helpful in reinforcing what we learned in research.
Always good to go over the differences between reliability and validity as well as being reminded that an instrument can be reliable and not valid but a valid instrument has to also be reliable.
This video was useful in describing validity and reliability. Emphasizing that reliability doesn't have to be valid but that in order to be valid it has to be reliable and reliability has to come first was a crucial take away from this video. I appreciated the detailed explanation of the different types of methods used to determine reliability as well as the different types of validity. Face validity not being a true form of validity but is useful for clients and has value I think was an important component to understand.
I remember going over this stuff in my undergrad, this was a very good refresher video. I always find it hard to remember that an instrument can be reliable but not valid and a valid instrument needs to be reliable.
Great refresher to the reliability and validity video we watched last semester. I have a better understanding of the concepts watching this video matched with the textbook.
The level of detail about reliability and validity in this presentation helped bridge the gap between the definitions of reliability and validity and its significance when using it to evaluate scientific studies.
I found it a great reminder to clarify the difference between reliability (consistent results) vs. validity (the accuracy of an instrument).
This video was very helpful in understanding reliability and validity. I've heard these terms so many times in the past. It wasn't until I watched this video and read the text that I truly understood the concepts in depth. Beyond learning their definitions, I learned how they are developed and maintained in the field.
I often find the different types of validity to be confusing. This video help to make the concept clearer for me. I think this was a good supplement to the information in our text.
This video was a good refresher on reliability and validity. I never knew there were so many different types of validity and consistency. This video will be good to look back on when making sure an instrument being used is reliable and valid to what we are measuring.
I didn't realize there were so many different types of consistency either! It really goes to show how you how nuanced the concept of reliability truly is.
This was video was helpful for me to remember the difference between validity and reliability. It was a great addition to the text and helped prepare me for the relate quiz. The examples to real life scenarios, were also helpful in being able to retain and remember this information.
This video was an excellent refresher. I remember during my undergrad Test and Measurements class being really confused about the difference between reliability and validity. Dr. Grande’s video has cleared up any remaining confusion I may have had.
This video was great help after reading chapters 5&6. It really showed how intricate the process is for developing assessments and tests.
Thanks for the review of these concepts, Dr. Grande. I especially appreciate the discussion on rater interreliability.
I appreciated how Dr. Grande explained face validity.
This was a great review on validity and reliability. I easily confuse the two terms! I really appreciated how Dr. Grande broke down how reliability comes first, making valid instruments always reliable. I understand this much better having Dr. Grande explain that.
I agree that this video was helpful and I also liked the example of the scale being 10 pounds off and how it can be consistent, but not valid.
+Rachel Foster These seem like simple concepts, but there is a lot more too them. I really enjoyed Dr. Grande's video on how to make differentiating them simpler.
The video was a great way to bring chapters 5 and 6 together. It helped me understand reliability and validity better. It is always nice to have different perspectives on the subject. These videos would be a great learning tool in class.
This was a great video that explained concepts of reliability and validity used in appraisal techniques. I appreciated that everything was explained in a slow-paced and easy to understand way. I also was unaware of the three types of internal consistency.
As the others have pretty much stated, it was nice to have a refresher on reliability and validity as we enter Appraisal.
Thank you for this wonderful video! This video is a really useful refresher for learning the difference between reliability and validity. It is important to remember that a test that is reliable isn't always useful or valid. Also, an instrument can't be valid without first being reliable.
I found this video very fascinating! i had to watch twice due to the plethora of information. i think construct validity was the easiest topic to follow in this video. but i will keep watching until it makes better sense! great resource!
I thought this was a good presentation about reliability and validity. I think it is easy to become confused regarding the difference between reliability and validity, and this serves as a good reminder.
Great refresher! Great to revisit validity vs. reliability. Nice to be reminded of a lot of the concepts we are already familiar with, makes appraisals a little less intimidating.
It certainly does make appraisal a little less intimidating! Its nice to know that the KR20 and KR21 formulas can be used as alternatives for the split half method.
I often get reliability and validity confused, and I think reliability is a lot more clear cut that validity, and I think this video clears up a lot of confusion about the two concepts.
This was a good overview of reliability and validity. It makes sense to me that some testing instruments may not be completely accurate, however, it can be useful or reliable, as it can offer up a general consensus. I think this is also why there are so many different testing instruments created and made available to help assure the validity or accuracy of the test.
One thing I enjoy about these videos is that I can follow along with the presented power point. Great video on looking at reliability and validity.
I also found the video easy to follow and understand, and I was able to grasp more information as a result.
So far the most resourceful video. I do understand reliability and validity but the video gave a more insight. Reliability deals with consistency and validity
Great lesson in methods of determining reliability. I think as counselor, it's very important for us to understand these two concepts in order to effectively conceptualize, estimate, predict and determine our clients scores in order to make judgements about them as this can affect their lives.
Great video.
Vida,
I completely agree. It was as if I'd only been given the introductory lesson on these topics. This video and the text illuminated the intricacies and deeper details of each component respectively.
As always, I found this video to be very useful. We studied reliability and validity in statistics too but this was a good reminder!
These two concepts have been somewhat plaguing me for distinction since my courses began in the summer. I could get them straight for a moment, and then have difficulty five minutes later so to speak. However, this helped to delineate the terms in a way that I feel I will be able to continue with. Thank you!
This video is useful since the terms reliability and validity are sometimes hard to differentiate. So a reliable instrument must be dependable and consistent and validity is accuracy and there are multiple types of validity. The example of the weight scale was helpful.
I don't know why I keep mixing these two terms up all the time because with hearing the definitions and explanations it is easy to tell the difference. This is a good video to really cement the information in.
I agree! After watching the video I felt like I had it because of the definitions provided. Don’t ask me to explain it to someone else though :p
This video is helpful in distinguishing between reliability and validity, and was a good reminder of the various forms of reliability and validity. I also found thought it was helpful in remembering that an instrument can be reliable and not valid, but to be valid it also has to be reliable.
+Jacklin Skibicki I agree Jackie. This video was a good reminder overall of the importance of the concepts since we haven't had research in a while! And how this is incorporated into the usage of instruments.
Although we learned this in Research it was a great opportunity to refresh what we previously learned. I feel like I understood it a little bit better this time and somethings that I thought I understood before have changed, for example the test-retest.
I had an understanding of valid and reliable, but this video gave a more in depth explanation of the two. I was unaware of face validity, I know I have heard it in class before but it never stuck.
I understand what reliability and validity are, but sometimes I confuse myself on which is which. I really enjoyed the scale example because it simplified it enough for me to understand. I also get confused on the "it can be reliable and not valid, but not the other way around". The scale metaphor helped me understand that as well. So, reliability means that the results will be consistent, and validity means that the instrument measures what it's suppose to measure.
This a good video that sums up reliability and validity. I think it is good tool to review this video before an exam.
I agree! This would've been much more helpful to watch this before I took the quiz. I'll remember this before the final!
I tend to find myself using the terms reliability and validity interchangeably even though I understand the difference and the video provided a great reminder on how to use the terms correctly and why.
This video helped to clarify the interpretation of the statistical analysis. I'm not great at using the formulas and remembering which one to use. Any refresher on these terms is welcome at any time. This is a video that I will probably be going back to time and again.
Excellent refresher on validity and reliability. Validity = reliability but reliability does not necessarily = validity. Thanks Dr. Grande.
Yes I agree, this video was a good refresher.
This presentation was very helpful. Gave me insight to the concepts and were broken down t understand.
The two terms reliability and validity has came up some many times since 2010 when I started taking classes. This was the fist time that it actually made sense to me. This was a very good video and should be presented the classroom. A very good video!
I agree Robert, I like how simple and straightforward the video was. It is a great summary of these two concepts.
Oh yes please go over in class! true validity and not true validity within content! I understand when Dr, Grande presents in class so much better! I think you are saying the same thing Robert!
I get the two of these confused sometimes. I think this was a good overview and I think that I have a better understanding now. I makes a lot of sense that the test needs to be consistent- it has to be reliable so that when it is run, we can count on the results. It doesn't matter if the results are good- at least the test is reliable.
Reliability and validity are so necessary, and I think that I appreciate videos like this because as a counselor, we will use measures and tests and somewhat take for granted all of the work that was done for us to make sure that our results are "trustworthy." Aside from this, the "true score" construct was interesting; something that I had not been exposed to before.
Angelique Castro Interesting point! I think I was definitely guilty of taking this work for granted. I now have a greater respect and understanding of this field. Although my mind is not particularly built for research and stats, I now understand and respect the importance this has on our careers!
Most definitely. Some people take tests and have meltdowns over their scores but disregard that there's either no info on reliability or it's not valid for their group. These are two central concepts to understand when talking about assessment and experimentation.
ive never thought of it that way before and you're right, i think we take for granted all the work that was done for us and just trust that the measures we are using are reliable and valid. Which is why it is important to be able to know these concepts so we can read the research or do the research in order to pick useful instruments or develop them ourselves and test them
This was a good refresher on reliability and validity. I also remember learning about Test and Retest to determine reliability. It was a great reminder that reliability measures consistency. I liked the example of the scale being off by 10 lbs; the scale is consistent but not valid. Validity measures accuracy and it must be reliable to be valid.
+Michelle Robinson Yes, it's been several months since research class, so this was a helpful overview.
+Michelle Robinson I like the scale example as well
Pretty good refresher video. I may have to revisit again to understand what measures of reliability are appropriate for what test types, but much of it is a refresher. Test-retest I always thought would be easily arguable against because memory of the questions would affect the scores, but in here you say that's not enough to prevent the method from being used so that is interesting.
There is a lot to take in on this video. I learned the straight forward method that the reliability coefficient is not squared, .8 is 80% not the square of 80%. I also learned the importance of raters working independently, which will reduce error.
This was a good refresher of reliability and validity. I liked how it discussed the different types of validity. I found it interesting that a instrument can be reliable but might not be valid.
I agree, this was a good refresher.
The ideal that face validity could potentially change the way a client answers questions was very interesting and a valid point.
lori wardwell, I thought that was interesting also, & that they might lose motivation, &/or not take it seriously.
I really liked this video and how it pointed out the differences between reliability and validity, and even the different forms of validity.
+Kimberly Dixon I also liked how it pointed out the differences between reliability and validity; I used to get confused between the two.
I agree, I am constantly working on gaining a better understanding of the differences in validity.
Although I can recognized the difference between reliability and validity, I still tend to confuse the different types of validity with one another. This video and the examples provided throughout were rather helpful in clarifying this distinction!
I am the same way when it comes to the different types if validity. I find it hard to remember the differences without examples, and this video did provided some clarification.
Great video differentiating reliability and validity, and different forms of each. One of the biggest things I'm taking from this video is that an instrument can be reliable yet not valid. The scale/10 lbs. weight difference was a good example demonstrating reliability.
+Kimberly Kelly I agree that it was informative to learn that an instrument can be reliable but not valid.
This video shows clear distinction between reliability and validity, and the different methods that are used to measure reliability
While reading the Chapters 5 and 6 in the D&J text, I found myself understanding reliability and validity however; the terminology and equations that accompany these terms can be confusing. There are so many ways to explore reliability and validity! I found the video to be a great help. When Dr. Grande explained that an instrument can be reliable but not valid BUT in order to be valid it must be reliable... for some reason, it clicked.
I agree, I think the video really simplifies things. Sometimes books can be too detailed and it is easy to get lost in all of the information. This video is clear and simple and that is what helps.
I appreciate the overview of Reliability & Validity. The information makes sense, but requires repetition for my retention.
While I have a good understanding of reliability vs validity, it was helpful to learn about the different types of validity.
I thought it was interesting that with inter rater consistency that the raters should work independently so they don't know how the other rater rated. It was also interesting to know that in order for an instrument to be valid it has to be reliable but a instrument can be reliable without being valid
Although I had learned this information last semester, this was a greater refresher. I also find it interesting that in order for an instrument to be valid it must be reliable but it can be reliable without being valid.
I can tell we are back to the statistical measurement portion once we start talking reliability and validity. The example given for reliability was a great example of how a scale meant to measure weight can be off by 10 pounds but it is still reliable not a valid measurement but one that shows consistent reliability. I could easily relate to the example of face validity. If I am taking a test, questionnaire, or whatever and I do not think it is questions that pertain to what should be measurable I start to change my answers because I do not think the instrument has face validity.
This was a great video to outline these concepts and refresh my memory from research. They can seem like very simple concepts but they are so important when using assessments. Anyone can create an instrument to measure a concept but if we're going to use it with clients, we want to be able to ensure that it is reliable and valid.
I thought it was interesting too because the same instrument can be considered both valid and invalid, depending on the purpose it's being used.
I think it's important for us to understand these concepts well so we can make confident decisions whenever we have to use an instrument. It's not about which instrument we like better, it's about identifying which one is appropriate for the specific purpose.
As I watched this video, I too was able to recall some terms from research. This is an area that is quite important when using assessments and interpreting results but for me, I would really need to see it first hand to really grasp a clearer understanding.
I agree Kendall, these two ideas are deceptively simple. I think everyone uses them interchangeably at some point, when that really is incorrect.
I too believe this video is a great refresher for research concepts.
Kendall Wilson Definitely a good refresher of these concepts.
I can sometimes confuse these terms, so this video is a good reminder about the difference between the two concepts. It is important to remember that just because it is reliable doesn't mean it is valid. for some reason i have a harder time understanding the coefficient portion and needed to replay more than once to understand. Good refresher from research class. I truely struggle with statistical concepts and when to use them so while the video was helpful, i was still a bit confused.
I was more confused about the reliability cofefficient in the video.. I thought I understood it, or at least had some understanding of it, but this was confusing in the video.. The breakdown of construct validity was very helpful though. I was a little confused between the difference of convergent and discriminant validity. This wasn't defined as clearly in the text, but the video helped for these concepts.
I never considered the way face validity would affect a test taker's motivation and score. Very interesting!
Excellent video explaining the differences in reliability and validity. I understand the measurement concept a tad better but I still need to revisit calculations! I wish there was a tool to drill this information in my head!!!
Agreed Eva.I understand the concepts and the differences between the two terms. However, all of the formulas are a bit confusing. I think once we start using real world data with the formulas given, more of these concepts will make sense to us.
I feel like I really grasped the difference between the two and how they apply to assessments. I read the chapters in D&J and then watched the videos which helped really explain the info.
As other classmates have noted, reliability and validity, while easy to understand, they are also a necessary component when conducting and understanding research. Although these two terms are simple enough to understand, there are so many complex parts to them, and if researchers are not fully knowledgeable about those parts, could cause problems with the research.
this video is a great reminder and refresher on the difference between reliability and validity. The two terms tend to blend together for me at times which can be confusing.
+Melissa Clendaniel This was a simple break down of the two terms again. The examples give were easy to follow. When it comes to construct validity which seems to be the most important type since it can not be directly observed it makes things a little more difficult for me to understand. I get the big picture, but it is hard to grasp because the measure is of a hypothetical construct.
+Bethany Elstrom The examples were easy to follow but not so easy to completely grasp. Each time I learn and relearn about reliability and validity more sinks in. Something must be reliable before it can valid but it does not have to be valid in order to be reliable.
A good refresher for me with this video. Reliability and validity are often confused but this video helped me to re-establish the difference between the two.
The coefficient and stat portion is what makes me nervous. Even though the video did help somewhat, I am still not confident in my knowledge of this. Hopefully the book will help clear it up more for me.
Overall, useful video.
I agree, the stat portion of these concepts do make me nervous as well. The topics were touched on but not really talked about in depth. I think the book will help with that a little as well.
Yes, it was a good refresher on the terms. Appraisal class is like an advanced form of research class, but with more complex pieces, and application of those research terminologies. I am confuse about a whole of things with this video, because there are so many parts of reliability and validity, and each plays various roles, and some work better with measuring specific assessments, and do not work well with other assessments.
A Od Yes, it seems simple when the terms are explained. But when we talk about collecting evidence of validity and estimating reliability, things get more complex. So far, these two chapters were the easiest ones to follow.
I think that I learned a lot in this video. I did not know that there were so many other kinds of validity. I also never thought of the a instrument having to be relaiable to be vaild. I thought that was a good point to remember. It also makes a lot of sense that it doesnt work the other way around. An instrument can be reliable without being vaild.
+Mandy Moore When I read the chapters for this week, this video coincides very well with it. Reliability and validity are very important, and it is very important to know and to understand the differences between the two.
+Mandy Moore I though the same thing! It was good to be reminded that reliability has to come before validity.
+Mandy Moore I'm with you! I didn't recall there being so many kinds of validity. I appreciated the difference between content and criterion validity.
"Reliability-- Does the measure provide stable dependable results?" In addition, validity refers to if an assessment is sound or meaningful. These are both crucial for assessment and are used for clinical purposes about our client.
I thought. Dr. Grande made the distincition between reliablity and validity very clear. I also thought that it was a good refresher from research class. The scale example was really great!
It was a nice little reminder of the difference between a measure or scale's reliability and validity. Reliability is to consistency as validity is to accuracy. True score in addition to measurement error yields the observed score for a given measure and scale as well. Just as we cannot know the exact true score for a measure, we also estimate the reliability coefficient. Seems a little confusing, so I am hoping the text can clear up some of these statistical measures.
Your comment is a great summary of these two concepts and actually helped me differentiate between reliability and validity.
I used this video in combination with the chapters in the D&J textbook. I use to get them mixed up all the time. But I feel I have finally grasped the difference. Reliability is in reference to the test scores and validity is in reference to the test itself.
Angely, I also find using the book, videos, etc in combination help reinforce these concepts.
This is very educative as it clearly breaks down the two concepts.
This video was a great refresher of reliability and validity. With reliability, does the measure provide stable, dependable and consistent results and with validity does the test measure what it is supposed to be measuring.
+Regina Ames Exactly! I just noticed that your response was pretty much the same as mine for this video! But yes reliability and validity do hold such truths!
+Regina Ames I agree, this was a great refresher as it has been awhile since we have discussed reliability and validity. Your breakdown of the video information did help me to better understand the difference among the two terms.
Thank youuuuuu❤❤❤❤
It is always interesting to me that an instrument can be reliable but not valid, yet it does not work the other way around. It cannot be valid if it is not also reliable. It makes sense that the measure has to be stable and consistent before you can even consider if it is measuring accurately.
+Alicia Zahn Yeah, I agree with you. I hadn't really thought about it like that either. But it definitely makes a lot of sense.
The terms reliability and validity themselves are easy to understand.
With reliability, to find the coefficients was a bit confusing. A couple of the formulas, I remember from my first stats class. Putting the numbers in the formulas are easy, I just don't know when to use what formula... this is so much! I truly hope I don't have to work with stats in my career as much as this class insinuates... lol
The interpretation of the coefficients is simple too, I thought, such as .95 or . or .80 meaning that 95% and 80% respectively indicates that only 5% of variation in tests scores (in the first case) and 20% (in the second case) is attributed to error. Did I get that right?
Some of the methods used to estimate reliability are easy, others are a bit more challenging, but I think Dr. Grande did a good job explaining them and their characteristics. The book also explained them pretty well, I thought.
The formulas are not that hard to interpret. I just need to know which ones to use at each situation... that's the challenge for me.
Validity is easier to understand overall. My favorite chapter so far! lol No formulas and no numbers! Just the way I like it! :) The different types of validity: face, content, criterion, predictive, construct, and convergent and discriminant are simple to understand.
Dani, I too find the coefficent and stat part of this confusing. I am not a fan of the stats! Hopefully over time this will come easier for us.
I agree with both of you. I think that we will be seeing more of this, so hopefully it will seem less confusing to us as time goes on. I think this is something that I will need to hear again and again.
Yes, girls... I am hoping that one day, miraculously, I will understand this better too...
Right there with you on the dislike of stats... No matter how many times i learn these constructs, i feel like they go in one ear and out the other and don't fully sink in. Its almost like another language. I understand why its important, such as choosing which assessment to use and understanding the research on various measures... but its still frustrating to understand
I always though the test-retest method was very reliable. However, I realize that it has times when it's not appropriate.
I had the same thought, Sherrie. This goes back to the 'reliable but not valid' vs. 'valid and reliable' concept.
I didn't get the reliability coefficient part. Everything else was easy to understand.
Reliability and validity are so relevent for counselors when one conducts testing and interpreting results. This is an area that I am not confident but with practice and some one on one training, it can be mastered.
Laura, this was the first time reliability and validity was explained in this matter; it was easy to follow and understand. The big take away that I got which is very important is reliability has to come first before it can be valid.