Webinar - Scale Development and Validation: A thorough guide on how to develop and validate a scale

The session focused on Scale Development and Validation. The session focused on
Key Steps in Scale Development
Exploratory Factor Analysis
Confirmatory Factor Analysis
Scale Reliability
Construct Validity
#ScaleDevelopment #EFA #ExploratoryFactorAnalysis #ConfirmatoryFactorAnalysis #Reliability #Validity #ConstructValidity

[@ASMM1981EGY]

You can't imagine the scale of help you've provided to me Dr. All love, respect and regards from Egypt to you 🇵🇰🇪🇬🙏

[@researchwithfawad]

I am very happy to know that the video was helpful.

[@sachiko8266]

VERY useful and informative. Thank you very much!

[@researchwithfawad]

Thanks for your interest. I am glad you liked it.

[@surbhiverma7074]

Thank you so much, sir. Your video has cleared almost all my doubts. God bless you.

[@researchwithfawad]

Thanks. I am glad you liked it.

[@anamariabarcelos7024]

Hello Dr Latif. I loved your presentation, it is very clear and helped me understand scale validation. Thank you very much!

[@researchwithfawad]

Thanks Ana. I am glad that it helped. Do circulate the channel in your research circle. Someone may benefit.

[@missdolphincooking6128]

Thank you.. this video and concept means alot to me.. thank you alot

[@researchwithfawad]

Most welcome 😊

[@abdulahadroshansaeedabdula841]

Sir, you have made my day...Excellent explanation! very easy and understandable. May Allah Pak Bless you sir!

[@abdulahadroshansaeedabdula841]

How to contact you sir for any guidance related to thesis and research work? Is it possible?

[@researchwithfawad]

Thanks A. Ahad. I am glad it was helpful.

[@researchwithfawad]

You can email me on [e-mail]

[@abdulahadroshansaeedabdula841]

@@researchwithfawad Thanks a lot! I will send you email Inshallah

[@abhay7791]

Thats really very easy way to explain

[@researchwithfawad]

Thanks. I am glad you liked it.

[@debopriyakar7780]

Thank you so much Dr.

[@researchwithfawad]

Pleasure. I am glad you liked it.

[@Nafeesa_Fiaz]

Its just amazing.....

[@researchwithfawad]

Thanks. I am glad you liked it.

[@johrinecronje7120]

Fantastic - thank you!!

[@researchwithfawad]

Thanks. I am glad you liked it

[@anushavelamuri9372]

Wonderful

[@researchwithfawad]

Thank you. I am glad you liked it.

[@rajatrana91]

Hi Fawad ! Can you please provide the AVE Calculator and other calculators that you used for the analysis? Thanks in advance :)

[@researchwithfawad]

Thanks for your interest. Please visit researchwithfawad.com for download. File is available in downloads section.

[@brentward1831]

Excellent! You illuminated a lot of areas, and did it without miring us in formulae and in a relatively short amount of time. Nice job. Now I have a question, some psychometrists correlate their scale after EFA with known correlates of the main construct and then remove items that don't correlate sufficiently with known correlates. For example, Boredom Proneness correlates with Aggression. Boredom Proneness Scale items that don't correlate well with Aggression are removed. What kind of validity would this be called? Concurrent validity?

[@researchwithfawad]

Thanks. I am glad you like the video. For for concurrent validity, the measure is correlated with the well established assessment/measure. Here in your example Boredom and Aggression are different concepts. This can be referred to as nomological validity, the is focused on testing the relationship or predicting a construct of interest.

[@brentward1831]

Thank you very much! I assume you mean the concurrent validity is associating the scale with another, established scale that measures the same construct -- right? Nomological validity means testing the scale to see if it associates with constructs that are known to associate with the construct you are testing. Correct?

[@researchwithfawad]

Yes, please.

[@jamesrobert8321]

Thank you so much for your comprehensive video. I just have a query in EFA. What if some items are loading negatively in the rotated component method?

[@researchwithfawad]

Please. This is because the item is negatively related to the factor.

[@emaannoor5629]

Thank you so much sir

[@researchwithfawad]

Most welcome.

[@MsKeljon]

Thank you for your such a comprehensive video. I was wondering how must we treat multiple missing scores?

[@researchwithfawad]

Thanks. I am glad you liked it. For missing data watch kzbin.info/www/bejne/movHepx7qMx7jac

[@jekaterinaschneider1328]

Thank you for this presentation. I was wondering how you can determine the order of the items within the scale. Is it better to group them based on subscales or present them randomly? Does item order need to be fixed before analyses? And, once the scale is validated, can item order be changed (e.g., if items were randomised during data collection). Thank you!

[@researchwithfawad]

Hi. Thanks for watching the video. I normally keep items of a single scale together. I do not randomize the items. Although, randomization may help.

[@brentward1831]

Can you provide the spreadsheet you used to calculate composite reliability and AVE?

[@researchwithfawad]

Thanks for your interest. You can download them here researchwithfawad.com/index.php/download-research-resources/

[@mirzaiqa3051]

Thank you so much for such a wonderful presentation. Could you please share link of our publication.

[@researchwithfawad]

Please email me on [e-mail]. I will share the paper

[@rogerturingan6141]

great video sir... Thank u so much... May i ask if u have a video that uses rasch analysis in scale validation?

[@researchwithfawad]

Not yet. I will work on that and will upload a video soon.

[@rogerturingan6141]

@@researchwithfawad thank you sir... It will be a very big help for us..

[@priyadarshinilaishram4206]

Thank you for replying to my query earlier that I can add statements to already tested scales of previous researchers but then recommend validating it for content and face validity, and running EFA on the scale. Sir, can you please elaborate on how to go about or share videos/resources . Will be immensely helpful !

[@researchwithfawad]

Hi. For EFA watch this kzbin.info/www/bejne/q6TXaotmeLB-is0 Reason i am suggesting efa is because you are incorporating new items and this may change the factor structure. For face Validity get your scale reviewed by a senior prof or any ogher subject expert who has researched in the area

[@laxmanpokhrel5153]

Thanks for the wonderful video on scale development. I have read your papers as well. If possible, could you prepare video on before run EFA because there are so many variations of techniques such as interview, FGD and herarchical clustering.

[@researchwithfawad]

Great suggestion! I will work on it. I guess i can make a video on Steps before running EFA in Scale Development.

[@laxmanpokhrel5153]

@@researchwithfawad Indeed that would be awesome!

[@sastrawansastrawan5702]

Dear Dr. Latif, Thanks for your very clear presentation. Just wondering whats the name of the software you used in this demonstration?. Would you please share the link to your publication you used in the presentation? thank you very much

[@researchwithfawad]

Thanks for the interest. The software is Jamovi. It is free to use. Drop an email on [e-mail]. I will send the paper. Thanks

[@yasinyalcin1705]

Thank you for the presentation, Dr. Latif. It has been extremely helpful. I was wondering if we are supposed to conduct CFA on a different dataset than the one used for EFA? In your example, I believe you used the same dataset if I did not miss any point. Also, what is the difference between Principal Component Analysis and Principal Axis Factoring? Are there specific situations where we are supposed to use a specific one? Thank you.

[@researchwithfawad]

Thanks. I am glad you liked it. For CFA, although preferred is to have a new dataset. However, researchers have used the same dataset. I too have used the same in most of my studies. As for PCA and PAF, both are dimension reduction techniques, one is focused on Whether the items reflect or cause the factor. Read more. stats.stackexchange.com/questions/280746/what-is-the-difference-between-pca-and-paf-method-in-factor-analysis

[@markmuga19]

Hi Dr. Can you share a link to the paper you were referring to for efa and cfa

[@researchwithfawad]

Please can you mention the title from the video.

[@hspanaych]

Sir if we take different constructs from different authors and also in some constructs combine two or more authors and make a scale can we use Efa in this regard ?

[@researchwithfawad]

Yes, better to use EFA

[@mizhou3120]

Thank you for the great presentation. I am conducting a scale validation study using Jamovi inspired by your presentation. For Exploratory Factor Analysis, the results were better if I run PCA than ran EFA in Jamovi. However, one of my coauthors pointed out that we should not use PCA for EFA since they are different. Could you please provide a valid justification for why we can use PCA for EFA? Also, the variance explained by my data is only 54% after selecting the appropriate number of factors, is this okay since most references mentioned that this value should be at least 60%? Thank you so much.

[@researchwithfawad]

Thanks. I am glad you liked it. if through scale development, your focus is on reducing the number of variables while retaining the most amount of information in the data, PCA is useful.

[@mizhou3120]

Thank you very much.

[@talhamansoor7108]

Great Sir very well explained... Would you provide me ppt of this Webinar if possible please?

[@researchwithfawad]

Let me search, will email if i find it, i hope it was not deleted during that virus attack

[@m.hashirhussain179]

Thanks sir.I need this lecture in PDF form

[@researchwithfawad]

Please visit the link to download researchwithfawad.com/index.php/understanding-the-scale-development-process/

[@Nanjers]

dear brother really impressive information. As i am developing a construct for my variable. i need your assistance. will you please help me？

[@researchwithfawad]

Thanks for watching. How can I help you?

[@ruqiarasoolbaba2337]

Sir, can we use a multidimensional scale into a unidimensional to avoid the model complexities ?

[@researchwithfawad]

Yes but is there a theoretical justification or analytical one

[@ruqiarasoolbaba2337]

@@researchwithfawad Analytical one. When I tried to see the impact of this variable treating it as multi-dimensional then all of the results were insignificant but when I treated it as unidimensional, the results were quite significant.

[@skwasafulquader3151]

What a wonderful video sir. Thank you so much. Love and respect from India. Sir, I have one request. Can you please provide this data to practice? and also the research papers you showed here?

[@researchwithfawad]

Thanks for watching. Sample data is available on researchwithfawad.com

[@skwasafulquader3151]

@@researchwithfawad Thank you so much sir.

[@makathleenadona9957]

Warmest greetings, Sir! Thank you for this great help. Sir, should I still go for EFA even if I already modified the adapted instruments from the existing study?

[@researchwithfawad]

Pleasure. I am glad you liked it l. No you don't have to perform EFA for an established scale that is already validated.

[@makathleenadona9957]

@@researchwithfawad Even if I added some items to it? Then, I should proceed to CFA already? Thank you for your quick response.

[@researchwithfawad]

How did you add the items. Did you combine two scales into one. Even then, no need to do EFA

[@makathleenadona9957]

@@researchwithfawad I just added items. Is it okay to send my initial factor analysis for you to have a closer look? Actually, after I have finished your video, I also tested each dimension separately to get a better result.

[@hspanaych]

Greetings sir If we take different statements from different studies and form a scale then it will be adapted scale? Can we apply efa in this regard.

[@researchwithfawad]

Yes it is an adapted scale. Better to check it with EFA

[@priyadarshiniandabraham7847]

Thank you sir! Sir, can I adapt the scale of previous researchers, say done in the logistics industry to use in other service sector industry? Can i add more relevant items and what should be the next process to make it relevant?

[@researchwithfawad]

Yes you can add statements but then i recommend validating it for content and face validity, and running EFA on the scale.

[@priyadarshinilaishram4206]

@@researchwithfawad Thank you so much sir for the help and prompt reply ! I really liked your presentation, clarity and explanation ! Sir, may I contact you for any guidance ?

[@cookingtales4415]

Assalam o Alikum sir hope for your good health.. I wanted to ask.. Removing items during factor loading means discarding them from scale???

[@researchwithfawad]

WAS. Yes, you have to remove them from further analysis and the final scale.

[@amanbahri8527]

WHICH QUESTIONNAIRE TO BE ADDED IN THESIS WITH FULL LIST OF QUESTIONS OR FINAL LIST OF QUESTIONS AFTER EXPERT VIEW

[@researchwithfawad]

The final questionnaire used to collect the data.

[@amanbahri8527]

@@researchwithfawad HOW THE ITEMS ARE REDUCED BY WHICH TEST AND WHAT IS VALUE BELOW WHICH ITEMS ARE DELETED . CAN I CALL U .PLEASE HELP ME SIR .

[@researchwithfawad]

Please watch this kzbin.info/www/bejne/q6TXaotmeLB-is0

[@mailtosadhana]

Sir ! Do you have good references for scale development research papers? Easy to comprehend for a beginner.

[@researchwithfawad]

Thanks for your comment. This paper may be helpful Title: Measuring corporate social responsibility: A critical review of survey instruments Scale development i a complex process, reading more and more will help. Try to read papers on scale development.

[@obaidullahniaz5128]

After principal component analysis, the component loading matrix show items from different construct coming in a single factor and the number of factors are more than constructs. The items you have generated for each construct very well come under a single factor. Can you please suggest a remedial action for this as well?

[@researchwithfawad]

If items are not loading onto their respective factor, those items shall be removed one by one, or if the items are not loading acceptable loading they shall be removed too. But if you are using an already validated scale, do not go for EFA, go for CFA

[@obaidullahniaz5128]

@@researchwithfawad I'm not using an already validated scale so I've to for EFA. Does the sample size has an affect on this? Because this was observed during pilot test.

[@pablochandra4727]

Can i get the article to study

[@researchwithfawad]

Please mail me on [e-mail]. I will share the article.

[@navneetjain622]

Sir, does development of any scale , test or inventory depends on the variable that we choose .if i want to make any one of three(test/scale/inventory) then it will depend on variable or my choice ?🤔

[@researchwithfawad]

Can you please clarify your question, please

[@navneetjain622]

@@researchwithfawad suppose i choose a variable. How do I know whether this variable will scale or test or inventory? . Beacuse test ,scale and inventory are different from one to another. Or Can we make all (i.e.test / scale/ inventory ) on a variable?

[@researchwithfawad]

You can possibly look at the original source and see if the development was for a scale or something else

[@anithats7599]

For doing first pilot study of rating scale how many samples we should take

[@researchwithfawad]

For pilot a sample of 50 is good enough. But dont put it through EFA, just check it for reliability.

[@ammukanmani]

should we first do validity or reliability? everyone has different opinion. some say reliability should be first , while others say validity comes first. Since from social science background, different opinion confuses me. please clarify the order of analysis sir. Is there any reference for order of analysis?

[@researchwithfawad]

Factor Loadings, Reliability, and then Validity.

[@ammukanmani]

@@researchwithfawad thank you so much sir.

[@pasarlai1419]

Sir could you make a video about scale modification from A -z

[@researchwithfawad]

Thanks for the suggestion. Hopefully soon.

[@talzabidi1569]

Thanks Dr How can I make the key score that help me to measure the level of X construct such( high , moderate, low level) among group of students?

[@researchwithfawad]

You can yake mean ans then take percentiles or define what you can refer to high, and low, while moderate could be your mean.

[@talzabidi1569]

@@researchwithfawad Could you please provide any support or reference?

[@rogerturingan6141]

Gud day sir! I watched ur video a lot of times.. it is very helpful sir to my study.. i am just curious sir if I still need to validate the questions for my Focus Group Discussion in the developmental phase of my study.?.

[@researchwithfawad]

Hi. Thanks. If you are developing a questionnaire that is based on interviews/focus group and literature, the questionnaire shall be validated.. Even if you are using an already developed scale, Reliability and Validity must be tested.

[@rogerturingan6141]

@@researchwithfawad ok sir... Thanks.. what i mean sir are the questions for focus group discussions/interviews that will be asked to potential respondents and will be used to generate the items. .i still need to validate those?

[@sadhanamishra5814]

Hello Sir, can you make one video on the difference between scale, variable, and construct, and in case it is already there can you please share the link. Thanks once again

[@researchwithfawad]

Hopefully soon.

[@biplabdey3154]

pls share the link of this paper, pls

[@researchwithfawad]

Please email the title on [e-mail]

[@obaidullahniaz5128]

How to remedy low KMO value? During a pilot test of my questionnaire, I observed the KMO value is 0.28 which is below the threshold value 0.5.

[@researchwithfawad]

KMO is a measure of Sampling adequacy, your sample is low. We do not normally use EFA in Pilot. If you are using previously validated scales you do not need to conduct EFA.

[@obaidullahniaz5128]

@@researchwithfawad Thank you , Do you have a video of testing hypothesis? For instance, testing the hypothesis that psychological factors are a significant dimension of consumer behaviour? or something similar which studies causal effect?

[@docmarYTC]

Sir I like your presentation If you can read my comments please help me on my Dissertation..

[@researchwithfawad]

If you have any questions, you can email me on [e-mail]

[@isstudents7923]

What’s ur email?

[@researchwithfawad]

[e-mail]