featured, Notebook

25th Anniversary Editorial bonus material (methods and data)

One of the sections of the 25th Anniversary Editorial of the International Journal of Social Research Methodology (IJSRM), presents the thematic trends in published contributions, for the whole period of 25 years of the journal’s life. Investigating the thematic trends in published contributions was not an easy task, not only because of the huge number of published papers, but also because of various technical details (for example, the published papers were not accompanied by keywords in the first volumes). 

Coding and charting the thematic trends of published papers proved to be a very laborious task and the workload was shared between four researchers. The aim of this document is to help interested readers understand the nature and the structure of the dataset. This could be useful to those interested in extending our own analysis, which had to be confined in the limited space of an Editorial.  

Methodology 

It is important for prospective users of the dataset to understand how the published content was coded and how reliable the coding was. 

Three coders worked in parallel for three weeks, under the supervision of an experienced researcher. They coded each of the contributions published by IJSRM, not only in the first 25 issues, but also in the ‘latest papers’ section of the journal’s web page, which includes papers which have not yet been assigned to specific volumes/issues.  

The three coders and the experienced researcher, developed a coding scheme, which included all the necessary variables to be coded in an Excel file. Through long online meeting, the group discussed the aims of the coding exercise, the structure and content of the coding scheme etc. The group coded a number of common papers to confirm that they interpreted the coding scheme in the same way. Regular online meetings and email exchanges were necessary to discuss various issues which emerged and to keep the coders in sync. To make sure that the coders did not ‘drift’ over time, they were instructed to ‘blindly’ re-code 5%-10% of each other’s excel file incrementally (every few days). The coders were in communication all the time and they exchanged emails where they would update each other about coding difficulties in order to remain in sync. As a result of this procedure, various issues came to the surface (e.g. there were many papers which could not be easily categorized as Qualitative, Quantitative or Mixed, so a new category was created; more information later). 

When all the coding was completed, the experienced researcher re-coded blindly 50 random papers – around 5% of the total number of papers in the database – but no major discrepancies were detected (for example, in one case, the number of views was miskeyed as ‘867’ instead of ‘861’) .  

Overall, there is no reason to believe that there is widespread bias or errors in the data. We expect the dataset to give a fair interpretation of what has been published in the journal in the last 25 years of its life. 

Variables in dataset 

The dataset includes the following variables: 

Vol Volume 
No Issue number 
Title The title of the paper (no coding, it was just copied and pasted) 
Abstract The abstract of the paper (no coding, it was just copied and pasted) 
Keywords The keywords of the paper (no coding, it was just copied and pasted) 
Paradigm Main research paradigm. Takes four values: Qualitative, Quantitative, Mixed Methods, General/Other.  Note: The General/Other category refers to papers which cannot be described accurately by the three other codes (Qualitative, Quantitative, Mixed Methods) 
Views Number of views (as reported on the journal’s web page) 
CrossRef Number of CrossRef citations (as reported on the journal’s web page) 
Altmetric Altmetric count (as reported on the journal’s web page) 

Data filtering 

The original dataset consisted of 1043 records, but book reviews, editorials and other small items were removed, resulting to a ‘clean’ dataset of 924 published papers (including ‘Research Notes’). 

Dataset format 

The dataset is provided as an R data frame, with the name EditorialData.Rda

You can download the data files here.

featured, Notebook

A virtual collection to celebrate 25 volumes of IJSRM 

The International Journal of Social Research Methodology is celebrating its 25th anniversary!!  In that period, we have become a leading methods journal publishing high quality contributions across the methodological field – both qualitative and quantitative, and including mixed, multi-media, comparative and simulation methods. 

To mark the occasion, we have gathered together a series of methods discussions that have been published in the journal, and our publisher, Routledge, is making them freely available as a collection.  

Choosing which articles to include in our anniversary virtual collection was a hard task.  We inevitably had to leave some important and favourite pieces aside.  The collection below includes contributions that we felt represented the range of methodological articles that we publish in IJSRM, a selection of early career prize winning articles, influential pieces and discussions that deserve more attention for their contributions, and individual editors’ personal choices.  

The methodological reach of our anniversary, then, ranges across survey non-response, behavioural experiments, quantitative pedagogy, the Delphi method, the problem-centred expert interview, the self-interview, narrative and computerised text analysis, qualitative methods transformations, anonymisation, triangulation of perspectives, indigenous data sovereignty, post-humanism, and researcher safety. 

We hope that you enjoy our selection. You can access it at:  

https://www.tandfonline.com/journals/tsrm20/collections/TSRM_25th_Anniversary_SI

Rosalind Edwards, Jason Lamprianou, Jane Pulkingham, Malcolm Williams 

IJSRM Co-Editors 

featured, Notebook

Seeking alternatives: A reflection on conducting online interviews with disabled young people during the COVID-19 pandemic

Angharad Butler-Rees and Stella Chatzitheochari

While scholars have increasingly documented and reflected on their approaches to conducting research during the pandemic, little is still known about the impact of social distancing measures on qualitative research with disabled young people.

Our new paper provides a methodological reflection on undertaking qualitative research with disabled young people as part of the Educational Pathways and Work Outcomes longitudinal study. Our study started in March 2021 during the third national lockdown in England. Due to social distancing measures in place at the time of commencing, it was necessary to revise our original plans to conduct face-to-face interviews with disabled young people and conduct online interviews instead. We conducted a total of 35 online interviews with autistic, dyslexic, and physically disabled young people aged 15-16 years old.

Ensuring Accessibility

The internet has long been deemed as a potentially empowering platform for disabled people, connecting isolated individuals and ensuring access to social, civic and community life. Our focus on young people was particularly useful, as this population tends to be very comfortable with the use of technology. The extensive periods of enforced home-learning during the covid-19 pandemic had further increased young people’s familiarity with online communication platforms, rendering the idea of online interviews a far less daunting prospect. However, it is worth noting that online tools can also present a number of accessibility barriers e.g., poor text layout, little colour contrast and limited keyboard functionality. These were important factors to consider when designing online interviews for our project.

Accessibility has to be incorporated into every part of the research process when working with disabled people. To put participants at ease prior to their interview, we sent them participant information packs as well as a short video of the interviewer introducing themselves and the study. Familiarity with the researcher was greatly valued for autistic young people, making them feel more at ease. Previous literature has suggested that autistic young people may be disconcerted or unresponsive in encounters with strangers, so building a degree of initial trust and rapport was of upmost importance for successful interviewing. In line with this, we also arranged online pre-interview meetings with participants and their parents to build rapport.

Pre-interview meetings also helped us ensure that any accessibility requirements were put into place. We asked participants to choose their preferred communication platform. Several participants opted to use assistive software during their interview e.g., enabling captioning, magnification or modifying volume. Other adjustments included allowing participants to sit off screen or to keep their cameras off while the interviewer remained visible. This made interview far less intrusive and anxiety provoking and was greatly valued by autistic participants. Other adjustments included the presence of a guardian that could provide practical assistance or emotional support, simplification of interview questions, as well as collection of data over several interviews as opposed to one. Overall, we felt that these adjustments made interviews considerably more accessible for disabled young people, ultimately giving voice to a population who may not always be amenable to conventional face-to-face interviewing methods that can be experienced as more restricting and demanding.  

Challenges during Interviewing

While some young people were very comfortable in engaging with the interview process and narrating their lived experiences, others were far more hesitant, requiring regular prompting and reassurance. The online medium made this slightly more challenging for the interviewer, with prompting and encouragement occasionally leading to cross-talking. It was also notably more difficult to interpret emotion and body language online, while the loss of internet connection at times affected the flow of the interview.

Another challenge was the difficulty in maintaining participants’ attention. We sometimes felt that the lack of physical presence meant that participants were far easier distracted by being in their homes, e.g., checking their mobiles, playing with family pet. However, we also recognise that this may be interpreted in a different manner: Indeed, it may be indicative of a greater share of power afforded to disabled young people in online settings. Overall, we did not feel that such distractions affected the quality of our data collection and think that the physical distance may have aided disclosure of personal experiences. A feedback survey confirmed that participants enjoyed the use of the online medium, with the vast majority requesting online interviews for the future waves of data collection.

A final note on accessibility

Our reflections may not speak to studies seeking to interview disabled young people with different accessibility needs such as speech or communication difficulties (e.g., stammering). These participants may find online communication more difficult due to possible misunderstanding and difficulties in lip reading and interpretation. Similarly, it is worth noting that interviews can be experienced as particularly exhausting by some disabled young people, whether face to face or online, preventing them from taking part. Researchers may consider offering alternatives such as email interviews alongside conventional online interviews.

Looking ahead

Our overall experience with online interviews was very positive. We were privileged to be able to access disabled young people’s lived experiences during an unprecedented period of global disruption. Notwithstanding the challenges mentioned above, we feel that online interviewing is a valuable tool that should not be viewed as second best to face-to-face conversational methods. We therefore encourage researchers to explore the use of online methods, especially with regards to young and disabled populations.

Read the full article here: Giving a Socially Distanced Voice to Disabled Young People: Insights from the Educational Pathways and Work Outcomes Longitudinal Study

Announcements, featured

The winners of our ECR paper competition for 2020-21

We are pleased to announce the results of our 2020-21 IJSRM competition for papers written by early career researchers (ECRs) who, at the time of submission, were either doctoral students or in their first three years of post-doctoral employment. Our aim has been to encourage and recognise research and contributions from new scholars in current and emerging methodological debates and practice.

All entries were subject to the Journal’s usual refereeing processes and had to reach our normal publishing standard. The winners were selected by a sub-panel of members of the IJSRM Editorial Board and the Journal Editors. The panel were impressed with the very strong field of entries, and we are pleased to announce not only a winner of the ‘Best ECR Article’ but also three ‘highly commended’ runners up.

Our IJSRM Early Career Researcher Prize is awarded to Stefanie Döringer (Austrian Academy of Sciences and University of Vienna) for her article on ‘The problem-centred expert interview: Combining qualitative interviewing approaches for investigating implicit expert knowledge’. The panel of judges remarked on a ‘clearly written and illuminating account’, representing ‘a lightbulb moment that brings two previously disconnected traditions together’, and that will be ‘highly valuable as a reference for many researchers for years to come’. Stephanie’s article has already been viewed over 16,500 times.

Stephanie said, ‘It is a great honor for me that my paper is awarded with the IJSRM Early Career Researchers’ prize. The appreciative comments from the competition judges encourage me to follow my research interest further and to deepen my work with qualitative methods in social research’.

Our highly commended runners (in alphabetical order) are: Riccardo Ladini (University of Milan): ‘Assessing general attentiveness to online panel surveys: The use of instructional manipulation checks’ Órla Meadhbh Murray (Imperial College London): ‘Text, Process, Discourse: Doing Feminist Text Analysis in Institutional Ethnography’ Kate Summers (London School of Economic and Political Science): ‘For the greater good? Ethical reflections on interviewing the ‘rich’ and ‘poor’ in qualitative research

Many congratulations to Stephanie, and also to Kate, Órla and Riccardo.

featured, Notebook

Using objects to help facilitate qualitative interviews

by Signe Ravn

Doing empirical research on imagined futures is a methodological challenge. As scholars have argued, generating rich insights into how such futures might look can be difficult as participants may produce somewhat generic or stereotypical accounts of what the future might hold or even refuse to engage in such tasks (which of course provides other insights). Over the past decade, these challenges have led many qualitative researchers to explore different forms of creative, arts-based and/or participatory methods to approach the topic in new ways. In some cases, these approaches have been productive, and in other cases they lead to new questions about how to then interpret the findings. And sometimes they don’t really generate more concrete insights after all.

In my longitudinal research on the everyday lives and imagined futures of young women with interrupted formal schooling, I also used various creative methods to break away from the traditional interview format and to seek to approach the ways in which participants imagined their futures from multiple different perspectives. This approach was inspired by Jennifer Mason’s work on facet methodology. In my recent paper for the International Journal of Social Research Methodology I explore one creative method that proved particularly fruitful, that is, an object-based method. In brief, this method was deployed in the third interview with my participants (after one year) and involved asking participants to bring ‘one thing (like a gift, some clothing, a thing you once bought, or something else) that reminds you of your past and a thing that you relate to your future’. Only one participant asked for a clarification of what these items could be, while the remainder were happy to do this task, and some even said right away that they knew exactly what to bring. On the day of the interview, some participants did say that deciding on a ‘future’ thing had been difficult, but nevertheless they all had chosen something. Towards the end of the interview I asked about their ‘things’ and we spoke about each object in turn, exploring why they had brought a particular object, how it related to their past/future, and whether and how this was something they used in their day-to-day lives.

Reflecting on the interviews I was wondering what made this particular exercise helpful for exploring and speaking about ‘futures’. Other scholars have successfully drawn on objects to study memories, but none have turned their attention to the potential of objects for studying futures. In the paper I argue that what makes the object-method productive is to do with materiality. More specifically, I argue that what makes this method unique is the combination of ‘materiality as method’ as well as the ‘materiality of the method’, and that this double materiality at play is what is producing elaborate future narratives. In other words, via the materiality of the objects, specific imagined futures become ‘within reach’ for participants, with the object serving as an anchor for these future narratives. The method suggests a temporal complexity as well: the future objects come to represent futures that the participants have already taken steps towards; they are ‘futures-already-in-the-making. Drawing on Jose Esteban Munoz, we can consider them ‘futures in the present’, that is, futures that already exist, perhaps just in glimpses, in the present.

To make this argument I draw on both narrative research, material culture studies and qualitative research methodology. One key source of inspiration was Liz Moor and Emma Uprichard’s work on material approaches to empirical research, where the authors argue for paying greater attention to the ‘latent messages’ of methods and data, for instance in the form of sensory and emotional responses but also, as I point to in the paper, the messages conveyed by a dirty and bent P plate and a carefully crafted name tag.   Due to limitations of space, the published paper focuses on the ‘future’ objects and the future narratives generated through these, and only briefly mentions the ‘past’ object that participants also brought to the interview. This is due to the paper’s ambition to highlight the potentials of using object methods, and a focus on materiality more generally, in research on futures. However, for a full analysis of the insights gained through this method, both in terms of the settled and unsettled future narratives and the normative dimensions shaping which objects became ‘proper’ objects for the interview situation, both ‘past’ and ‘future’ objects should be analysed together.

Read the full article in the IJSRM here.