Skip to main contentSkip to search
Episciences
Open Access Journals
Sign in(new window)
Transformations logo
TransformationsA DARIAH Journal
Transformations logo
Transformations
Sign in(new window)
Articles & Issues
All articlesAll accepted articlesAll volumesLast volumeSectionsAuthors
About
The journalNews
Boards
Publish
For authorsEthical charterFor reviewersProposing special issues
Submit
Transformations logo
Journal's leaflet
|
Contact
|
Credits
eISSN 3095-3200
|
RSS
|
Atom
Episciences
Documentation
|
Acknowledgements
|
Publishing policy
Accessibility: non-compliant
|
Legal mentions
|
Privacy statement
|
Terms of use
  1. Home > Articles & Issues >
  2. Articles >
  3. finnsurveytext: Anal ...
Article

finnsurveytext: Analysis of Open-Ended Survey Responses in R

Adeline Clarke ORCID (1), Krista Lagus ORCID (1), Maria Valaste ORCID (2)
(1) University of Helsinki
(2) University of Helsinki (UH)
Download article
Open on Zenodo
Submitted on
November 15, 2024
Accepted on
April 9, 2025
Published on
June 23, 2025
Last modified on
September 25, 2025
Volume 1
Workflows
Textual data-based workflows
DOI
10.46298/transformations.14770
License
Attribution 4.0 International (CC BY 4.0)
Indicators
726
Views
316
Downloads

finnsurveytext: Analysis of Open-Ended Survey Responses in R

Adeline Clarke ORCID (1), Krista Lagus ORCID (1), Maria Valaste ORCID (2)
(1) University of Helsinki
(2) University of Helsinki (UH)
Abstract
English
The finnsurveytext R package has been created to facilitate the analysis of responses to open-ended survey questions and other structured text data. The package offers a user-friendly, open-source tool and workflow that supports reproducible analysis of text data, including summarisation of response properties, identification of frequent words and phrases, visualisation of responses and creation of a concept network plot. The second version of the package was released in August 2024. It includes integration with the popular survey package to allow survey design to be incorporated into the analysis. While the package was created for the analysis of responses written in Finnish, it can also be used to analyse text in other languages. The tool aims to make analysing open-ended questions accessible to social science and humanities scholars without strong programming skills or extensive knowledge of Natural Language Processing methodologies. The objective is to enable the rich data obtained from responses to open-ended questions to be harnessed so that it can be better understood within the context of numeric or categorical data analysis. 
Finnish
R-paketti finnsurveytext on kehitetty helpottamaan kyselytutkimusten avovastauksien ja muiden jäsenneltyjen tekstiaineistojen analysointia. Paketti tarjoaa käyttäjäystävällisen, avoimen lähdekoodin työkalun ja työnkulun, joka tukee tekstiaineiston toistettavissa olevaa analyysiä, mukaan lukien vastausten ominaisuuksien tiivistämistä, yleisten sanojen ja fraasien tunnistamista, vastausten visualisointia sekä käsiteverkoston luomista. Paketin toinen versio julkaistiin elokuussa 2024. Se sisältää yhteensopivuuden R-ohjelman suositun survey-paketin kanssa, mikä mahdollistaa surveyasetelman sisällyttämisen analyysiin. Vaikka paketti on luotu suomenkielisten vastausten analysointiin, sitä voidaan käyttää myös muiden kielten tekstien analysointiin. Työkalun tavoitteena on tehdä avoimien kysymysten analysointi yhteiskunta- ja humanististen tieteiden tutkijoiden mahdolliseksi ilman syvällisiä ohjelmointitaitoja tai laajoja tietoja luonnollisen kielen käsittelymenetelmistä (NLP). Tavoitteena on mahdollistaa avoimien kysymysten vastauksista saatavan monipuolisen datan hyödyntäminen siten, että sitä voidaan ymmärt
Keywords
  • concept network
  • open-ended questions
  • R
  • survey design
  • text analysis
  • käsiteverkko
  • avovastaukset
  • surveyasetelma
  • tekstianalyysi
Linked publications - datasets - software
  • Is based on
    https://cran.r-project.org/web/packages/finnsurveytext/index.html
  • Is based on
    https://github.com/DARIAH-FI-Survey-Concept-Network/finnsurveytext
Preview
Loading PDF preview...
References
  1. ATLAS.ti. 2022. ATLAS.ti Windows: User Man- ual. ATLAS.ti.https://atlasti.com/manuals-and-documents.

    DOI : 10.1055/s-0042-1759655
  2. Benoit, Kenneth, and Akitaka Matsuo. 2020. spacyr: Wrapper to the "spaCy" "NLP" Library. R package version 1.2.1. The CRAN Comprehensive R Archive Network. https://CRAN.R-project.org /package= spacyr.

    DOI : 10.32614/cran.package.spacyr
  3. Benoit, Kenneth, Kohei Watanabe, Haiyan Wang, Paul Nulty, Adam Obeng, Ste- fan Müller, and Akitaka Matsuo. 2018. "Quanteda: An R Package for the Quan- titative Analysis of Textual Data." Journal of Open Source Software 3 (30): 774. https://doi.org/10.21105/joss.00774.

    DOI : 10.21105/joss.00774
  4. Bird, Steven, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. O'Reilly Media, Inc.

  5. Brin, Sergey, and Lawrence Page. 1998. "The Anatomy of a Large-scale Hypertextual Web Search Engine." Computer Networks and ISDN Systems 30 (1): 107-117. https://doi.org/10 . 1016/S0169 -7552(98)00110-X.

    DOI : 10.1016/s0169-7552(98)00110-x
  6. Es, Karin van. 2023. "Unpacking Tool Criticism as Practice, in Practice." Digital Humanities Quarterly 17 (2). https://www.digitalhumanities.org/dhq/vol/17/2/ 000692/000692.html.

    DOI : 10.2307/jj.5973156.5
  7. Es, Karin van, Maranke Wieringa, and Mirko Tobias Schäfer. 2018. "Tool Criticism: From Digital Methods to Digital Method- ology." In WS.2 2018 Proceedings of the 2nd International Conference on Web Studies, 24-27. New York: Association for Computing Machinery. https://doi.org/ 10.1145/3240431.3240436.

    DOI : 10.1145/3240431.3240436
  8. Feuerriegel, Stefan, and Nicolas Proellochs. 2019. SentimentAnalysis: Dictionary- Based Sentiment Analysis. R package version 1.3-3. The CRAN Comprehensive R Archive Network. https://CRAN.R-project.org/package= SentimentAnalysis.

  9. Finnish Children and Youth Foundation. 2019. "Young People's Views on Development Cooperation 2012." Dataset. Version 2.0. http://urn.fi/urn:nbn:fi:fsd:T-FSD2821.

    DOI : 10.33339/fuf.114616
  10. Firoozeh, Nazanin, Adeline Nazarenko, Fabrice Alizon, and Béatrice Daille. 2020. "Keyword Extraction: Issues and Methods." Natural Language Engineering 26, no. 3 (May): 259-291. https://doi.org/10.1017/S1351324919000457.

    DOI : 10.1017/s1351324919000457
  11. He, Zhoushanyue, and Matthias Schonlau. 2021. "Coding Text Answers to Open-ended Questions: Human Coders and Statistical Learning Algorithms Make Similar Mistakes." Methods, data, analyses (mda) 15, no. 1 (January): 17. https://doi.org/10.12758/mda.2020.10.

    DOI : 10.12758/mda.2020.10
  12. Kanerva, Jenna, Filip Ginter, Niko Miekka, Akseli Leino, and Tapio Salakoski. 2018. "Turku Neural Parser Pipeline: An End-to-End System for the CoNLL 2018

    DOI : 10.18653/v1/k18-2013
  13. Shared Task." In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies (Brussels, Belgium, October), 133-142. Kerrville, TX: Association for Computational Linguistics. https://doi.org/10.18653/v1/K18-2013.

    DOI : 10.18653/v1/K18-2013
  14. Lagus, Krista, Minna Ruckenstein, Atte Juvonen, and Chang Rajani. 2018. "Medicine Radar-A Tool for Exploring Online Health Discussions." In Proceedings of the Digital Humanities in the Nordic Countries 3rd Conference (Helsinki, Finland, 7- 9 March), 460-468. CEUR-WS.org. http://ceur-ws.org/ol-2084/.

    DOI : 10.5617/dhnbpub.11061
  15. Lumley, Thomas. 2004. "Analysis of Complex Survey Samples." Journal of Statistical Software 9 (8): 1-19. https://doi.org/10.18637/jss.v009.i08.

    DOI : 10.18637/jss.v009.i08
  16. Luoma, Jouni, Miika Oinonen, Maria Pyykö- nen, Veronika Laippala, and Sampo Pyysalo. 2020. "A Broad-coverage Corpus for Finnish Named Entity Recognition." In Proceedings of the Twelfth Language Resources and Evaluation Conference, edited by Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, et al., 4615-4624.

  17. Marseille, France: European Language Resources Association. https://aclanthology.org/2020.lrec-1.567/.

    DOI : 10.26615/978-954-452-092-2_075
  18. Michalke, Meik. 2020. koRpus: An R Package for Text Analysis. Version 0.13-3. https://reaktanz.de/?c=hacking&s=koRpus.

  19. A. Clarke, K. Lagus, and M. Valaste Mihalcea, Rada, and Paul Tarau. 2004. "Tex-tRank: Bringing Order into Text." In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing (Barcelona, Spain, 25-26 July), edited by Dekang Lin and Dekai Wu, 404-411. Kerrville, TX: Association for Computational Linguistics. https://aclanthology.org/W04-3252.

  20. Nadim, Mohammad, David Akopian, and Adolfo Matamoros. 2023. "A Comparative Assessment of Unsupervised Keyword Extraction Tools." IEEE Access 11:144778-144798. https://doi.org/10.1109/ACCESS.2023.3344032.

    DOI : 10.1109/access.2023.3344032
  21. Neuert, Cornelia E., Katharina Meitinger, Dorothée Behr, and Matthias Schonlau. 2021. "Editorial: The Use of Open-ended Questions in Surveys." Methods, data, analyses (mda) 15 (1): 3-6. https://mda.gesis.org/index.php/mda/article/view/366.

    DOI : 10.1177/00491241211031271
  22. Pyysalo, Sampo, Jenna Kanerva, Anna Missilä, Veronika Laippala, and Filip Ginter. 2015. "Universal Dependencies for Finnish." In Proceedings of the 20th Nordic Conference of Computational Linguistics (NODALIDA 2015) (Vilnius, Lithuania, 11-13 May), edited by Beáta Megyesi, 163-172. Linköping: Linköping University Electronic Press. https://aclanthology.org/W15-1821.

    DOI : 10.3384/wcc5
  23. Roberts, Margaret E., Brandon M. Stewart, and Dustin Tingley. 2019. "stm: An R Package for Structural Topic Models." Journal of Statistical Software 91 (2): 1- 40. https://doi.org/10.18637/jss.v091.

    DOI : 10.18637/jss.v091.i02
  24. Schlicht, Helene. 2020. "Open Access, Open Data, Open Software? Proprietary Tools and Their Restrictions." In Digital Meth- ods in the Humanities: Challenges, Ideas, Perspectives, edited by Silke Schwandt, 25-58. Bielefeld: Bielefeld University Press. https://doi.org/10.1515/9783839454190-002.

    DOI : 10.1515/9783839454190-002
  25. Schonlau, Matthias. 2022. "Patient Joe (Open-ended Question)." GESIS, Cologne. Data File Version 1.0.0. https://doi.org/10.7802/2474.

    DOI : 10.7802/2474
  26. Selivanov, Dmitriy, Manuel Bickel, and Qing Wang. 2020. text2vec: Modern Text Mining Framework for R. R package version 0.6. The CRAN Comprehensive R Archive Network. https://CRAN.R-project.org/package=text2vec.

    DOI : 10.32614/cran.package.text2vec
  27. Silge, Julia, and David Robinson. 2016. "tidytext: Text Mining and Analysis Using Tidy Data Principles in R." JOSS 1 (3). https : //doi.org/10.21105/joss.00037.

    DOI : 10.21105/joss.00037
  28. Singer, Eleanor, and Mick P. Couper. 2017. "Some Methodological Uses of Responses to Open Questions and Other Verbatim Comments in Quantitative Surveys." Methods, data, analyses (mda) 11, no. 2 (July): 115-134. https://doi.org/ 10.12758/MDA.2017.01.

    DOI : 10.12758/MDA.2017.01
  29. Turner, Kenneth J., and Paul S. Lambert. 2015. "Workflows for Quantitative Data Analysis in the Social Sciences." International Journal on Software Tools for Technology Transfer 17 (3): 321-338. https://doi.org/10.1007/s10009-014-0315-4.

    DOI : 10.1007/s10009-014-0315-4
  30. University of Helsinki. 2014. "UD Finnish- FTB: The UD Version of FinnTreeBank 1." Dataset. http://urn.fi/urn:nbn:fi:lb- 2023050801.

  31. Virtanen, Antti, Jenna Kanerva, Rami Ilo, Jouni Luoma, Juhani Luotolahti, Tapio Salakoski, Filip Ginter, and Sampo Pyysalo. 2019. "Multilingual Is Not Enough: BERT for Finnish." ArXiv. https://arxiv.org/abs/1912.07076.

  32. Wickham, Hadley, Mara Averick, Jennifer Bryan, Winston Chang, Lucy D'Agostino McGowan, Romain François, Garrett Grolemund, et al. 2019. "Welcome to the Tidyverse." Journal of Open Source Software 4 (43): 1686. https://doi.org/10. 21105/joss.01686.

    DOI : 10.21105/joss.01686
  33. Wijffels, Jan. 2020. textrank: Summarize Text by Ranking Sentences and Finding Key- words. R package version 0.3.1. The Com- prehensive R Archive Network. https://CRAN.R-project.org/package=textrank.

    DOI : 10.32614/cran.package.textrank
  34. Wijffels, Jan. 2023. udpipe: Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing with the "UDPipe" "NLP" Toolkit. R package version 0.8.11. The Comprehensive R Archive Network. https://CRAN.R-project.org/package=udpipe.

    DOI : 10.32614/cran.package.udpipe
  35. Wilson, Scott. 2022. DACT Qualitative Analysis Toolkit (qualkit). Python package version 0.1.5. The Python Package Index. https://pypi.org/project/qualkit/

  36. A. Clarke, K. Lagus, and M. Valaste R> fst_print_available_models()

    DOI : 10.46298/transformations.14770
  37. "afrikaans-afribooms" "ancient_greek-perseus"

    DOI : 10.1201/9780367810467-17
  38. "ancient_greek-proiel" "arabic-padt"

    DOI : 10.1163/2214-448x_eagll_com_00000146
  39. "armenian-armtdp" "basque-bdt"

    DOI : 10.46991/bysu:b/2024.15.3.139
  40. "belarusian-hse" "bulgarian-btb"

    DOI : 10.31168/2305-6754.2024.1.07
  41. "buryat-bdt" "catalan-ancora"

    DOI : 10.1007/s10579-009-9108-x
  42. "chinese-gsd" "chinese-gsdsimp"

  43. "classical_chinese-kyoto" "coptic-scriptorium"

    DOI : 10.1163/2452-4107_thb_com_233274
  44. "croatian-set" "czech-cac"

    DOI : 10.22586/rch.v19i1.28481
  45. "czech-cltt" "czech-fictree"

    DOI : 10.46720/f2020-mml-058
  46. "czech-pdt" "danish-ddt"

    DOI : 10.1021/acs.inorgchem.6b01065.s001
  47. "dutch-alpino" "dutch-lassysmall"

    DOI : 10.4324/9780203407899-8
  48. "english-ewt" "english-gum"

    DOI : 10.1093/oed/3261993595
  49. "english-lines" "english-partut"

    DOI : 10.1093/english/43.175.80
  50. "estonian-edt" "estonian-ewt"

    DOI : 10.7592/mt2025.91.u03
  51. "finnish-ftb" "finnish-tdt"

    DOI : 10.5334/bax.s
  52. "french-gsd" "french-partut"

    DOI : 10.1093/fs/58.3.448
  53. "french-sequoia" "french-spoken"

    DOI : 10.1093/acprof:oso/9780199573714.003.0007
  54. "galician-ctg" "galician-treegal"

    DOI : 10.33108/galicianvisnyk_tntu
  55. "german-gsd" "german-hdt"

    DOI : 10.18653/v1/w19-8006
  56. "gothic-proiel" "greek-gdt"

    DOI : 10.1163/2666-6421_gllo_com_059572
  57. "hebrew-htb" "hindi-hdtb"

    DOI : 10.7554/elife.33465.007
  58. "hungarian-szeged" "indonesian-gsd"

    DOI : 10.1515/9783486700305.367
  59. "irish-idt" "italian-isdt"

    DOI : 10.1093/obo/9780199846719-0212
  60. "italian-partut" "italian-postwita"

    DOI : 10.4000/books.aaccademia.1961
  61. "italian-twittiro" "italian-vit"

    DOI : 10.3366/edinburgh/9780748693528.003.0014
  62. "japanese-gsd" "kazakh-ktb"

    DOI : 10.5632/jila.64.212
  63. "korean-gsd" "korean-kaist"

    DOI : 10.9798/kosham.2017.17.3.357
  64. "kurmanji-mg" "latin-ittb"

    DOI : 10.1163/1570-6699_eall_eall_dum_vol2_0037
  65. "latin-perseus" "latin-proiel"

    DOI : 10.1515/9783110599572-005
  66. "latvian-lvtb" "lithuanian-alksnis"

    DOI : 10.7220/20.500.12259/239870
  67. "lithuanian-hse" "maltese-mudt"

    DOI : 10.17583/hse.12131
  68. "marathi-ufal" "north_sami-giella"

    DOI : 10.28998/2179-5428.20140101
  69. "norwegian-bokmaal" "norwegian-nynorsk"

    DOI : 10.2307/j.ctv8d5sbr.29
  70. "norwegian-nynorsklia" "old_church_slavonic-proiel"

    DOI : 10.31168/91244-112-7
  71. "old_french-srcmf" "old_russian-torot"

    DOI : 10.5040/9781350885912
  72. "persian-seraji" "polish-lfg"

    DOI : 10.33011/lilt.v7i.1297
  73. "polish-pdb" "polish-sz"

    DOI : 10.1515/9783110947977.1521
  74. "portuguese-bosque" "portuguese-br"

    DOI : 10.7717/peerj.9039/supp-3
  75. "portuguese-gsd" "romanian-nonstandard"

    DOI : 10.4324/9781315157498
  76. "romanian-rrt" "russian-gsd"

    DOI : 10.13140/rg.2.2.10594.94400
  77. "russian-syntagrus" "russian-taiga"

    DOI : 10.3726/978-3-653-03879-8/40
  78. "sanskrit-ufal" "scottish_gaelic-arcosg"

    DOI : 10.3366/edinburgh/9781474454599.003.0006
  79. "serbian-set" "slovak-snk"

    DOI : 10.31577/sociologia.2022.54.6.18
  80. "slovenian-ssj" "slovenian-sst"

    DOI : 10.7152/ssj.v26i1.4223
  81. "spanish-ancora" "spanish-gsd"

    DOI : 10.9783/9781512800524-156
  82. "swedish-lines" "swedish-talbanken"

    DOI : 10.1016/b978-0-08-025240-7.50023-1
  83. "tamil-ttb" "telugu-mtg"

    DOI : 10.34256/irjt22s52
  84. "turkish-imst" "ukrainian-iu"

    DOI : 10.19080/imst.01.1
  85. "upper_sorbian-ufal" "urdu-udtb"

    DOI : 10.7717/peerj-cs.2577/table-9
  86. "uyghur-udt" "vietnamese-vtb"

    DOI : 10.31477/rjmf.202101.104
  87. "wolof-wtb"

    DOI : 10.1163/9789004206106_eifo_dum_3530