CRUNCH. infrastructure for computationally-intense learning analytics.

CRUNCH is an infrastructure — for computationally-intense learning analytics, supporting researchers in investigating big data generated in the co-construction of knowledge.

Living documents reports and tutorials generated using embedded scripts and data.

Interrater agreement with Krippendorff's alpha coefficient

http://crunch.kmi.open.ac.uk/people/~fwild/services/interrater-agreement.Rmw

One approach to evaluate novel approaches for predicting learning

Sentiment detection using the Harvard General Inquirer dictionaries

http://crunch.kmi.open.ac.uk/people/~fwild/services/sentiment-demo.Rmw

This is an example of using just two out of the dictionaries provided

#LAK13 twitter monitor

http://crunch.kmi.open.ac.uk/people/~fwild/services/lak13twittermonitor.Rmw

The following activity monitor (by week) is using the twitter archive google spreadsheet Martin Hawksey provides. Cudoz to Martin for setting this up!

Monitoring weekly learner activity with TwitteR

http://crunch.kmi.open.ac.uk/people/~fwild/services/twitter-demo.Rmw

This is a very simple example on how to do an analysis of twitter feeds and hastags and such. It largely follows the examples provided in the package Vignette.

Creating html reports with Knitr markdown

http://crunch.kmi.open.ac.uk/people/~fwild/services/report.rmw

This is an example of using knitr with extended markdown. It shows how to run our own template from a crunch studio. And have it magically show up in the big data blog.

http://crunch.kmi.open.ac.uk/people/~fwild/services/test-rjava.Rmw

Social Network Analysis - Basics

http://crunch.kmi.open.ac.uk/people/~fwild/services/simple-sna.Rmw

R language basics

http://crunch.kmi.open.ac.uk/people/~fwild/services/r-language-basics.Rmw

Getting started with R is simple - at least when you are already familiar with any other sort of programming language. In this short tutorial, you will see a few examples of how working with R can be fun.

LAK13 twitter monitor

http://crunch.kmi.open.ac.uk/people/~fwild/services/lak13twittermonitor-tutorial.Rmw

The following activity monitor (by week) is using the twitter archive google spreadsheet Martin Hawksey provides. Cudoz to Martin for setting this up!

The social relations in a publication network

http://crunch.kmi.open.ac.uk/people/~fwild/services/young-researcher-network.Rmw

The International Journal of Technology-Enhanced Learning has been running a series of dedicated special issues to facilitate publishing of work of PhD candidates. Here we inspect the network generated around three (of four) special issues, each of which with its own character in composition and organisation.

SPARQLing with R

http://crunch.kmi.open.ac.uk/people/~fwild/services/sparql-demo.Rmw

This is a very brief demo of how to use sparql queries in R.

The social networks hidden in forum data

http://crunch.kmi.open.ac.uk/people/~fwild/services/forum-sna.Rmw

Scoring Essays with Latent Semantic Analysis

http://crunch.kmi.open.ac.uk/people/~fwild/services/lsa-essay-scoring.Rmw

To score essays automatically with a single score as such and

LSA with sparse input

http://crunch.kmi.open.ac.uk/people/~fwild/services/sparseLSA.Rmw

Social Network Analysis of Forum

http://crunch.kmi.open.ac.uk/people/~fwild/services/demo.Rmw

Investigate how learners interact and build their future networks.

Indexing with latent semantic analysis

http://crunch.kmi.open.ac.uk/people/~fwild/services/lsa-indexing.Rmw

The introductory papers of the Bellcore group often feature the same, simple example to

Social Network Analysis of a Blog Network

http://crunch.kmi.open.ac.uk/people/~fwild/services/blog-sna-demo.Rmw

Once you have interaction data, it's easy to visualise the social network diagramme: see below for an example, how to configure the network plot routines to visualise the network nicely.

#LAK13 discussion boards

http://crunch.kmi.open.ac.uk/people/~fwild/services/lak13discussions.Rmw

Here are some basic statistics about discussion forum use (as extracted by Martin Hawksey from Canvas).

This is an example of using **knitr** with extended markdown (e.g.

http://crunch.kmi.open.ac.uk/people/~restriegana/services/prueba2.rmw

[GFM](http://github.github.com/github-flavored-markdown/)). Note

http://crunch.kmi.open.ac.uk/people/~restriegana/services/pruebamarkdown.rmw

You can generate living reports easily: just open a textfile in your studio and write some text and markdown chunks into it. Markdown chunks are basically R code in the text, framed by three apostrophees.

‹ ›

The gallery data displays generated using embedded scripts and data.

<< plot-demo.png >>

<< qq-plot.png >>

<< lsa-indexing.png >>

<< networkFin.png >>

<< networkFinStuds.png >>

<< network.png >>

<< technology-and-knowledge-0.8.pdf >>

<< mooc-report-002.pdf >>

<< mooc-report-006.pdf >>

<< mooc-report-007.pdf >>

<< mooc-report-004.pdf >>

<< mooc-report-005.pdf >>

<< mooc-report.pdf >>

<< snapshot-1.png >>

<< mooc-report-003.pdf >>

<< report-demo.pdf >>

<< simple-sna.pdf >>

<< openlearn-concept-map.png >>

<< LAK13-week3-twittermonitor.pdf >>

<< sna-4.pdf >>

<< icamp-net-trial2.pdf >>

<< report-demo.pdf >>

<< sna-3.pdf >>

<< fanplot-telmap-mooc4.pdf >>

<< sna-plot2.pdf >>

<< telmap3.pdf >>

<< telmap-term-trends-2011.png >>

<< pdf-report-1.pdf >>

<< telmap-trends.png >>

<< unnamed-chunk-11.png >>

<< unnamed-chunk-1.png >>

<< unnamed-chunk-13.png >>

<< unnamed-chunk-113.png >>

<< unnamed-chunk-15.png >>

<< unnamed-chunk-19.png >>

<< unnamed-chunk-16.png >>

<< unnamed-chunk-112.png >>

<< unnamed-chunk-17.png >>

<< unnamed-chunk-12.png >>

<< unnamed-chunk-18.png >>

<< unnamed-chunk-14.png >>

<< unnamed-chunk-110.png >>

<< unnamed-chunk-111.png >>

<< unnamed-chunk-11.png >>

<< unnamed-chunk-10.png >>

<< unnamed-chunk-2.png >>

<< unnamed-chunk-1.png >>

<< unnamed-chunk-13.png >>

<< unnamed-chunk-9.png >>

<< unnamed-chunk-8.png >>

<< unnamed-chunk-12.png >>

<< unnamed-chunk-14.png >>

<< md-cars2.png >>

<< md-cars1.png >>

<< cv.pdf >>

<< Rplot13.png >>

<< Rplot03.png >>

<< Rplot02.png >>

<< Rplot06.png >>

<< Rplot21.png >>

<< Rplot.png >>

<< Rplot18.png >>

<< Rplot10.png >>

<< Rplot07.png >>

<< Rplot12.png >>

<< Rplot08.png >>

<< Rplot15.png >>

<< Rplot16.png >>

<< Rplot05.png >>

<< Rplot11.png >>

<< Rplot14.png >>

<< Rplot17.png >>

<< Rplot01.png >>

<< Rplot20.png >>

<< Rplot09.png >>

<< Rplot04.png >>

<< Rplot19.png >>

<< knitr-minimal.pdf >>

<< md-cars-scatter.png >>

<< spinner.gif >>

<< Example.png >>

<< arduino blog docs.png >>

<< arduino blog freq.png >>

<< apple blog docs.png >>

<< apple blog freq.png >>

<< enquiry blog docs.png >>

<< enquiry blog freq.png >>

<< inquiry blog freq.png >>

<< inquiry blog docs.png >>

<< social-learning blog freq.png >>

<< social-all blog docs.png >>

<< social-social blog docs.png >>

<< social-all blog freq.png >>

<< social-learning blog docs.png >>

<< social-social blog freq.png >>

<< kmi blog docs.png >>

<< kmi blog freq.png >>

<< Analytics blog freq.png >>

<< Analytics blog docs.png >>

<< elearning blog freq.png >>

<< elearning blog docs.png >>

<< gamefication blog freq.png >>

<< gamefication blog docs.png >>

<< cetis blog freq.png >>

<< cetis blog docs.png >>

<< ipad-android blog docs.png >>

<< ipad-tablet blog docs.png >>

<< ipad-android blog freq.png >>

<< ipad-tablet blog freq.png >>

<< ipad-ipad blog docs.png >>

<< ipad-all blog docs.png >>

<< ipad-ipad blog freq.png >>

<< ipad-all blog freq.png >>

<< open-all blog freq.png >>

<< open-university blog docs.png >>

<< open-all blog docs.png >>

<< open-open blog freq.png >>

<< open blog docs.png >>

<< open blog freq.png >>

<< open-open blog docs.png >>

<< open-university blog freq.png >>

<< tablet blog freq.png >>

<< tablet-ipad blog docs.png >>

<< tablet blog docs.png >>

<< tablet-ipad blog freq.png >>

<< tablet-tablet blog freq.png >>

<< tablet-all blog docs.png >>

<< tablet-smartphone blog docs.png >>

<< tablet-smartphone blog freq.png >>

<< tablet-iphone blog docs.png >>

<< tablet-iphone blog freq.png >>

<< tablet-all blog freq.png >>

<< tablet-tablet blog docs.png >>

<< UKOU blog docs.png >>

<< UKOU blog freq.png >>

<< android blog docs.png >>

<< android blog freq.png >>

<< 3d-3d blog docs.png >>

<< 3d-3d blog freq.png >>

<< 3d-all blog freq.png >>

<< 3d-printer blog freq.png >>

<< 3d-printer blog docs.png >>

<< 3d-all blog docs.png >>

<< standards blog docs.png >>

<< standards blog freq.png >>

<< MOOCs-MOOCs blog freq.png >>

<< MOOCs- blog freq.png >>

<< MOOCs-all blog freq.png >>

<< MOOCs-all blog docs.png >>

<< MOOCs blog freq.png >>

<< MOOCs blog docs.png >>

<< MOOCs-MOOCs blog docs.png >>

<< MOOCs- blog docs.png >>

<< flipped blog freq.png >>

<< flipped blog docs.png >>

<< connectivism blog freq.png >>

<< connectivism blog docs.png >>

<< mooc-cmooc blog freq.png >>

<< mooc-xmooc blog freq.png >>

<< mooc-cmooc blog docs.png >>

<< mooc-all blog docs.png >>

<< mooc blog docs.png >>

<< mooc-mooc blog docs.png >>

<< mooc-xmooc blog docs.png >>

<< mooc-mooc blog freq.png >>

<< mooc blog freq.png >>

<< mooc-coursera blog freq.png >>

<< mooc-all blog freq.png >>

<< mooc-coursera blog docs.png >>

<< highr-education blog freq.png >>

<< highr-all blog docs.png >>

<< highr-education blog docs.png >>

<< highr-highr blog docs.png >>

<< highr-highr blog freq.png >>

<< highr-all blog freq.png >>

<< higher-all blog freq.png >>

<< higher-education blog docs.png >>

<< higher-all blog docs.png >>

<< higher-education blog freq.png >>

<< higher-higher blog freq.png >>

<< higher-higher blog docs.png >>

<< China blog docs.png >>

<< China blog freq.png >>

<< gamified blog freq.png >>

<< gamified blog docs.png >>

<< connectivist-connectivism blog docs.png >>

<< connectivist-connectivist blog docs.png >>

<< connectivist-connectivist blog freq.png >>

<< connectivist- blog freq.png >>

<< connectivist- blog docs.png >>

<< connectivist-all blog docs.png >>

<< connectivist-mooc blog docs.png >>

<< connectivist-connectivism blog freq.png >>

<< connectivist-mooc blog freq.png >>

<< connectivist-all blog freq.png >>

<< online-learning-all blog freq.png >>

<< online-learning- blog docs.png >>

<< online-learning- blog freq.png >>

<< online-learning-online-learning blog docs.png >>

<< online-learning-online-learning blog freq.png >>

<< online-learning-all blog docs.png >>

<< class-classroom blog freq.png >>

<< class-class blog docs.png >>

<< class-classroom blog docs.png >>

<< class-class blog freq.png >>

<< class-all blog docs.png >>

<< class-all blog freq.png >>

<< game-gamification blog freq.png >>

<< game-all blog docs.png >>

<< game-gamification blog docs.png >>

<< game-all blog freq.png >>

<< game-gamebased blog docs.png >>

<< game-game blog docs.png >>

<< game-game blog freq.png >>

<< game-gamebased blog freq.png >>

<< gamification-game-based blog docs.png >>

<< gamification-gamified blog docs.png >>

<< gamification-gamification blog freq.png >>

<< gamification-game-based blog freq.png >>

<< gamification blog docs.png >>

<< gamification-gamification blog docs.png >>

<< gamification-all blog docs.png >>

<< gamification blog freq.png >>

<< gamification-gamified blog freq.png >>

<< gamification-all blog freq.png >>

<< jisc blog docs.png >>

<< jisc blog freq.png >>

<< printer blog freq.png >>

<< printer blog docs.png >>

<< interoperability blog docs.png >>

<< interoperability blog freq.png >>

<< MOOC-all blog docs.png >>

<< MOOC-cMOOC blog docs.png >>

<< MOOC blog docs.png >>

<< MOOC blog freq.png >>

<< MOOC-cMOOC blog freq.png >>

<< MOOC-xMOOC blog docs.png >>

<< MOOC-MOOC blog docs.png >>

<< MOOC-xMOOC blog freq.png >>

<< MOOC-MOOC blog freq.png >>

<< MOOC-all blog freq.png >>

<< augmented-reality blog freq.png >>

<< augmented-all blog docs.png >>

<< augmented-augmented blog docs.png >>

<< augmented-all blog freq.png >>

<< augmented-augmented blog freq.png >>

<< augmented-reality blog docs.png >>

<< school blog freq.png >>

<< school blog docs.png >>

<< eat blog freq.png >>

<< eat blog docs.png >>

<< cuts blog docs.png >>

<< cuts blog freq.png >>

<< economic-economic blog docs.png >>

<< economic blog freq.png >>

<< economic-funding blog freq.png >>

<< economic-funding blog docs.png >>

<< economic-economic blog freq.png >>

<< economic-all blog docs.png >>

<< economic-all blog freq.png >>

<< economic blog docs.png >>

<< china-all blog freq.png >>

<< china-chinese blog freq.png >>

<< china blog docs.png >>

<< china-all blog docs.png >>

<< china blog freq.png >>

<< china-china blog freq.png >>

<< china-china blog docs.png >>

<< china-chinese blog docs.png >>

<< OU blog freq.png >>

<< OU blog docs.png >>

<< computing-computing blog docs.png >>

<< computing-PCs blog freq.png >>

<< computing-all blog freq.png >>

<< computing-computing blog freq.png >>

<< computing-all blog docs.png >>

<< computing-PCs blog docs.png >>

<< computing blog docs.png >>

<< computing blog freq.png >>

<< microlearning-all blog docs.png >>

<< microlearning-schools blog freq.png >>

<< microlearning-schools blog docs.png >>

<< microlearning-games blog docs.png >>

<< microlearning-games blog freq.png >>

<< microlearning-microlearning blog docs.png >>

<< microlearning-microlearning blog freq.png >>

<< microlearning-all blog freq.png >>

<< mobile-all blog freq.png >>

<< mobile-smartphone blog freq.png >>

<< mobile-iphone blog freq.png >>

<< mobile-ipad blog freq.png >>

<< mobile-ipad blog docs.png >>

<< mobile-tablet blog docs.png >>

<< mobile-all blog docs.png >>

<< mobile-mobile blog docs.png >>

<< mobile-mobile blog freq.png >>

<< mobile-tablet blog freq.png >>

<< mobile-smartphone blog docs.png >>

<< mobile-iphone blog docs.png >>

<< online-online blog freq.png >>

<< online-distance blog docs.png >>

<< online- blog freq.png >>

<< online-distance blog freq.png >>

<< online-all blog freq.png >>

<< online- blog docs.png >>

<< online-learning blog freq.png >>

<< online-learning blog docs.png >>

<< online-all blog docs.png >>

<< online-online blog docs.png >>

<< glass-overlay blog freq.png >>

<< glass-all blog freq.png >>

<< glass-googles blog freq.png >>

<< glass-3d blog freq.png >>

<< glass-glass blog freq.png >>

<< glass-glass blog docs.png >>

<< glass-all blog docs.png >>

<< glass-3d blog docs.png >>

<< glass-googles blog docs.png >>

<< glass-overlay blog docs.png >>

<< future-learn blog freq.png >>

<< future-future blog docs.png >>

<< future-all blog docs.png >>

<< future-learn blog docs.png >>

<< future-all blog freq.png >>

<< future-future blog freq.png >>

<< google-glasses blog freq.png >>

<< google-google blog docs.png >>

<< google-glasses blog docs.png >>

<< google-all blog docs.png >>

<< google-google blog freq.png >>

<< google-all blog freq.png >>

<< futurelearn blog freq.png >>

<< futurelearn blog docs.png >>

‹ ›

Data-shop explore the open data sets available

<< networkFinStuds.RData >>

<< users-anon.RData >>

<< am-sparse.RData >>

<< net-noisolates.RData >>

<< am3-noisolates.RData >>

<< im-sparse.RData >>

<< im.RData >>

<< forum-data.RData >>

<< allusersFin.RData >>

<< network.RData >>

<< am-noisolates.RData >>

<< imFin.RData >>

<< LAK13-tweets.rda >>

<< lak13archive.rda >>

<< openlearn-space.rda >>

<< openlearn-dtmsc.rda >>

<< openlearn-dtms.rda >>

<< LAK13-search.rda >>

<< lak13tweets.rda >>

<< openlearn_netcoords.RData >>

<< humanratings.RData >>

<< openlearn_proximity.RData >>

<< sentDict.rda >>

<< openlearn_businessbooks.rda >>

<< openlearn-tm.rda >>

<< openlearn_business_space.rda >>

<< openlearn-dtm.rda >>

<< lak13.rda >>

<< icamp-blog-network.rda >>

<< a.RData >>

<< openlearn_businessbooks.rda >>

<< telmap-blogs-dict.RData >>

<< telmap-blogs-space2.RData >>

<< telmap-blogs-freqs.RData >>

<< telmap-blogs-tm2reduced.RData >>

<< telmap-blogs-lsatm.RData >>

<< telmap-blogs-filtered-tm3-mooc.RData >>

<< telmap-blogs-space.RData >>

<< telmap-blogs-tm.RData >>

<< .RData >>

<< .RData >>

<< LAK-Dataset.RData >>

‹ ›

Scripts and Services benefit from the codebase of others

<< test.rws >>

<< demo.R >>

<< icamp-blog-network.R >>

<< kmi-news-generate.rws >>

<< young-researcher-network.R >>

<< server.R >>

<< ui.R >>

<< generate-report.rws >>

<< benchmarks-2-5.rws >>

<< knitr-demo.rws >>

<< image-demo.rws >>

<< a-secret-key.rws >>

<< hello-world.rws >>

<< testpublic.rws >>

<< benchmarks.R >>

<< benchmarks-deleeuw.R >>

<< kripp-alpha-demo.R >>

<< mysql-tutorial.R >>

<< db2.R >>

<< getRSS.R >>

<< generate-reports.R >>

<< blogCorpus.R >>

<< telmap-analytics.R >>

<< benchmarks-2-5.R >>

<< benchmarks-MASS-ex.R >>

<< qauliSummary.R >>

<< image.rws >>

<< report.rws >>

<< tweetgraph.R >>

<< JSONexample.r >>

<< imagefile.r >>

<< imagefile.rws >>

<< sentiment.rws >>

<< JSONexample2.r >>

<< knitr-minimal.R >>

<< HV_stemming.R >>

<< HV_handler.R >>

<< LAK RDF2RData.R >>

<< CustomStopwords.R >>

<< sentimentFunctions.R >>

‹ ›

Documentation

scripting icon

Analytics Workspace

Click here to find out, how to obtain an account for our hosted RStudio, the fully-fledging, browser-based data analysis work space environment — with which you can kick off exploratory scripting for analysing big data.

View details »

pipelining icon

Pipelining

We are discussing currently, how we could support simple chaining and pipelining of services, so that the output of one script can serve as input for another. Wouldn't that be sweet? Click here to join the discussion...

View details »

publishing icon

Service Publishing

Click here to learn more on how to release your scripts as public web services, hosted on crunch.

View details »

scheduling icon

Scheduling

Some scripts take way too long to wait for them finishing. Crunch can do cron jobs. We are currently discussing what advanced job scheduling solution we would like to offer. Click here to join the discussion...

View details »