Skip to content

lawremi/rsolr

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Description

The `rsolr` package is an idiomatic R interface to Solr based on deferred evaluation. A Solr core is represented as a data frame or list that supports Solr-side filtering, sorting, transformation and aggregation, all through the familiar base R API. Queries are processed lazily, i.e., a query is only sent to the database when the data are required.

Features

  • Store, retrieve and compute on data with Solr, from R
  • Use familiar R syntax and function names from the base R API, with some extensions
  • Model data as either a data.frame or list, or use the low-level query API
  • Conveniently manipulate document collections after retrieval
  • Autogenerate a Solr schema from a data.frame
  • Experiment with the embedded Solr instance
  • Extend to support additional/custom Solr features

Example using data from R

This is inspired by some manipulations in the dplyr vignette.

Load the New York City 2013 flight data and upload to Solr:

library(nycflights13)
schema <- deriveSolrSchema(flights)
solr <- rsolr:::TestSolr(schema)
sr <- SolrFrame(solr$uri)
sr[] <- flights

Filtering:

subset(sr, month == 1 & day == 1)
head(sr, 10L)

Sorting:

sort(sr, by = ~ year + month + day)

Select fields:

subset(sr, select=c(year, month, day))
sr[c("year", "month", "day")]
sr[c("arr_*", "dep_*")] # Solr globs

Transform:

sr2 <- transform(sr,
                 gain = arr_delay - dep_delay,
                 speed = distance / air_time * 60)
sr2[c("gain", "speed")]

Aggregate:

unique(sr["tailnum"])
aggregate(~ tailnum, sr,
          count = TRUE,
          dist = mean(distance, na.rm=TRUE),
          delay = mean(arr_delay, na.rm=TRUE))

Example using existing Solr core

Construct a SolrFrame using the URL to the existing core:

sr <- SolrFrame("http://my.host.com/solr/mycore")

Convert the SolrFrame to a data.frame, typically after some filtering or aggregation:

df <- as.data.frame(sr)

About

An idiomatic R interface to Solr

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published