MLOps and Admin

MLOps and Admin Data Wrangling Ai Packages Releases Spark

News from the sparkly-verse

Highlights to the most recent updates to sparklyr and friends

Edgar Ruiz

Apr 22, 2024

tidyverse bundle MLOps and Admin Tidyverse Packages

Announcing bundle

Some models store information in locations that cannot be saved via regular R serialization. The new bundle package provides a consistent interface for bundling model objects with their references so that they can be safely saved and re-loaded in production

Julia Silge

Sep 16, 2022

tidyverse tidymodels vetiver-r MLOps and Admin Vetiver Tidyverse Packages

Announcing vetiver for MLOps in R and Python

Announcing vetiver for MLOps in R and Python

We are thrilled to announce the release of vetiver, a framework for MLOps tasks in R and Python. Use vetiver to version, share, deploy, and monitor a trained model

Julia Silge

Jun 9, 2022

plumbertableau Interactive Apps MLOps and Admin BI Tools Product How-To RStudio

Integrating Dynamic R and Python Models in Tableau Using plumbertableau

Integrating Dynamic R and Python Models in Tableau Using plumbertableau

The plumbertableau and fastapitableau packages allow you to integrate dynamic R and Python models in Tableau, enhancing your organization’s preferred dashboard tool

Isabella Velásquez

Dec 20, 2021

Katie Masiello, Isabella Velásquez

Sharing Data With the pins Package

The pins package publishes R objects, such as data sets and predictive models, on a virtual corkboard so that you can share and reuse them easily and safely

Dec 15, 2021

pins-r MLOps and Admin Pins Packages RStudio

pins-r MLOps and Admin Pins RStudio

pins 1.0.0

pins 1.0.0 is now available on CRAN! The pins package publishes data, models, and other R objects, making it easy to share them across projects and with your colleagues. Pins can be versioned, making it straightforward to track changes, re-run analyses on historical data, and undo mistakes

Hadley Wickham

Oct 4, 2021

sparklyr.sedona: A sparklyr extension for analyzing geospatial data

sparklyr.sedona: A sparklyr extension for analyzing geospatial data

We are excited to announce the availability of sparklyr.sedona, a sparklyr extension making geospatial functionalities of the Apache Sedona library easily accessible from R

MLOps and Admin Ai Packages Releases Distributed Computing Spatial Data

Jul 7, 2021

sparklyr 1.7: New data sources and spark_apply() capabilities, better interfaces for sparklyr extensions, and more!

sparklyr 1.7: New data sources and spark_apply() capabilities, better interfaces for sparklyr extensions, and more!

Sparklyr 1.7 delivers much-anticipated improvements, including R interfaces for image and binary data sources, several new spark_apply() capabilities, and better integration with sparklyr extensions

MLOps and Admin Ai Packages Releases Distributed Computing

Jul 6, 2021

sparklyr 1.6: weighted quantile summaries, power iteration clustering, spark_write_rds(), and more

The sparklyr 1.6 release introduces weighted quantile summaries, an R interface to power iteration clustering, spark_write_rds(), as well as a number of dplyr-related improvements

MLOps and Admin Ai Packages Releases Distributed Computing

Mar 25, 2021

A hollywood star with the text 'sparklyr 1.5'

sparklyr 1.5: better dplyr interface, more sdf_* functions, and RDS-based serialization routines

Unlike all three previous sparklyr releases, the recent release of sparklyr 1.5 placed much more emphasis on enhancing existing sparklyr features rather than creating new ones. As a result, many valuable suggestions from sparklyr users were taken into account and were successfully addressed in a long list of bug fixes and improvements

MLOps and Admin Ai Packages Releases Distributed Computing

Dec 14, 2020

sparklyr 1.4: Weighted Sampling, Tidyr Verbs, Robust Scaler, RAPIDS, and more

sparklyr 1.4: Weighted Sampling, Tidyr Verbs, Robust Scaler, RAPIDS, and more

Sparklyr 1.4 is now available! This release comes with delightful new features such as weighted sampling and tidyr verbs support for Spark dataframes, robust scaler for standardizing data based on median and interquartile range, spark_connect interface for RAPIDS GPU acceleration plugin, as well as a number of dplyr-related improvements

MLOps and Admin Ai Packages Releases Distributed Computing

Sep 30, 2020

Training ImageNet with R

This post explores how to train large datasets with TensorFlow and R. Specifically, we present how to download and repartition ImageNet, followed by training ImageNet across multiple GPUs in distributed environments using TensorFlow and Apache Spark

keras3 Machine Learning MLOps and Admin Ai TensorFlow Keras Distributed Computing Data Management

Aug 24, 2020

Parallelized sampling using exponential variates

Parallelized sampling using exponential variates

How can the seemingly iterative process of weighted sampling without replacement be transformed into something highly parallelizable? Turns out a well-known technique based on exponential variates accomplishes exactly that

Best Practices MLOps and Admin Ai Concepts Distributed Computing

Jul 29, 2020

sparklyr 1.3: Higher-order Functions, Avro and Custom Serializers

sparklyr 1.3: Higher-order Functions, Avro and Custom Serializers

Sparklyr 1.3 is now available, featuring exciting new functionalities such as integration of Spark higher-order functions and data import/export in Avro and in user-defined serialization formats

MLOps and Admin Ai Packages Releases Distributed Computing

Jul 16, 2020

pins 0.4.0: Versioning

A new release of pins is available on CRAN today. This release adds support to time travel across dataset versions, which improves collaboration and protects your code from breaking when remote resources change unexpectedly

pins-r MLOps and Admin Pins Connect RStudio

May 29, 2020

sparklyr 1.2: Foreach, Spark 3.0 and Databricks Connect

sparklyr 1.2: Foreach, Spark 3.0 and Databricks Connect

sparklyr 1.2: foreach parallel backend, Databricks Connect support, and Spark 3.0 compatibility

Data Wrangling MLOps and Admin Big Data SparklyR Spark Packages RStudio

May 6, 2020

sparklyr 1.2: Foreach, Spark 3.0 and Databricks Connect

A new sparklyr release is now available. This sparklyr 1.2 release features new functionalities such as support for Databricks Connect, a Spark backend for the ‘foreach’ package, inter-op improvements for working with Spark 3.0 preview, as well as a number of bug fixes and improvements addressing user-visible pain points

MLOps and Admin Ai Packages Releases Distributed Computing

Apr 21, 2020

pins 0.4: Versioning

pins-r MLOps and Admin Ai Packages Releases Data Management

Apr 13, 2020

sparklyr 1.1: Foundations, Books, Lakes and Barriers

sparklyr 1.1: Delta Lake support, Spark 3.0 preview, and barrier execution for deep learning

Data Wrangling MLOps and Admin SparklyR Big Data Spark Packages RStudio

Jan 29, 2020

pins 0.3.0: Azure, GCloud and S3

New CRAN release for pins adds support for cloud boards (Azure, Google Cloud and S3), new functions, use cases and many other improvements

pins-r MLOps and Admin Pins Connect Microsoft Azure Google Cloud Platform Packages RStudio

Nov 28, 2019

pins-r MLOps and Admin Pins Reproducible Packages RStudio

pins: Pin, Discover and Share Resources

Introducing pins: cache remote resources locally, discover datasets, and share across teams

RStudio Team

Sep 9, 2019

MLOps and Admin R Conference Rstudio::conf RStudio Training

rstudio::conf 2019 Workshop materials now available

All 15 workshop materials from rstudio::conf 2019, covering tidyverse, Shiny, R Markdown, and machine learning

Mine Çetinkaya-Rundel

Feb 6, 2019

sparklyr 0.9: Streams and Kubernetes

sparklyr 0.9: Spark structured streams for real-time data processing and Kubernetes cluster support

Data Wrangling MLOps and Admin Spark SparklyR Streaming Big Data Packages RStudio

Oct 1, 2018

Data Wrangling MLOps and Admin SparklyR Packages RStudio

sparklyr 0.8: Production pipelines and graphs

sparklyr 0.8: production ML pipelines with mleap export and graph analysis with graphframes

Kevin Kuo

May 14, 2018

tensorflow keras3 tfestimators MLOps and Admin Ai Cloud

GPU Workstations in the Cloud with Paperspace

GPU Workstations in the Cloud with Paperspace

If you don’t have local access to a modern NVIDIA GPU, your best bet is typically to run GPU intensive training jobs in the cloud. Paperspace is a cloud service that provides access to a fully preconfigured Ubuntu 16.04 desktop environment equipped with a GPU

J.J. Allaire

Apr 2, 2018

Machine Learning MLOps and Admin Data Science Distributed Computing Spark SparklyR Packages RStudio

sparklyr 0.7: Spark Pipelines and Machine Learning

sparklyr 0.7: ML Pipelines API for building, tuning, and deploying machine learning workflows at scale

Kevin Kuo

Jan 29, 2018

cloudml keras3 tfestimators tensorflow Machine Learning MLOps and Admin Ai Cloud Packages Releases

R Interface to Google CloudML

We are excited to announce the availability of the cloudml package, which provides an R interface to Google Cloud Machine Learning Engine. CloudML provides a number of services including on-demand access to training on GPUs and hyperparameter tuning to optimize key attributes of model architectures

J.J. Allaire

Jan 10, 2018

tfruns: Tools for TensorFlow Training Runs