{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Train Models on Large Datasets\n",
"==============================\n",
"\n",
"Most estimators in scikit-learn are designed to work with NumPy arrays or scipy sparse matricies.\n",
"These data structures must fit in the RAM on a single machine.\n",
"\n",
"Estimators implemented in Dask-ML work well with Dask Arrays and DataFrames. This can be much larger than a single machine's RAM. They can be distributed in memory on a cluster of machines."
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"execution": {
"iopub.execute_input": "2021-07-26T20:13:47.277646Z",
"iopub.status.busy": "2021-07-26T20:13:47.276955Z",
"iopub.status.idle": "2021-07-26T20:13:47.715301Z",
"shell.execute_reply": "2021-07-26T20:13:47.716110Z"
}
},
"outputs": [],
"source": [
"%matplotlib inline"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"execution": {
"iopub.execute_input": "2021-07-26T20:13:47.719410Z",
"iopub.status.busy": "2021-07-26T20:13:47.718385Z",
"iopub.status.idle": "2021-07-26T20:13:49.225978Z",
"shell.execute_reply": "2021-07-26T20:13:49.226733Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"