{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Train Models on Large Datasets\n",
"==============================\n",
"\n",
"Most estimators in scikit-learn are designed to work with NumPy arrays or scipy sparse matricies.\n",
"These data structures must fit in the RAM on a single machine.\n",
"\n",
"Estimators implemented in Dask-ML work well with Dask Arrays and DataFrames. This can be much larger than a single machine's RAM. They can be distributed in memory on a cluster of machines."
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"execution": {
"iopub.execute_input": "2021-10-14T16:51:21.347920Z",
"iopub.status.busy": "2021-10-14T16:51:21.346993Z",
"iopub.status.idle": "2021-10-14T16:51:21.771650Z",
"shell.execute_reply": "2021-10-14T16:51:21.772772Z"
}
},
"outputs": [],
"source": [
"%matplotlib inline"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"execution": {
"iopub.execute_input": "2021-10-14T16:51:21.776455Z",
"iopub.status.busy": "2021-10-14T16:51:21.775477Z",
"iopub.status.idle": "2021-10-14T16:51:23.328773Z",
"shell.execute_reply": "2021-10-14T16:51:23.329987Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"