Data Cleaning Automation for Large Datasets

Data Cleaning Automation schedules batch runs of selected Flookup custom functions so you can process large datasets in Google Sheets. Jobs run on a schedule and write results to the output range you choose, which helps with large ranges that are difficult to handle in a single formula calculation.

On This Page

Open the Scheduler

In Google Sheets, open Extensions > Flookup Data Wrangler > Data Cleaning Automation. The sidebar lets you choose a function, define ranges and options, set a schedule, and monitor progress.


Supported Batch Jobs

Data Cleaning Automation currently schedules batch processing for five custom functions that are commonly used on large datasets:

JobWhat it doesTypical inputsOutput
NORMALIZE Cleans and transforms values row by row, for example removing diacritics, keeping text or numbers, removing punctuation, trimming or changing case. For text and punctuation operations you can provide an optional stop-words/characters range. Source range (single column), operation, optional stop range One cleaned value per source row written to the output range
FUZZYSIM Compares values in two ranges row by row and returns a similarity score. Left range, right range, compare mode One score per row written to the output range
FLOOKUP Finds the best fuzzy match for each lookup value in a table and returns the matched value. You can also return the score or row position with the match. Lookup range, table range, lookup column, return column, threshold, output mode Matched value (and optional score or position) per lookup row
ULIST Extracts unique rows from a source range based on a key column, using exact or fuzzy matching. Source range, key column, threshold Unique rows written to the output range
DEDUPE Removes duplicate rows by key column, keeping the first or last occurrence, using exact or fuzzy matching. Source range, key column, keep mode, threshold Deduplicated rows written to the output range

For formula-by-formula syntax and examples, see Custom Functions.


How Scheduling Works


Configure and Run a Job

  1. Select a function. Choose NORMALIZE, FUZZYSIM, FLOOKUP, ULIST or DEDUPE. The form shows the fields required for that job.
  2. Set ranges and options. Enter ranges in A1 notation (you can include a sheet name, for example Sheet1!A2:A or Data!A2:D), then set columns, thresholds or modes as needed. Choose the output range top-left cell where results should be written.
  3. Set the schedule. Pick minutes, hours or days and the frequency (and start time for daily schedules).
  4. Save schedule. Click Save schedule to create or update the trigger and stored job configuration.
  5. Run now (optional). Click Run now to process a chunk immediately.

Manage Schedules


Important Notes