Scale Python across 1000 computers in 1 second.

Burla is a package with only one function. Here's how it works:

my_inputs = [1, 2, ... 1000]

def my_function(x):
    print(f"[#{x}] running on separate computer")

burla.remote_parallel_map(my_function, my_inputs)

This runs my_function on 1000 vm's in the cloud, in < 1 second:

☝️ Try this example yourself in Google Colab 🔗

Burla is the simplest way to scale any data pipeline.

Burla scales up to 10,000 CPUs in a single function call, supports GPUs, and custom containers. Load data in parallel from cloud storage, then write results in parallel from thousands of VMs at once.

remote_parallel_map(process, [...])
remote_parallel_map(aggregate, [...], func_cpu=64)
remote_parallel_map(predict, [...], func_gpu="A100")

This creates a pipeline like:

Monitor progress in the dashboard:

Cancel bad runs, filter logs to watch individual inputs, or monitor output files in the UI.

How it works:

With Burla, running code in the cloud feels the same as coding on your laptop:

return_values = remote_parallel_map(my_function, my_inputs)

When functions are run with remote_parallel_map:

• Anything they print appears locally (and inside Burla's dashboard).

• Any exceptions are thrown locally.

• Any packages or local modules they use are (very quickly) cloned on remote machines.

• Code starts running in under one second! Even with millions of inputs or thousands of machines.

Features:

📦 Automatic Package Sync

Burla automatically (and very quickly) clones your Python packages on every remote machine where code is executed.

🐋 Custom Containers

Easily run code in any Docker container. Public or private, just paste an image URI in the settings, then hit start!

📂 Network Filesystem

Need to get big data into/out of the cluster? Burla automatically mounts a cloud storage bucket to a folder in every container.

⚙️ Variable Hardware Per-Function

The func_cpu and func_ram args make it possible to assign big hardware to some functions, and less to others.

Try Burla in less than 2 minutes:

1. Sign in using your Google or Microsoft account.

2. Follow the 3-step quickstart on the homepage!

Burla is open-source and easy to self-host. Click here to deploy Burla in your cloud instead.

---

Questions? Schedule a call, or email [email protected]. We're always happy to talk.