Scale Python across 1000 computers in 1 second.

Burla is an open-source cloud platform for Python developers. It only has one function:

from burla import remote_parallel_map

my_inputs = list(range(1000))

def my_function(x):
    print(f"[#{x}] running on separate computer")

remote_parallel_map(my_function, my_inputs)

This runs my_function on 1000 vm's in the cloud, in < 1 second:

The simplest way to build scalable data-pipelines.

Burla scales up to 10,000 CPUs in a single function call, supports GPUs, and custom containers. Load data in parallel from cloud storage, then write results in parallel from thousands of VMs at once.

This creates a pipeline like:

Monitor progress in the dashboard:

Cancel bad runs, filter logs to watch individual inputs, or monitor output files in the UI.

How it works:

With Burla, running code in the cloud feels the same as coding on your laptop:

When functions are run with remote_parallel_map:

  • Anything they print appears locally (and inside Burla's dashboard).

  • Any exceptions are thrown locally.

  • Any packages or local modules they use are (very quickly) cloned on remote machines.

  • Code starts running in under one second! Even with millions of inputs or thousands of machines.

Features:

📦 Automatic Package Sync

Burla automatically (and very quickly) clones your Python packages on every remote machine where code is executed.

🐋 Custom Containers

Easily run code in any Docker container. Public or private, just paste an image URI in the settings, then hit start!

📂 Network Filesystem

Need to get big data into/out of the cluster? Burla automatically mounts a cloud storage bucket to a folder in every container.

⚙️ Variable Hardware Per-Function

The func_cpu and func_ram args make it possible to assign big hardware to some functions, and less to others.

Try Burla in less than 2 minutes:

  1. Sign inarrow-up-right using your Google or Microsoft account.

  2. Follow the 3-step quickstart on the homepage!

Burla is open-source and easy to self-host. Click herearrow-up-right to deploy Burla in your cloud instead.


Questions? Schedule a callarrow-up-right, or email [email protected]. We're always happy to talk.