Altair performance questions

AAdrDar87

Hi team, thanks for your work on this package. Apologies for the dumb question, I have been using large datasets and used altair for dynamic plotting with slider filters.
Using on jupyter:
alt.data_transformers.enable("vegafusion")
alt.renderers.enable("jupyter", offline=True), this is very fast (less than 1 sec for the update).
I tried to achieve the same filtering using marimo sliders directly on my polars dataframe and then plotting, this works but it is slower as obviously polars needs to do the filtering and run 2 cells (2-5 seconds).
For this use case, the JupyterChart (jupyter renderer) is faster, is there any plan to have it supported in marimo ? (Other renderers being too slow for large datasets)

20 comments

MMyles Scolnick

can you share an example with us? you can use alt.data_transformers.enable("vegafusion") in marimo as well

AAdrDar87

Let me send something tomorrow

AAdrDar87

https://marimo.io/p/@adrien-dart/notebook-if8m1s

AAdrDar87

with a heavier dataset, the difference becomes noticeable

AAdrDar87

https://altair-viz.github.io/user_guide/jupyter_chart.html

AAdrDar87

I'm basically asking about support for JupyterChart at some point

AAdrDar87

Thank you for looking into this

AAdrDar87

🙂

MMyles Scolnick

I cant see any slowness - it takes a 83ms for your example to re-render for me. (although its not a large dataset). happy to debug an example if you can send one with a larger dataset.

also, I was able to render a JupyterChart as it was shown in the altair docs:

Plain Text

import pandas as pd
source = pd.DataFrame({
    'a': ['A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I'],
    'b': [28, 55, 43, 91, 81, 53, 19, 87, 52]
})
chart = alt.Chart(source).mark_bar().encode(
    x='a',
    y='b'
)

jchart = alt.JupyterChart(chart)
jchart

MMyles Scolnick

Attachment

MMyles Scolnick

We also have a doc about better performance utilizing Data Transformers
https://docs.marimo.io/api/plotting.html#performance-and-data-transformers

AAdrDar87

Thank you for looking into this! I'll have another look over the coming days 🙂

AAdrDar87

"The JupyterChart widget and the "jupyter" renderer are designed to work with the VegaFusion data transformer to evaluate data transformations interactively in response to selection events. This avoids the need to transfer the full dataset to the browser, and so supports interactive exploration of aggregated datasets on the order of millions of rows." I'm curious, is marimo_csv doing the same thing under the hood?

AAdrDar87

https://marimo.io/p/dev/notebook-dn5hsm-vfmcetat8211da33ux796r

AAdrDar87

are you able to run the notebook with either renderers?

AAdrDar87

jupyter renderer (works instantly in jupyter FYI) gets me an output limit

AAdrDar87

marimo_csv plot is empty for some reason

AAdrDar87

I still need to get you an example of a heavy dataset where the re-rendering time is long

MMyles Scolnick

marimo_csv won't work like vegafusion, but you can also just use vegafusion which should be performant
I can look at the jupyter data_transformer as well to see if we can bridge some capabailities

AAdrDar87

That would be nice ! 🙂 thank you for your help!

Add a reply

Get help from the marimo community

Altair performance questions