Feedback on Alembic in Blender from a VFX pov

Hia,

We’re a small VFX house (feature films), using alembic (and slowly toying with USD) for most of our work. We’re primarily a Houdini place but have introduced Blender for modeling and the VSE for contextual review of shots (thanks to the cache updates!) and now we’ve been rendering with Cycles on a few shots.

We’ve hit some roadblocks/showstoppers (in both 2.79b and latest 2.8 builds) in regards to Blenders Alembic implementation.

I hope to provide some meaningful feedback from production land and propose some suggestions for how to elevate some of our current issues. I welcome any pointers on how to circumvent the problems or discussions about best practice in terms of Blender and Alembic in its current form.

Alembic is a fantastic interchange format, with support for some crucial production features, like streaming data, data-deduplication ,instancing, hierarchy, custom attributes to name a few. I want to highlight two things in particular that we’re having issues with:

Poor streaming data support

Currently Blender only streams geometry if its deforming, but not if its a packed/instanced set of geometry, then Blender unpacks and loads all of the geometry data and stores it in the Blend file.

I can have a single ABC file with a fairly hefty point cloud that I instance an object on and it will only save the instance and the point cloud in a small .ABC file. Blender will unpack and copy all of the objects around into memory, and break the file link to the .ABC file (as in I would have to re-import the entire data-set for a new version of the cache). Which makes working with cache versioning a proper PITA. The point is to stream and load the data of disk OR import and unpack.

Our issues are, file size ballooning and duplication of data. Poor version/file control.

Suggestions:Alembic render primitive, fuzzy filtering of ABC file in Alembic modifier. Let the user chose if you want to unpack the alembic into blender for editing. Or just reference the file if it’s for static reference, render or sim work.

Poor attribute support

Alembic supports arbitrary data stored on points, vertices, primitives etc as Floats, Vectors and Strings. A lot of additional data concerning caches are stored here, including things like rest positions, velocities, age and other useful data that can be used in contexts like shading and simulation work.

Blender’s ABC support is limited to a single Color channel (which is actually clipped to 0-1!) and a single UV float2 stored on vertices. Inside of Blender I can have multiple layers of vertex colors but it only reads the first one inside an alembic file. Blender supports multiple layers internally but when I export a Blender native object with multiple UV and Col maps no other application reads them. Neither Houdini nor Gaffer can read/see that data. However blender will see it once you re-import the file into Blender. I suspect Blender isn’t following the specification of the format here.

Issue: Can’t do any production rendering of complex nature since we’re severely limited by the number of data channels we can import. No motion blur on deforming meshes based on velocity attributes! (showstopper, but it CAN render motion blur if there are only hierarchal transformation from the ABC file, just not mesh deforms)

Suggestion: please remove the clipping of data in the Col/Cd attribute on import, copy the other vertex data from the ABC file into other Col vertex maps since blender already supports multiple data types on points. The latter is a hack, but could be easier to implement.

TLDR, these are stopping us from using Blender/Cycles;

  • Can’t stream alembic archives to the full specification (no instancing without unpacking, no file-read only)

  • Can’t import attributes beyond Cd and UV (which are also crippled)

With USD looming around the corner these are issues that would need to be tackled before even thinking about USD in Blender.

We’re loving using blender for VFX and are well impressed with 2.8 and the talented developers pushing the envelope and appreciate everyones efforts. I hope this post comes across as informative and not to off-putting, but ABC is an industry standard and full support would not only benefit VFX artists working in other applications but also Blender artists directly.

It’s a good format.

9 Likes

Tell us this is a cross post:

I just want to bring some RCS topics about Alembic together:

Alembics are used in productions a lot!

5 Likes

Almost six months later, and we’re more or less in the same boat.
Things like these are vital to a mixed pipeline, so some word from the devs would be nice.

Also, you can import Alembic only once it seems. Swapping a existing Alembic set for another in Blender doesn’t seem to work… Models disappear and animation is lost. :frowning:

1 Like

Alembics are still one of the most important exchange formats in VFX pipelines, so I dare to revive this old topic.
Brecht recentlly added this which is a life changer for me and my workflow (Houdini <-> Blender):

https://developer.blender.org/rB128eb6cbe928e58dfee1c64f340fd8d663134c26

The only thing that kind of bothers me is that there is now a kind of mixture of names for the velocity attribute:

  • In the Geometry Nodes spreadsheet it’s called “velocity”
  • In the Mesh Cache Sequence modifier “.velocities”
  • In the exported Alembic “v”, just like in Houdini. Even though the attribute I created in Geometry Nodes was called “velocity”
1 Like

We still need to be able to load and save random attributes with Alembic and USD, that’s what would make the system really powerful :slight_smile:

2 Likes

+1
Especially with the geometry node attributes, it would open up a ton of possibilities.

2 Likes

Naming conventions is something of a thing inside Blender.
It would be nice for the devs to ‘look over the fence’ sometimes, or do a quick poll here for naming conventions.

e.g. Houdini is so ingrained in workflows with VDB’s and Alembics, everybody expects certain attributes to be there. :wink:

2 Likes

Hello there,

any news on this? One year of silence :wink:

Are (piont context) attributes from an Alembic (from Houdini) file still not getting through? According to my tests I would say: NO.
Or ist there a special trick I should be aware of?
I do not find any proper state of the Alembic/USD support, some sort of list, what is working, what not and what is under development.
Is this kind of stuff like cache-formats and interoperability also meant, when Ton talks about “work that Hollywood should do”…?
Just asking, because to get Blender also into smaller pipelines, stuff like that is crucial! This thread turned THREE YEARS last July.

Could anybody please comment on this?
And also I would be glad to help in any concern! Geo nodes do have so much potential, but without getting data properly into it…

Cheers

3 Likes