TL;DR: I suggest having a place to share development .blend files, which developers maintain under good practice principles. This can be useful for other developers and on-boarding.
Developers often have their own testing files for development in specific areas.
For example, Sergey has files for working on the Motion Tracker; Sybren set up some pose library files for us (Campbell and me) to use; …
If somebody else wants to work in these areas, they have to spend time setting things up themselves. That’s not always trivial. E.g. this may be one reason why pose libraries haven’t seen much development in Blender for years: even getting started is a hassle.
Sharing Development Testing Files
It would be great if developers would share their testing files publicly, to help other developers as well as on-boarding new ones.
This needs to be simple to use so developers actually share files there. We could explicitly consider this a good practice, refer to it often and push ourselves to use it well.
A CC-BY-SA license seems appropriate.
Delimitation
Such files differ from the blender.org demo files in that they are can be much less formal and lower quality. It’s a different purpose and a different target audience.
They also differ from the files for regression testing or general quality assurance, which are often set up to allow testing very specific things, often in a check-list manner. However, they may be similar enough to be put in the same place.
Where to put it?
The Blender Libraries SVN repository already contains a bunch of testing files, not all are for automated tests. We could just put more files there.
Or should we better create a new directory in the same repository?
Either way, it may be a good idea to link to this from docs like the developer intro resources. Plus, modules can link to their test files from the developer.blender.org module landing page and such.
Possible Problems
- If everybody uses the same test files, issues may go unnoticed. Or Blender becomes more optimized for these specific test cases. They are not a replacement for general quality assurance.
- Compatibility: How well do such files age? Probably depends, but in many cases they should be valid for longer periods. Blender is good at file compatibility.
- An SVN repository isn’t as easy to use as a simple drag & drop interface. Might be acceptable for now though, but we’ll have to push (no pun intended!) ourselves a bit more to actually use it.
- There may be redundancy with the blender.org demo files or the other testing files. The repository directories could just contain
README
files linking to them, to avoid the copies. - Testing files may be large and slow to download. That would be true for any kind of testing file sharing. But here the files can be reduced a bit more than typical demo or production files.
AFAIK providing the space to host them isn’t a problem.