I think machine learning applications, especially deep learning, can be abstracted as data processing. If that’s true, can we do some visualization for the data processing pipeline, like a graphic workflow configuration tool to build the training and validation process? I’ve seen that Microsoft already has it in their Azure . And the NVIDIA DIGITS seems also want’s to do this.
Recently I’ve been working on this for a time but I’ve met a lot of troubles. I want to keep the flexibility as well as the simplicity, but it seems like very hard to keep both of them. And I start to doubt is this the correct way, or should we just write plain code?
I want to know what the community sees about this, so if you have any ideas, positive or negative, please let me know : )
Here are some screenshots about these kind of products:
I think you’re right for the 2 productions(Azure and NVIDIA DIGITS), I have tried them and I’m confused about WHO will use these tools:
For developers? Not flexible enough to build complicated applications.
For newbies? Too much to learn and also, not flexible enough.
So the baseline is, the machine learning applications require coding abilities. But is it possible to visualize the process, or even build the process by semi-graph-semi-code way?
Story is, last year I have developed a tool to help people use PyTorch more easily. It does bring me benefits in some Kaggle competitions.
So I want it to do more, like visualizing pipeline of the dataflow, or even better: configure the dataflow through web interface.
Well, I always count myself in the still learning group even though I sometimes claim to have a bit of first hand knowledge around PyTorch. That aside, if the vision is that ML/Deep Learning will be as ubiquitous as, say, Excel is today, there is a dire need for tools that are as easy to use as Excel. Python goes a long way in making non-programmers feel at home fast, but it’s not perfect.
Quite likely it would be beneficial to have something visual that is extensible.
Think about PyTorch itself: You have the ready-made torch.nn.* that you can just compose (with torch.nn.Sequential if you wish) and you can easily roll your own because that’s what we’re there for.
Another learning from this line of thought: A good and general visualization is the first step to a good visual editor.
Yes! Have been thinking about Blockly, but we think it’s more complicated than workflow. The web should be as simple as it could be. So we chose workflow rather than blockly as the frontend interface.