Hello Mi Fans,
If you've ever wanted a custom bobble hat but your knitting skills aren't up to par, let the robots do it. Well, there are people who are really bad when it comes to knitting, a team of computer scientists at MIT have seen their despair, and they want to help. They’ve developed a software called InverseKnit that will allow anyone to design a pattern on a computer (no coding skills required!) or upload a picture of an existing knitted item. That image can be sent to any existing 3D knitting machine to produce the final product.
You might sketch out some hip fingerless gloves or a beanie with a unicorn on it, and a few minutes later, the garment will appear as if by magic. Or you might upload a picture of an infinity scarf, tweak the color on the computer, and presto! Your scarf is done.
What it is?
A team of researchers at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), led by computer scientist Alexandre Kaspar, released two new papers describing the software. One is about a system called InverseKnit that automatically creates patterns from photos of knitted items. The other introduces new design software, called CADKnit, that allows people with no knitting or design experience to quickly customize templates, adjusting the size, final shape and decorative details (like the gloves shown below).
Even non expert knitters can use the system to create individual designs from customizable templates on a computer. The designs are then sent to a knitting machine, which fabricates the designs out of real wool. The advantage of templates is that common shapes such as hats or gloves are easy to recreate, and users can apply texture and patterns to the objects as well. More ambitious users can create their own patterns from scratch, and there's a neural network system which will generate more panels from an existing pattern.
How it works?
"Whether it's for the everyday user who wants to mimic a friend's beanie hat, or a subset of the public who might benefit from using this tool in a manufacturing setting, we're aiming to make the process more accessible for personal customization," says Alexandre Kaspar, lead author of the paper about the new system.
To make this software, the scientists created an enormous data set of knitting instructions and matched images to each of those patterns. They then trained the neural network on the data to translate the images into knitting instructions using computer vision technology. By the end of the process, they were able to give the system a photo of a glove and let the model generate a set of instructions for the knitting machine. During tests, InverseKnit produced accurate instructions 94% of the time.
CADKnit combines 2D images with CAD (computer-aided design) and photo-editing software to create customizable templates. It was tested with knitting newbies, who, despite having little machine knitting experience, were still able to create relatively complex garments, like gloves, and effects, including lace motifs and color patterns.
mit-neural-knitting-data-set-examples.png (2.8 MB, Downloads: 159)
2019-08-08 12:38:18 Upload
In a test, even users who had never knitted before were able to use the system to create knitted hats and gloves, some with intricate patterns. This is only a first step toward full garment customization; these machines have a lot to learn. Kaspar and the team are still finessing the software. For instance, right now, it has trouble creating patterns with multiple parts, like a sweater where the sleeves need to be attached. And the software can only handle one yarn, so the team is working on adapting it to use multiple types of yarn of different thicknesses for a single garment.
The software also has the potential to upend the fashion industry. Kaspar believes it would be relatively easy for fashion companies to adapt and scale this software to help customers create customized garments.
Would You Like to Have this AI Based Knitting system?
Share Your thoughts in comments below!
In order to fulfill the basic functions of our service, the user hereby agrees to allow Xiaomi to collect, process and use personal information which shall include but not be limited to written threads, pictures, comments, replies in the Mi Community, and relevant data types listed in Xiaomi's Private Policy. By selecting "Agree", you agree to Xiaomi's Private Policy and Content Policy .